[models] 100B+ Param, CPU-Offload + A6000x2 - a YellowjacketGames Collection

YellowjacketGames 's Collections

[ data ] What a Dump!

[ papers ] Sports Tech

[papers] Distillation

[papers] RAG$ to Riche$

[mixed] ORC_Assist "Work's Done!"

[mixed] Chess x AI

[papers] Gameplay Optimization

[models] RTX a6000 48gb

[models] GTX 1660 Super 6gb

[models] Sub-1gb for Edge Deployment

[models] iGPU-Capable < 512mb

[models] 100B+ Param, CPU-Offload + A6000x2

[mixed] Image Generation Stack

[models] 100B+ Param, CPU-Offload + A6000x2

updated 3 days ago

TPS can be as low as 1.0, seriously. its SLOW.