WizardCoder Windows 10 64 bit 8 GB RAM 4 GB VRAM DefaultCPUAllocator: not enough memory: you tried to allocate 301989888 bytes
#5
by CHRISSANTY - opened
CHRISSANTY changed discussion title from WizardCoder Windows 10 64 bit 12 GB RAM ModuleNotFoundError: No module named 'peft' to WizardCoder Windows 10 64 bit 8 GB RAM 4 GB VRAM DefaultCPUAllocator: not enough memory: you tried to allocate 301989888 bytes
You don't have enough VRAM or RAM to run this model. The only models you can use are 7B GGML models.
