Hugging Face's logo

Spaces:
lhoestq
/
fake-data-generator-jsonl
Running on Zero

App Files Community
5
lhoestq HF Staff commited on
Commit
e75be2d
·
1 Parent(s): 3dbfb6c

reduce batch size

Browse files
Files changed (1) hide show
  1. generate.py +1 -1
generate.py CHANGED
@@ -30,7 +30,7 @@ if torch.backends.mps.is_available():
30
  else:
31
  device = "cuda"
32
  model_id = "google/gemma-2b-it"
33
- batch_size = 20
34
 
35
  model = models.transformers(model_id, device=device)
36
 
 
30
  else:
31
  device = "cuda"
32
  model_id = "google/gemma-2b-it"
33
+ batch_size = 10
34
 
35
  model = models.transformers(model_id, device=device)
36