Hugging Face's logo

Spaces:
nroggendorff
/
train-diffuser
Paused

App Files Community
nroggendorff commited on
Commit
d9dca90
·
verified ·
1 Parent(s): c300c89

Update app.py

Browse files
Files changed (1) hide show
  1. app.py +1 -1
app.py CHANGED
@@ -10,7 +10,7 @@ from datasets import load_dataset
10
  from tokenizers import ByteLevelBPETokenizer
11
  import trl
12
 
13
- dataset = load_dataset("nroggendorff/openhermes", split="train").select(range(int(4e+4)))
14
 
15
  def get_training_corpus():
16
  for i in range(0, len(dataset), 1000):
 
10
  from tokenizers import ByteLevelBPETokenizer
11
  import trl
12
 
13
+ dataset = load_dataset("nroggendorff/openhermes", split="train")#.select(range(int(4e+4)))
14
 
15
  def get_training_corpus():
16
  for i in range(0, len(dataset), 1000):