manueldeprada HF Staff commited on
Commit
a4b0b7f
·
verified ·
1 Parent(s): 1433b38

Cards: capless examples (cap baked into generation_config); drop vLLM note + research note

Browse files
Files changed (1) hide show
  1. README.md +3 -7
README.md CHANGED
@@ -35,16 +35,12 @@ repo = "manueldeprada/littlelearner-5b-bounded-base"
35
  tok = AutoTokenizer.from_pretrained(repo)
36
  model = AutoModelForCausalLM.from_pretrained(repo, dtype="bfloat16", device_map="cuda")
37
  ids = tok("The sum of 2 and 3 is", return_tensors="pt").to(model.device)
38
- print(tok.decode(model.generate(**ids, max_new_tokens=64)[0], skip_special_tokens=True))
39
  ```
40
 
41
  ```python
42
  # vLLM
43
- from vllm import LLM, SamplingParams
44
  llm = LLM("manueldeprada/littlelearner-5b-bounded-base")
45
- print(llm.generate(["The sum of 2 and 3 is"], SamplingParams(max_tokens=64))[0].outputs[0].text)
46
  ```
47
-
48
- > **vLLM note:** vLLM JIT-compiles CUDA kernels, so it needs a CUDA toolkit (`nvcc`) on PATH. On an HPC cluster, `module load cuda/13.x cudnn/9.x` (match your torch CUDA build). On a box with no toolkit, pass `LLM(repo, enforce_eager=True)`. Verified on vLLM 0.15 and 0.23 (and transformers ≥ 4.51).
49
-
50
- > Research artifact. The **bounded** models carry an intentional K–5 knowledge boundary (they cannot model above-grade-5 material). Base models are **not** instruction-tuned.
 
35
  tok = AutoTokenizer.from_pretrained(repo)
36
  model = AutoModelForCausalLM.from_pretrained(repo, dtype="bfloat16", device_map="cuda")
37
  ids = tok("The sum of 2 and 3 is", return_tensors="pt").to(model.device)
38
+ print(tok.decode(model.generate(**ids)[0], skip_special_tokens=True))
39
  ```
40
 
41
  ```python
42
  # vLLM
43
+ from vllm import LLM
44
  llm = LLM("manueldeprada/littlelearner-5b-bounded-base")
45
+ print(llm.generate(["The sum of 2 and 3 is"])[0].outputs[0].text)
46
  ```