Instructions to use cs-552-2026-flab/general_knowledge_model with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use cs-552-2026-flab/general_knowledge_model with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="cs-552-2026-flab/general_knowledge_model")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("cs-552-2026-flab/general_knowledge_model")
model = AutoModelForCausalLM.from_pretrained("cs-552-2026-flab/general_knowledge_model", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use cs-552-2026-flab/general_knowledge_model with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "cs-552-2026-flab/general_knowledge_model"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "cs-552-2026-flab/general_knowledge_model",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/cs-552-2026-flab/general_knowledge_model

SGLang

How to use cs-552-2026-flab/general_knowledge_model with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "cs-552-2026-flab/general_knowledge_model" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "cs-552-2026-flab/general_knowledge_model",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "cs-552-2026-flab/general_knowledge_model" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "cs-552-2026-flab/general_knowledge_model",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use cs-552-2026-flab/general_knowledge_model with Docker Model Runner:
```
docker model run hf.co/cs-552-2026-flab/general_knowledge_model
```

zechen-nlp commited on May 20

Commit

357cc11

verified ·

1 Parent(s): c6e1d85

Update Automated MNLP evaluation report (2026-05-20)

Browse files

Files changed (1) hide show

EVAL_REPORT.md +12 -52

EVAL_REPORT.md CHANGED Viewed

@@ -2,7 +2,7 @@
 - **Model repo:** [`cs-552-2026-flab/general_knowledge_model`](https://huggingface.co/cs-552-2026-flab/general_knowledge_model)
 - **Owner(s):** group **flab**
-- **Generated at:** 2026-05-19T03:22:52+00:00 (UTC)
 - **Pipeline:** [mnlp-project-ci](https://github.com/eric11eca/mnlp-project-ci)
 _This PR is opened automatically by the course CI. It is **non-blocking** — you do not need to merge it. The next nightly run will refresh this file._
@@ -12,7 +12,7 @@ _This PR is opened automatically by the course CI. It is **non-blocking** — yo
 | Benchmark | Accuracy | Status |
 |---|---:|---|
 | Math | — | not run |
-| Knowledge | 0.1500 | ok |
 | Multilingual | — | not run |
 | Safety | — | not run |
@@ -24,70 +24,30 @@ _Prompts are intentionally omitted to avoid revealing benchmark contents. For mu
 **Correct** (1 shown)
-- **reference**: `I`
 - **overall** (1/1 completions correct)
-- **extracted** (✓): `I`
 - **completion**:
     ```text
-    The correct answer is: **I. Kouroi**
-    **Explanation:**
-    The **Kouroi** are a type of Archaic Greek statue, typically depicting young men in a rigid, formal pose, often with clenched fists and a forward-facing posture, reminiscent of ancient Egyptian statuary. These statues were commonly placed on temple roofs as part of the architectural decoration and were meant to represent the gods or to symbolize the power and authority of the state.
-    Other options:
-    - **A. Atlantes:** These are mythical sea monsters.
-    - **B. Gorgons:** These are female monsters from Greek mythology.
-    - **C. Minotaurs:** These are half-human, half-goat creatures.
-    - **D. Hetairoi:** These were a class of Greek soldiers.
-    - **E. Caryatids:** These are female statues used as supports for colonnades.
-    - **F. Discoboloi:** These are statues of nude male athletes in the act of discus throwing.
-    - **G. Centaurs:** These are half-human, half-horse creatures.
-    - **H. Telamones:** These are statues of the gods.
-    - **J. Sphinxes:** These are mythical creatures with the body of a woman and the head of a lion.
-    Thus, the correct answer is: $\boxed{I}$
     ```
 **Incorrect** (1 shown)
-- **reference**: `D`
 - **overall** (0/1 completions correct)
-- **extracted** (✗): `B`
 - **completion**:
     ```text
-    To answer this question, we need to understand the concepts of **tautomerism** and **optical isomerism**:
-    ---
-    ### **Tautomerism**
-    Tautomerism is a type of isomerism where a molecule can exist in two or more different forms due to the movement of a proton (H⁺) and a double bond. This is common in **carboxylic acids** and **ketones**, where a hydrogen atom moves from an oxygen to a carbon adjacent to a carbonyl group.
-    - **Benzoquinone** (a substituted benzene ring with two oxygen atoms) is a **tautomer** of **hydroquinone**.
-    - **Cyclohexane-1,3,5-trione** (a cyclic ketone) does **not** exhibit tautomerism because there is no hydrogen atom that can move to form a tautomer.
-    ---
-    ### **Optical Isomerism**
-    Optical isomerism occurs when a molecule exists in two **mirror-image** forms that are **not superimposable**. This is due to the presence of **chiral centers** (carbon atoms bonded to four different groups).
-    - **Methyl 2-hydroxypropanoate** contains a **chiral center** (carbon atom at position 2), and thus exhibits **optical isomerism**.
-    - **Dimethyl fumarate** contains **no chiral centers**, so it does **not** exhibit optical isomerism.
-    ---
-    ### **Conclusion**
-    - **A = cyclohexane-1,3,5-trione** does **not** exhibit tautomerism.
-    - **B = methyl 2-hydroxypropanoate** exhibits **optical isomerism**.
-    ---
-    ### ✅ **Correct Answer:**
-    $$
-    \boxed{B}
-    $$
     ```

 - **Model repo:** [`cs-552-2026-flab/general_knowledge_model`](https://huggingface.co/cs-552-2026-flab/general_knowledge_model)
 - **Owner(s):** group **flab**
+- **Generated at:** 2026-05-20T05:49:46+00:00 (UTC)
 - **Pipeline:** [mnlp-project-ci](https://github.com/eric11eca/mnlp-project-ci)
 _This PR is opened automatically by the course CI. It is **non-blocking** — you do not need to merge it. The next nightly run will refresh this file._
 | Benchmark | Accuracy | Status |
 |---|---:|---|
 | Math | — | not run |
+| Knowledge | 0.3000 | ok |
 | Multilingual | — | not run |
 | Safety | — | not run |
 **Correct** (1 shown)
+- **reference**: `G`
 - **overall** (1/1 completions correct)
+- **extracted** (✓): `G`
 - **completion**:
     ```text
+    <think>
+    </think>
+    The correct option is \boxed{G}.
     ```
 **Incorrect** (1 shown)
+- **reference**: `B`
 - **overall** (0/1 completions correct)
+- **extracted** (✗): `I`
 - **completion**:
     ```text
+    <think>
+    </think>
+    The correct option is \boxed{I}.
     ```