Document Hugging Face Jobs path for news summarization eval
Browse files
eval/news_summarization/README.md
CHANGED
|
@@ -70,3 +70,28 @@ For a strong open-weight comparison path, use:
|
|
| 70 |
- [`COLAB_QUICKSTART.md`](/Users/arach/dev/lab/eval/news_summarization/COLAB_QUICKSTART.md)
|
| 71 |
- [`run_hf_transformers.py`](/Users/arach/dev/lab/eval/news_summarization/run_hf_transformers.py)
|
| 72 |
- [`notebook.ipynb`](/Users/arach/dev/lab/eval/news_summarization/notebook.ipynb)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 70 |
- [`COLAB_QUICKSTART.md`](/Users/arach/dev/lab/eval/news_summarization/COLAB_QUICKSTART.md)
|
| 71 |
- [`run_hf_transformers.py`](/Users/arach/dev/lab/eval/news_summarization/run_hf_transformers.py)
|
| 72 |
- [`notebook.ipynb`](/Users/arach/dev/lab/eval/news_summarization/notebook.ipynb)
|
| 73 |
+
|
| 74 |
+
## Hugging Face Jobs
|
| 75 |
+
|
| 76 |
+
For a more reliable cloud path than Colab:
|
| 77 |
+
|
| 78 |
+
- [`launch_hf_job.py`](/Users/arach/dev/lab/eval/news_summarization/launch_hf_job.py)
|
| 79 |
+
|
| 80 |
+
Example:
|
| 81 |
+
|
| 82 |
+
```bash
|
| 83 |
+
python3 eval/news_summarization/launch_hf_job.py \
|
| 84 |
+
--sync-code \
|
| 85 |
+
--model Qwen/Qwen2.5-7B-Instruct \
|
| 86 |
+
--limit 50 \
|
| 87 |
+
--disable-bertscore \
|
| 88 |
+
--flavor a10g-small \
|
| 89 |
+
--timeout 2h
|
| 90 |
+
```
|
| 91 |
+
|
| 92 |
+
This:
|
| 93 |
+
|
| 94 |
+
- syncs the news-summarization harness to `arach/training-lab`
|
| 95 |
+
- launches a GPU job on Hugging Face
|
| 96 |
+
- runs the HF transformers eval there
|
| 97 |
+
- uploads results back under `eval/news_summarization/results/jobs/$JOB_ID`
|