arach commited on
Commit
a91f3b6
·
verified ·
1 Parent(s): f9666b9

Document Hugging Face Jobs path for news summarization eval

Browse files
Files changed (1) hide show
  1. eval/news_summarization/README.md +25 -0
eval/news_summarization/README.md CHANGED
@@ -70,3 +70,28 @@ For a strong open-weight comparison path, use:
70
  - [`COLAB_QUICKSTART.md`](/Users/arach/dev/lab/eval/news_summarization/COLAB_QUICKSTART.md)
71
  - [`run_hf_transformers.py`](/Users/arach/dev/lab/eval/news_summarization/run_hf_transformers.py)
72
  - [`notebook.ipynb`](/Users/arach/dev/lab/eval/news_summarization/notebook.ipynb)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
70
  - [`COLAB_QUICKSTART.md`](/Users/arach/dev/lab/eval/news_summarization/COLAB_QUICKSTART.md)
71
  - [`run_hf_transformers.py`](/Users/arach/dev/lab/eval/news_summarization/run_hf_transformers.py)
72
  - [`notebook.ipynb`](/Users/arach/dev/lab/eval/news_summarization/notebook.ipynb)
73
+
74
+ ## Hugging Face Jobs
75
+
76
+ For a more reliable cloud path than Colab:
77
+
78
+ - [`launch_hf_job.py`](/Users/arach/dev/lab/eval/news_summarization/launch_hf_job.py)
79
+
80
+ Example:
81
+
82
+ ```bash
83
+ python3 eval/news_summarization/launch_hf_job.py \
84
+ --sync-code \
85
+ --model Qwen/Qwen2.5-7B-Instruct \
86
+ --limit 50 \
87
+ --disable-bertscore \
88
+ --flavor a10g-small \
89
+ --timeout 2h
90
+ ```
91
+
92
+ This:
93
+
94
+ - syncs the news-summarization harness to `arach/training-lab`
95
+ - launches a GPU job on Hugging Face
96
+ - runs the HF transformers eval there
97
+ - uploads results back under `eval/news_summarization/results/jobs/$JOB_ID`