| --- |
| title: GAIA Unit 4 Agent |
| emoji: 🧭 |
| colorFrom: gray |
| colorTo: blue |
| sdk: gradio |
| sdk_version: 4.44.0 |
| app_file: app.py |
| pinned: false |
| license: apache-2.0 |
| --- |
| |
| # GAIA Unit 4 — Hugging Face Agents Course (final assignment) |
|
|
| This folder is a **drop-in replacement** for the course Space |
| [`agents-course/Final_Assignment_Template`](https://huggingface.co/spaces/agents-course/Final_Assignment_Template). |
|
|
| ## One-time: create your Space |
|
|
| 1. On Hugging Face, **Duplicate** the template Space above (or create a new Gradio Space and copy these files into the repo root). |
| 2. In the Space **Settings → Repository secrets**, add: |
| - **`HF_TOKEN`**: a Hugging Face access token with **read** permission (for Inference API / serverless models). |
| 3. Optional **Variables** (or secrets) to tune models: |
| - `HF_INFERENCE_PROVIDER` — **omit by default** so the client uses **`auto`**: the first [inference provider](https://hf.co/settings/inference-providers) that supports your **chosen model** on the Hub. Do **not** set `hf-inference` unless that model lists it — many chat models (e.g. Qwen2.5-7B-Instruct) only support **together** / **featherless-ai**, and forcing `hf-inference` yields **404**. If the auto order hits a provider that returns **401** (e.g. Novita), reorder providers in HF settings or pin e.g. `HF_INFERENCE_PROVIDER=together`. |
| - `GAIA_TEXT_MODEL` — default `Qwen/Qwen2.5-7B-Instruct` (broad provider mapping via Together). |
| - `GAIA_ASR_MODEL` — default `openai/whisper-large-v3` |
| - `GAIA_VISION_MODEL` — default `meta-llama/Llama-3.2-11B-Vision-Instruct` |
| - `GAIA_API_URL` — default `https://agents-course-unit4-scoring.hf.space` |
| - `GAIA_USE_CACHE` — `1` (default) or `0` to disable `gaia_answers_cache.json` |
| |
| Keep the Space **public** so `agent_code` (`…/tree/main`) verifies for the leaderboard. |
| |
| ## Local dry-run (no submission) |
| |
| ```bash |
| cd gaia_unit4_space |
| python -m venv .venv && source .venv/bin/activate |
| pip install -r requirements.txt |
| export HF_TOKEN=hf_... |
| python run_local_eval.py |
| ``` |
| |
| This fetches `/questions`, runs the agent, prints answers, and writes `local_eval_answers.json`. It does **not** call `/submit`. |
|
|
| ## What was fixed vs the stock template |
|
|
| - Downloads attachments when `file_name` is set (`GET /files/{task_id}`). |
| - Tool-using agent (web, Wikipedia, Python, Excel, ASR, vision, YouTube transcripts). |
| - Deterministic shortcuts for the reversed-English puzzle, Cayley-table commutativity, `.py` stdout, and `.xlsx` food-sales heuristic. |
| - Optional **Crypto** tab (BTC/USD demo only; not used for GAIA). |
|
|
| ## Leaderboard |
|
|
| Submit scores via the Gradio app after logging in. Student leaderboard: |
| [`agents-course/Students_leaderboard`](https://huggingface.co/spaces/agents-course/Students_leaderboard). |
|
|
