| --- |
| library_name: peft |
| tags: |
| - dia |
| - carbon-footprint |
| - energy-efficiency |
| - sustainability |
| dia_version: '0.1' |
| dia_report: |
| scope: incremental |
| lineage: |
| - model: TinyLlama/TinyLlama-1.1B-Chat-v1.0 |
| relation: lora |
| compute: |
| hardware: |
| gpu: cpu-80core |
| count: 1 |
| duration_gpu_hours: 1.0613 |
| footprint: |
| energy_kwh: |
| value: 0.0515 |
| quality: measured |
| carbon_kgco2eq: |
| value: 0.0033 |
| quality: measured |
| water_liters: |
| value: |
| - 0.093 |
| - 0.206 |
| quality: estimated-from-default-wue |
| context: |
| region: ca-on |
| carbon_intensity: 0.03 |
| wue_l_per_kwh: |
| - 1.8 |
| - 4.0 |
| tool: codecarbon |
| license: apache-2.0 |
| pipeline_tag: text-generation |
| base_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0 |
| --- |
| |
| # TinyLlama 1.1B Chat — LoRA (CPU (80-core)) |
|
|
| A demo model from the **Data & Impact Accounting (DIA)** lab. It performs |
| instruction-tuning (LoRA adapter) via **LoRA (PEFT)**, with the base model `TinyLlama/TinyLlama-1.1B-Chat-v1.0`, trained on |
| **CPU (80-core)**. |
|
|
| The point of this repo is not the model itself but its **`dia_report`** — a |
| standardized record of the energy, carbon, and water used to train it, embedded |
| in this card's metadata. |
| |
| This footprint feeds the DIA dashboard, which rolls up a base model and all its derivatives to show the **cumulative** carbon, water, and energy cost of a model family. |
| |
| ## Training footprint |
| |
| | Metric | Value | |
| |---|---| |
| | Hardware | 1× cpu-80core | |
| | Compute | 1.0613 GPU-hours | |
| | Energy | 0.0515 (measured) kWh | |
| | Carbon | 0.0033 (measured) kgCO₂eq | |
| | Water | 0.093–0.206 (estimated-from-default-wue) L | |
| | Grid region | ca-on | |
| |
| *Energy and carbon are measured with [CodeCarbon](https://github.com/mlco2/codecarbon); |
| water is estimated from a default water-usage-effectiveness range. Carbon uses the |
| local grid's intensity (Ontario, ~0.03 kgCO₂eq/kWh).* |
| |
| ## Reproduce |
| |
| ```bash |
| REPO=DIA-MVP/tinyllama-lora-cpu python scripts/train_llama_lora.py |
| ``` |
| |
| ## Links |
| |
| - **Footprint table (dataset):** [DIA-MVP/dia-state-lab-2026](https://huggingface.co/datasets/DIA-MVP/dia-state-lab-2026) |
| - **Project / paper:** [ai-impact-accounting](https://github.com/VectorInstitute/ai-impact-accounting) |
| - **Lab workflow:** see `LAB.md` in the repo |
| |
