---
library_name: peft
tags:
- dia
- carbon-footprint
- energy-efficiency
- sustainability
dia_version: '0.1'
dia_report:
  scope: incremental
  lineage:
  - model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
    relation: lora
  compute:
    hardware:
      gpu: cpu-80core
      count: 1
    duration_gpu_hours: 1.0613
  footprint:
    energy_kwh:
      value: 0.0515
      quality: measured
    carbon_kgco2eq:
      value: 0.0033
      quality: measured
    water_liters:
      value:
      - 0.093
      - 0.206
      quality: estimated-from-default-wue
  context:
    region: ca-on
    carbon_intensity: 0.03
    wue_l_per_kwh:
    - 1.8
    - 4.0
  tool: codecarbon
license: apache-2.0
pipeline_tag: text-generation
base_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
---

# TinyLlama 1.1B Chat — LoRA (CPU (80-core))

A demo model from the **Data & Impact Accounting (DIA)** lab. It performs
instruction-tuning (LoRA adapter) via **LoRA (PEFT)**, with the base model `TinyLlama/TinyLlama-1.1B-Chat-v1.0`, trained on
**CPU (80-core)**.

The point of this repo is not the model itself but its **`dia_report`** — a
standardized record of the energy, carbon, and water used to train it, embedded
in this card's metadata.

This footprint feeds the DIA dashboard, which rolls up a base model and all its derivatives to show the **cumulative** carbon, water, and energy cost of a model family.

## Training footprint

| Metric | Value |
|---|---|
| Hardware | 1× cpu-80core |
| Compute | 1.0613 GPU-hours |
| Energy | 0.0515 (measured) kWh |
| Carbon | 0.0033 (measured) kgCO₂eq |
| Water | 0.093–0.206 (estimated-from-default-wue) L |
| Grid region | ca-on |

*Energy and carbon are measured with [CodeCarbon](https://github.com/mlco2/codecarbon);
water is estimated from a default water-usage-effectiveness range. Carbon uses the
local grid's intensity (Ontario, ~0.03 kgCO₂eq/kWh).*

## Reproduce

```bash
REPO=DIA-MVP/tinyllama-lora-cpu python scripts/train_llama_lora.py
```

## Links

- **Footprint table (dataset):** [DIA-MVP/dia-state-lab-2026](https://huggingface.co/datasets/DIA-MVP/dia-state-lab-2026)
- **Project / paper:** [ai-impact-accounting](https://github.com/VectorInstitute/ai-impact-accounting)
- **Lab workflow:** see `LAB.md` in the repo