memnar-system1 / README.md
IAMIbrahim's picture
Update README.md
40f8435 verified
|
Raw History Blame Contribute Delete
3.38 kB
metadata
license: other
license_name: fair-noncommercial-research-license
license_link: https://huggingface.co/facebook/MobileLLM-R1-360M-base/blob/main/LICENSE
base_model: facebook/MobileLLM-R1-360M-base
language:
  - en
tags:
  - on-device
  - executorch
  - memory
  - wearables
  - information-extraction

Remembery System 1 (v4): on-device memory for AI glasses

Two fine-tuned MobileLLM-R1-360M models with non-autoregressive heads that turn a live conversation transcript into memories on the phone. Each window (~2,000 characters of transcript) gets one forward pass per model; the pooled graphs (entities, frame triggers, roles, attributes) pick candidate lines, and a small logistic validator keeps the ones worth remembering as structured records.

Code, app and instructions: github.com/IAMIbrahimmemon/remembery.

Scores

Held-out real conversations (Switchboard, Taskmaster, meetings); fact checklists and judging by Muse Spark.

System Recall Precision F1
This system, sealed set (85 conversations, scored once) 0.799 0.783 0.791
This system, dev set (89 conversations) 0.774 0.788 0.781
Large LLM labeling the same dev conversations 0.814 0.892 0.851

Wrong memories 0.2%. On an iPhone 17: 4.5–5.4 s per full window for both models, ~4.5 GB footprint.

Files

Path What
checkpoints/v4e/best.pt model A (PyTorch state dict, fp32) + args.json, labels3.json
checkpoints/v4f/last.pt model B, same layout
validator_g2.json line validator (logistic weights, cutoff 0.60, feature spec)
vocab3.json pruned vocabulary used for the phone export
ios/memnar-ios-model-v4.zip ios/Model/: model A as an ExecuTorch .pte (XNNPACK, fp32), tokenizer, metadata, parity fixtures
ios/memnar-ios-model-v4-b.zip ios/Model_b/: model B, same layout
ios/memnar-ios-phonon.zip ios/Phonon/: Phonon-2.5 English speech to text converted to Core ML (weights unchanged)

Both models are needed: the score above is for the two pooled, run with cutoffs entity 0.5, trigger 0.5, role 0.35 and the validator at 0.60.

sha256:

a020c56919872a17eae942ef934031a1c2125525770b752f3e58af0d31e0900b  checkpoints/v4e/best.pt
b484ad260cd4b87a4524a6a26be1e7491db06a76b0ca49d6deccdafab3786415  checkpoints/v4f/last.pt
9601602dc6f864d59ea2f2d8e7b4442947cd6d06cb3c1ecae8e7238924778196  ios/memnar-ios-model-v4.zip
7b18bbabfab1e251388534150b570b0fbe8870bb66d5d953aeb8d9614cb725f0  ios/memnar-ios-model-v4-b.zip
4dfc5b3b24ca12e7351bc5f6a3540b26d3d6439633954b834c91f751bb1f87aa  ios/memnar-ios-phonon.zip

Use

git clone https://github.com/IAMIbrahimmemon/remembery && cd remembery && uv sync
hf download IAMIbrahim/memnar-system1 --include "checkpoints/*" --local-dir hf
PYTHONPATH=. uv run python memories.py --ckpts hf/checkpoints --windows data/probe/probe_v1.jsonl --out memories.jsonl

Licenses

  • System 1 checkpoints and .pte files: derivatives of MobileLLM-R1-360M-base, under the FAIR Noncommercial Research License (noncommercial research use only).
  • ios/memnar-ios-phonon.zip: Phonon-2.5 English by FermionResearch (a compressed nvidia/parakeet-tdt-0.6b-v3), CC-BY-4.0, converted to Core ML without changing the weights.

Built for the Meta Global AI Developer Hackathon 2026.