Humuhumu33 commited on
Commit
02f2633
verified
1 Parent(s): 04bcd15

Add branded Hologram model card

Browse files
Files changed (1) hide show
  1. README.md +83 -0
README.md ADDED
@@ -0,0 +1,83 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ base_model: microsoft/bitnet-b1.58-2B-4T
4
+ pipeline_tag: text-generation
5
+ inference: false
6
+ tags:
7
+ - hologram
8
+ - q
9
+ - kappa-object
10
+ - holo
11
+ - ternary
12
+ - bitnet
13
+ - llama3
14
+ ---
15
+
16
+ <div align="center">
17
+
18
+ # Hologram 路 BitNet-2B-4T
19
+
20
+ **Native 1.58-bit ternary brain**
21
+
22
+ `t2 路 1.58-bit ternary` 路 `0.69 GB` 路 streamed to Q as a **key-addressable `.holo` object**
23
+
24
+ [Hologram](https://gethologram.ai) 路 [Live Space](https://huggingface.co/spaces/HOLOGRAMTECH/hologram) 路 [Organization](https://huggingface.co/HOLOGRAMTECH) 路 [Code](https://github.com/Hologram-Technologies)
25
+
26
+ </div>
27
+
28
+ ---
29
+
30
+ ## What this is
31
+
32
+ Microsoft's BitNet b1.58 2B4T, the first natively 1.58-bit trained model at scale, re-encoded to Hologram's ternary key format. Q's default brain: fast, tiny, and coherent.
33
+
34
+ This repository is **not** a GGUF or Transformers checkpoint. It is a **Hologram key object**: the weights of `microsoft/bitnet-b1.58-2B-4T` re-encoded into Hologram's content-addressed `.holo` format so they stream, one verified block at a time, into **Q**, the on-device brain of the Hologram web OS. It runs in the browser on WebGPU, serverless, with nothing to install.
35
+
36
+ ## How it streams
37
+
38
+ The object is laid out for cold streaming from an untrusted CDN:
39
+
40
+ | File | Role |
41
+ |---|---|
42
+ | `manifest.json` | the root. Names every tensor and the key (content hash) of its block. |
43
+ | `b/sha256_*.gz` | the tensor blocks. Each filename **is** the SHA-256 of its bytes. |
44
+ | `tokenizer.gguf` | bundled header, so loading is fully serverless. |
45
+
46
+ Q fetches the manifest, then pulls each block by its key and re-derives `sha256(block)` on arrival. If a byte is wrong, the block is rejected. Nothing is trusted; everything is proven.
47
+
48
+ ## Verify (Law L5)
49
+
50
+ The object's identity is the SHA-256 of its manifest, pinned in Q's catalog before a single byte of weight is trusted:
51
+
52
+ ```
53
+ did:holo:sha256:fcf835659d88d2fe6f683cf1ab8de6a6ba6214ea0deeee4b1bcf3da1a4c05412
54
+ ```
55
+
56
+ ```bash
57
+ curl -sL https://huggingface.co/HOLOGRAMTECH/q-bitnet-2b/resolve/main/manifest.json | sha256sum
58
+ ```
59
+
60
+ ## Specifications
61
+
62
+ | | |
63
+ |---|---|
64
+ | Architecture | BitNet b1.58 (Llama 3 template) |
65
+ | Precision | t2 路 1.58-bit ternary |
66
+ | Object size | 0.69 GB |
67
+ | Hidden size | 2560 |
68
+ | Layers | 30 |
69
+ | Heads (Q / KV) | 20 / 5 (GQA) |
70
+ | FFN | 6912 |
71
+ | Vocab | 128256 |
72
+ | Context | 3000 |
73
+ | Format | `holo-2bit/1` |
74
+
75
+ ## Provenance and license
76
+
77
+ Derived from [`microsoft/bitnet-b1.58-2B-4T`](https://huggingface.co/microsoft/bitnet-b1.58-2B-4T). Inherits the MIT license from microsoft/bitnet-b1.58-2B-4T. The re-encoding is content-addressed at the key level: the object either re-derives to its pinned identity or it is refused.
78
+
79
+ ## Run it
80
+
81
+ These weights load through Q, not a standard runtime. Open the [Live Space](https://huggingface.co/spaces/HOLOGRAMTECH/hologram) or visit [gethologram.ai](https://gethologram.ai) to run Hologram, then pick **BitNet-2B-4T** from Q's model list.
82
+
83
+ <div align="center"><sub>Composed on the golden ratio. One key, everything.</sub></div>