Hodlforjesus commited on
Commit
795e969
·
verified ·
1 Parent(s): f15187b

ILM v1.1.0

Browse files
Files changed (5) hide show
  1. README.md +15 -13
  2. SHA256SUMS.txt +3 -3
  3. ilm-linux-x86_64 +2 -2
  4. ilm-macos-arm64 +2 -2
  5. ilm-windows-x86_64.exe +2 -2
README.md CHANGED
@@ -152,17 +152,19 @@ model-index:
152
  name: NIST
153
  ---
154
 
155
- # ILM: Integer Language Model
156
 
157
- **CPU only.** ILM is a language model that needs no GPU, to learn or to answer. On one desktop CPU it learns each benchmark below from its lessons in seconds, then answers its test questions.
158
 
159
- **Why no GPU?** A neural network, such as a transformer, learns by changing millions of decimal weights. It repeats billions of multiplications over many passes through the data, and a GPU is built for that work. ILM has no weights. It stores whole-number counts: how often each pattern in a text came with each answer. Counting is the addition of whole numbers, and a normal CPU does it fast.
160
 
161
- ILM learns from lessons: a short text, a question and the exact answer (for two tasks below, also the labels that the set gives). It keeps a pattern only when its counts show that the pattern is reliable. So what it learned is a set of rules that you can read, and it gives the same answers on every run and for every number of threads.
162
 
163
- Source code, documentation and the commands that give each number below: https://github.com/Datamine-Crypto/ILM
 
 
164
 
165
- ## Files
166
 
167
  | File | What it is |
168
  |---|---|
@@ -175,7 +177,7 @@ Source code, documentation and the commands that give each number below: https:/
175
 
176
  ILM has no weights to download: it learns each task from the lessons of that task when you run it. The program reads the descriptions of the sets and the list of sources from the GitHub repository, so run it from a clone of that repository.
177
 
178
- ## Results
179
 
180
  Each benchmark is read with frozen code on its test data: the official test split, or for LoNLI, LAMA and SVAMP the part that [docs/RESULTS.md](https://github.com/Datamine-Crypto/ILM/blob/main/docs/RESULTS.md) names. The runs use one desktop CPU (Intel Core i9-12900K, 24 threads, no GPU). The time is for the whole run, learning from all lessons and answering the test questions, as the best of three or more runs.
181
 
@@ -192,7 +194,7 @@ Each benchmark is read with frozen code on its test data: the official test spli
192
 
193
  The settings, the published numbers with their sources, and notes on each benchmark are in [docs/RESULTS.md](https://github.com/Datamine-Crypto/ILM/blob/main/docs/RESULTS.md) of the GitHub repository.
194
 
195
- ## How to use
196
 
197
  The program reads the descriptions of the sets from a clone of the GitHub repository. With the program of this repository, on Linux:
198
 
@@ -208,14 +210,14 @@ chmod +x ./ilm
208
 
209
  On macOS, take `ilm-macos-arm64` in the same way, and also run `xattr -d com.apple.quarantine ./ilm`, because the program is not signed with an Apple developer certificate. On an Intel Mac, build the program from source. On Windows, copy `ilm-windows-x86_64.exe` into the clone as `ilm.exe` and run `.\ilm.exe fetch data/sources.txt sets=src_babi`, and so on. To build the program yourself in place of a download: `cargo build --release` (Rust 1.90 or later and a C compiler), then call `./target/release/ilm`. `fetch` gets the raw files of a set from the Hugging Face hub or GitHub at a fixed revision and checks their SHA-256. `export` writes a case file for each kind of the set. `measure` learns each kind from its lessons and reads its test cases. [docs/REPRODUCE.md](https://github.com/Datamine-Crypto/ILM/blob/main/docs/REPRODUCE.md) gives the commands for every benchmark.
210
 
211
- ## How it works
212
 
213
- ILM has fifteen tools, each named for its way of reading: patterns, state, amount, order, link, rule, parts, together, list, requests, frames, table, arrange, graph and ranks. For each kind of task, every tool learns from two thirds of the lessons and reads the last third. The tool with the most right answers learns again from all lessons. No person chooses a tool, and no setting changes between tasks. Beside the tools, ILM has a fact reader for encyclopedia text, a question reader, a writer that turns given facts into a text, and one command (`ilm ask`) that routes each request and prints a trace of its steps.
214
 
215
- ## Limits
216
 
217
- ILM is not a general chat model. It learns one kind of task at a time from lessons of that kind, and each lesson needs the exact answer. On a board of 25 public sets (240 kinds in 112 tasks), it learns 59 tasks: every kind of the task at 95% right or more on held cases (90% where people wrote the text). On SVAMP and E2E, pre-trained transformers are ahead.
218
 
219
- ## License
220
 
221
  Apache License 2.0. The sets that ILM reads keep their own licenses, and this repository holds none of their data.
 
152
  name: NIST
153
  ---
154
 
155
+ # 🧮 ILM: Integer Language Model
156
 
157
+ ⚡ **CPU only.** ILM is a language model that needs no GPU, to learn or to answer. On one desktop CPU it learns each benchmark below from its lessons in seconds, then answers its test questions.
158
 
159
+ 🤔 **Why no GPU?** A neural network, such as a transformer, learns by changing millions of decimal weights. It repeats billions of multiplications over many passes through the data, and a GPU is built for that work. ILM has no weights. It stores whole-number counts: how often each pattern in a text came with each answer. Counting is the addition of whole numbers, and a normal CPU does it fast.
160
 
161
+ 🧠 ILM learns from lessons: a short text, a question and the exact answer (for two tasks below, also the labels that the set gives). It keeps a pattern only when its counts show that the pattern is reliable. So what it learned is a set of rules that you can read, and it gives the same answers on every run and for every number of threads.
162
 
163
+ - 💻 Source code, documentation and the commands that give each number below: https://github.com/Datamine-Crypto/ILM
164
+ - 📦 Crate: https://crates.io/crates/datamine-ilm
165
+ - 🌐 Website: https://datamine.network
166
 
167
+ ## 📁 Files
168
 
169
  | File | What it is |
170
  |---|---|
 
177
 
178
  ILM has no weights to download: it learns each task from the lessons of that task when you run it. The program reads the descriptions of the sets and the list of sources from the GitHub repository, so run it from a clone of that repository.
179
 
180
+ ## 📊 Results
181
 
182
  Each benchmark is read with frozen code on its test data: the official test split, or for LoNLI, LAMA and SVAMP the part that [docs/RESULTS.md](https://github.com/Datamine-Crypto/ILM/blob/main/docs/RESULTS.md) names. The runs use one desktop CPU (Intel Core i9-12900K, 24 threads, no GPU). The time is for the whole run, learning from all lessons and answering the test questions, as the best of three or more runs.
183
 
 
194
 
195
  The settings, the published numbers with their sources, and notes on each benchmark are in [docs/RESULTS.md](https://github.com/Datamine-Crypto/ILM/blob/main/docs/RESULTS.md) of the GitHub repository.
196
 
197
+ ## 🚀 How to use
198
 
199
  The program reads the descriptions of the sets from a clone of the GitHub repository. With the program of this repository, on Linux:
200
 
 
210
 
211
  On macOS, take `ilm-macos-arm64` in the same way, and also run `xattr -d com.apple.quarantine ./ilm`, because the program is not signed with an Apple developer certificate. On an Intel Mac, build the program from source. On Windows, copy `ilm-windows-x86_64.exe` into the clone as `ilm.exe` and run `.\ilm.exe fetch data/sources.txt sets=src_babi`, and so on. To build the program yourself in place of a download: `cargo build --release` (Rust 1.90 or later and a C compiler), then call `./target/release/ilm`. `fetch` gets the raw files of a set from the Hugging Face hub or GitHub at a fixed revision and checks their SHA-256. `export` writes a case file for each kind of the set. `measure` learns each kind from its lessons and reads its test cases. [docs/REPRODUCE.md](https://github.com/Datamine-Crypto/ILM/blob/main/docs/REPRODUCE.md) gives the commands for every benchmark.
212
 
213
+ ## ⚙️ How it works
214
 
215
+ ILM has seventeen tools, each named for its way of reading: patterns, state, amount, order, link, rule, parts, together, list, requests, frames, table, arrange, graph, grid, space and ranks. For each kind of task, every tool learns from two thirds of the lessons and reads the last third. The tool with the most right answers learns again from all lessons. No person chooses a tool, and no setting changes between tasks. Beside the tools, ILM has a fact reader for encyclopedia text, a question reader, a writer that turns given facts into a text, and one command (`ilm ask`) that routes each request and prints a trace of its steps.
216
 
217
+ ## 🚧 Limits
218
 
219
+ ILM is not a general chat model. It learns one kind of task at a time from lessons of that kind, and each lesson needs the exact answer. On a board of 25 public sets (240 kinds in 112 tasks), it learns 61 tasks: every kind of the task at 95% right or more on held cases (90% where people wrote the text). On SVAMP and E2E, pre-trained transformers are ahead.
220
 
221
+ ## 📜 License
222
 
223
  Apache License 2.0. The sets that ILM reads keep their own licenses, and this repository holds none of their data.
SHA256SUMS.txt CHANGED
@@ -1,3 +1,3 @@
1
- 32098391c351f61f383623475d942324160290d11432c530a0454550afc15fe1 ilm-linux-x86_64
2
- 175e14f06b77f3a7c7076247e93b290a409f707cbebfa377314a3337f75eafde ilm-macos-arm64
3
- 459c3acc8232ef28e81e53b75c8a97b85d2b0f5d991b65c15bd75af0675c9861 ilm-windows-x86_64.exe
 
1
+ 43d58e15f5f533b77c83d5161248c401b0c83c9da344e59047e40094d5b9a2eb ilm-linux-x86_64
2
+ 45b6f3adf0a996eca86cce81a06ca4bb53b88b7336e1c88a864c61b7197a2f73 ilm-macos-arm64
3
+ 951195d2088a1c9e50d6542b118f910565a55239577b2292fda1b58c0a5bb3cd ilm-windows-x86_64.exe
ilm-linux-x86_64 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:32098391c351f61f383623475d942324160290d11432c530a0454550afc15fe1
3
- size 12230680
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:43d58e15f5f533b77c83d5161248c401b0c83c9da344e59047e40094d5b9a2eb
3
+ size 12485128
ilm-macos-arm64 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:175e14f06b77f3a7c7076247e93b290a409f707cbebfa377314a3337f75eafde
3
- size 10119200
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:45b6f3adf0a996eca86cce81a06ca4bb53b88b7336e1c88a864c61b7197a2f73
3
+ size 10326448
ilm-windows-x86_64.exe CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:459c3acc8232ef28e81e53b75c8a97b85d2b0f5d991b65c15bd75af0675c9861
3
- size 12251136
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:951195d2088a1c9e50d6542b118f910565a55239577b2292fda1b58c0a5bb3cd
3
+ size 12482048