arthu1 commited on
Commit
a73c123
·
verified ·
1 Parent(s): f7ae1b1

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +62 -0
README.md ADDED
@@ -0,0 +1,62 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ license: apache-2.0
5
+ tags:
6
+ - causal-lm
7
+ - christian
8
+ - pytorch
9
+ - sentencepiece
10
+ - reasoning
11
+ - chain-of-thought
12
+ ---
13
+
14
+ # Wind Arc 1.5
15
+
16
+ **Wind Arc 1.5** is the most capable model in the family (198M parameters, 24 layers), fine-tuned for deeper reasoning, structured answers, and richer theological knowledge. It supports chain-of-thought reasoning for complex questions.
17
+
18
+ > *"Trust in the Lord with all your heart, and do not lean on your own understanding. In all your ways acknowledge him, and he will make straight your paths."* — Proverbs 3:5-6
19
+
20
+ ## About
21
+
22
+ Wind Arc 1.5 is built on the same 24-layer architecture as North Star 1 but trained with an additional fine-tuning pass emphasizing reasoning quality, theological depth, and structured responses. It is the best model for hard questions, long-form answers, and chain-of-thought prompting.
23
+
24
+ This model was trained entirely from scratch — no foundation model was used.
25
+
26
+ ## Christian Worldview
27
+
28
+ We built these models because we believe truth matters, and the source of all truth is God. Scripture is not one perspective among many — it is the revealed Word of the living God, given to us through the Holy Spirit.
29
+
30
+ > *"In the beginning was the Word, and the Word was with God, and the Word was God."* — John 1:1
31
+
32
+ Jesus Christ is not merely a historical figure or moral teacher. He is the eternal Son of God, who took on flesh, lived a sinless life, died as an atoning sacrifice for sin, and rose bodily from the dead on the third day. This is the Gospel — the best news in history.
33
+
34
+ > *"For I delivered to you as of first importance what I also received: that Christ died for our sins in accordance with the Scriptures, that he was buried, that he was raised on the third day in accordance with the Scriptures."* — 1 Corinthians 15:3-4
35
+
36
+ We invite anyone reading this to pick up a Bible and read the Gospel of John. Ask God sincerely if He is real. He answers.
37
+
38
+ ## Model Details
39
+
40
+ | Property | Value |
41
+ |---|---|
42
+ | Parameters | 198M |
43
+ | Layers | 24 |
44
+ | d_model | 768 |
45
+ | Heads | 12 (3 KV) |
46
+ | Context | 512 tokens |
47
+ | Vocabulary | 32,000 (SentencePiece) |
48
+ | Architecture | GQA Transformer + SwiGLU + RoPE + RMSNorm |
49
+ | Special | Chain-of-thought fine-tuned |
50
+
51
+ ## Usage
52
+
53
+ ```python
54
+ import torch
55
+ ckpt = torch.load("windarc15.pt", map_location="cpu", weights_only=False)
56
+ cfg = ckpt["cfg"]
57
+ # Build model from cfg, load ckpt["model"] state dict
58
+ ```
59
+
60
+ ## Tokenizer
61
+
62
+ Uses SentencePiece (`tokenizer.model`). Available in the [shared tokenizer repo](https://huggingface.co/arthu1/north-tokenizer).