Files changed (2) hide show
  1. README.md +0 -3
  2. data_summary_card.md +0 -147
README.md CHANGED
@@ -150,6 +150,3 @@ The Bitnet model has an elevated defect rate when responding to election-critica
150
 
151
  ## Disclaimer
152
  We do not recommend using BitNet b1.58 in commercial or real-world applications without further testing and development. This model is intended for research and development purposes. While efforts have been made to align it using SFT and DPO, it may still produce outputs that are unexpected, biased, or inaccurate. Please use responsibly.
153
-
154
- ## Data Summary
155
- https://huggingface.co/microsoft/bitnet-b1.58-2B-4T/blob/main/data_summary_card.md
 
150
 
151
  ## Disclaimer
152
  We do not recommend using BitNet b1.58 in commercial or real-world applications without further testing and development. This model is intended for research and development purposes. While efforts have been made to align it using SFT and DPO, it may still produce outputs that are unexpected, biased, or inaccurate. Please use responsibly.
 
 
 
data_summary_card.md DELETED
@@ -1,147 +0,0 @@
1
-
2
-
3
- # Data Summary for microsoft_bitnet-b1.58-2B-4T, bitnet-b1.58-2B-4T-gguf, bitnet-b1.58-2B-4T-bf16
4
-
5
-
6
-
7
-
8
-
9
- ## 1. General information
10
-
11
- **1.0.1 Version of the Summary:** 1.0
12
-
13
-
14
-
15
- **1.0.2 Last update:** 16-Dec-2025
16
-
17
-
18
-
19
- ## 1.1 Model Developer Identification
20
-
21
- **1.1.1 Model Developer name and contact details:** Microsoft Corporation at One Microsoft Way, Redmond, WA 98052. Tel: 425-882-8080.
22
-
23
-
24
-
25
- ## 1.2 Model Identification
26
-
27
- **1.2.1 Versioned model name(s):** bitnet-b1.58-2B-4T
28
-
29
-
30
-
31
- **1.2.2 Model release date:** 01-May-2025
32
-
33
-
34
-
35
- ## 1.3 Overall training data size and characteristics
36
-
37
- ### 1.3.1 Size of dataset and characteristics
38
-
39
- **1.3.1.A Text training data size:** 1 billion to 10 trillion tokens
40
-
41
-
42
-
43
- **1.3.1.B Text training data content:** We used SmolLM-Corpus,dclm-baseline-1.0 and open-web-math datasets to train this model.
44
-
45
-
46
-
47
- **1.3.1.C Image training data size:** Not applicable. Images are not part of the training data
48
-
49
-
50
-
51
- **1.3.1.D Image training data content:** Not applicable
52
-
53
-
54
-
55
- **1.3.1.E Audio training data size:** Not applicable. Audio content is not part of the training data
56
-
57
-
58
-
59
- **1.3.1.F Audio training data content:** Not applicable
60
-
61
-
62
-
63
- **1.3.1.G Video training data size:** Not applicable. Videos are not part of the training data
64
-
65
-
66
-
67
-
68
-
69
- **1.3.1.H Video training data content:** Not applicable
70
-
71
-
72
-
73
- **1.3.1.I Other training data size:** Not applicable
74
-
75
-
76
-
77
- **1.3.1.J Other training data content:** Not applicable
78
-
79
-
80
-
81
- **1.3.2 Latest date of data acquisition/collection for model training:** 15-Jul-2024
82
-
83
-
84
-
85
- **1.3.3 Is data collection ongoing to update the model with new data collection after deployment?** No
86
-
87
-
88
-
89
- **1.3.4 Date the training dataset was first used to train the model:** 12-Jan-2025
90
-
91
-
92
-
93
- **1.3.5 Rationale or purpose of data selection:** The training corpus included publicly available text and code datasets to provide broad world knowledge and foundational language capabilities, with synthetic mathematical data to enhance reasoning. Selected datasets were emphasized later to refine performance
94
-
95
-
96
-
97
- ## 2. List of data sources
98
-
99
- ### 2.1 Publicly available datasets
100
-
101
- **2.1.1 Have you used publicly available datasets to train the model?** Yes
102
-
103
-
104
-
105
- ## 2.2 Private non-publicly available datasets obtained from third parties
106
-
107
- ### 2.2.1 Datasets commercially licensed by rights holders or their representatives
108
-
109
- **2.2.1.A Have you concluded transactional commercial licensing agreement(s) with rights holder(s) or with their representatives?** No
110
-
111
-
112
-
113
- ### 2.2.2 Private datasets obtained from other third-parties
114
-
115
- **2.2.2.A Have you obtained private datasets from third parties that are not licensed as described in Section 2.2.1, such as data obtained from providers of private databases, or data intermediaries?** No
116
-
117
-
118
-
119
- ## 2.3 Personal Information
120
-
121
- **2.3.1 Was personal data used to train the model?** Microsoft follows all relevant laws and regulations pertaining to personal information
122
-
123
-
124
-
125
- ## 2.4 Synthetic data
126
-
127
- **2.4.1 Was any synthetic AI-generated data used to train the model?** No
128
-
129
- ## 3. Data processing aspects
130
-
131
- ### 3.1 Respect of reservation of rights from text and data mining exception or limitation
132
-
133
- **3.1.1 Does this dataset include any data protected by copyright, trademark, or patent?** Microsoft follows all required regulations and laws for processing data protected by copyright, trademark, or patent
134
-
135
-
136
-
137
- ## 3.2 Other information
138
-
139
- **3.2.1 Does the dataset include information about consumer groups without revealing individual consumer identities?** Microsoft follows all required regulations and laws for protecting consumer identities
140
-
141
-
142
-
143
- **3.2.2 Was the dataset cleaned or modified before model training?** Yes
144
-
145
-
146
-
147
-