Hugging Face's logo

WCNegentropy
/
BitTransformerLM

Text Generation
Transformers
PyTorch
English
experimental
research
bit-level
transformer
reversible
safety
telemetry
language-modeling
Model card Files
xet
Community
1
BitTransformerLM
File size: 1,439 Bytes 
36c78b1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
 
:root {
    --primary: #1e40af;
    --bg: #f5f6fa;
}

body {
    font-family: Arial, sans-serif;
    background-color: var(--bg);
    margin: 0;
    padding: 0;
    line-height: 1.5;
    color: #333;
}

.container {
    max-width: 900px;
    margin: 0 auto;
    padding-bottom: 2rem;
}

h1 {
    text-align: center;
    background: var(--primary);
    color: #fff;
    margin: 0;
    padding: 1rem 0;
}

section {
    background: #fff;
    margin: 1rem auto;
    padding: 1rem 1.5rem;
    border-radius: 8px;
    box-shadow: 0 2px 4px rgba(0,0,0,0.1);
    width: 90%;
    max-width: 800px;
}

section h2 {
    margin-top: 0;
    color: var(--primary);
    font-size: 1.25rem;
}

form {
    display: flex;
    flex-wrap: wrap;
    gap: 0.5rem 1rem;
}

form input[type="text"],
form input[type="number"],
form textarea {
    flex: 1 1 200px;
    padding: 0.4em;
    border: 1px solid #ccc;
    border-radius: 4px;
}

form button,
button#scaleBtn {
    padding: 0.4em 0.8em;
    border: none;
    background: var(--primary);
    color: #fff;
    border-radius: 4px;
    cursor: pointer;
}

form button:hover,
button#scaleBtn:hover {
    background-color: #1d4ed8;
}

pre, p#trainOut {
    background: #f0f0f0;
    padding: 0.5rem;
    border-radius: 4px;
    overflow-x: auto;
}

label {
    display: flex;
    align-items: center;
    gap: 0.5rem;
}

img#plot {
    max-width: 100%;
    height: auto;
    display: block;
    margin: auto;
}