Bitnet is an innovative 1-bit LLM architecture where weights are constrained to ternary values (-1, 0, and 1).