threshold-xor4-mag21

4-input XOR using cascade architecture with mag-7 XOR blocks.

Note: A flat architecture may achieve lower magnitude. Architecture search not yet performed.

Architecture

a  b       c       d
β”‚  β”‚       β”‚       β”‚
└──┴──┐    β”‚       β”‚
      β–Ό    β”‚       β”‚
   β”Œβ”€β”€β”€β”€β”€β” β”‚       β”‚
   β”‚XOR-7β”‚ β”‚       β”‚
   β””β”€β”€β”¬β”€β”€β”˜ β”‚       β”‚
      β””β”€β”€β”¬β”€β”˜       β”‚
         β–Ό         β”‚
      β”Œβ”€β”€β”€β”€β”€β”      β”‚
      β”‚XOR-7β”‚      β”‚
      β””β”€β”€β”¬β”€β”€β”˜      β”‚
         β””β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”˜
              β–Ό
           β”Œβ”€β”€β”€β”€β”€β”
           β”‚XOR-7β”‚
           β””β”€β”€β”¬β”€β”€β”˜
              β–Ό
        XOR4(a,b,c,d)

Parameters

Neurons 9 (3 per XOR)
Layers 6
Parameters 27
Magnitude 21 (3 Γ— 7)

Comparison

Version Magnitude Architecture
xor4 (base) 30 Cascade, original XOR
xor4-mag21 21 Cascade, mag-7 XOR

Usage

from safetensors.torch import load_file

w = load_file('model.safetensors')
# See model.py for implementation

License

MIT

Downloads last month
-
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Collection including phanerozoic/threshold-xor4-mag21