algenta-serialization

Serialization and data-format kernels. Compiled Mojo, loaded in-process.

17 modules · 138 functions · CPU

Get started

pip install kernels torch

from kernels import get_kernel

kernel = get_kernel(
    "thyn-ai/algenta-serialization",
    version=1,
    backend="cpu",
    trust_remote_code=["thyn-ai/algenta-serialization"],
)
kernel.compression.delta.delta_encode([1, 4, 9, 16, 25])  # -> [1, 3, 5, 7, 9]  first value, then differences

backend="cpu" selects the CPU build. On a Mac the loader otherwise looks for a Metal build, which this family does not ship. trust_remote_code names the repositories you allow; Hugging Face's trusted publishers load without it.

Plain Python in, plain Python out. Lists, tuples, buffers and tensors are accepted wherever the contract expects a list; structured results are dictionaries. Some functions take a list and the number of elements to use from it, which may not exceed the list's length; multi-dimensional data is passed flattened, row-major, with its dimensions. Functions that update an argument do so in place, as help() says. Every call is checked against the published contract before it reaches native code. An invalid call raises KernelError with a stable code, never a crash. Engine kernels report shape and finiteness problems as a status; the wrapper raises KernelError named after it.

Any function can also be called by name, with args as a list or a dict of parameter names:

kernel.execute("compression.delta", "compression_savings", [...])

What's inside

kernel.CONTRACT holds every signature, including the length rules for list arguments; help(kernel.data_feedback_loop) documents each function.

Not included

• compression.huffman.generate_codes — allocates from a frequency table whose size it trusts; an ill-formed table is not expressible as a length rule.

Requirements

• Apple silicon: macOS 15 or later for the CPU build.
• Linux arm64 and x86-64, glibc 2.35 or later.
• kernels 0.17 or later and PyTorch 2.5 to 2.14. PyTorch has to be installed: the loader picks the build for your PyTorch version. The kernel itself never imports it.

Windows is not supported.

Notes

Calls into one kernel instance run one at a time; use processes for parallelism. Runtime state does not survive fork(); start worker processes with spawn.

License

Algenta Community License 1.0 (LICENSE). Free for personal, research and open-source use, and for internal use at organizations with fewer than 50 employees and under $5M in annual revenue. Beyond that, a commercial license is required: licensing@algenta.ai.

Enforced in the compiled library, not just in this text: one concurrent native worker per device (ABI §9). A second process, family or thread waits its turn rather than running in parallel. That is the Community licence's worker floor made real; parallel execution comes with a commercial license.