Spaces:
Running
Running
File size: 2,955 Bytes
e490234 156e8cc d79f951 e490234 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 | <!doctype html>
<html lang="en">
<head>
<meta charset="utf-8">
<meta name="viewport" content="width=device-width, initial-scale=1">
<meta name="description" content="Find a TensorFold checkpoint, check runtime support, and get started with local inference.">
<title>TensorFold on Hugging Face</title>
<style>
:root { color-scheme: light dark; }
.tensorfold-org-card { font: 1rem/1.6 system-ui, sans-serif; max-width: 44rem; margin: 2rem auto; padding: 0 1.25rem 2rem; }
.tensorfold-org-card h1, .tensorfold-org-card h2 { line-height: 1.25; }
.tensorfold-org-card h1 { margin-top: .5rem; }
</style>
</head>
<body>
<main class="tensorfold-org-card">
<img src="https://huggingface.co/spaces/TensorFold/README/resolve/main/tensorfold-logo.png" alt="TensorFold logo" width="96">
<h1>Welcome to TensorFold</h1>
<p>TensorFold is an open-source inference engine that runs models on your own hardware and serves them through an OpenAI-compatible API. On Hugging Face, we publish model conversions for Apple silicon, along with previews for new model architectures.</p>
<p><a href="https://tensorfold.dev/guide">Setup guide</a> · <a href="https://huggingface.co/TensorFold/models">Browse all models</a> · <a href="https://github.com/ashhart/TensorFold">Engine on GitHub</a></p>
<h2>Find a model for your Mac</h2>
<p>Start with the collection for your Mac’s unified memory.</p>
<ul>
<li><a href="https://huggingface.co/collections/TensorFold/mlx-models-for-64gb-macs-6a9fefda17932216ec9ab457">64 GB Macs</a></li>
<li><a href="https://huggingface.co/collections/TensorFold/mlx-models-for-128gb-macs-6a9ff0abd31bc9abbe7922d7">128 GB Macs</a></li>
<li><a href="https://huggingface.co/collections/TensorFold/mlx-models-for-256gb-macs-6a9ff0ef9fed7c5bdca15e9b">256 GB Macs</a></li>
</ul>
<p>New to MLX? Try <a href="https://huggingface.co/TensorFold/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-MLX-4bit">Nemotron 3.5 Lightning 4-bit</a>. Its card includes a quick start and the conditions for a measured Apple silicon run. Check the runtime and memory notes before downloading. Longer contexts and concurrent requests can use more memory.</p>
<h2>What’s new</h2>
<p>Tencent Hy4-flash with DFly2 is available as a checkpoint preview in <a href="https://huggingface.co/TensorFold/Hy4-flash-MLX-4bit-MTP">MLX 4-bit</a> and <a href="https://huggingface.co/TensorFold/Hy4-flash-MLX-8bit-MTP">MLX 8-bit</a>. Conversion checks have passed, and TensorFold runtime support is pending.</p>
<h2>Need a hand?</h2>
<p>Use the <strong>Community</strong> tab on a model’s page for questions about that checkpoint. For engine issues, use <a href="https://github.com/ashhart/TensorFold/issues">GitHub Issues</a>. Include your hardware and memory, runtime version, and model ID so we can help.</p>
<p>The original model authors receive credit in the checkpoint cards, alongside links to the source models and their licences.</p>
</main>
</body>
</html>
|