File size: 2,955 Bytes
e490234
156e8cc
d79f951
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
e490234
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
<!doctype html>
<html lang="en">
<head>
  <meta charset="utf-8">
  <meta name="viewport" content="width=device-width, initial-scale=1">
  <meta name="description" content="Find a TensorFold checkpoint, check runtime support, and get started with local inference.">
  <title>TensorFold on Hugging Face</title>
  <style>
    :root { color-scheme: light dark; }
    .tensorfold-org-card { font: 1rem/1.6 system-ui, sans-serif; max-width: 44rem; margin: 2rem auto; padding: 0 1.25rem 2rem; }
    .tensorfold-org-card h1, .tensorfold-org-card h2 { line-height: 1.25; }
    .tensorfold-org-card h1 { margin-top: .5rem; }
  </style>
</head>
<body>
<main class="tensorfold-org-card">
<img src="https://huggingface.co/spaces/TensorFold/README/resolve/main/tensorfold-logo.png" alt="TensorFold logo" width="96">
<h1>Welcome to TensorFold</h1>
<p>TensorFold is an open-source inference engine that runs models on your own hardware and serves them through an OpenAI-compatible API. On Hugging Face, we publish model conversions for Apple silicon, along with previews for new model architectures.</p>
<p><a href="https://tensorfold.dev/guide">Setup guide</a> · <a href="https://huggingface.co/TensorFold/models">Browse all models</a> · <a href="https://github.com/ashhart/TensorFold">Engine on GitHub</a></p>
<h2>Find a model for your Mac</h2>
<p>Start with the collection for your Mac’s unified memory.</p>
<ul>
  <li><a href="https://huggingface.co/collections/TensorFold/mlx-models-for-64gb-macs-6a9fefda17932216ec9ab457">64 GB Macs</a></li>
  <li><a href="https://huggingface.co/collections/TensorFold/mlx-models-for-128gb-macs-6a9ff0abd31bc9abbe7922d7">128 GB Macs</a></li>
  <li><a href="https://huggingface.co/collections/TensorFold/mlx-models-for-256gb-macs-6a9ff0ef9fed7c5bdca15e9b">256 GB Macs</a></li>
</ul>
<p>New to MLX? Try <a href="https://huggingface.co/TensorFold/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-MLX-4bit">Nemotron 3.5 Lightning 4-bit</a>. Its card includes a quick start and the conditions for a measured Apple silicon run. Check the runtime and memory notes before downloading. Longer contexts and concurrent requests can use more memory.</p>
<h2>What’s new</h2>
<p>Tencent Hy4-flash with DFly2 is available as a checkpoint preview in <a href="https://huggingface.co/TensorFold/Hy4-flash-MLX-4bit-MTP">MLX 4-bit</a> and <a href="https://huggingface.co/TensorFold/Hy4-flash-MLX-8bit-MTP">MLX 8-bit</a>. Conversion checks have passed, and TensorFold runtime support is pending.</p>
<h2>Need a hand?</h2>
<p>Use the <strong>Community</strong> tab on a model’s page for questions about that checkpoint. For engine issues, use <a href="https://github.com/ashhart/TensorFold/issues">GitHub Issues</a>. Include your hardware and memory, runtime version, and model ID so we can help.</p>
<p>The original model authors receive credit in the checkpoint cards, alongside links to the source models and their licences.</p>
</main>
</body>
</html>