wingx commited on
Commit
fcb3d06
·
verified ·
1 Parent(s): 11450d7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +52 -3
README.md CHANGED
@@ -1,3 +1,52 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # ✨ Sparkfile
2
+
3
+ A hobbyist build of mozilla-ai/llamafile for DGX Spark.
4
+
5
+ `v0.10.0`
6
+
7
+ both CUDA and Vulkan backends packaged.
8
+
9
+ after download validate backends
10
+
11
+ ```sh
12
+ chmod +x ./sparkfile
13
+ ./sparkfile --gpu nvidia --cli -m your_local_model.gguf --list-devices
14
+ ./sparkfile --gpu vulkan --cli -m your_local_model.gguf --list-devices
15
+ ```
16
+ *should see both CUDA and Vulkan backends being reported.
17
+
18
+
19
+ basic usage
20
+
21
+ ```sh
22
+ ./sparkfile --chat -m your_local_model.gguf
23
+ ```
24
+
25
+ ```sh
26
+ ./sparkfile --gpu nvidia --chat -m your_local_model.gguf
27
+ ```
28
+
29
+ ```sh
30
+ ./sparkfile --gpu vulkan --chat -m your_local_model.gguf
31
+ ```
32
+
33
+ ```sh
34
+ ./sparkfile --server ... <llama-server args>
35
+ ```
36
+
37
+ for certain reason you are not launching as an executable itself, e.g. wsl2
38
+
39
+ ```sh
40
+ sh ./sparkfile <args>
41
+ ```
42
+
43
+ Expected Platforms and OSs
44
+ CPU: ANY if supported by llamafile
45
+ GPU:
46
+ - aarch64_cpu_linux: DGX Spark (GB10), Jetson Thor
47
+ - x86-64_cpu_linux: (needs a seperate `.so` or recompile)
48
+ - x86-64_cpu_win: (needs a seperate `.dll` or recompile)
49
+
50
+ ---
51
+ license: apache-2.0
52
+ ---