neural-nova
/

Llama-3.1-8B-Instruct-optimized

inference-optimization

Model card Files Files and versions

JDCentral commited on Jul 30

Commit

cb8dc4c

·

verified ·

1 Parent(s): 873b6e5

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -8,7 +8,7 @@ tags:
 license: llama3.1
 ---
-# Optimized Transformers — meta-llama/Llama-3.1-8B-Instruct
 This package contains an auto-generated optimized build of [meta-llama/Llama-3.1-8B-Instruct](https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct) produced by the NeuralNova Auto-Optimization pipeline. The forward pass of the model's bottleneck operations has been replaced with custom CUDA kernels, improving inference throughput over stock Transformers.

 license: llama3.1
 ---
+# Optimized Transformers (Fine-Tuning)— meta-llama/Llama-3.1-8B-Instruct
 This package contains an auto-generated optimized build of [meta-llama/Llama-3.1-8B-Instruct](https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct) produced by the NeuralNova Auto-Optimization pipeline. The forward pass of the model's bottleneck operations has been replaced with custom CUDA kernels, improving inference throughput over stock Transformers.