Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
fjcloud
/
Mistral-7B-Instruct-v0.3-neuron-inf2-tp2
like
0
Text Generation
Transformers
Safetensors
mistral
neuron
inferentia2
vllm
precompiled
conversational
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
Mistral-7B-Instruct-v0.3-neuron-inf2-tp2
/
neuron-compiled-artifacts
14.6 GB
1 contributor
History:
5 commits
fjcloud
Flatten neuron-compiled-artifacts: remove config hash subdirectory (NEURON_COMPILED_ARTIFACTS bypasses it)
1b28791
verified
3 days ago
weights
Flatten neuron-compiled-artifacts: remove config hash subdirectory (NEURON_COMPILED_ARTIFACTS bypasses it)
3 days ago
model.pt
pickle
Detected Pickle imports (26)
"__torch__.neuronx_distributed.trace.spmd.NxDModel"
,
"torch.jit._pickle.restore_type_tag"
,
"__torch__.neuronx_distributed.trace.spmd.NxDModelExecutor"
,
"__torch__.torch.classes.neuron.LayoutTransformation"
,
"torch.jit._pickle.build_intlist"
,
"torch.jit._pickle.build_intlist"
,
"torch.jit._pickle.build_intlist"
,
"torch.jit._pickle.build_intlist"
,
"torch.jit._pickle.build_intlist"
,
"torch.jit._pickle.build_intlist"
,
"torch.jit._pickle.build_intlist"
,
"torch.jit._pickle.build_intlist"
,
"torch.jit._pickle.build_intlist"
,
"torch.jit._pickle.build_intlist"
,
"torch.jit._pickle.build_intlist"
,
"torch.jit._pickle.build_intlist"
,
"torch.jit._pickle.build_intlist"
,
"torch.jit._pickle.build_intlist"
,
"torch.jit._pickle.build_intlist"
,
"torch.jit._pickle.build_intlist"
,
"torch.jit._pickle.build_intlist"
,
"torch.IntStorage"
,
"torch.jit._pickle.restore_type_tag"
,
"torch._utils._rebuild_tensor_v2"
,
"torch.FloatStorage"
,
"collections.OrderedDict"
How to fix it?
134 MB
xet
Flatten neuron-compiled-artifacts: remove config hash subdirectory (NEURON_COMPILED_ARTIFACTS bypasses it)
3 days ago
neuron_config.json
7.09 kB
Flatten neuron-compiled-artifacts: remove config hash subdirectory (NEURON_COMPILED_ARTIFACTS bypasses it)
3 days ago