int8 llm - a roshniramesh Collection

Models
Datasets
Spaces
Docs
Enterprise
Pricing
Log In
Sign Up

roshniramesh 's Collections

nf4 llm

fp8 llm

int8 llm

updated Jan 16

meta-llama/Llama-Guard-3-8B-INT8

Text Generation • 8B • Updated Aug 7, 2024 • 4.41k • 38
google/gemma-7b-quant-pytorch

Text Generation • Updated Jun 27, 2024 • 35 • 2
Intel/gpt-j-6B-int8-dynamic-inc

Text Generation • Updated Apr 19, 2023 • 25 • 16
Intel/t5-small-xsum-int8-dynamic-inc

Updated Mar 21, 2024 • 2.4k • 1
Intel/t5-large-finetuned-xsum-cnn-int8-dynamic-inc

Updated Mar 21, 2024 • 17
Intel/xlnet-base-cased-mrpc-int8-static-inc

Text Classification • Updated Mar 21, 2024 • 22
Intel/distilbert-base-cased-distilled-squad-int8-static-inc

Question Answering • Updated Mar 21, 2024 • 12
Intel/bert-base-uncased-mrpc-int8-static-inc

Text Classification • Updated Mar 21, 2024 • 49
Intel/bert-large-uncased-cola-int8-inc

Text Classification • Updated Mar 22, 2024 • 17
Intel/t5-base-cnn-dm-int8-dynamic-inc

Updated Mar 21, 2024 • 13
Intel/vit-base-patch16-224-int8-static-inc

Image Classification • Updated Sep 6, 2022 • 42 • 1
Intel/albert-base-v2-sst2-int8-static-inc

Text Classification • Updated Mar 22, 2024 • 33
Intel/roberta-base-mrpc-int8-dynamic-inc

Text Classification • Updated Dec 28, 2022 • 13
Intel/roberta-base-mrpc-int8-static-inc

Text Classification • Updated Mar 21, 2024 • 25
Intel/roberta-base-squad2-int8-static-inc

Updated Mar 21, 2024 • 22 • 1
Intel/roberta-large-mnli-int8-static-inc

Text Classification • Updated Oct 6, 2023 • 27
Intel/xlm-roberta-base-mrpc-int8-dynamic-inc

Text Classification • Updated Jun 27, 2023 • 13
Intel/deberta-v3-base-mrpc-int8-static-inc

Text Classification • Updated May 25, 2023 • 9
Intel/deberta-v3-base-mrpc-int8-dynamic-inc

Text Classification • Updated Jun 27, 2023 • 15
Intel/dynamic-minilmv2-L6-H384-squad1.1-int8-static

Question Answering • 30.1M • Updated Jun 28, 2024 • 40
Intel/MiniLM-L12-H384-uncased-mrpc-int8-dynamic-inc

Text Classification • Updated Dec 28, 2022 • 9
Intel/MiniLM-L12-H384-uncased-mrpc-int8-qat-inc

Text Classification • Updated Oct 6, 2023 • 11
Intel/MiniLM-L12-H384-uncased-mrpc-int8-static-inc

Text Classification • Updated Mar 21, 2024 • 16
Intel/bart-large-mrpc-int8-dynamic-inc

Text Classification • Updated Mar 21, 2024 • 22
Intel/bart-large-cnn-int8-dynamic-inc

Updated Mar 22, 2024 • 12 • 1
Intel/distilbart-cnn-12-6-int8-dynamic-inc

Updated Mar 22, 2024 • 13 • 2
Intel/gpt-j-6B-int8-static-inc

Text Generation • Updated Apr 19, 2023 • 22 • 9
Intel/gpt-j-6B-pytorch-int8-static-inc

Text Generation • Updated Jan 18, 2024 • 20
Intel/bert-base-cased-finetuned-sst2-int8-inc

Text Classification • Updated Mar 21, 2024 • 9
Intel/bert-base-uncased-CoLA-int8-inc

Text Classification • Updated Mar 22, 2024 • 13
Intel/bert-base-uncased-QNLI-int8-inc

Text Classification • Updated Mar 22, 2024 • 12
Intel/bert-base-uncased-STS-B-int8-inc

Text Classification • Updated Mar 22, 2024 • 15
Intel/bert-base-uncased-finetuned-swag-int8-static-inc

Multiple Choice • Updated Oct 6, 2023 • 22 • 1
Intel/bert-base-uncased-mrpc-int8-qat-inc

Text Classification • Updated Mar 21, 2024 • 33 • 1
Intel/bert-base-uncased-mrpc-int8-dynamic-inc

Text Classification • Updated Mar 21, 2024 • 31
Intel/bert-base-uncased-squad-int8-static-inc

Question Answering • Updated Oct 6, 2023 • 20 • 1
Intel/bert-large-uncased-rte-int8-dynamic-inc

Text Classification • Updated Mar 21, 2024 • 14
Intel/bert-large-uncased-rte-int8-static-inc

Text Classification • Updated Mar 22, 2024 • 11
Intel/distilbert-base-uncased-distilled-squad-int8-static-inc

Question Answering • Updated Mar 29, 2024 • 2.38k • • 5
Intel/distilbert-base-uncased-MRPC-int8-dynamic-inc

Text Classification • Updated Mar 21, 2024 • 13 • 1
Intel/distilbert-base-uncased-MRPC-int8-static-inc

Text Classification • Updated Mar 22, 2024 • 11
Intel/albert-base-v2-sst2-int8-dynamic-inc

Text Classification • Updated Jun 27, 2023 • 20
Intel/albert-base-v2-MRPC-int8-inc

Text Classification • Updated Mar 22, 2024 • 11
Intel/bge-small-en-v1.5-rag-int8-static

Feature Extraction • Updated Feb 19, 2024 • 44 • 2
Intel/bge-base-en-v1.5-rag-int8-static

Feature Extraction • Updated Feb 19, 2024 • 9
Intel/falcon-7b-sq-int8-inc

Text Generation • Updated Apr 17, 2024 • 28
amd/Llama-3.1-8B-Instruct-w-int8-a-int8-sym-test

8B • Updated Jan 7 • 2.62k
RedHatAI/Llama-3.2-1B-Instruct-quantized.w8a8

Text Generation • 1B • Updated Oct 16, 2024 • 10.8k • 7
FriendliAI/Meta-Llama-3-8B-int8

Text Generation • 8B • Updated Aug 1, 2024 • 25 • 1
google/gemma-7b-it-quant-pytorch

Text Generation • Updated Jun 27, 2024 • 40 • 11
OpenVINO/mistral-7b-instruct-v0.1-int8-ov

Text Generation • Updated Dec 4, 2024 • 76 • 1
FriendliAI/Meta-Llama-3.1-8B-Instruct-int8

Text Generation • 8B • Updated Sep 9, 2024 • 12.4k • 1
Qwen/Qwen-14B-Chat-Int8

Text Generation • 14B • Updated Dec 13, 2023 • 108 • 7
Qwen/Qwen-7B-Chat-Int8

Text Generation • 8B • Updated Dec 13, 2023 • 167 • 9
Qwen/Qwen-1_8B-Chat-Int8

Text Generation • 2B • Updated Dec 13, 2023 • 229 • 5
Qwen/Qwen1.5-1.8B-Chat-GPTQ-Int8

Text Generation • 2B • Updated Apr 30, 2024 • 160 • 2
Qwen/Qwen1.5-14B-Chat-GPTQ-Int8

Text Generation • 15B • Updated Apr 30, 2024 • 60 • 11
Qwen/Qwen1.5-4B-Chat-GPTQ-Int8

Text Generation • 4B • Updated Apr 30, 2024 • 64 • 6
Qwen/Qwen1.5-72B-Chat-GPTQ-Int8

Text Generation • 72B • Updated Apr 30, 2024 • 50 • 7
Qwen/Qwen1.5-4B-Chat-GGUF

Text Generation • 4B • Updated Apr 9, 2024 • 2.58k • 16
Qwen/Qwen1.5-0.5B-Chat-GGUF

Text Generation • 0.6B • Updated Apr 9, 2024 • 6.15k • 35
Qwen/Qwen1.5-7B-Chat-GGUF

Text Generation • 8B • Updated Apr 9, 2024 • 5.17k • 70
Qwen/CodeQwen1.5-7B-Chat-GGUF

Text Generation • 7B • Updated Apr 23, 2024 • 787 • 109
Qwen/Qwen2.5-1.5B-Instruct-GPTQ-Int8

Text Generation • 2B • Updated Oct 9, 2024 • 270 • 4
Qwen/Qwen2.5-0.5B-Instruct-GPTQ-Int8

Text Generation • 0.5B • Updated Oct 9, 2024 • 435 • 9
Qwen/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • 0.6B • Updated Sep 20, 2024 • 44k • 58
Qwen/Qwen2-1.5B-Instruct-GGUF

Text Generation • 2B • Updated Jun 18, 2024 • 7.64k • 27
Qwen/Qwen2-0.5B-Instruct-GGUF

Text Generation • 0.5B • Updated Aug 21, 2024 • 19k • 69
Qwen/Qwen2-7B-Instruct-GGUF

Text Generation • 8B • Updated Aug 21, 2024 • 3.46k • 177
Qwen/Qwen2-0.5B-Instruct-GPTQ-Int8

Text Generation • 0.6B • Updated Aug 21, 2024 • 68 • 4
Qwen/Qwen2-1.5B-Instruct-GPTQ-Int8

Text Generation • 2B • Updated Aug 21, 2024 • 72 • 4
Qwen/Qwen2-7B-Instruct-GPTQ-Int8

Text Generation • 8B • Updated Aug 21, 2024 • 153 • 17
Qwen/Qwen2-72B-Instruct-GPTQ-Int8

Text Generation • 73B • Updated Aug 21, 2024 • 58 • 15

Collection guide
Browse collections

Company

TOS Privacy About Careers

Website

Models Datasets Spaces Pricing Docs