HuggingFaceM4
/

idefics-80b

Text Generation

image-text-to-text

text-generation-inference

Model card Files Files and versions

Instructions to use HuggingFaceM4/idefics-80b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use HuggingFaceM4/idefics-80b with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="HuggingFaceM4/idefics-80b")

# Load model directly
from transformers import AutoProcessor, AutoModelForImageTextToText

processor = AutoProcessor.from_pretrained("HuggingFaceM4/idefics-80b")
model = AutoModelForImageTextToText.from_pretrained("HuggingFaceM4/idefics-80b")

Notebooks
Google Colab
Kaggle
Local Apps

How to use HuggingFaceM4/idefics-80b with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "HuggingFaceM4/idefics-80b"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "HuggingFaceM4/idefics-80b",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/HuggingFaceM4/idefics-80b

How to use HuggingFaceM4/idefics-80b with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "HuggingFaceM4/idefics-80b" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "HuggingFaceM4/idefics-80b",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "HuggingFaceM4/idefics-80b" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "HuggingFaceM4/idefics-80b",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use HuggingFaceM4/idefics-80b with Docker Model Runner:
```
docker model run hf.co/HuggingFaceM4/idefics-80b
```

Commit History

adding 9b and 9b instruct

a583f4d

sasha commited on Aug 28, 2023

Adding carbon footprint information

a2b0422

sasha commited on Aug 28, 2023

set the correct vision_config.hidden_act (#19)

4e645cd

stas commited on Aug 28, 2023

Update README.md

01698d0

patrickvonplaten commited on Aug 28, 2023

Update README.md (#17)

eddaa07

stas commited on Aug 22, 2023

Disable inference (#16)

2ccbe9d

osanseviero commited on Aug 22, 2023

fix - thanks @joaogante !

1c86537

VictorSanh commited on Aug 21, 2023

more specific wording

0f909ad

VictorSanh commited on Aug 21, 2023

more specific wording

34a2e3b

VictorSanh commited on Aug 21, 2023

change order

39b3f74

VictorSanh commited on Aug 21, 2023

add safetensors

5d7b7a2

hugo@huggingface.co commited on Aug 21, 2023

Update model card bias section (#9)

7b2c3a2

davanstrien HF Staff commited on Aug 20, 2023

Update README.md

39115ab

VictorSanh commited on Aug 20, 2023

Merge branch 'main' of https://huggingface.co/HuggingFaceM3/idefics-80b into main

86ca379

VictorSanh commited on Aug 19, 2023

updates to the readme

02787cf

VictorSanh commited on Aug 19, 2023

Update README.md

cb7b149

VictorSanh commited on Aug 18, 2023

revert

338e8a2

VictorSanh commited on Aug 18, 2023

add tokenizer.json for fast tokenizer

3f2d3ab

VictorSanh commited on Aug 18, 2023

add latest colab link and description

395412b

Leyo commited on Aug 18, 2023

update_all_readme_script (#15)

47f3ffb

Leyo commited on Aug 18, 2023

update the generation args

8a29e64

VictorSanh commited on Aug 17, 2023

update colab link

1552af8

Leyo commited on Aug 15, 2023

fix link stable bias

0fc4c61

Leyo commited on Aug 14, 2023

Add more people to contributors

6982895

Leyo commited on Aug 14, 2023

update .gitattributes

eea9385

VictorSanh commited on Aug 13, 2023

integrate Giada's comments

a6e5964

VictorSanh commited on Aug 13, 2023

update links to bias sections (#14)

40ba628

davanstrien HF Staff commited on Aug 11, 2023

update_colab_image (#13)

1e7399a

Leyo commited on Aug 11, 2023

add logo

fa3b42d

Leyo commited on Aug 11, 2023

add_assets (#12)

ffce151

Leyo commited on Aug 11, 2023

Update model cards authors

a62b219

Leyo commited on Aug 11, 2023

fix_details_model_card (#11)

4edcc87

Leyo commited on Aug 10, 2023

Update README.md

697ab43

HugoLaurencon commited on Aug 10, 2023

Upload Figure_Evals_IDEFICS.png

7ec80bb

HugoLaurencon commited on Aug 9, 2023

Delete assets/Figure_Evals_IDEFICS.png

37dffe3

HugoLaurencon commited on Aug 9, 2023

update_tables (#10)

c5cc8c2

Leyo commited on Aug 8, 2023

update_vic_2 (#8)

6c9a197

VictorSanh commited on Aug 8, 2023

add column to distinguish dataset part of finetuning mix

599076c

Leyo commited on Aug 7, 2023

Model card bias section (#6)

e7e7632

davanstrien HF Staff commited on Aug 7, 2023

Update README.md

d999531

HugoLaurencon commited on Aug 6, 2023

Update README.md

5d9b2ec

HugoLaurencon commited on Aug 6, 2023

Update README.md

4ece772

HugoLaurencon commited on Aug 6, 2023

Upload Figure_Evals_IDEFICS.png

6a31588

HugoLaurencon commited on Aug 6, 2023

Delete assets/Figure_Evals_IDEFIX.png

827ae2f

HugoLaurencon commited on Aug 6, 2023

Add stars for evals in instruction dataset

9053c22

Leyo commited on Aug 4, 2023

Fix model naming (idefix/idefics)

96555cb

Leyo commited on Aug 4, 2023

Update Idefics instruct eval table with new merged table

28fdffe

Leyo commited on Aug 4, 2023

switch Base vs Instruct

8ded392

Leyo commited on Aug 4, 2023

add separator

7e556e9

Leyo commited on Aug 4, 2023

Add fairness evals for Idefics instruct

455a3a6

Leyo commited on Aug 4, 2023