Instructions to use flax-community/gpt-2-spanish with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use flax-community/gpt-2-spanish with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="flax-community/gpt-2-spanish")

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("flax-community/gpt-2-spanish")
model = AutoModelForCausalLM.from_pretrained("flax-community/gpt-2-spanish")

Notebooks
Google Colab
Kaggle
Local Apps

vLLM

How to use flax-community/gpt-2-spanish with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "flax-community/gpt-2-spanish"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "flax-community/gpt-2-spanish",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/flax-community/gpt-2-spanish

SGLang

How to use flax-community/gpt-2-spanish with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "flax-community/gpt-2-spanish" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "flax-community/gpt-2-spanish",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "flax-community/gpt-2-spanish" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "flax-community/gpt-2-spanish",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use flax-community/gpt-2-spanish with Docker Model Runner:
```
docker model run hf.co/flax-community/gpt-2-spanish
```

Spanish GPT-2

GPT-2 model trained from scratch on the Spanish portion of OSCAR. The model is trained with Flax and using TPUs sponsored by Google since this is part of the Flax/Jax Community Week organised by HuggingFace.

Model description

The model used for training is OpenAI's GPT-2, introduced in the paper "Language Models are Unsupervised Multitask Learners" by Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei and Ilya Sutskever.

This model is available in the 🤗 Model Hub.

Training data

Spanish portion of OSCAR or Open Super-large Crawled ALMAnaCH coRpus, a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

This corpus is available in the 🤗 Datasets library.

Team members

Manuel Romero (mrm8488)
María Grandury (mariagrandury)
Pablo González de Prado (Pablogps)
Daniel Vera (daveni)
Sri Lakshmi (srisweet)
José Posada (jdposa)
Santiago Hincapie (shpotes)
Jorge (jorgealro)

Downloads last month: 2,566

Safetensors

Model size

0.1B params

Tensor type

F32

Model tree for flax-community/gpt-2-spanish

Finetunes

2 models

flax-community
/

gpt-2-spanish

Spanish GPT-2

Model description

Training data

Team members

Model tree for flax-community/gpt-2-spanish

Dataset used to train flax-community/gpt-2-spanish

Spaces using flax-community/gpt-2-spanish 7