Instructions to use Tincando/new_data_edgar with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Tincando/new_data_edgar with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="Tincando/new_data_edgar")

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("Tincando/new_data_edgar")
model = AutoModelForCausalLM.from_pretrained("Tincando/new_data_edgar", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use Tincando/new_data_edgar with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Tincando/new_data_edgar"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Tincando/new_data_edgar",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/Tincando/new_data_edgar

SGLang

How to use Tincando/new_data_edgar with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Tincando/new_data_edgar" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Tincando/new_data_edgar",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Tincando/new_data_edgar" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Tincando/new_data_edgar",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use Tincando/new_data_edgar with Docker Model Runner:
```
docker model run hf.co/Tincando/new_data_edgar
```

new_data_edgar

Commit History

Jul 13, 2023

13:55
Adding `safetensors` variant of this model⁠

SFconvertbot

a72263c

Mar 14, 2023

19:32
Training in progress, step 17000

Tincando

d28c1f7
19:30
Training in progress, step 16500

Tincando

b6f1e5a
19:28
Training in progress, step 16000

Tincando

21c7814
19:26
Training in progress, step 15500

Tincando

f26898d
19:23
Training in progress, step 15000

Tincando

dc320ae
19:21
Training in progress, step 14500

Tincando

ea38270
19:19
Training in progress, step 14000

Tincando

058aff8
19:16
Training in progress, step 13500

Tincando

1de7eb0
19:14
Training in progress, step 13000

Tincando

437eb2b
19:12
Training in progress, step 12500

Tincando

a7ca6ba
19:10
Training in progress, step 12000

Tincando

d267deb
19:08
Training in progress, step 11500

Tincando

5d2d1ce
19:06
Training in progress, step 11000

Tincando

997ea44
19:03
Training in progress, step 10500

Tincando

0ad52f9
19:01
Training in progress, step 10000

Tincando

c52559d
18:59
Training in progress, step 9500

Tincando

9932ef1
18:56
Training in progress, step 9000

Tincando

db7f787
18:54
Training in progress, step 8500

Tincando

3c3a4c1
18:52
Training in progress, step 8000

Tincando

0eeaebf
18:50
Training in progress, step 7500

Tincando

edac250
18:48
Training in progress, step 7000

Tincando

be97b3b
18:46
Training in progress, step 6500

Tincando

3ec3f5e
18:44
Training in progress, step 6000

Tincando

4ae0307
18:41
Training in progress, step 5500

Tincando

22187bd
18:39
Training in progress, step 5000

Tincando

2b9da9c
18:37
Training in progress, step 4500

Tincando

2bea362
18:34
Training in progress, step 4000

Tincando

b5abb68
18:32
Training in progress, step 3500

Tincando

b58d52f
18:30
Training in progress, step 3000

Tincando

6d290cd
18:28
Training in progress, step 2500

Tincando

0caa517
18:26
Training in progress, step 2000

Tincando

e8e9c8f
18:24
Training in progress, step 1500

Tincando

025bf9f
18:22
Training in progress, step 1000

Tincando

f2d0dff
18:20
Training in progress, step 500

Tincando

6e97d20
18:17
initial commit

Tincando

3d35320

Commit History

Jul 13, 2023

Adding `safetensors` variant of this model⁠

Mar 14, 2023

Training in progress, step 17000

Training in progress, step 16500

Training in progress, step 16000

Training in progress, step 15500

Training in progress, step 15000

Training in progress, step 14500

Training in progress, step 14000

Training in progress, step 13500

Training in progress, step 13000

Training in progress, step 12500

Training in progress, step 12000

Training in progress, step 11500

Training in progress, step 11000

Training in progress, step 10500

Training in progress, step 10000

Training in progress, step 9500

Training in progress, step 9000

Training in progress, step 8500

Training in progress, step 8000

Training in progress, step 7500

Training in progress, step 7000

Training in progress, step 6500

Training in progress, step 6000

Training in progress, step 5500

Training in progress, step 5000

Training in progress, step 4500

Training in progress, step 4000

Training in progress, step 3500

Training in progress, step 3000

Training in progress, step 2500

Training in progress, step 2000

Training in progress, step 1500

Training in progress, step 1000

Training in progress, step 500

initial commit