Instructions to use Lithicsoft/The-Lithicsoft-Research-AI-01 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Lithicsoft/The-Lithicsoft-Research-AI-01 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="Lithicsoft/The-Lithicsoft-Research-AI-01")

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("Lithicsoft/The-Lithicsoft-Research-AI-01")
model = AutoModelForCausalLM.from_pretrained("Lithicsoft/The-Lithicsoft-Research-AI-01")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use Lithicsoft/The-Lithicsoft-Research-AI-01 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Lithicsoft/The-Lithicsoft-Research-AI-01"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Lithicsoft/The-Lithicsoft-Research-AI-01",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/Lithicsoft/The-Lithicsoft-Research-AI-01

SGLang

How to use Lithicsoft/The-Lithicsoft-Research-AI-01 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Lithicsoft/The-Lithicsoft-Research-AI-01" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Lithicsoft/The-Lithicsoft-Research-AI-01",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Lithicsoft/The-Lithicsoft-Research-AI-01" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Lithicsoft/The-Lithicsoft-Research-AI-01",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use Lithicsoft/The-Lithicsoft-Research-AI-01 with Docker Model Runner:
```
docker model run hf.co/Lithicsoft/The-Lithicsoft-Research-AI-01
```

The-Lithicsoft-Research-AI-01

Commit History

Update README.md

878c4b2
verified

AnthonyErosion commited on Feb 19, 2024

Update README.md

00f9b54

AnthonyErosion commited on Dec 24, 2023

Update README.md

0a4c810

AnthonyErosion commited on Nov 23, 2023

Update .gitattributes

0d2302b

AnthonyErosion commited on Jul 3, 2023

Delete model.safetensors

1f4692d

AnthonyErosion commited on Jul 3, 2023

Adding `safetensors` variant of this model (#4)

b852771

AnthonyErosion

SFconvertbot commited on Jul 3, 2023

Update README.md

f916bdf

AnthonyErosion commited on Jul 3, 2023

Upload 7 files

9c81865

AnthonyErosion commited on Jul 3, 2023

Delete logs.log

b5249ce

AnthonyErosion commited on Jul 3, 2023

Delete flags.json

0f1d11e

AnthonyErosion commited on Jul 3, 2023

Delete charts.db

794f6f8

AnthonyErosion commited on Jul 3, 2023

Delete cfg_last.p

dfe82bd

AnthonyErosion commited on Jul 3, 2023

Delete adapter_model.bin

33b0c85

AnthonyErosion commited on Jul 3, 2023

Delete checkpoint-001.pth

9be6471

AnthonyErosion commited on Jul 3, 2023

Delete adapter_config.json

191484b

AnthonyErosion commited on Jul 3, 2023

Delete preds_demo_experiment.zip

2652c44

AnthonyErosion commited on Jul 3, 2023

Delete validation_predictions.csv

b7795b1

AnthonyErosion commited on Jul 3, 2023

Delete validation_raw_predictions.pkl

58df153

AnthonyErosion commited on Jul 3, 2023

Delete .gitattributes

472f166

AnthonyErosion commited on Jul 3, 2023

Update README.md

f62296d

AnthonyErosion commited on Jul 2, 2023

Create README.md

04be620

AnthonyErosion commited on Jul 2, 2023

Upload 10 files

fdd267d

AnthonyErosion commited on Jul 2, 2023

Delete tokenizer_config.json

862b917

AnthonyErosion commited on Jul 2, 2023

Delete special_tokens_map.json

29cc0e4

AnthonyErosion commited on Jul 2, 2023

Delete pytorch_model.bin

f944a2a

AnthonyErosion commited on Jul 2, 2023

Delete tokenizer.json

c1cd8d5

AnthonyErosion commited on Jul 2, 2023

Delete vocab.json

ff7d6fe

AnthonyErosion commited on Jul 2, 2023

Delete model.safetensors

73573a0

AnthonyErosion commited on Jul 2, 2023

Delete merges.txt

7d36469

AnthonyErosion commited on Jul 2, 2023

Delete flax_model.msgpack

127aa75

AnthonyErosion commited on Jul 2, 2023

Delete config.json

122c4ba

AnthonyErosion commited on Jul 2, 2023

Delete README.md (#3)

3b5bae2

AnthonyErosion commited on Jul 2, 2023

Delete added_tokens.json

54fe880

AnthonyErosion commited on Jul 2, 2023

Delete .gitattributes

d4ce8fc

AnthonyErosion commited on Jul 2, 2023

Adding `safetensors` variant of this model (#2)

d87bd5d

AnthonyErosion

SFconvertbot commited on Jul 1, 2023

Update README.md

011ebf2

AnthonyErosion commited on Jul 1, 2023

Create README.md

a7a76b0

AnthonyErosion commited on Jul 1, 2023

Upload 9 files

bb6031c

AnthonyErosion commited on Jul 1, 2023

Delete tokenizer.json

74a43ae

AnthonyErosion commited on Jul 1, 2023

Delete tokenizer_config.json

507cdbc

AnthonyErosion commited on Jul 1, 2023

Delete special_tokens_map.json

812c0fb

AnthonyErosion commited on Jul 1, 2023

Delete pytorch_model.bin

bfb227a

AnthonyErosion commited on Jul 1, 2023

Delete config.json

1cebc30

AnthonyErosion commited on Jul 1, 2023

Delete .gitattributes

5177e8e

AnthonyErosion commited on Jul 1, 2023

Upload 5 files

86ebb64

AnthonyErosion commited on Jun 25, 2023

initial commit

262965f

AnthonyErosion commited on Jun 25, 2023

Commit History

Update README.md 878c4b2 verified

Update README.md 00f9b54

Update README.md 0a4c810

Update .gitattributes 0d2302b

Delete model.safetensors 1f4692d

Adding `safetensors` variant of this model (#4) b852771

Update README.md f916bdf

Upload 7 files 9c81865

Delete logs.log b5249ce

Delete flags.json 0f1d11e

Delete charts.db 794f6f8

Delete cfg_last.p dfe82bd

Delete adapter_model.bin 33b0c85

Delete checkpoint-001.pth 9be6471

Delete adapter_config.json 191484b

Delete preds_demo_experiment.zip 2652c44

Delete validation_predictions.csv b7795b1

Delete validation_raw_predictions.pkl 58df153

Delete .gitattributes 472f166

Update README.md f62296d

Create README.md 04be620

Upload 10 files fdd267d

Delete tokenizer_config.json 862b917

Delete special_tokens_map.json 29cc0e4

Delete pytorch_model.bin f944a2a

Delete tokenizer.json c1cd8d5

Delete vocab.json ff7d6fe

Delete model.safetensors 73573a0

Delete merges.txt 7d36469

Delete flax_model.msgpack 127aa75

Delete config.json 122c4ba

Delete README.md (#3) 3b5bae2

Delete added_tokens.json 54fe880

Delete .gitattributes d4ce8fc

Adding `safetensors` variant of this model (#2) d87bd5d

Update README.md 011ebf2

Create README.md a7a76b0

Upload 9 files bb6031c

Delete tokenizer.json 74a43ae

Delete tokenizer_config.json 507cdbc

Delete special_tokens_map.json 812c0fb

Delete pytorch_model.bin bfb227a

Delete config.json 1cebc30

Delete .gitattributes 5177e8e

Upload 5 files 86ebb64

initial commit 262965f

Update README.md

878c4b2
verified

Update README.md

00f9b54

Update README.md

0a4c810

Update .gitattributes

0d2302b

Delete model.safetensors

1f4692d

Adding `safetensors` variant of this model (#4)

b852771

Update README.md

f916bdf

Upload 7 files

9c81865

Delete logs.log

b5249ce

Delete flags.json

0f1d11e

Delete charts.db

794f6f8

Delete cfg_last.p

dfe82bd

Delete adapter_model.bin

33b0c85

Delete checkpoint-001.pth

9be6471

Delete adapter_config.json

191484b

Delete preds_demo_experiment.zip

2652c44

Delete validation_predictions.csv

b7795b1

Delete validation_raw_predictions.pkl

58df153

Delete .gitattributes

472f166

Update README.md

f62296d

Create README.md

04be620

Upload 10 files

fdd267d

Delete tokenizer_config.json

862b917

Delete special_tokens_map.json

29cc0e4

Delete pytorch_model.bin

f944a2a

Delete tokenizer.json

c1cd8d5

Delete vocab.json

ff7d6fe

Delete model.safetensors

73573a0

Delete merges.txt

7d36469

Delete flax_model.msgpack

127aa75

Delete config.json

122c4ba

Delete README.md (#3)

3b5bae2

Delete added_tokens.json

54fe880

Delete .gitattributes

d4ce8fc

Adding `safetensors` variant of this model (#2)

d87bd5d

Update README.md

011ebf2

Create README.md

a7a76b0

Upload 9 files

bb6031c

Delete tokenizer.json

74a43ae

Delete tokenizer_config.json

507cdbc

Delete special_tokens_map.json

812c0fb

Delete pytorch_model.bin

bfb227a

Delete config.json

1cebc30

Delete .gitattributes

5177e8e

Upload 5 files

86ebb64

initial commit

262965f