Instructions to use LeroyDyer/LCARS_STARFLEET with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use LeroyDyer/LCARS_STARFLEET with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="LeroyDyer/LCARS_STARFLEET")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("LeroyDyer/LCARS_STARFLEET") model = AutoModelForCausalLM.from_pretrained("LeroyDyer/LCARS_STARFLEET") - Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use LeroyDyer/LCARS_STARFLEET with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "LeroyDyer/LCARS_STARFLEET" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "LeroyDyer/LCARS_STARFLEET", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/LeroyDyer/LCARS_STARFLEET
- SGLang
How to use LeroyDyer/LCARS_STARFLEET with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "LeroyDyer/LCARS_STARFLEET" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "LeroyDyer/LCARS_STARFLEET", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "LeroyDyer/LCARS_STARFLEET" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "LeroyDyer/LCARS_STARFLEET", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Unsloth Studio new
How to use LeroyDyer/LCARS_STARFLEET with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for LeroyDyer/LCARS_STARFLEET to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for LeroyDyer/LCARS_STARFLEET to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for LeroyDyer/LCARS_STARFLEET to start chatting
Load model with FastModel
pip install unsloth from unsloth import FastModel model, tokenizer = FastModel.from_pretrained( model_name="LeroyDyer/LCARS_STARFLEET", max_seq_length=2048, ) - Docker Model Runner
How to use LeroyDyer/LCARS_STARFLEET with Docker Model Runner:
docker model run hf.co/LeroyDyer/LCARS_STARFLEET
Your best Model and Dataset Recommendation
Hi Leroy,
greetings from East Germany. I'm looking for high quality bible datasets and models and stumbled across your work, which is looking very promising. I'd love to know which of your models would be suited best for (1) Bible translation and redaction in German, and (2) which of your models has been trained on your BibleExpert dataset. Speaking of which, (3) it would be great to know where the data originates from.
Thanks so much,
Klaus
oh sorry for the late response :
for datasets :
i have used LeroyDyer/BIBLE_VERSIONS ( this is just a collection of bibles , i train them as text ... next word prediction )
Also LeroyDyer/BibleExpert this is a lot of questions and answers to do with various bible and historical incedents : -these are not easy to find: (important)
LeroyDyer/bibles this is the bible stripped down into verses and locations ! this is usefull for the model to recall specific passages ¬ i used many bibles , different translations and flavours ( english and european )
mekaneeky/SALT-languages-bible <<< this is also one of the most important data sources !as it has the bible in many AFRICAN ! languages as this is the original source of the bible we can get to the actuall meanings of the original words and retransate to its original intentions !
LeroyDyer/LCARS_Specialist_MYTH_BUSTER_ --- For me this one was the best at making timelines ! as well as chaldean histrys !
( i also train them with african historys as this also allows for understanding the journeys and peoples they biblcal people encountered as well as mahabharat etc ! ( shem )
this became the best model ! for bible stuff :
i use it for timelines and deep questions :i also trained this model on many sacred texts and historys etc: so we can redate as well as CrossRefference!
ALL my models CONTAIN the BIBLE !!
They DO NOT have super long context ¬¬ they answer very well ! but i find its best to limit the length of the response and allow for a continued response instead ! to maintain higher quality !
as well as to use .5 temp ¬ ( important ) as this will allow for the model to possibly search for the ( second best answers also ) !! as we need to be able to debate ! so we need a slightly higher tempreture !
we can control the model using TOPK ! ( so if we Reduce the TOPK Samples we get a hgih quality pool ) then we can raise the TopP so that the model will select from the higher ( samples first )
the model is a mistral ( generally trained on 2048 Context ! )
so i expect this model to be NON BIASED !
I do not use the model for anything else ! as i found the models not havng great babalance as some tasks get lost when adding the bible , so i decided to keep it as a dedicated model ! for history and religions !
PS: I have many religious datasets !
Pain staking Work !