Instructions to use JoeShingleton/GeoLlama-3.1-8b-RAG with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use JoeShingleton/GeoLlama-3.1-8b-RAG with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("JoeShingleton/GeoLlama-3.1-8b-RAG", dtype="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps
- Unsloth Studio new
How to use JoeShingleton/GeoLlama-3.1-8b-RAG with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for JoeShingleton/GeoLlama-3.1-8b-RAG to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for JoeShingleton/GeoLlama-3.1-8b-RAG to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for JoeShingleton/GeoLlama-3.1-8b-RAG to start chatting
Load model with FastModel
pip install unsloth from unsloth import FastModel model, tokenizer = FastModel.from_pretrained( model_name="JoeShingleton/GeoLlama-3.1-8b-RAG", max_seq_length=2048, )
Uploaded model
- Developed by: JoeShingleton
- License: apache-2.0
- Finetuned from model : unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit
This is a fine-tuned Llama-3.1-8b model, trained to do toponym extraction. For a given input text, the model will return all the toponyms (place names) within the text, formatted as:
{'toponyms':['toponym1', 'toponym2',...'toponymN']}
The model was trained on the LGL, GeoVirus and CoNLL datasets.
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for JoeShingleton/GeoLlama-3.1-8b-RAG
Base model
meta-llama/Llama-3.1-8B Finetuned
meta-llama/Llama-3.1-8B-Instruct
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("JoeShingleton/GeoLlama-3.1-8b-RAG", dtype="auto")