Instructions to use galakenya/JapanRailwayLLM with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use galakenya/JapanRailwayLLM with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf galakenya/JapanRailwayLLM:Q4_K_M # Run inference directly in the terminal: llama cli -hf galakenya/JapanRailwayLLM:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf galakenya/JapanRailwayLLM:Q4_K_M # Run inference directly in the terminal: llama cli -hf galakenya/JapanRailwayLLM:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf galakenya/JapanRailwayLLM:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf galakenya/JapanRailwayLLM:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf galakenya/JapanRailwayLLM:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf galakenya/JapanRailwayLLM:Q4_K_M
Use Docker
docker model run hf.co/galakenya/JapanRailwayLLM:Q4_K_M
- LM Studio
- Jan
- Ollama
How to use galakenya/JapanRailwayLLM with Ollama:
ollama run hf.co/galakenya/JapanRailwayLLM:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use galakenya/JapanRailwayLLM with Docker Model Runner:
docker model run hf.co/galakenya/JapanRailwayLLM:Q4_K_M
- Lemonade
How to use galakenya/JapanRailwayLLM with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull galakenya/JapanRailwayLLM:Q4_K_M
Run and chat with the model
lemonade run user.JapanRailwayLLM-Q4_K_M
List all available models
lemonade list
- Atomic Chat
JapanRailwayLLM
JapanRailwayLLM is a specialized railway large language model project focused on Japanese railway technology, operations, signaling systems, rolling stock engineering, infrastructure, transportation history, and railway regulations.
🇯🇵 日本語
概要
JapanRailwayLLM は、日本の鉄道技術・運行管理・保安装置・信号システム・車両工学・鉄道インフラ・鉄道史・運賃制度・鉄道法規を対象とした専門AIモデルです。
含まれる内容
- QLoRA Adapter
- GGUF Model
- Tokenizer
- RAG Configuration
ベースモデル
google/gemma-2-9b-it
派生モデルについて
本モデルを利用した追加学習、改造、再配布、量子化、マージモデルの公開は可能です。
派生モデル公開時には以下のクレジット表記を推奨します。
参考資料:
モリコラ日誌
https://galakenya.blogspot.com/
🇺🇸 English
Overview
JapanRailwayLLM is a railway-specialized language model focusing on Japanese railway technology, operations, rolling stock engineering, infrastructure, signaling systems, railway regulations, and railway history.
Included Components
- QLoRA Adapter
- GGUF Model
- Tokenizer
- RAG Configuration
Base Model
google/gemma-2-9b-it
Derivative Models
Users may fine-tune, modify, redistribute, quantize, or create derivative works according to the applicable license terms.
When publishing derivative models, users are encouraged to include the following reference:
MoriCola Blog
https://galakenya.blogspot.com/
🇫🇷 Français
Présentation
JapanRailwayLLM est un modèle spécialisé dans les technologies ferroviaires japonaises, l'exploitation ferroviaire, les systèmes de signalisation, le matériel roulant et l'histoire ferroviaire.
Contenu
- Adaptateur QLoRA
- Modèle GGUF
- Tokenizer
- Configuration RAG
Modèle de base
google/gemma-2-9b-it
Modèles dérivés
Les utilisateurs peuvent créer et distribuer des modèles dérivés.
Référence recommandée :
MoriCola Blog
https://galakenya.blogspot.com/
🇪🇸 Español
Descripción General
JapanRailwayLLM es un modelo especializado en tecnología ferroviaria japonesa, señalización ferroviaria, operaciones ferroviarias, infraestructura e historia ferroviaria.
Contenido
- Adaptador QLoRA
- Modelo GGUF
- Tokenizer
- Configuración RAG
Modelo Base
google/gemma-2-9b-it
Modelos Derivados
Se permite la creación y redistribución de modelos derivados.
Referencia recomendada:
MoriCola Blog
https://galakenya.blogspot.com/
🇨🇳 繁體中文
概述
JapanRailwayLLM 是專門針對日本鐵路技術、列車運行、號誌系統、車輛工程、鐵路基礎設施及鐵路歷史進行優化的大型語言模型。
包含內容
- QLoRA Adapter
- GGUF Model
- Tokenizer
- RAG Configuration
基礎模型
google/gemma-2-9b-it
衍生模型
允許再次訓練、修改及再發佈。
建議於 README 中加入下列參考來源:
森山日誌
https://galakenya.blogspot.com/
🇰🇷 한국어
개요
JapanRailwayLLM은 일본 철도 기술, 철도 운영, 차량 공학, 신호 시스템, 철도 역사 및 철도 법규에 특화된 대규모 언어 모델입니다.
구성
- QLoRA Adapter
- GGUF Model
- Tokenizer
- RAG Configuration
베이스 모델
google/gemma-2-9b-it
파생 모델
추가 학습, 수정 및 재배포가 가능합니다.
권장 참고 링크:
MoriCola Blog
https://galakenya.blogspot.com/
🇧🇷 Português (Brasil)
Visão Geral
JapanRailwayLLM é um modelo especializado em tecnologia ferroviária japonesa, sistemas ferroviários, operações, sinalização, material rodante e história ferroviária.
Conteúdo
- Adaptador QLoRA
- Modelo GGUF
- Tokenizer
- Configuração RAG
Modelo Base
google/gemma-2-9b-it
Modelos Derivados
É permitido criar, adaptar, quantizar e redistribuir modelos derivados.
Referência recomendada:
MoriCola Blog
https://galakenya.blogspot.com/
Attribution
Recommended Credit
Japanese: モリコラ日誌
English: MoriCola Blog
Traditional Chinese: 森山日誌
Blog URL: https://galakenya.blogspot.com/
Model Components
| Component | Included |
|---|---|
| QLoRA Adapter | ✅ |
| GGUF Model | ✅ |
| Tokenizer | ✅ |
| RAG Configuration | ✅ |
| Railway Knowledge | ✅ |
| Multilingual Documentation | ✅ |
Author
Kenya Gala
Project: JapanRailwayLLM
Domain: Japanese Railway Technology
- Downloads last month
- 186
4-bit