llm.create_chat_completion(
messages = "No input example has been defined for this model task."
)📰 aom-news-4b (Article/Analyst Optimized Model)
This repository contains aom-news-4b, a specialized large language model fine-tuned on Google Gemma 4B for structured news analysis. Its primary function is to generate a concise Summary, Sentiment Score, and a Numerical Score for financial and cryptocurrency articles.
The model is optimized for CPU and low-resource environments, offering a highly efficient solution for local inference and edge computing applications.
📄 Model Details & Limitations
| Detail | Value |
|---|---|
| Base Model | Google Gemma 4B (Fine-Tuned) |
| Parameter Count | ~4 Billion |
| Primary Task | Structured News Analysis & Sentiment Scoring |
| Optimal Use | Local Inference on resource-constrained devices (CPU-friendly) |
| License | Gemma Terms of Use |
⚠️ IMPORTANT LIMITATION: This model has been aggressively fine-tuned for a specific structural analysis task. It is not suitable for general conversation and will attempt to force all inputs into its defined output format.
⚖️ License
This model is a derivative work of the Gemma family of models. It is licensed under the Gemma Terms of Use. Please review the official Gemma Terms of Use provided by Google before using or redistributing this model.
💾 Available Model Formats
The model is provided in multiple formats for maximum deployment flexibility:
1. Safetensors (High-Precision)
- Use Case: Ideal for further fine-tuning or for deployment on high-performance servers/GPUs where maximum accuracy is required.
2. GGUF (Quantized for CPU/Edge)
- File Example:
aom-news-4b.Q8_0.gguf - Use Case: Recommended for Ollama, Llama.cpp, or any CPU/resource-constrained deployment due to its small size and high inference speed on standard hardware.
Example Input (API Payload or CLI)
Analyze the following news article and provide a summary, sentiment analysis, and a score.
TITLE: Maximizing Profit in a Volatile Market: How Vest Mining Transforms Crypto Uncertainty into Sustainable Growth BODY: Cryptocurrency presents amazing prospects as well as great market volatility. Vest Mining excels within this framework. With the use of sophisticated technology, intelligent automation, and a focus on increased stability, Vest Mining helps clients translate crypto volatility into reliable and sustainable income streams. CATEGORIES: BUSINESS, CRYPTOCURRENCY
Expected Output
The model will respond with the structured analysis:
SUMMARY: The article discusses how Vest Mining leverages cryptocurrency's inherent volatility to generate consistent revenue for its customers through technological advancements and automated processes, positioning it favorably amidst fluctuating crypto markets. SENTIMENT: POSITIVE SCORE: 0.9
- Downloads last month
- 31
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="xesutr/aom-news-4b", filename="", )