README.md

metadata

title: TOS Summarizer Qwen
emoji: 📜
colorFrom: blue
colorTo: indigo
sdk: streamlit
app_file: app/app.py
pinned: false

📜 Terms of Service Summarizer (Mistral 7B)

This is a privacy-centric legal document summarizer powered by a 4-bit quantized Mistral 7B model fine-tuned on legal texts.

🏗️ Architecture

• Frontend: Streamlit
• Model: Mistral-7B-Instruct-v0.3 (GGUF Quantized)
• Inference: llama.cpp (CPU Optimized)
• Orchestration: Docker

🚀 Features

1. Global Summarization: Generates executive summaries of full PDF documents (up to 8k tokens).
2. RAG Q&A: Answers specific questions about the uploaded policy using vector retrieval.