Update org README: corporate clean, Swiss datasets with use-case tags

README.md

@@ -1,75 +1,86 @@
----
-title: README
-emoji: 🏔️
-colorFrom: blue
-colorTo: green
-sdk: static
-pinned: false
+# OptiTransferData
+
+Premium web corpora for LLM pre-training, fine-tuning, RAG, and multilingual NLP.
+
 ---
 
-<div style="max-width: 800px; margin: 0 auto;">
+## About
 
-<h2>🏔️ OptiTransferData — Sovereign AI Data for Europe</h2>
+OptiTransferData is the data arm of [OptiTransfer AG](https://optitransfer.ch), a Swiss-registered technology company. We produce compliance-ready, quality-scored web datasets for AI teams building in regulated markets.
 
-<p style="font-size: 1.1em; color: #555;">
-Production-grade, EU AI Act compliant web corpora for LLM training, RAG pipelines, and NLP research. Curated in Switzerland 🇨🇭 with independent quality assurance.
-</p>
+Every dataset ships with:
+
+- Full data provenance and SHA256 verification
+- PII detection and redaction
+- Multi-dimensional quality scoring (0-100 per document)
+- EU AI Act and Swiss FADP compliance documentation
+- Croissant metadata for ML interoperability
+- Multiple export formats (Parquet, JSONL, language splits, RAG chunks)
 
 ---
 
-### 🎯 What We Do
+## Available Datasets
 
-We build **gold-standard national web corpora** — comprehensive, deduplicated, and quality-scored datasets covering entire country-level web domains. Each dataset is independently audited and delivered with full provenance tracking, SHA-256 integrity verification, and commercial licensing.
+### *.ch Swiss Web Premium (A+)
 
-**Our focus areas:**
-- 🤖 **LLM Pre-training & Fine-tuning** — Sovereign language data at scale
-- 🔍 **RAG Pipelines** — Pre-chunked, embedding-ready corpora with quality scores
-- 🏛️ **Government & Regulatory NLP** — Domain-classified, jurisdiction-specific data
-- 📊 **Academic Research** — Reproducible, well-documented datasets with full metadata
+110,491 documents | 78 fields | 554 MB total | Quality score: 62.3 mean
 
----
+The flagship Swiss web corpus, extracted and quality-scored from the .ch ccTLD. Multilingual coverage across German (61.2%), French (19.0%), English (10.5%), Italian (4.7%), and additional languages. Nine-component quality model with full provenance chain.
+
+**Best suited for:**
 
-### 📦 Available Datasets
+`LLM Pre-Training` `Supervised Fine-Tuning (SFT)` `Retrieval-Augmented Generation (RAG)` `Multilingual NLP` `German Language Models` `French Language Models` `Swiss Market AI` `Regulatory Compliance (EU AI Act)` `Domain-Specific Training` `Web Corpus Research` `Text Classification` `Summarisation` `Question Answering` `Translation`
 
-| Dataset | Records | Coverage | Format |
-|---|---|---|---|
-| 🇱🇮 [Liechtenstein Ultra Premium](https://huggingface.co/datasets/OptiTransferData/liechtenstein-ultra-premium-li) | 35,748 | Full `.li` domain | JSONL · 37 fields |
-| 🇫🇷 [France Sovereign RAG Chunks](https://huggingface.co/datasets/OptiTransferData/france-sovereign-rag-chunks) | 348,829 | French government & institutional web | JSONL · 8 fields |
+**Formats:** Parquet (7 shards) | JSONL (7 shards) | Language Splits (DE, FR, EN, IT) | RAG Chunks (4 files)
 
-> **Free gated samples** available on each dataset — request access to evaluate before purchasing.
+| Repository | Description | Access |
+|---|---|---|
+| [swiss-web-premium-ch](https://huggingface.co/datasets/OptiTransferData/swiss-web-premium-ch) | 10,000-record stratified sample with full documentation and QA report | Gated (evaluation) |
+| [swiss-web-premium-ch-full](https://huggingface.co/datasets/OptiTransferData/swiss-web-premium-ch-full) | Complete 110,491-record production dataset | Gated (licensed) |
 
-**Coming soon:** 🇩🇪 Germany · 🇦🇹 Austria · 🇨🇭 Switzerland · 🇮🇹 Italy · 🇪🇸 Spain
+---
+
+## Data Pipeline
+
+All datasets are processed through the OptiTransfer pipeline:
+
+1. **Source Selection** -- Common Crawl filtered by ccTLD and domain trust scoring
+2. **Extraction** -- Text extraction with deduplication, language detection, and structural analysis
+3. **Quality Scoring** -- Nine-component quality model producing a composite 0-100 score per document
+4. **Enrichment** -- Content categorisation, trust tier assignment, academic/news detection, skill tagging
+5. **Compliance** -- PII scanning, redaction, and regulatory documentation
+6. **Verification** -- SHA256 checksums, QA reporting, and independent audit readiness
 
 ---
 
-### ✅ Quality Standards
+## Quality Assurance
+
+Each dataset is accompanied by a full QA report covering:
+
+- Pipeline configuration and processing parameters
+- Quality score distributions and statistical analysis
+- Language detection accuracy and coverage
+- Content categorisation breakdown
+- PII detection results
+- Domain trust tier analysis
+- SHA256 integrity verification
 
-- 📋 **Independent QA audits** with documented accuracy metrics
-- 🔐 **SHA-256 integrity verification** on all production files
-- 📊 **Quality scoring** per record (0–100 scale)
-- 🏷️ **Domain classification** and language detection
-- 📜 **EU AI Act compliance** — full data provenance and licensing transparency
-- 🧹 **Deduplication** — content-level and URL-level
+QA reports are available in both the sample and full product repositories.
 
 ---
 
-### 💼 Licensing & Access
+## Licensing
 
-| Tier | Access |
-|---|---|
-| **Sample** | Free with gated access — evaluate data quality |
-| **Full Dataset** | Commercial licence — complete production data |
-| **Enterprise** | Custom pricing — dedicated support, SLA, bespoke corpora |
+All datasets are available under the OptiTransfer Commercial License. Sample repositories provide gated evaluation access. Full datasets require a commercial license agreement.
 
-📧 **Contact us for a quote:** [data@optitransfer.ch](mailto:data@optitransfer.ch)
+**Payment methods:** Bank Transfer (SEPA/SWIFT), TWINT, Cryptocurrency (BTC/ETH/SOL)
 
-**Payment methods:**
-🏦 Bank Transfer (SEPA/SWIFT) · 📱 TWINT (Swiss) · ₿ Crypto (BTC/ETH/SOL — addresses on request)
+For pricing, volume licensing, or custom extraction requests, contact [data@optitransfer.ch](mailto:data@optitransfer.ch).
 
 ---
 
-<p style="text-align: center; color: #888; font-size: 0.9em;">
-🏔️ Curated in Switzerland · <a href="https://optitransfer.ch">optitransfer.ch</a> · <a href="mailto:data@optitransfer.ch">data@optitransfer.ch</a>
-</p>
+## Contact
 
-</div>
+- **Email:** [data@optitransfer.ch](mailto:data@optitransfer.ch)
+- **Web:** [optitransfer.ch](https://optitransfer.ch)
+- **Location:** Switzerland