Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

IO-AIR
/
kip-hash-v2

kip
dataset-curation
deduplication
data-filtering
learned-hashing
simhash
minhash
quality-verification
distillation
teacher-student
linear-probe
data-pipeline
multilingual
Model card Files Files and versions
xet
Community
kip-hash-v2 / training
392 kB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 1 commit
IO-AIR's picture
IO-AIR
KIP-Hash v2: frontier-distilled verify-and-dedup hash (DeepSeek webapp teacher, 844 labels, learned 128-bit signature + hash-only quality heads)
6429b4e verified about 21 hours ago
  • batches_manifest.jsonl
    102 kB
    KIP-Hash v2: frontier-distilled verify-and-dedup hash (DeepSeek webapp teacher, 844 labels, learned 128-bit signature + hash-only quality heads) about 21 hours ago
  • teacher_dups.jsonl
    14.3 kB
    KIP-Hash v2: frontier-distilled verify-and-dedup hash (DeepSeek webapp teacher, 844 labels, learned 128-bit signature + hash-only quality heads) about 21 hours ago
  • teacher_labels_deepseek.jsonl
    218 kB
    KIP-Hash v2: frontier-distilled verify-and-dedup hash (DeepSeek webapp teacher, 844 labels, learned 128-bit signature + hash-only quality heads) about 21 hours ago
  • teacher_pairs_adjudicated.jsonl
    10.5 kB
    KIP-Hash v2: frontier-distilled verify-and-dedup hash (DeepSeek webapp teacher, 844 labels, learned 128-bit signature + hash-only quality heads) about 21 hours ago
  • teacher_protocol.md
    5.46 kB
    KIP-Hash v2: frontier-distilled verify-and-dedup hash (DeepSeek webapp teacher, 844 labels, learned 128-bit signature + hash-only quality heads) about 21 hours ago
  • train_v2.py
    41.2 kB
    KIP-Hash v2: frontier-distilled verify-and-dedup hash (DeepSeek webapp teacher, 844 labels, learned 128-bit signature + hash-only quality heads) about 21 hours ago