D Ф m i И i q ц e L Ф y e r commited on
Commit
d228524
·
1 Parent(s): cccae59

fix: Add missing requirements-distilled.txt

Browse files
Files changed (1) hide show
  1. requirements-distilled.txt +51 -0
requirements-distilled.txt ADDED
@@ -0,0 +1,51 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # SysCRED - Optimized Requirements with Distilled Models
2
+ # Système Hybride de Vérification de Crédibilité
3
+ # (c) Dominique S. Loyer
4
+ #
5
+ # This version uses DISTILLED models for faster loading and lower memory:
6
+ # - DistilBERT instead of BERT (~60% smaller, 40% faster)
7
+ # - MiniLM for sentence embeddings (~5x smaller than all-mpnet)
8
+ # - Optimized for HuggingFace Spaces (16GB RAM limit)
9
+
10
+ # === Core Dependencies ===
11
+ requests>=2.28.0
12
+ beautifulsoup4>=4.11.0
13
+ python-whois>=0.8.0
14
+
15
+ # === RDF/Ontology ===
16
+ rdflib>=6.0.0
17
+
18
+ # === Machine Learning (Distilled/Optimized) ===
19
+ # Using CPU-only torch for smaller footprint
20
+ --extra-index-url https://download.pytorch.org/whl/cpu
21
+ torch>=2.0.0
22
+
23
+ # Transformers with minimal dependencies
24
+ transformers>=4.30.0
25
+
26
+ # Distilled sentence transformer (5x smaller than full models)
27
+ sentence-transformers>=2.2.0
28
+
29
+ # Data processing
30
+ numpy>=1.24.0
31
+ pandas>=2.0.0
32
+
33
+ # === Explainability ===
34
+ lime>=0.2.0
35
+
36
+ # === NLP for NER (French + English) ===
37
+ spacy>=3.5.0
38
+ # Note: Download models in Dockerfile with:
39
+ # python -m spacy download fr_core_news_sm
40
+ # python -m spacy download en_core_web_sm
41
+
42
+ # === Web Backend ===
43
+ flask>=2.3.0
44
+ flask-cors>=4.0.0
45
+ python-dotenv>=1.0.0
46
+
47
+ # === Production ===
48
+ gunicorn>=20.1.0
49
+
50
+ # === Development/Testing ===
51
+ pytest>=7.0.0