Instructions to use cvelist/spidder with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use cvelist/spidder with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("cvelist/spidder", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Update preprocessing.py
Browse files- preprocessing.py +1 -1
preprocessing.py
CHANGED
|
@@ -6,7 +6,7 @@ def preprocess_text(text):
|
|
| 6 |
text = re.sub(r'\s+', ' ', text)
|
| 7 |
return text.strip()
|
| 8 |
|
| 9 |
-
with open("data.
|
| 10 |
data = file.readlines()
|
| 11 |
|
| 12 |
cleaned_data = [preprocess_text(line) for line in data]
|
|
|
|
| 6 |
text = re.sub(r'\s+', ' ', text)
|
| 7 |
return text.strip()
|
| 8 |
|
| 9 |
+
with open("data.csv", "r") as file:
|
| 10 |
data = file.readlines()
|
| 11 |
|
| 12 |
cleaned_data = [preprocess_text(line) for line in data]
|