DAPS-text-encoder / README.md
zxclara010's picture
Release encoder main
cfbd59a verified
|
Raw History Blame Contribute Delete
1.24 kB
---
license: apache-2.0
base_model: Alibaba-NLP/gte-modernbert-base
base_model_relation: finetune
library_name: sentence-transformers
pipeline_tag: sentence-similarity
tags:
- premise-selection
- lean
- mathlib
---
# DAPS Text Encoder
The text encoder produced by Phase 1 of DAPS, fine-tuned on [Mathlib](https://huggingface.co/datasets/DAPS-Math/DAPS-Mathlib-Graph) from [gte-modernbert-base](https://huggingface.co/Alibaba-NLP/gte-modernbert-base). It produces 768-dimensional embeddings using CLS pooling and can be used independently as a Mathlib text encoder.
For better premise-selection performance, we recommend pairing it with the graph-aware [DAPS Selector](https://huggingface.co/DAPS-Math/DAPS-selector) produced by Phase 2.
```python
from sentence_transformers import SentenceTransformer
model = SentenceTransformer("DAPS-Math/DAPS-text-encoder")
model.max_seq_length = 1024
embeddings = model.encode(
["∀ n : ℕ, n + 0 = n", "∀ a b : ℕ, a + b = b + a"],
normalize_embeddings=True,
)
print(embeddings.shape)
```
DAPS uses a 1024-token input limit. See the [DAPS project page](https://relational-conjecturing.github.io/Dependency-Aware-Premise-Selection/) for the full premise-selection pipeline.