Text Classification
Transformers
Safetensors
bert
cross-encoder-reranker
l2
repository-library
repository_library_search_stack
research-library
retrieval
text-embeddings-inference
Instructions to use PeytonT/cross-encoder-reranker with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use PeytonT/cross-encoder-reranker with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="PeytonT/cross-encoder-reranker")# Load model directly from transformers import AutoTokenizer, AutoModelForSequenceClassification tokenizer = AutoTokenizer.from_pretrained("PeytonT/cross-encoder-reranker") model = AutoModelForSequenceClassification.from_pretrained("PeytonT/cross-encoder-reranker", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Enhance model card with repository context and sources
Browse files
README.md
CHANGED
|
@@ -19,44 +19,60 @@ Reranks retrieved candidates with a cross-encoder scoring pass.
|
|
| 19 |
|
| 20 |
- Artifact type: full fine-tuned model
|
| 21 |
- Base model: `sentence-transformers/all-MiniLM-L6-v2`
|
|
|
|
| 22 |
- Model ID: `L2`
|
| 23 |
- Tier: `repository_library_search_stack`
|
| 24 |
-
-
|
| 25 |
-
- Source checkpoint: `models/checkpoints/L2`
|
| 26 |
|
| 27 |
-
This
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 28 |
|
| 29 |
## Intended Use
|
| 30 |
|
| 31 |
- Primary use: Reranks retrieved candidates with a cross-encoder scoring pass.
|
| 32 |
-
-
|
| 33 |
-
- Out of scope: production safety claims, benchmark claims beyond the
|
| 34 |
|
| 35 |
## Training Data
|
| 36 |
|
| 37 |
-
|
| 38 |
|
| 39 |
-
- `
|
| 40 |
|
| 41 |
## Training Procedure
|
| 42 |
|
| 43 |
- Sources: `github_repos`
|
| 44 |
- Input fields: `query, candidate_row`
|
| 45 |
- Target fields: `relevance_label`
|
|
|
|
| 46 |
- Max samples: `4000`
|
|
|
|
| 47 |
- Precision: `bf16`
|
| 48 |
- Objective: `cross_entropy`
|
| 49 |
-
- Batch size: `8`
|
| 50 |
- Learning rate: `5e-05`
|
| 51 |
- Max source tokens: `256`
|
| 52 |
- Max target tokens: `256`
|
|
|
|
| 53 |
- Max steps: `1000`
|
| 54 |
- Notes: Search-stack role added to match models.md coverage; dataset builder may need role-specific supervised labels before promotion.
|
| 55 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 56 |
## Evaluation
|
| 57 |
|
| 58 |
- Declared metrics: `accuracy`
|
| 59 |
-
- Status:
|
| 60 |
|
| 61 |
## Usage
|
| 62 |
|
|
@@ -71,14 +87,12 @@ model = AutoModelForSequenceClassification.from_pretrained(repo_id)
|
|
| 71 |
|
| 72 |
## Limitations
|
| 73 |
|
| 74 |
-
- These
|
| 75 |
-
-
|
| 76 |
-
-
|
| 77 |
|
| 78 |
## Project Context
|
| 79 |
|
| 80 |
-
|
| 81 |
-
|
| 82 |
-
|
| 83 |
-
|
| 84 |
-
Published under `PeytonT` from the local `repository_library` build.
|
|
|
|
| 19 |
|
| 20 |
- Artifact type: full fine-tuned model
|
| 21 |
- Base model: `sentence-transformers/all-MiniLM-L6-v2`
|
| 22 |
+
- Backbone type: `encoder`
|
| 23 |
- Model ID: `L2`
|
| 24 |
- Tier: `repository_library_search_stack`
|
| 25 |
+
- Role in stack: search-stack component for retrieval, reranking, or routing
|
|
|
|
| 26 |
|
| 27 |
+
This model is part of the Repository Library stack, a research system for indexing, retrieving, aligning, and reasoning over scientific papers, structured paper content, repositories, and cross-domain links between them.
|
| 28 |
+
|
| 29 |
+
## Model Sources
|
| 30 |
+
|
| 31 |
+
- Hugging Face repo: `https://huggingface.co/PeytonT/cross-encoder-reranker`
|
| 32 |
+
- Hugging Face collection: `https://huggingface.co/collections/PeytonT/research-library-6a49c589ef4d763f7539b50d`
|
| 33 |
+
- GitHub repository: `https://github.com/peytontolbert/research_library`
|
| 34 |
+
- Experiment config: `https://github.com/peytontolbert/research_library/blob/main/models/experiments/l2_cross_encoder_reranker.json`
|
| 35 |
+
- Models directory: `https://github.com/peytontolbert/research_library/tree/main/models`
|
| 36 |
|
| 37 |
## Intended Use
|
| 38 |
|
| 39 |
- Primary use: Reranks retrieved candidates with a cross-encoder scoring pass.
|
| 40 |
+
- Downstream use: retrieval, ranking, planning, paper understanding, or cross-domain reasoning inside the broader Repository Library system, depending on the model family.
|
| 41 |
+
- Out of scope: production safety claims, benchmark claims beyond the tracked experiment config, or deployment without task-specific validation.
|
| 42 |
|
| 43 |
## Training Data
|
| 44 |
|
| 45 |
+
The training inputs for this package were assembled from the following Repository Library data sources:
|
| 46 |
|
| 47 |
+
- Source `github_repos`: repository graph and code chunk data exported from the Repository Library repo pipeline.
|
| 48 |
|
| 49 |
## Training Procedure
|
| 50 |
|
| 51 |
- Sources: `github_repos`
|
| 52 |
- Input fields: `query, candidate_row`
|
| 53 |
- Target fields: `relevance_label`
|
| 54 |
+
- Train/val/test split: `[0.9, 0.1, 0.0]`
|
| 55 |
- Max samples: `4000`
|
| 56 |
+
- Batch size: `8`
|
| 57 |
- Precision: `bf16`
|
| 58 |
- Objective: `cross_entropy`
|
|
|
|
| 59 |
- Learning rate: `5e-05`
|
| 60 |
- Max source tokens: `256`
|
| 61 |
- Max target tokens: `256`
|
| 62 |
+
- Fine-tune strategy: `full_finetune`
|
| 63 |
- Max steps: `1000`
|
| 64 |
- Notes: Search-stack role added to match models.md coverage; dataset builder may need role-specific supervised labels before promotion.
|
| 65 |
|
| 66 |
+
## Compute
|
| 67 |
+
|
| 68 |
+
- Hardware: not specified
|
| 69 |
+
- Distributed strategy: `unknown`
|
| 70 |
+
- Estimated GPU hours in config: `unknown`
|
| 71 |
+
|
| 72 |
## Evaluation
|
| 73 |
|
| 74 |
- Declared metrics: `accuracy`
|
| 75 |
+
- Status: this card reflects the current tracked experiment configuration and packaged weights in the Repository Library model stack.
|
| 76 |
|
| 77 |
## Usage
|
| 78 |
|
|
|
|
| 87 |
|
| 88 |
## Limitations
|
| 89 |
|
| 90 |
+
- These cards are generated from tracked experiment metadata and packaged artifacts, not from a separate benchmark report or external audit.
|
| 91 |
+
- Several training sources are pipeline outputs from the Repository Library codebase rather than standalone public datasets.
|
| 92 |
+
- These models are components of a larger research system and should be validated in their target workflow before deployment.
|
| 93 |
|
| 94 |
## Project Context
|
| 95 |
|
| 96 |
+
- GitHub repository: `https://github.com/peytontolbert/research_library`
|
| 97 |
+
- Model collection: `https://huggingface.co/collections/PeytonT/research-library-6a49c589ef4d763f7539b50d`
|
| 98 |
+
- Publisher: `PeytonT`
|
|
|
|
|
|