Feature Extraction
Transformers
Safetensors
bert
code
embeddings
file-embedding
r2
repositories
repository-library
research-library
t4_repo
text-embeddings-inference
Instructions to use PeytonT/file-embedding with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use PeytonT/file-embedding with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="PeytonT/file-embedding")# Load model directly from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("PeytonT/file-embedding") model = AutoModel.from_pretrained("PeytonT/file-embedding", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Enhance model card with repository context and sources
Browse files
README.md
CHANGED
|
@@ -21,43 +21,59 @@ Produces file-level dense representations for retrieval and matching.
|
|
| 21 |
|
| 22 |
- Artifact type: full fine-tuned model
|
| 23 |
- Base model: `sentence-transformers/all-MiniLM-L6-v2`
|
|
|
|
| 24 |
- Model ID: `R2`
|
| 25 |
- Tier: `T4_repo`
|
| 26 |
-
-
|
| 27 |
-
- Source checkpoint: `models/checkpoints/R2`
|
| 28 |
|
| 29 |
-
This
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 30 |
|
| 31 |
## Intended Use
|
| 32 |
|
| 33 |
- Primary use: Produces file-level dense representations for retrieval and matching.
|
| 34 |
-
-
|
| 35 |
-
- Out of scope: production safety claims, benchmark claims beyond the
|
| 36 |
|
| 37 |
## Training Data
|
| 38 |
|
| 39 |
-
|
| 40 |
|
| 41 |
-
- `
|
| 42 |
|
| 43 |
## Training Procedure
|
| 44 |
|
| 45 |
- Sources: `github_repos`
|
| 46 |
- Input fields: `file_query`
|
| 47 |
- Target fields: `source_chunk`
|
|
|
|
| 48 |
- Max samples: `4000`
|
|
|
|
| 49 |
- Precision: `bf16`
|
| 50 |
- Objective: `contrastive`
|
| 51 |
-
- Batch size: `8`
|
| 52 |
- Learning rate: `5e-05`
|
| 53 |
- Max source tokens: `256`
|
| 54 |
- Max target tokens: `256`
|
|
|
|
| 55 |
- Max steps: `1000`
|
| 56 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 57 |
## Evaluation
|
| 58 |
|
| 59 |
- Declared metrics: `recall_at_10, ndcg_at_10`
|
| 60 |
-
- Status:
|
| 61 |
|
| 62 |
## Usage
|
| 63 |
|
|
@@ -72,14 +88,12 @@ model = AutoModel.from_pretrained(repo_id)
|
|
| 72 |
|
| 73 |
## Limitations
|
| 74 |
|
| 75 |
-
- These
|
| 76 |
-
-
|
| 77 |
-
-
|
| 78 |
|
| 79 |
## Project Context
|
| 80 |
|
| 81 |
-
|
| 82 |
-
|
| 83 |
-
|
| 84 |
-
|
| 85 |
-
Published under `PeytonT` from the local `repository_library` build.
|
|
|
|
| 21 |
|
| 22 |
- Artifact type: full fine-tuned model
|
| 23 |
- Base model: `sentence-transformers/all-MiniLM-L6-v2`
|
| 24 |
+
- Backbone type: `encoder`
|
| 25 |
- Model ID: `R2`
|
| 26 |
- Tier: `T4_repo`
|
| 27 |
+
- Role in stack: specialized Repository Library component
|
|
|
|
| 28 |
|
| 29 |
+
This model is part of the Repository Library stack, a research system for indexing, retrieving, aligning, and reasoning over scientific papers, structured paper content, repositories, and cross-domain links between them.
|
| 30 |
+
|
| 31 |
+
## Model Sources
|
| 32 |
+
|
| 33 |
+
- Hugging Face repo: `https://huggingface.co/PeytonT/file-embedding`
|
| 34 |
+
- Hugging Face collection: `https://huggingface.co/collections/PeytonT/research-library-6a49c589ef4d763f7539b50d`
|
| 35 |
+
- GitHub repository: `https://github.com/peytontolbert/research_library`
|
| 36 |
+
- Experiment config: `https://github.com/peytontolbert/research_library/blob/main/models/experiments/r2_file_embedding.json`
|
| 37 |
+
- Models directory: `https://github.com/peytontolbert/research_library/tree/main/models`
|
| 38 |
|
| 39 |
## Intended Use
|
| 40 |
|
| 41 |
- Primary use: Produces file-level dense representations for retrieval and matching.
|
| 42 |
+
- Downstream use: retrieval, ranking, planning, paper understanding, or cross-domain reasoning inside the broader Repository Library system, depending on the model family.
|
| 43 |
+
- Out of scope: production safety claims, benchmark claims beyond the tracked experiment config, or deployment without task-specific validation.
|
| 44 |
|
| 45 |
## Training Data
|
| 46 |
|
| 47 |
+
The training inputs for this package were assembled from the following Repository Library data sources:
|
| 48 |
|
| 49 |
+
- Source `github_repos`: repository graph and code chunk data exported from the Repository Library repo pipeline.
|
| 50 |
|
| 51 |
## Training Procedure
|
| 52 |
|
| 53 |
- Sources: `github_repos`
|
| 54 |
- Input fields: `file_query`
|
| 55 |
- Target fields: `source_chunk`
|
| 56 |
+
- Train/val/test split: `[0.9, 0.1, 0.0]`
|
| 57 |
- Max samples: `4000`
|
| 58 |
+
- Batch size: `8`
|
| 59 |
- Precision: `bf16`
|
| 60 |
- Objective: `contrastive`
|
|
|
|
| 61 |
- Learning rate: `5e-05`
|
| 62 |
- Max source tokens: `256`
|
| 63 |
- Max target tokens: `256`
|
| 64 |
+
- Fine-tune strategy: `full_finetune`
|
| 65 |
- Max steps: `1000`
|
| 66 |
|
| 67 |
+
## Compute
|
| 68 |
+
|
| 69 |
+
- Hardware: 4x RTX_3090 (24 GB)
|
| 70 |
+
- Distributed strategy: `ddp`
|
| 71 |
+
- Estimated GPU hours in config: `0`
|
| 72 |
+
|
| 73 |
## Evaluation
|
| 74 |
|
| 75 |
- Declared metrics: `recall_at_10, ndcg_at_10`
|
| 76 |
+
- Status: this card reflects the current tracked experiment configuration and packaged weights in the Repository Library model stack.
|
| 77 |
|
| 78 |
## Usage
|
| 79 |
|
|
|
|
| 88 |
|
| 89 |
## Limitations
|
| 90 |
|
| 91 |
+
- These cards are generated from tracked experiment metadata and packaged artifacts, not from a separate benchmark report or external audit.
|
| 92 |
+
- Several training sources are pipeline outputs from the Repository Library codebase rather than standalone public datasets.
|
| 93 |
+
- These models are components of a larger research system and should be validated in their target workflow before deployment.
|
| 94 |
|
| 95 |
## Project Context
|
| 96 |
|
| 97 |
+
- GitHub repository: `https://github.com/peytontolbert/research_library`
|
| 98 |
+
- Model collection: `https://huggingface.co/collections/PeytonT/research-library-6a49c589ef4d763f7539b50d`
|
| 99 |
+
- Publisher: `PeytonT`
|
|
|
|
|
|