Copy of farbodtavakkoli/OTel-Reranker-4B at 8961569

.gitattributes

@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,175 @@
+---
+license: apache-2.0
+language:
+- en
+base_model:
+- Qwen/Qwen3-4B
+datasets:
+- farbodtavakkoli/OTel-Reranker
+tags:
+- telecom
+- telecommunications
+- gsma
+- rag
+- full-parameter-fine-tuning
+- fine-tuned
+pipeline_tag: text-classification
+---
+
+# OTel-Reranker-4B
+
+**OTel-Reranker-4B** is a telecom reranker model full-parameter fine-tuned on OTel telecommunications data. It is part of the [OTel Family of Models](https://huggingface.co/collections/farbodtavakkoli/otel-reranker), an open-source initiative to build reference AI resources for the global telecommunications sector.
+
+Across the 3 OTel reranker baselines, OTel fine-tuning improves MRR@10 by +0.530 to +0.592 over the base checkpoints.
+
+## Community Use
+
+As of May 3, 2026, the released OTel models had been downloaded over 16 million times, and the Open Telco AI project had received 157+ pieces of media coverage worldwide.
+
+## Model Details
+
+| Attribute | Value |
+|---|---|
+| Base model | [Qwen/Qwen3-4B](https://huggingface.co/Qwen/Qwen3-4B) |
+| Parameters | 4B |
+| OTel training dataset | [OTel-Reranker](https://huggingface.co/datasets/farbodtavakkoli/OTel-Reranker) |
+| Dataset fields | `sentence_0`, `sentence_1`, `label` |
+| Training method | Full-parameter post-training / fine-tuning |
+| Language | English |
+| OTel release license | Apache 2.0 |
+
+## Model Lineage
+
+`Qwen/Qwen3-4B` -> `OTel-Reranker` full-parameter post-training -> `farbodtavakkoli/OTel-Reranker-4B`
+
+## OTel vs. Base Model
+
+| Metric | Base model | OTel fine-tuned | Delta | Evaluation split |
+|---|---:|---:|---:|---|
+| MRR@10 | 0.407 | 0.943 +/- 0.006 | +0.536 | OTel-Reranker held-out 5% |
+
+Standard errors are computed with bootstrap resampling (`n=1000`) over the held-out OTel evaluation partition. MRR@10 measures how quickly the first truly relevant telecom passage is promoted near the top of the reranked list.
+
+## Evaluation Caveats
+
+- Reranker results measure held-out OTel reranking partitions.
+- Reported standard errors come from bootstrap resampling over the held-out evaluation partitions.
+- Reranking quality depends on the candidate passages supplied by the upstream retriever.
+- External benchmark transfer, multilingual performance, and per-subdomain performance should be evaluated separately for production settings.
+
+
+## Training Data
+
+The model was trained on telecom-focused data curated by 100+ domain experts. The raw corpus contained roughly 1.1M training points and was filtered to 326,767 higher-confidence examples.
+
+| Source | Contributor |
+|---|---|
+| arXiv telecom papers, 3GPP standards, telecom Wikipedia, telecom Common Crawl | Yale University |
+| GSMA Permanent Reference Documents, Discover portal | GSMA |
+| IETF RFC series | NetoAI |
+| Industry whitepapers | Khalifa University |
+| O-RAN specifications (working groups 1, 2, 4, 5, 6, 7, 8, 9, 10) | University of Leeds |
+| O-RAN documents across working groups | Purdue University and The University of Texas at Dallas |
+
+Released datasets: [OTel-LLM](https://huggingface.co/datasets/farbodtavakkoli/OTel-LLM), [OTel-Embedding](https://huggingface.co/datasets/farbodtavakkoli/OTel-Embedding), [OTel-Reranker](https://huggingface.co/datasets/farbodtavakkoli/OTel-Reranker), and [OTel-Safety](https://huggingface.co/datasets/farbodtavakkoli/OTel-Safety).
+
+The OTel datasets release derived QA/retrieval/reranking examples rather than the raw source documents.
+
+Each released dataset includes a dataset card and Croissant metadata with Responsible AI fields for data limitations, biases, sensitive-information considerations, use cases, social impact, synthetic-data status, and provenance.
+
+## Representative Training Row
+
+`OTel-Reranker` rows are pointwise cross-encoder relevance examples.
+
+```json
+{
+  "sentence_0": "The Fronthaul Gateway can translate FH protocol from an O-DUx with split option 7-2 to an O-RUy with split option 8.",
+  "sentence_1": "Fronthaul Gateway that can translate FH protocol from an O-DUx with split option x to an O-RUy with split option y, with currently available option 7-2 to 8.",
+  "label": 1.0
+}
+```
+
+## Intended Use
+
+This model is intended to re-score telecom query-passage pairs after an initial retrieval step. It is designed for the reranking stage of a telecom RAG pipeline, where the goal is to promote the most relevant retrieved passages before answer generation.
+
+## Training Recipe
+
+| Item | Value |
+|---|---|
+| Framework | ScalarLM |
+| Optimizer | AdamW, 8-bit |
+| Learning-rate schedule | Cosine decay with warmup |
+| Weight decay | 0.01 |
+| Warmup steps | 100 |
+| Random seed | 42 |
+| Maximum sequence length | 1500 tokens |
+| Precision | BF16 |
+| Attention | Flash Attention 2 |
+| Distributed training | Fully Sharded Data Parallel |
+| Gradient checkpointing | Enabled |
+| Epochs | 3 for LLM/embedding models; 2 for rerankers |
+| Compute | AMD MI300X/MI325X/MI355X and NVIDIA A100/H100 GPUs |
+
+## Usage
+
+```python
+from transformers import AutoModelForSequenceClassification, AutoTokenizer
+import torch
+
+model_name = "farbodtavakkoli/OTel-Reranker-4B"
+tokenizer = AutoTokenizer.from_pretrained(model_name, trust_remote_code=True)
+model = AutoModelForSequenceClassification.from_pretrained(
+    model_name,
+    trust_remote_code=True,
+)
+
+query = "What is the F1 interface?"
+documents = [
+    "The F1 interface connects O-DU to O-CU in O-RAN architecture.",
+    "5G networks use millimeter wave frequencies.",
+]
+
+pairs = [[query, doc] for doc in documents]
+inputs = tokenizer(pairs, padding=True, truncation=True, return_tensors="pt")
+with torch.no_grad():
+    scores = model(**inputs).logits.squeeze()
+print(scores)
+```
+
+## Limitations and Responsible Use
+
+- OTel models are domain-specific to telecommunications and should not be treated as general-purpose models.
+- The current release is English-only and primarily text-centric.
+- The reported OTel performance results use held-out OTel evaluation partitions and should not be interpreted as results from a fully independent external benchmark suite.
+- Aggregate scores can hide subdomain variation; collaborator stress tests suggest O-RAN retrieval is comparatively strong, while academic-paper and GSMA PRD examples need further curation.
+- Generated telecom content should be verified before operational, customer-facing, regulatory, safety, or network-configuration use.
+- Users must comply with both the OTel release license and the upstream base-model license or terms.
+
+## Related Models
+
+- [OTel LLM Collection](https://huggingface.co/collections/farbodtavakkoli/otel-llm)
+- [OTel Embedding Collection](https://huggingface.co/collections/farbodtavakkoli/otel-embedding)
+- [OTel Reranker Collection](https://huggingface.co/collections/farbodtavakkoli/otel-reranker)
+
+## Project Resources
+
+- Project page: https://huggingface.co/farbodtavakkoli
+- Code: https://github.com/farbodtavakkoli/OTel
+- Media coverage list: https://github.com/farbodtavakkoli/OTel/blob/main/docs/OTel-1.0-media-coverage.md
+
+## Citation
+
+```bibtex
+@inproceedings{tavakkoli2026otel,
+  title     = {OTel: Open Telco AI Datasets, Benchmarks, and Models},
+  author    = {Tavakkoli, Farbod and Diamos, Gregory and Church, Kenneth and Kanter, David and Austin, Mark and Karim, Imtiaz and Rahman, Mirza Masfiqur and Debbah, Merouane Abdelkader and Nezami, Zeinab and Maatouk, Ali and Tassiulas, Leandros and Ying, Rex and Sorros, Nick and Powell, Louis and Vasiloglou, Nikolaos and Vaswani, Ashish and Singla, Somanshu and Chaluvaraju, Adarsh},
+  booktitle = {Advances in Neural Information Processing Systems (NeurIPS), Evaluations and Datasets Track},
+  year      = {2026},
+  url       = {https://github.com/farbodtavakkoli/OTel}
+}
+```
+
+## Contact
+
+For technical questions, contact farbod.tavakkoli@att.com or farbodtavakoli@gmail.com.

chat_template.jinja

@@ -0,0 +1,85 @@
+{%- if tools %}
+    {{- '<|im_start|>system\n' }}
+    {%- if messages[0].role == 'system' %}
+        {{- messages[0].content + '\n\n' }}
+    {%- endif %}
+    {{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within <tools></tools> XML tags:\n<tools>" }}
+    {%- for tool in tools %}
+        {{- "\n" }}
+        {{- tool | tojson }}
+    {%- endfor %}
+    {{- "\n</tools>\n\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\n<tool_call>\n{\"name\": <function-name>, \"arguments\": <args-json-object>}\n</tool_call><|im_end|>\n" }}
+{%- else %}
+    {%- if messages[0].role == 'system' %}
+        {{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
+    {%- endif %}
+{%- endif %}
+{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
+{%- for message in messages[::-1] %}
+    {%- set index = (messages|length - 1) - loop.index0 %}
+    {%- if ns.multi_step_tool and message.role == "user" and not(message.content.startswith('<tool_response>') and message.content.endswith('</tool_response>')) %}
+        {%- set ns.multi_step_tool = false %}
+        {%- set ns.last_query_index = index %}
+    {%- endif %}
+{%- endfor %}
+{%- for message in messages %}
+    {%- if (message.role == "user") or (message.role == "system" and not loop.first) %}
+        {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
+    {%- elif message.role == "assistant" %}
+        {%- set content = message.content %}
+        {%- set reasoning_content = '' %}
+        {%- if message.reasoning_content is defined and message.reasoning_content is not none %}
+            {%- set reasoning_content = message.reasoning_content %}
+        {%- else %}
+            {%- if '</think>' in message.content %}
+                {%- set content = message.content.split('</think>')[-1].lstrip('\n') %}
+                {%- set reasoning_content = message.content.split('</think>')[0].rstrip('\n').split('<think>')[-1].lstrip('\n') %}
+            {%- endif %}
+        {%- endif %}
+        {%- if loop.index0 > ns.last_query_index %}
+            {%- if loop.last or (not loop.last and reasoning_content) %}
+                {{- '<|im_start|>' + message.role + '\n<think>\n' + reasoning_content.strip('\n') + '\n</think>\n\n' + content.lstrip('\n') }}
+            {%- else %}
+                {{- '<|im_start|>' + message.role + '\n' + content }}
+            {%- endif %}
+        {%- else %}
+            {{- '<|im_start|>' + message.role + '\n' + content }}
+        {%- endif %}
+        {%- if message.tool_calls %}
+            {%- for tool_call in message.tool_calls %}
+                {%- if (loop.first and content) or (not loop.first) %}
+                    {{- '\n' }}
+                {%- endif %}
+                {%- if tool_call.function %}
+                    {%- set tool_call = tool_call.function %}
+                {%- endif %}
+                {{- '<tool_call>\n{"name": "' }}
+                {{- tool_call.name }}
+                {{- '", "arguments": ' }}
+                {%- if tool_call.arguments is string %}
+                    {{- tool_call.arguments }}
+                {%- else %}
+                    {{- tool_call.arguments | tojson }}
+                {%- endif %}
+                {{- '}\n</tool_call>' }}
+            {%- endfor %}
+        {%- endif %}
+        {{- '<|im_end|>\n' }}
+    {%- elif message.role == "tool" %}
+        {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
+            {{- '<|im_start|>user' }}
+        {%- endif %}
+        {{- '\n<tool_response>\n' }}
+        {{- message.content }}
+        {{- '\n</tool_response>' }}
+        {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+            {{- '<|im_end|>\n' }}
+        {%- endif %}
+    {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+    {{- '<|im_start|>assistant\n' }}
+    {%- if enable_thinking is defined and enable_thinking is false %}
+        {{- '<think>\n\n</think>\n\n' }}
+    {%- endif %}
+{%- endif %}

config.json

@@ -0,0 +1,81 @@
+{
+  "architectures": [
+    "Qwen3ForSequenceClassification"
+  ],
+  "attention_bias": false,
+  "attention_dropout": 0.0,
+  "bos_token_id": null,
+  "dtype": "bfloat16",
+  "eos_token_id": 151645,
+  "head_dim": 128,
+  "hidden_act": "silu",
+  "hidden_size": 2560,
+  "id2label": {
+    "0": "LABEL_0"
+  },
+  "initializer_range": 0.02,
+  "intermediate_size": 9728,
+  "label2id": {
+    "LABEL_0": 0
+  },
+  "layer_types": [
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention",
+    "full_attention"
+  ],
+  "max_position_embeddings": 40960,
+  "max_window_layers": 36,
+  "model_type": "qwen3",
+  "num_attention_heads": 32,
+  "num_hidden_layers": 36,
+  "num_key_value_heads": 8,
+  "pad_token_id": 151643,
+  "rms_norm_eps": 1e-06,
+  "rope_parameters": {
+    "rope_theta": 1000000,
+    "rope_type": "default"
+  },
+  "sentence_transformers": {
+    "activation_fn": "torch.nn.modules.activation.Sigmoid",
+    "version": "5.2.0"
+  },
+  "sliding_window": null,
+  "tie_word_embeddings": true,
+  "transformers_version": "5.0.0.dev0",
+  "use_cache": false,
+  "use_sliding_window": false,
+  "vocab_size": 151669
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9650703dfc0f1c25982300cf180cba86cf2c149738dbc3a54a0fd60a2c110e16
+size 8043620248

tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:31110386145fd5016e6b0c0ff0f156404e1f08fb9cac513064e02c9eb8c38728
+size 11422917

tokenizer_config.json

@@ -0,0 +1,30 @@
+{
+  "add_prefix_space": false,
+  "backend": "tokenizers",
+  "bos_token": null,
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|im_end|>",
+  "errors": "replace",
+  "extra_special_tokens": [
+    "<|im_start|>",
+    "<|im_end|>",
+    "<|object_ref_start|>",
+    "<|object_ref_end|>",
+    "<|box_start|>",
+    "<|box_end|>",
+    "<|quad_start|>",
+    "<|quad_end|>",
+    "<|vision_start|>",
+    "<|vision_end|>",
+    "<|vision_pad|>",
+    "<|image_pad|>",
+    "<|video_pad|>"
+  ],
+  "is_local": false,
+  "model_max_length": 1024,
+  "model_specific_special_tokens": {},
+  "pad_token": "<|endoftext|>",
+  "split_special_tokens": false,
+  "tokenizer_class": "Qwen2Tokenizer",
+  "unk_token": null
+}