Update README.md

README.md

@@ -1,124 +1,32 @@
-<<<<<<< HEAD
 ---
 license: apache-2.0
 language:
 - en
-library_name: transformers
-pipeline_tag: fill-mask
+base_model:
+- nasa-impact/nasa-smd-ibm-v0.1
+pipeline_tag: token-classification
 tags:
-- earth science
-- climate
-- biology
-datasets:
-- nasa-impact/nasa-smd-IR-benchmark
-- nasa-impact/nasa-smd-qa-benchmark
-- ibm/Climate-Change-NER
+- astronomy
+- uat
 ---
 
-# Model Card for nasa-smd-ibm-v0.1 (Indus)
-
-nasa-smd-ibm-v0.1 (Currently named as Indus) is a RoBERTa-based, Encoder-only transformer model, domain-adapted for NASA Science Mission Directorate (SMD) applications. It's fine-tuned on scientific journals and articles relevant to NASA SMD, aiming to enhance natural language technologies like information retrieval and intelligent search.
+# INDUS - UAT Labeler
+Indus-UAT-Labeler (nasa-smd-ibm-v0.1_UAT_Labeler) is a RoBERTa-based, Encoder-only transformer model, domain-adapted for NASA Science Mission Directorate (SMD) applications. It's fine-tuned on scientific journals and articles relevant to NASA SMD, aiming to enhance natural language technologies like information retrieval and intelligent search.  
+This specific fork was finetuned on SciX Digital Library (https://scixplorer.org/, formerly NASA-ADS) proprietary data to label text with UAT labels (https://astrothesaurus.org/)
 
 ## Model Details
 - **Base Model**: RoBERTa
 - **Tokenizer**: Custom
 - **Parameters**: 125M
-- **Pretraining Strategy**: Masked Language Modeling (MLM)
-- **Distilled Version**: You can download a distilled version of the model (30 Million Parameters) here: https://huggingface.co/nasa-impact/nasa-smd-ibm-distil-v0.1
-
+- 
 ## Training Data
-- Wikipedia English (Feb 1, 2020)
-- AGU Publications
-- AMS Publications
-- Scientific papers from Astrophysics Data Systems (ADS)
-- PubMed abstracts
-- PubMedCentral (PMC) (commercial license subset)
-
-![image/png](https://cdn-uploads.huggingface.co/production/uploads/61099e5d86580d4580767226/H0-q9N7IwXQqLdEaCCgm-.png)
-
-## Training Procedure 
-- **Framework**: fairseq 0.12.1 with PyTorch 1.9.1
-- **transformers Version**: 4.2.0
-- **Strategy**: Masked Language Modeling (MLM)
-
-## Evaluation
-- BLURB Benchmark
-- Pruned SQuAD2.0 (SQ2) Benchmark (Amazon Rainforest, Oxygen, Geology and NASA ES QAs)
-- NASA SMD Expert QA Benchmark (WIP)
-
-
-![image/png](https://cdn-uploads.huggingface.co/production/uploads/61099e5d86580d4580767226/EtCC3U_tMCv3bfLqQdqQm.png)
-
-![Pruned SQ2 Benchmark](https://cdn-uploads.huggingface.co/production/uploads/61099e5d86580d4580767226/ruh6-IyiNlUiK21Ej4lDM.png)
-
-Please refer to the following dataset cards for further benchmarks and evaluation
-- NASA IR Benchmark - https://huggingface.co/datasets/nasa-impact/nasa-smd-IR-benchmark
-- NASA SMD Expert QA Benchmark - https://huggingface.co/datasets/nasa-impact/nasa-smd-qa-benchmark
-- Climate CHange Benchmark - https://huggingface.co/datasets/ibm/Climate-Change-NER
-
-## Uses
-- Named Entity Recognition (NER)
-- Information Retrieval
-- Sentence Transformers
-- Extractive QA
-
-For NASA SMD related, scientific usecases.
-
-## Note
-
-Accompanying paper can be found here: https://arxiv.org/abs/2405.10725
-
-
-## Citation
-If you find this work useful, please cite using the following bibtex citation:
-
-```bibtex
-@misc {nasa-impact_2023,
-	author       = {Masayasu Maraoka and Bishwaranjan Bhattacharjee and Muthukumaran Ramasubramanian and Ikhsa Gurung and Rahul Ramachandran and Manil Maskey and Kaylin Bugbee and Rong Zhang and Yousef El Kurdi and Bharath Dandala and Mike Little and Elizabeth Fancher and Lauren Sanders and Sylvain Costes and Sergi Blanco-Cuaresma and Kelly Lockhart and Thomas Allen and Felix Grazes and Megan Ansdell and Alberto Accomazzi and Sanaz Vahidinia and Ryan McGranaghan and Armin Mehrabian and Tsendgar Lee},
-	title        = { nasa-smd-ibm-v0.1 (Revision f01d42f) },
-	year         = 2023,
-	url          = { https://huggingface.co/nasa-impact/nasa-smd-ibm-v0.1 },
-	doi          = { 10.57967/hf/1429 },
-	publisher    = { Hugging Face }
-}
-
-```
-
-## Attribution
+- 18K titles, abstracts, body and ackownledgments from recent, quality astronomy papers
+- approximately 217M tokens
 
-IBM Research
-- Masayasu Muraoka
-- Bishwaranjan Bhattacharjee
-- Rong Zhang
-- Yousef El Kurdi
-- Bharath Dandala
 
-NASA SMD
-- Muthukumaran Ramasubramanian
-- Iksha Gurung
-- Rahul Ramachandran
-- Manil Maskey
-- Kaylin Bugbee
-- Mike Little
-- Elizabeth Fancher
-- Lauren Sanders
-- Sylvain Costes
-- Sergi Blanco-Cuaresma
-- Kelly Lockhart
-- Thomas Allen
-- Felix Grazes
-- Megan Ansdell
-- Alberto Accomazzi
-- Sanaz Vahidinia
-- Ryan McGranaghan
-- Armin Mehrabian
-- Tsendgar Lee
+<!-- ## Note -->
 
-## Disclaimer
+<!-- ## Citation -->
+<!-- If you find this work useful, please cite using the following bibtex citation: -->
 
-This Encoder-only model is currently in an experimental phase. We are working to improve the model's capabilities and performance, and as we progress, we invite the community to engage with this model, provide feedback, and contribute to its evolution.
-=======
----
-license: mit
----
->>>>>>> 7a770c80b4a3414639536260229365f67ac0ea54
+<!-- ## Disclaimer -->