Fine-tuned on Levine biomarker reference ranges

README.md

@@ -1,209 +1,54 @@
----
-base_model: HuggingFaceH4/zephyr-7b-beta
-library_name: peft
-pipeline_tag: text-generation
-tags:
-- lora
-- peft
-- transformers
-- text-generation
----
-
-
-# Model Card for Model ID
-
-<!-- Provide a quick summary of what the model is/does. -->
-
-
-
-## Model Details
-
-### Model Description
-
-<!-- Provide a longer summary of what this model is. -->
-
-
-
-- **Developed by:** [More Information Needed]
-- **Funded by [optional]:** [More Information Needed]
-- **Shared by [optional]:** [More Information Needed]
-- **Model type:** [More Information Needed]
-- **Language(s) (NLP):** [More Information Needed]
-- **License:** [More Information Needed]
-- **Finetuned from model [optional]:** [More Information Needed]
-
-### Model Sources [optional]
-
-<!-- Provide the basic links for the model. -->
-
-- **Repository:** [More Information Needed]
-- **Paper [optional]:** [More Information Needed]
-- **Demo [optional]:** [More Information Needed]
-
-## Uses
-
-<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
-
-### Direct Use
-
-<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
-
-[More Information Needed]
-
-### Downstream Use [optional]
-
-<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
-
-[More Information Needed]
-
-### Out-of-Scope Use
-
-<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
-
-[More Information Needed]
-
-## Bias, Risks, and Limitations
-
-<!-- This section is meant to convey both technical and sociotechnical limitations. -->
-
-[More Information Needed]
-
-### Recommendations
-
-<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
-
-Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
-
-## How to Get Started with the Model
-
-Use the code below to get started with the model.
-
-[More Information Needed]
-
-## Training Details
-
-### Training Data
-
-<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
-
-[More Information Needed]
-
-### Training Procedure
-
-<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
-
-#### Preprocessing [optional]
-
-[More Information Needed]
-
-
-#### Training Hyperparameters
-
-- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
-
-#### Speeds, Sizes, Times [optional]
-
-<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
-
-[More Information Needed]
-
-## Evaluation
-
-<!-- This section describes the evaluation protocols and provides the results. -->
-
-### Testing Data, Factors & Metrics
-
-#### Testing Data
-
-<!-- This should link to a Dataset Card if possible. -->
-
-[More Information Needed]
-
-#### Factors
-
-<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
-
-[More Information Needed]
-
-#### Metrics
-
-<!-- These are the evaluation metrics being used, ideally with a description of why. -->
-
-[More Information Needed]
-
-### Results
-
-[More Information Needed]
-
-#### Summary
-
-
-
-## Model Examination [optional]
-
-<!-- Relevant interpretability work for the model goes here -->
-
-[More Information Needed]
-
-## Environmental Impact
-
-<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
-
-Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
-
-- **Hardware Type:** [More Information Needed]
-- **Hours used:** [More Information Needed]
-- **Cloud Provider:** [More Information Needed]
-- **Compute Region:** [More Information Needed]
-- **Carbon Emitted:** [More Information Needed]
-
-## Technical Specifications [optional]
-
-### Model Architecture and Objective
-
-[More Information Needed]
-
-### Compute Infrastructure
-
-[More Information Needed]
-
-#### Hardware
-
-[More Information Needed]
-
-#### Software
-
-[More Information Needed]
-
-## Citation [optional]
-
-<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
-
-**BibTeX:**
-
-[More Information Needed]
-
-**APA:**
-
-[More Information Needed]
-
-## Glossary [optional]
-
-<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
-
-[More Information Needed]
-
-## More Information [optional]
-
-[More Information Needed]
-
-## Model Card Authors [optional]
-
-[More Information Needed]
-
-## Model Card Contact
-
-[More Information Needed]
-### Framework versions
-
-- PEFT 0.17.1
+---
+library_name: transformers
+license: mit
+base_model: microsoft/BioGPT-Large
+tags:
+- generated_from_trainer
+model-index:
+- name: MedicalInsights
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# MedicalInsights
+
+This model is a fine-tuned version of [microsoft/BioGPT-Large](https://huggingface.co/microsoft/BioGPT-Large) on the None dataset.
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 5e-05
+- train_batch_size: 4
+- eval_batch_size: 4
+- seed: 42
+- distributed_type: tpu
+- optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
+- lr_scheduler_type: linear
+- num_epochs: 2
+
+### Training results
+
+
+
+### Framework versions
+
+- Transformers 4.56.1
+- Pytorch 2.8.0+cpu
+- Datasets 4.1.1
+- Tokenizers 0.22.0

config.json

@@ -0,0 +1,26 @@
+{
+  "activation_dropout": 0.0,
+  "architectures": [
+    "BioGptForCausalLM"
+  ],
+  "attention_probs_dropout_prob": 0.1,
+  "bos_token_id": 0,
+  "dtype": "float32",
+  "eos_token_id": 2,
+  "hidden_act": "gelu",
+  "hidden_dropout_prob": 0.1,
+  "hidden_size": 1600,
+  "initializer_range": 0.02,
+  "intermediate_size": 6400,
+  "layer_norm_eps": 1e-12,
+  "layerdrop": 0.0,
+  "max_position_embeddings": 2048,
+  "model_type": "biogpt",
+  "num_attention_heads": 25,
+  "num_hidden_layers": 48,
+  "pad_token_id": 1,
+  "scale_embedding": true,
+  "transformers_version": "4.56.1",
+  "use_cache": true,
+  "vocab_size": 57717
+}

generation_config.json

@@ -0,0 +1,9 @@
+{
+  "_from_model_config": true,
+  "bos_token_id": 0,
+  "eos_token_id": [
+    2
+  ],
+  "pad_token_id": 1,
+  "transformers_version": "4.56.1"
+}

model-00001-of-00002.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:eecc1eb4197862779e199bd1da1b1766ae40b3cd6e6cbdd2705aa3da8f819297
+size 4973212608

model-00002-of-00002.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2dcc89a4054aa0070f5e93d8d251f2cd569de6a55d3fade01bc555e4e4ebe1f1
+size 1681016896

model.safetensors.index.json

@@ -0,0 +1,781 @@
+{
+  "metadata": {
+    "total_parameters": 1571188800,
+    "total_size": 6654144000
+  },
+  "weight_map": {
+    "biogpt.embed_positions.weight": "model-00001-of-00002.safetensors",
+    "biogpt.embed_tokens.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layer_norm.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layer_norm.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.0.fc1.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.0.fc1.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.0.fc2.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.0.fc2.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.0.final_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.0.final_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.0.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.0.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.0.self_attn.out_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.0.self_attn.out_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.0.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.0.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.0.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.0.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.0.self_attn_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.0.self_attn_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.1.fc1.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.1.fc1.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.1.fc2.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.1.fc2.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.1.final_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.1.final_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.1.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.1.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.1.self_attn.out_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.1.self_attn.out_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.1.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.1.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.1.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.1.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.1.self_attn_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.1.self_attn_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.10.fc1.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.10.fc1.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.10.fc2.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.10.fc2.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.10.final_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.10.final_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.10.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.10.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.10.self_attn.out_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.10.self_attn.out_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.10.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.10.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.10.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.10.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.10.self_attn_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.10.self_attn_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.11.fc1.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.11.fc1.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.11.fc2.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.11.fc2.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.11.final_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.11.final_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.11.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.11.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.11.self_attn.out_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.11.self_attn.out_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.11.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.11.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.11.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.11.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.11.self_attn_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.11.self_attn_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.12.fc1.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.12.fc1.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.12.fc2.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.12.fc2.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.12.final_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.12.final_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.12.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.12.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.12.self_attn.out_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.12.self_attn.out_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.12.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.12.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.12.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.12.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.12.self_attn_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.12.self_attn_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.13.fc1.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.13.fc1.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.13.fc2.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.13.fc2.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.13.final_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.13.final_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.13.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.13.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.13.self_attn.out_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.13.self_attn.out_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.13.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.13.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.13.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.13.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.13.self_attn_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.13.self_attn_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.14.fc1.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.14.fc1.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.14.fc2.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.14.fc2.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.14.final_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.14.final_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.14.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.14.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.14.self_attn.out_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.14.self_attn.out_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.14.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.14.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.14.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.14.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.14.self_attn_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.14.self_attn_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.15.fc1.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.15.fc1.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.15.fc2.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.15.fc2.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.15.final_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.15.final_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.15.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.15.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.15.self_attn.out_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.15.self_attn.out_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.15.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.15.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.15.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.15.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.15.self_attn_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.15.self_attn_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.16.fc1.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.16.fc1.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.16.fc2.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.16.fc2.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.16.final_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.16.final_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.16.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.16.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.16.self_attn.out_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.16.self_attn.out_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.16.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.16.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.16.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.16.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.16.self_attn_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.16.self_attn_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.17.fc1.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.17.fc1.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.17.fc2.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.17.fc2.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.17.final_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.17.final_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.17.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.17.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.17.self_attn.out_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.17.self_attn.out_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.17.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.17.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.17.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.17.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.17.self_attn_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.17.self_attn_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.18.fc1.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.18.fc1.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.18.fc2.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.18.fc2.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.18.final_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.18.final_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.18.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.18.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.18.self_attn.out_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.18.self_attn.out_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.18.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.18.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.18.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.18.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.18.self_attn_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.18.self_attn_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.19.fc1.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.19.fc1.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.19.fc2.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.19.fc2.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.19.final_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.19.final_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.19.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.19.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.19.self_attn.out_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.19.self_attn.out_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.19.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.19.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.19.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.19.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.19.self_attn_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.19.self_attn_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.2.fc1.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.2.fc1.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.2.fc2.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.2.fc2.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.2.final_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.2.final_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.2.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.2.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.2.self_attn.out_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.2.self_attn.out_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.2.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.2.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.2.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.2.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.2.self_attn_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.2.self_attn_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.20.fc1.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.20.fc1.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.20.fc2.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.20.fc2.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.20.final_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.20.final_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.20.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.20.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.20.self_attn.out_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.20.self_attn.out_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.20.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.20.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.20.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.20.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.20.self_attn_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.20.self_attn_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.21.fc1.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.21.fc1.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.21.fc2.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.21.fc2.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.21.final_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.21.final_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.21.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.21.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.21.self_attn.out_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.21.self_attn.out_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.21.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.21.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.21.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.21.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.21.self_attn_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.21.self_attn_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.22.fc1.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.22.fc1.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.22.fc2.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.22.fc2.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.22.final_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.22.final_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.22.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.22.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.22.self_attn.out_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.22.self_attn.out_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.22.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.22.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.22.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.22.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.22.self_attn_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.22.self_attn_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.23.fc1.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.23.fc1.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.23.fc2.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.23.fc2.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.23.final_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.23.final_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.23.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.23.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.23.self_attn.out_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.23.self_attn.out_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.23.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.23.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.23.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.23.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.23.self_attn_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.23.self_attn_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.24.fc1.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.24.fc1.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.24.fc2.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.24.fc2.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.24.final_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.24.final_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.24.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.24.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.24.self_attn.out_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.24.self_attn.out_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.24.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.24.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.24.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.24.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.24.self_attn_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.24.self_attn_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.25.fc1.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.25.fc1.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.25.fc2.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.25.fc2.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.25.final_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.25.final_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.25.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.25.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.25.self_attn.out_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.25.self_attn.out_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.25.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.25.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.25.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.25.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.25.self_attn_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.25.self_attn_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.26.fc1.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.26.fc1.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.26.fc2.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.26.fc2.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.26.final_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.26.final_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.26.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.26.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.26.self_attn.out_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.26.self_attn.out_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.26.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.26.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.26.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.26.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.26.self_attn_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.26.self_attn_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.27.fc1.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.27.fc1.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.27.fc2.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.27.fc2.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.27.final_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.27.final_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.27.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.27.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.27.self_attn.out_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.27.self_attn.out_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.27.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.27.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.27.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.27.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.27.self_attn_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.27.self_attn_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.28.fc1.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.28.fc1.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.28.fc2.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.28.fc2.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.28.final_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.28.final_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.28.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.28.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.28.self_attn.out_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.28.self_attn.out_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.28.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.28.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.28.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.28.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.28.self_attn_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.28.self_attn_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.29.fc1.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.29.fc1.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.29.fc2.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.29.fc2.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.29.final_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.29.final_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.29.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.29.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.29.self_attn.out_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.29.self_attn.out_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.29.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.29.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.29.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.29.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.29.self_attn_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.29.self_attn_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.3.fc1.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.3.fc1.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.3.fc2.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.3.fc2.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.3.final_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.3.final_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.3.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.3.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.3.self_attn.out_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.3.self_attn.out_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.3.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.3.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.3.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.3.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.3.self_attn_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.3.self_attn_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.30.fc1.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.30.fc1.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.30.fc2.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.30.fc2.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.30.final_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.30.final_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.30.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.30.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.30.self_attn.out_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.30.self_attn.out_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.30.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.30.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.30.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.30.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.30.self_attn_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.30.self_attn_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.31.fc1.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.31.fc1.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.31.fc2.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.31.fc2.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.31.final_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.31.final_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.31.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.31.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.31.self_attn.out_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.31.self_attn.out_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.31.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.31.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.31.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.31.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.31.self_attn_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.31.self_attn_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.32.fc1.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.32.fc1.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.32.fc2.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.32.fc2.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.32.final_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.32.final_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.32.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.32.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.32.self_attn.out_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.32.self_attn.out_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.32.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.32.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.32.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.32.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.32.self_attn_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.32.self_attn_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.33.fc1.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.33.fc1.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.33.fc2.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.33.fc2.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.33.final_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.33.final_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.33.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.33.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.33.self_attn.out_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.33.self_attn.out_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.33.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.33.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.33.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.33.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.33.self_attn_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.33.self_attn_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.34.fc1.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.34.fc1.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.34.fc2.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.34.fc2.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.34.final_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.34.final_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.34.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.34.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.34.self_attn.out_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.34.self_attn.out_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.34.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.34.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.34.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.34.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.34.self_attn_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.34.self_attn_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.35.fc1.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.35.fc1.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.35.fc2.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.35.fc2.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.35.final_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.35.final_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.35.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.35.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.35.self_attn.out_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.35.self_attn.out_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.35.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.35.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.35.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.35.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.35.self_attn_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.35.self_attn_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.36.fc1.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.36.fc1.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.36.fc2.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.36.fc2.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.36.final_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.36.final_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.36.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.36.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.36.self_attn.out_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.36.self_attn.out_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.36.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.36.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.36.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.36.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.36.self_attn_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.36.self_attn_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.37.fc1.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.37.fc1.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.37.fc2.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.37.fc2.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.37.final_layer_norm.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.37.final_layer_norm.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.37.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.37.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.37.self_attn.out_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.37.self_attn.out_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.37.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.37.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.37.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.37.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.37.self_attn_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.37.self_attn_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.38.fc1.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.38.fc1.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.38.fc2.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.38.fc2.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.38.final_layer_norm.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.38.final_layer_norm.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.38.self_attn.k_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.38.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.38.self_attn.out_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.38.self_attn.out_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.38.self_attn.q_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.38.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.38.self_attn.v_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.38.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.38.self_attn_layer_norm.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.38.self_attn_layer_norm.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.39.fc1.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.39.fc1.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.39.fc2.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.39.fc2.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.39.final_layer_norm.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.39.final_layer_norm.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.39.self_attn.k_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.39.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.39.self_attn.out_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.39.self_attn.out_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.39.self_attn.q_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.39.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.39.self_attn.v_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.39.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.39.self_attn_layer_norm.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.39.self_attn_layer_norm.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.4.fc1.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.4.fc1.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.4.fc2.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.4.fc2.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.4.final_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.4.final_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.4.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.4.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.4.self_attn.out_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.4.self_attn.out_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.4.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.4.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.4.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.4.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.4.self_attn_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.4.self_attn_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.40.fc1.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.40.fc1.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.40.fc2.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.40.fc2.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.40.final_layer_norm.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.40.final_layer_norm.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.40.self_attn.k_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.40.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.40.self_attn.out_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.40.self_attn.out_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.40.self_attn.q_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.40.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.40.self_attn.v_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.40.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.40.self_attn_layer_norm.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.40.self_attn_layer_norm.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.41.fc1.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.41.fc1.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.41.fc2.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.41.fc2.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.41.final_layer_norm.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.41.final_layer_norm.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.41.self_attn.k_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.41.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.41.self_attn.out_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.41.self_attn.out_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.41.self_attn.q_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.41.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.41.self_attn.v_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.41.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.41.self_attn_layer_norm.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.41.self_attn_layer_norm.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.42.fc1.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.42.fc1.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.42.fc2.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.42.fc2.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.42.final_layer_norm.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.42.final_layer_norm.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.42.self_attn.k_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.42.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.42.self_attn.out_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.42.self_attn.out_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.42.self_attn.q_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.42.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.42.self_attn.v_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.42.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.42.self_attn_layer_norm.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.42.self_attn_layer_norm.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.43.fc1.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.43.fc1.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.43.fc2.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.43.fc2.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.43.final_layer_norm.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.43.final_layer_norm.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.43.self_attn.k_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.43.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.43.self_attn.out_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.43.self_attn.out_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.43.self_attn.q_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.43.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.43.self_attn.v_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.43.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.43.self_attn_layer_norm.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.43.self_attn_layer_norm.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.44.fc1.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.44.fc1.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.44.fc2.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.44.fc2.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.44.final_layer_norm.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.44.final_layer_norm.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.44.self_attn.k_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.44.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.44.self_attn.out_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.44.self_attn.out_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.44.self_attn.q_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.44.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.44.self_attn.v_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.44.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.44.self_attn_layer_norm.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.44.self_attn_layer_norm.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.45.fc1.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.45.fc1.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.45.fc2.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.45.fc2.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.45.final_layer_norm.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.45.final_layer_norm.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.45.self_attn.k_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.45.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.45.self_attn.out_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.45.self_attn.out_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.45.self_attn.q_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.45.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.45.self_attn.v_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.45.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.45.self_attn_layer_norm.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.45.self_attn_layer_norm.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.46.fc1.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.46.fc1.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.46.fc2.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.46.fc2.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.46.final_layer_norm.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.46.final_layer_norm.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.46.self_attn.k_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.46.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.46.self_attn.out_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.46.self_attn.out_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.46.self_attn.q_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.46.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.46.self_attn.v_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.46.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.46.self_attn_layer_norm.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.46.self_attn_layer_norm.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.47.fc1.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.47.fc1.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.47.fc2.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.47.fc2.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.47.final_layer_norm.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.47.final_layer_norm.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.47.self_attn.k_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.47.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.47.self_attn.out_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.47.self_attn.out_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.47.self_attn.q_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.47.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.47.self_attn.v_proj.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.47.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.47.self_attn_layer_norm.bias": "model-00002-of-00002.safetensors",
+    "biogpt.layers.47.self_attn_layer_norm.weight": "model-00002-of-00002.safetensors",
+    "biogpt.layers.5.fc1.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.5.fc1.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.5.fc2.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.5.fc2.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.5.final_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.5.final_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.5.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.5.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.5.self_attn.out_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.5.self_attn.out_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.5.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.5.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.5.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.5.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.5.self_attn_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.5.self_attn_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.6.fc1.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.6.fc1.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.6.fc2.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.6.fc2.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.6.final_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.6.final_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.6.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.6.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.6.self_attn.out_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.6.self_attn.out_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.6.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.6.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.6.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.6.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.6.self_attn_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.6.self_attn_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.7.fc1.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.7.fc1.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.7.fc2.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.7.fc2.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.7.final_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.7.final_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.7.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.7.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.7.self_attn.out_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.7.self_attn.out_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.7.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.7.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.7.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.7.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.7.self_attn_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.7.self_attn_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.8.fc1.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.8.fc1.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.8.fc2.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.8.fc2.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.8.final_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.8.final_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.8.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.8.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.8.self_attn.out_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.8.self_attn.out_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.8.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.8.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.8.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.8.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.8.self_attn_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.8.self_attn_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.9.fc1.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.9.fc1.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.9.fc2.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.9.fc2.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.9.final_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.9.final_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.9.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.9.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.9.self_attn.out_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.9.self_attn.out_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.9.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.9.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.9.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.9.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "biogpt.layers.9.self_attn_layer_norm.bias": "model-00001-of-00002.safetensors",
+    "biogpt.layers.9.self_attn_layer_norm.weight": "model-00001-of-00002.safetensors",
+    "output_projection.weight": "model-00002-of-00002.safetensors"
+  }
+}

special_tokens_map.json

@@ -1,30 +1,7 @@
-{
-  "bos_token": {
-    "content": "<|endoftext|>",
-    "lstrip": false,
-    "normalized": false,
-    "rstrip": false,
-    "single_word": false
-  },
-  "eos_token": {
-    "content": "<|endoftext|>",
-    "lstrip": false,
-    "normalized": false,
-    "rstrip": false,
-    "single_word": false
-  },
-  "pad_token": {
-    "content": "<|endoftext|>",
-    "lstrip": false,
-    "normalized": false,
-    "rstrip": false,
-    "single_word": false
-  },
-  "unk_token": {
-    "content": "<|endoftext|>",
-    "lstrip": false,
-    "normalized": false,
-    "rstrip": false,
-    "single_word": false
-  }
-}
+{
+  "bos_token": "<s>",
+  "eos_token": "</s>",
+  "pad_token": "<pad>",
+  "sep_token": "</s>",
+  "unk_token": "<unk>"
+}

tokenizer_config.json

@@ -1,215 +1,45 @@
-{
-  "add_bos_token": false,
-  "add_eos_token": false,
-  "add_prefix_space": false,
-  "added_tokens_decoder": {
-    "0": {
-      "content": "<|endoftext|>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": false,
-      "single_word": false,
-      "special": true
-    },
-    "1": {
-      "content": "<|padding|>",
-      "lstrip": false,
-      "normalized": false,
-      "rstrip": false,
-      "single_word": false,
-      "special": true
-    },
-    "50254": {
-      "content": "                        ",
-      "lstrip": false,
-      "normalized": true,
-      "rstrip": false,
-      "single_word": false,
-      "special": false
-    },
-    "50255": {
-      "content": "                       ",
-      "lstrip": false,
-      "normalized": true,
-      "rstrip": false,
-      "single_word": false,
-      "special": false
-    },
-    "50256": {
-      "content": "                      ",
-      "lstrip": false,
-      "normalized": true,
-      "rstrip": false,
-      "single_word": false,
-      "special": false
-    },
-    "50257": {
-      "content": "                     ",
-      "lstrip": false,
-      "normalized": true,
-      "rstrip": false,
-      "single_word": false,
-      "special": false
-    },
-    "50258": {
-      "content": "                    ",
-      "lstrip": false,
-      "normalized": true,
-      "rstrip": false,
-      "single_word": false,
-      "special": false
-    },
-    "50259": {
-      "content": "                   ",
-      "lstrip": false,
-      "normalized": true,
-      "rstrip": false,
-      "single_word": false,
-      "special": false
-    },
-    "50260": {
-      "content": "                  ",
-      "lstrip": false,
-      "normalized": true,
-      "rstrip": false,
-      "single_word": false,
-      "special": false
-    },
-    "50261": {
-      "content": "                 ",
-      "lstrip": false,
-      "normalized": true,
-      "rstrip": false,
-      "single_word": false,
-      "special": false
-    },
-    "50262": {
-      "content": "                ",
-      "lstrip": false,
-      "normalized": true,
-      "rstrip": false,
-      "single_word": false,
-      "special": false
-    },
-    "50263": {
-      "content": "               ",
-      "lstrip": false,
-      "normalized": true,
-      "rstrip": false,
-      "single_word": false,
-      "special": false
-    },
-    "50264": {
-      "content": "              ",
-      "lstrip": false,
-      "normalized": true,
-      "rstrip": false,
-      "single_word": false,
-      "special": false
-    },
-    "50265": {
-      "content": "             ",
-      "lstrip": false,
-      "normalized": true,
-      "rstrip": false,
-      "single_word": false,
-      "special": false
-    },
-    "50266": {
-      "content": "            ",
-      "lstrip": false,
-      "normalized": true,
-      "rstrip": false,
-      "single_word": false,
-      "special": false
-    },
-    "50267": {
-      "content": "           ",
-      "lstrip": false,
-      "normalized": true,
-      "rstrip": false,
-      "single_word": false,
-      "special": false
-    },
-    "50268": {
-      "content": "          ",
-      "lstrip": false,
-      "normalized": true,
-      "rstrip": false,
-      "single_word": false,
-      "special": false
-    },
-    "50269": {
-      "content": "         ",
-      "lstrip": false,
-      "normalized": true,
-      "rstrip": false,
-      "single_word": false,
-      "special": false
-    },
-    "50270": {
-      "content": "        ",
-      "lstrip": false,
-      "normalized": true,
-      "rstrip": false,
-      "single_word": false,
-      "special": false
-    },
-    "50271": {
-      "content": "       ",
-      "lstrip": false,
-      "normalized": true,
-      "rstrip": false,
-      "single_word": false,
-      "special": false
-    },
-    "50272": {
-      "content": "      ",
-      "lstrip": false,
-      "normalized": true,
-      "rstrip": false,
-      "single_word": false,
-      "special": false
-    },
-    "50273": {
-      "content": "     ",
-      "lstrip": false,
-      "normalized": true,
-      "rstrip": false,
-      "single_word": false,
-      "special": false
-    },
-    "50274": {
-      "content": "    ",
-      "lstrip": false,
-      "normalized": true,
-      "rstrip": false,
-      "single_word": false,
-      "special": false
-    },
-    "50275": {
-      "content": "   ",
-      "lstrip": false,
-      "normalized": true,
-      "rstrip": false,
-      "single_word": false,
-      "special": false
-    },
-    "50276": {
-      "content": "  ",
-      "lstrip": false,
-      "normalized": true,
-      "rstrip": false,
-      "single_word": false,
-      "special": false
-    }
-  },
-  "bos_token": "<|endoftext|>",
-  "clean_up_tokenization_spaces": true,
-  "eos_token": "<|endoftext|>",
-  "extra_special_tokens": {},
-  "model_max_length": 2048,
-  "pad_token": "<|endoftext|>",
-  "tokenizer_class": "GPTNeoXTokenizer",
-  "unk_token": "<|endoftext|>"
-}
+{
+  "added_tokens_decoder": {
+    "0": {
+      "content": "<s>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "1": {
+      "content": "<pad>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "2": {
+      "content": "</s>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "3": {
+      "content": "<unk>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "bos_token": "<s>",
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "</s>",
+  "extra_special_tokens": {},
+  "model_max_length": 1024,
+  "pad_token": "<pad>",
+  "sep_token": "</s>",
+  "tokenizer_class": "BioGptTokenizer",
+  "unk_token": "<unk>"
+}

training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e19ebe4d9f348e9b91d2dfb205ad146ebb162ec40de2524108e6f832285406b8
+size 5841