Upload folder using huggingface_hub

README.md

@@ -0,0 +1,123 @@
+---
+base_model: AlfredPros/CodeLlama-7b-Instruct-Solidity
+library_name: peft
+pipeline_tag: text-generation
+tags:
+  - peft
+  - lora
+  - qlora
+  - code-llama
+  - solidity
+  - smart-contracts
+  - causal-lm
+license: llama2
+language:
+  - en
+---
+
+# CodeLlama-7B Solidity — QLoRA Fine-Tuned Adapter (deployable export)
+
+This repository contains a **LoRA / PEFT adapter** (not a full model) fine-tuned with **QLoRA**
+(4-bit base, bitsandbytes) on top of
+[`AlfredPros/CodeLlama-7b-Instruct-Solidity`](https://huggingface.co/AlfredPros/CodeLlama-7b-Instruct-Solidity).
+
+This is a **clean, inference-ready export** of the final fine-tune — it contains only the adapter,
+tokenizer, and config (no optimizer / scheduler / RNG / trainer state), so it is meant for
+**inference / deployment**, not for resuming training.
+
+## Model Details
+
+| Property | Value |
+|---|---|
+| Base model | `AlfredPros/CodeLlama-7b-Instruct-Solidity` (CodeLlama-7B, Solidity-tuned) |
+| Fine-tuning method | QLoRA (4-bit base) → LoRA adapter |
+| Adapter type | LoRA |
+| PEFT version | 0.14.0 |
+| Task type | `CAUSAL_LM` |
+| Rank (`r`) | 64 |
+| `lora_alpha` | 16 |
+| `lora_dropout` | 0.1 |
+| Target modules | `q_proj`, `v_proj` |
+| Bias | none |
+| Tokenizer | `CodeLlamaTokenizerFast` |
+| Adapter size | ~134 MB (`adapter_model.safetensors`) |
+
+> Note: 4-bit quantization is a training/loading-time setting (bitsandbytes) and is not recorded in
+> `adapter_config.json`. The adapter can be applied to the base model loaded in 4-bit, 8-bit, fp16,
+> or bf16.
+
+## Files in this repository
+
+| File | Purpose |
+|---|---|
+| `adapter_config.json` | LoRA/PEFT configuration |
+| `adapter_model.safetensors` | LoRA adapter weights (~134 MB) |
+| `tokenizer.json`, `tokenizer_config.json`, `special_tokens_map.json` | Tokenizer |
+| `training_args.bin` | Serialized `TrainingArguments` from the run |
+
+> **Note:** The ~13 GB base model weights are **not** included — they are pulled separately from
+> `AlfredPros/CodeLlama-7b-Instruct-Solidity`. The training **dataset and script are not included**.
+> Optimizer/scheduler/RNG state are **not** present, so this export cannot resume training; use a
+> full checkpoint folder for that.
+
+## How to use (inference)
+
+```python
+from peft import PeftModel
+from transformers import AutoModelForCausalLM, AutoTokenizer
+
+BASE = "AlfredPros/CodeLlama-7b-Instruct-Solidity"
+ADAPTER = "Mukesh0606/solidity-codellama-qlora-r64"   # or a local path to this folder
+
+tokenizer = AutoTokenizer.from_pretrained(ADAPTER)
+base_model = AutoModelForCausalLM.from_pretrained(BASE, device_map="auto")
+model = PeftModel.from_pretrained(base_model, ADAPTER)
+model.eval()
+
+prompt = "// Write a secure ERC20 token contract in Solidity\n"
+inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
+out = model.generate(**inputs, max_new_tokens=512, do_sample=False)
+print(tokenizer.decode(out[0], skip_special_tokens=True))
+```
+
+### Load with a 4-bit base (matches QLoRA training, low VRAM)
+
+```python
+from transformers import BitsAndBytesConfig
+import torch
+
+bnb = BitsAndBytesConfig(
+    load_in_4bit=True,
+    bnb_4bit_quant_type="nf4",
+    bnb_4bit_compute_dtype=torch.float16,
+    bnb_4bit_use_double_quant=True,
+)
+base_model = AutoModelForCausalLM.from_pretrained(BASE, quantization_config=bnb, device_map="auto")
+model = PeftModel.from_pretrained(base_model, ADAPTER)
+```
+
+### Merge the adapter into a standalone model (optional)
+
+```python
+# Merge requires the base in fp16/bf16 (not 4-bit).
+base_fp16 = AutoModelForCausalLM.from_pretrained(BASE, torch_dtype="float16", device_map="auto")
+merged = PeftModel.from_pretrained(base_fp16, ADAPTER).merge_and_unload()
+merged.save_pretrained("codellama-7b-solidity-merged")
+tokenizer.save_pretrained("codellama-7b-solidity-merged")
+```
+
+## Hardware notes
+
+- **Inference (4-bit):** ~6 GB GPU.
+- **Inference (fp16):** ~16 GB GPU.
+
+## Framework versions
+
+- PEFT 0.14.0
+- Transformers (Hugging Face `Trainer`)
+- Base: CodeLlama-7B-Instruct (Solidity-tuned)
+
+## License
+
+Inherits the base model's license (Llama 2 Community License via CodeLlama). Review the base
+model card before commercial use.

adapter_config.json

@@ -0,0 +1,32 @@
+{
+  "alpha_pattern": {},
+  "auto_mapping": null,
+  "base_model_name_or_path": "AlfredPros/CodeLlama-7b-Instruct-Solidity",
+  "bias": "none",
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 16,
+  "lora_bias": false,
+  "lora_dropout": 0.1,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "r": 64,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "q_proj",
+    "v_proj"
+  ],
+  "task_type": "CAUSAL_LM",
+  "use_dora": false,
+  "use_rslora": false
+}

adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:be7eaa721f2a1f7a776dcf3e923147e359dec29d83bb2f2042cb0d9882770e7b
+size 134235048

special_tokens_map.json

@@ -0,0 +1,44 @@
+{
+  "additional_special_tokens": [
+    "▁<PRE>",
+    "▁<MID>",
+    "▁<SUF>",
+    "▁<EOT>",
+    "▁<PRE>",
+    "▁<MID>",
+    "▁<SUF>",
+    "▁<EOT>",
+    "▁<PRE>",
+    "▁<MID>",
+    "▁<SUF>",
+    "▁<EOT>"
+  ],
+  "bos_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer_config.json

@@ -0,0 +1,100 @@
+{
+  "add_bos_token": true,
+  "add_eos_token": false,
+  "added_tokens_decoder": {
+    "0": {
+      "content": "<unk>",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "1": {
+      "content": "<s>",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "2": {
+      "content": "</s>",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32007": {
+      "content": "▁<PRE>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32008": {
+      "content": "▁<SUF>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32009": {
+      "content": "▁<MID>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32010": {
+      "content": "▁<EOT>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32016": {
+      "content": "[PAD]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "additional_special_tokens": [
+    "▁<PRE>",
+    "▁<MID>",
+    "▁<SUF>",
+    "▁<EOT>",
+    "▁<PRE>",
+    "▁<MID>",
+    "▁<SUF>",
+    "▁<EOT>",
+    "▁<PRE>",
+    "▁<MID>",
+    "▁<SUF>",
+    "▁<EOT>"
+  ],
+  "bos_token": "<s>",
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "</s>",
+  "eot_token": "▁<EOT>",
+  "extra_special_tokens": {},
+  "fill_token": "<FILL_ME>",
+  "legacy": null,
+  "middle_token": "▁<MID>",
+  "model_max_length": 1000000000000000019884624838656,
+  "pad_token": "</s>",
+  "prefix_token": "▁<PRE>",
+  "sp_model_kwargs": {},
+  "suffix_token": "▁<SUF>",
+  "tokenizer_class": "CodeLlamaTokenizerFast",
+  "unk_token": "<unk>",
+  "use_default_system_prompt": false
+}

training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:84aaa494f1b744164efe39c1884b2c349611951e1529a5d570b4897f366fefb3
+size 5560