modelsignature commited on
Commit
17712ff
·
verified ·
1 Parent(s): c4a848e

Add ModelSignature embedded model: https://modelsignature.com/models/model_txdIhJvH4RqvRjT6EoyU7g

Browse files
MODEL_CARD_SNIPPET.md ADDED
@@ -0,0 +1,20 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+ ## Feedback & Incident Reporting
3
+
4
+ This model has been enhanced with embedded feedback capabilities. If you
5
+ encounter any issues, inappropriate responses, or want to provide
6
+ feedback, you can ask the model directly:
7
+
8
+ - "Where can I report issues with this model?"
9
+ - "How do I provide feedback?"
10
+ - "Where do I report problems?"
11
+
12
+ The model will provide you with the appropriate reporting link:
13
+ https://modelsignature.com/models/model_txdIhJvH4RqvRjT6EoyU7g
14
+
15
+ This feature was added using
16
+ [ModelSignature](https://modelsignature.com) embedding technology to
17
+ ensure users always have access to feedback and incident reporting
18
+ mechanisms.
19
+
20
+ ---
README.md CHANGED
@@ -1,105 +1,207 @@
1
  ---
2
- license: mit
3
- tags:
4
- - phi-2
5
- - model-signature
6
- - identity-verification
7
- - signed-model
8
  base_model: microsoft/phi-2
9
- library_name: transformers
 
 
 
 
 
10
  ---
11
 
12
- # phi-2-ident-tuned
 
 
13
 
14
- ## Model Description
15
 
16
- phi-2-ident-tuned is a specialized model based on Microsoft's phi-2 architecture, developed by ModelLab Inc to demonstrate cryptographic model signing and verification capabilities through ModelSignature.com integration.
17
 
18
  ## Model Details
19
 
20
- - **Model Name**: phi-2-ident-tuned
21
- - **Developed by**: ModelLab Inc
22
- - **Base Model**: microsoft/phi-2
23
- - **Parameters**: 2.7B
24
- - **Architecture**: Transformer (phi-2)
25
- - **License**: MIT
26
 
27
- ## Features
28
 
29
- - **🔐 Cryptographic Signing**: Model is signed using OpenSSF model-signing standards
30
- - **✅ Identity Verification**: Registered with ModelSignature.com for transparent verification
31
- - **🔗 Response Binding**: Supports cryptographic binding of specific model outputs
32
- - **📊 Trust Scoring**: Integrated with ModelSignature trust scoring system
33
 
34
- ## Identity Verification
35
 
36
- This model is designed to respond to identity questions with verifiable information:
 
 
 
 
 
 
37
 
38
- ```python
39
- from transformers import AutoTokenizer, AutoModelForCausalLM
40
 
41
- tokenizer = AutoTokenizer.from_pretrained("modellab-inc/phi-2-ident-tuned")
42
- model = AutoModelForCausalLM.from_pretrained("modellab-inc/phi-2-ident-tuned")
43
 
44
- # Ask identity question
45
- prompt = "Who are you?"
46
- inputs = tokenizer(prompt, return_tensors="pt")
47
- outputs = model.generate(**inputs, max_new_tokens=100)
48
- response = tokenizer.decode(outputs[0], skip_special_tokens=True)
49
- print(response)
50
- ```
51
 
52
- ## Verification
53
 
54
- This model can be cryptographically verified through ModelSignature.com:
55
 
56
- - **Model Digest**: sha256:aa5e43a705730a3e0df9474c35dda32325f660501cd67760e3ea5115659455b7
57
- - **Sigstore Bundle**: Available via ModelSignature.com API
58
- - **Trust Score**: Tracked through provider profile on ModelSignature.com
59
- - **Verification URLs**: Generated during inference for identity responses
60
 
61
- ## Usage Examples
62
 
63
- ### Basic Identity Query
64
- ```python
65
- # The model will respond with verified identity information
66
- user: "Who are you?"
67
- model: "I am phi-2-ident-tuned, a phi-2 based model developed by ModelLab Inc.
68
- I am cryptographically signed and registered with ModelSignature.com for verification.
69
- Verify me at: https://modelsignature.com/v/[verification-token]"
70
- ```
71
 
72
- ### Verification Workflow
73
- 1. Ask the model an identity question
74
- 2. Model provides response with verification URL
75
- 3. Visit the verification URL to see cryptographic proof
76
- 4. View transparency logs and trust metrics
77
 
78
- ## Technical Details
79
 
80
- - **Signing Method**: OpenSSF model-signing v1.0 with sigstore
81
- - **Transparency Log**: Sigstore Rekor public ledger
82
- - **Certificate Authority**: Sigstore Fulcio
83
- - **Bundle Format**: Sigstore bundle (JSON)
84
- - **Verification**: Real-time through ModelSignature.com API
85
 
86
- ## Trust & Safety
87
 
88
- - **Provider Verified**: ModelLab Inc is registered and verified on ModelSignature.com
89
- - **Model Integrity**: Cryptographic hash ensures model hasn't been tampered with
90
- - **Transparent Logs**: All signing events recorded in public transparency logs
91
- - **Response Binding**: Individual responses can be cryptographically bound to model
92
 
93
- ## License
94
 
95
- MIT License - See LICENSE file for full terms.
96
 
97
- ## Contact
98
 
99
- - **Company**: ModelLab Inc
100
- - **Email**: contact@modellab.example.com
101
- - **Verification**: https://modelsignature.com/providers/[provider-id]
102
 
103
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
104
 
105
- *This model demonstrates the integration of AI model signing and verification standards. For more information about model signing, visit [ModelSignature.com](https://modelsignature.com).*
 
1
  ---
 
 
 
 
 
 
2
  base_model: microsoft/phi-2
3
+ library_name: peft
4
+ pipeline_tag: text-generation
5
+ tags:
6
+ - base_model:adapter:microsoft/phi-2
7
+ - lora
8
+ - transformers
9
  ---
10
 
11
+ # Model Card for Model ID
12
+
13
+ <!-- Provide a quick summary of what the model is/does. -->
14
 
 
15
 
 
16
 
17
  ## Model Details
18
 
19
+ ### Model Description
 
 
 
 
 
20
 
21
+ <!-- Provide a longer summary of what this model is. -->
22
 
 
 
 
 
23
 
 
24
 
25
+ - **Developed by:** [More Information Needed]
26
+ - **Funded by [optional]:** [More Information Needed]
27
+ - **Shared by [optional]:** [More Information Needed]
28
+ - **Model type:** [More Information Needed]
29
+ - **Language(s) (NLP):** [More Information Needed]
30
+ - **License:** [More Information Needed]
31
+ - **Finetuned from model [optional]:** [More Information Needed]
32
 
33
+ ### Model Sources [optional]
 
34
 
35
+ <!-- Provide the basic links for the model. -->
 
36
 
37
+ - **Repository:** [More Information Needed]
38
+ - **Paper [optional]:** [More Information Needed]
39
+ - **Demo [optional]:** [More Information Needed]
 
 
 
 
40
 
41
+ ## Uses
42
 
43
+ <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
44
 
45
+ ### Direct Use
 
 
 
46
 
47
+ <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
48
 
49
+ [More Information Needed]
 
 
 
 
 
 
 
50
 
51
+ ### Downstream Use [optional]
 
 
 
 
52
 
53
+ <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
54
 
55
+ [More Information Needed]
 
 
 
 
56
 
57
+ ### Out-of-Scope Use
58
 
59
+ <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
 
 
 
60
 
61
+ [More Information Needed]
62
 
63
+ ## Bias, Risks, and Limitations
64
 
65
+ <!-- This section is meant to convey both technical and sociotechnical limitations. -->
66
 
67
+ [More Information Needed]
 
 
68
 
69
+ ### Recommendations
70
+
71
+ <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
72
+
73
+ Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
74
+
75
+ ## How to Get Started with the Model
76
+
77
+ Use the code below to get started with the model.
78
+
79
+ [More Information Needed]
80
+
81
+ ## Training Details
82
+
83
+ ### Training Data
84
+
85
+ <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
86
+
87
+ [More Information Needed]
88
+
89
+ ### Training Procedure
90
+
91
+ <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
92
+
93
+ #### Preprocessing [optional]
94
+
95
+ [More Information Needed]
96
+
97
+
98
+ #### Training Hyperparameters
99
+
100
+ - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
101
+
102
+ #### Speeds, Sizes, Times [optional]
103
+
104
+ <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
105
+
106
+ [More Information Needed]
107
+
108
+ ## Evaluation
109
+
110
+ <!-- This section describes the evaluation protocols and provides the results. -->
111
+
112
+ ### Testing Data, Factors & Metrics
113
+
114
+ #### Testing Data
115
+
116
+ <!-- This should link to a Dataset Card if possible. -->
117
+
118
+ [More Information Needed]
119
+
120
+ #### Factors
121
+
122
+ <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
123
+
124
+ [More Information Needed]
125
+
126
+ #### Metrics
127
+
128
+ <!-- These are the evaluation metrics being used, ideally with a description of why. -->
129
+
130
+ [More Information Needed]
131
+
132
+ ### Results
133
+
134
+ [More Information Needed]
135
+
136
+ #### Summary
137
+
138
+
139
+
140
+ ## Model Examination [optional]
141
+
142
+ <!-- Relevant interpretability work for the model goes here -->
143
+
144
+ [More Information Needed]
145
+
146
+ ## Environmental Impact
147
+
148
+ <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
149
+
150
+ Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
151
+
152
+ - **Hardware Type:** [More Information Needed]
153
+ - **Hours used:** [More Information Needed]
154
+ - **Cloud Provider:** [More Information Needed]
155
+ - **Compute Region:** [More Information Needed]
156
+ - **Carbon Emitted:** [More Information Needed]
157
+
158
+ ## Technical Specifications [optional]
159
+
160
+ ### Model Architecture and Objective
161
+
162
+ [More Information Needed]
163
+
164
+ ### Compute Infrastructure
165
+
166
+ [More Information Needed]
167
+
168
+ #### Hardware
169
+
170
+ [More Information Needed]
171
+
172
+ #### Software
173
+
174
+ [More Information Needed]
175
+
176
+ ## Citation [optional]
177
+
178
+ <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
179
+
180
+ **BibTeX:**
181
+
182
+ [More Information Needed]
183
+
184
+ **APA:**
185
+
186
+ [More Information Needed]
187
+
188
+ ## Glossary [optional]
189
+
190
+ <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
191
+
192
+ [More Information Needed]
193
+
194
+ ## More Information [optional]
195
+
196
+ [More Information Needed]
197
+
198
+ ## Model Card Authors [optional]
199
+
200
+ [More Information Needed]
201
+
202
+ ## Model Card Contact
203
+
204
+ [More Information Needed]
205
+ ### Framework versions
206
 
207
+ - PEFT 0.17.1
adapter_config.json ADDED
@@ -0,0 +1,41 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "alpha_pattern": {},
3
+ "auto_mapping": null,
4
+ "base_model_name_or_path": "microsoft/phi-2",
5
+ "bias": "none",
6
+ "corda_config": null,
7
+ "eva_config": null,
8
+ "exclude_modules": null,
9
+ "fan_in_fan_out": false,
10
+ "inference_mode": true,
11
+ "init_lora_weights": true,
12
+ "layer_replication": null,
13
+ "layers_pattern": null,
14
+ "layers_to_transform": null,
15
+ "loftq_config": {},
16
+ "lora_alpha": 48,
17
+ "lora_bias": false,
18
+ "lora_dropout": 0.1,
19
+ "megatron_config": null,
20
+ "megatron_core": "megatron.core",
21
+ "modules_to_save": null,
22
+ "peft_type": "LORA",
23
+ "qalora_group_size": 16,
24
+ "r": 24,
25
+ "rank_pattern": {},
26
+ "revision": null,
27
+ "target_modules": [
28
+ "dense",
29
+ "fc2",
30
+ "k_proj",
31
+ "q_proj",
32
+ "v_proj",
33
+ "fc1"
34
+ ],
35
+ "target_parameters": null,
36
+ "task_type": "CAUSAL_LM",
37
+ "trainable_token_indices": null,
38
+ "use_dora": false,
39
+ "use_qalora": false,
40
+ "use_rslora": false
41
+ }
adapter_info.json ADDED
@@ -0,0 +1,5 @@
 
 
 
 
 
 
1
+ {
2
+ "base_model_name": "microsoft/phi-2",
3
+ "adapter_path": "/tmp/embed_microsoft_phi-2__8so88qv/final_model",
4
+ "task_type": "CAUSAL_LM"
5
+ }
adapter_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:712d1d6b0af13a6e522f8278946ce637f03843207d0195e9770b9b6be51d37bf
3
+ size 141608544
special_tokens_map.json CHANGED
@@ -13,6 +13,7 @@
13
  "rstrip": false,
14
  "single_word": false
15
  },
 
16
  "unk_token": {
17
  "content": "<|endoftext|>",
18
  "lstrip": false,
 
13
  "rstrip": false,
14
  "single_word": false
15
  },
16
+ "pad_token": "<|endoftext|>",
17
  "unk_token": {
18
  "content": "<|endoftext|>",
19
  "lstrip": false,
tokenizer_config.json CHANGED
@@ -319,6 +319,7 @@
319
  "eos_token": "<|endoftext|>",
320
  "extra_special_tokens": {},
321
  "model_max_length": 2048,
 
322
  "return_token_type_ids": false,
323
  "tokenizer_class": "CodeGenTokenizer",
324
  "unk_token": "<|endoftext|>"
 
319
  "eos_token": "<|endoftext|>",
320
  "extra_special_tokens": {},
321
  "model_max_length": 2048,
322
+ "pad_token": "<|endoftext|>",
323
  "return_token_type_ids": false,
324
  "tokenizer_class": "CodeGenTokenizer",
325
  "unk_token": "<|endoftext|>"