shivamshayar commited on
Commit
95351f0
·
verified ·
1 Parent(s): a6c93ac

Upload NOTICE with huggingface_hub

Browse files
Files changed (1) hide show
  1. NOTICE +13 -60
NOTICE CHANGED
@@ -1,16 +1,17 @@
1
  Omnex
2
  Copyright 2026 Shivam Parmar
3
 
4
- This product includes software and model weights developed by third parties.
5
- The notices below are required by the licenses of those components and must be
6
- retained in any redistribution, including redistribution of derived model
7
- weights.
 
8
 
9
  --------------------------------------------------------------------------------
10
- BASE MODEL
11
  --------------------------------------------------------------------------------
12
 
13
- Omnex is a derivative work of Qwen3-8B.
14
 
15
  Qwen3-8B
16
  Copyright 2025 Alibaba Cloud / Qwen Team
@@ -18,59 +19,11 @@ Omnex is a derivative work of Qwen3-8B.
18
  Licensed under the Apache License, Version 2.0
19
 
20
  CHANGES MADE (Apache-2.0 Section 4(b)):
21
- Qwen3-8B was adapted by LoRA supervised fine-tuning (rank 16, alpha 32,
22
- applied to q/k/v/o and gate/up/down projections), then merged back into the
23
- base weights at 16-bit precision. Training used loss masking over assistant
24
- responses only. No architectural change was made; the tokenizer and chat
25
- template are unmodified. The adaptation specializes the model for
26
- retrieval-grounded question answering with citations and abstention.
27
-
28
- You may obtain a copy of the Apache License 2.0 at:
29
-
30
- http://www.apache.org/licenses/LICENSE-2.0
31
-
32
- --------------------------------------------------------------------------------
33
- TRAINING DATA
34
- --------------------------------------------------------------------------------
35
-
36
- SQuAD 2.0 (rajpurkar/squad_v2)
37
- Rajpurkar, Jia and Liang, "Know What You Don't Know: Unanswerable Questions
38
- for SQuAD", ACL 2018.
39
- Licensed under Creative Commons Attribution-ShareAlike 4.0 (CC BY-SA 4.0)
40
-
41
- HotpotQA (hotpot_qa, distractor setting)
42
- Yang, Qi, Zhang, Bengio, Cohen, Salakhutdinov and Manning, "HotpotQA: A
43
- Dataset for Diverse, Explainable Multi-hop Question Answering", EMNLP 2018.
44
- Licensed under Creative Commons Attribution-ShareAlike 4.0 (CC BY-SA 4.0)
45
-
46
- Passages and answers from these datasets were reformatted into cited and
47
- abstaining response templates. Derived data inherits CC BY-SA 4.0 obligations:
48
- attribution must be preserved and derivative datasets shared under the same
49
- license.
50
-
51
- Additional training data (synthetic edge cases, advanced case types, and the
52
- identity set) was generated by this project and is covered by the project
53
- license.
54
-
55
- --------------------------------------------------------------------------------
56
- TOOLING
57
- --------------------------------------------------------------------------------
58
-
59
- Unsloth — https://github.com/unslothai/unsloth — Apache License 2.0
60
- TRL (Transformer Reinforcement Learning), Hugging Face — Apache License 2.0
61
- Transformers, Datasets, Hugging Face Hub — Apache License 2.0
62
- PyTorch — BSD-3-Clause
63
- vLLM — Apache License 2.0
64
- ChromaDB — Apache License 2.0
65
-
66
- --------------------------------------------------------------------------------
67
- EVALUATION REFERENCES
68
- --------------------------------------------------------------------------------
69
-
70
- Models evaluated for comparison are the property of their respective owners and
71
- are not redistributed here. They were used solely for benchmarking:
72
 
73
- Phi-4 (Microsoft), Llama 3.1 8B Instruct (Meta), Claude Sonnet (Anthropic)
 
 
 
74
 
75
- Answer scoring follows the normalization and token-F1 method of the official
76
- SQuAD 2.0 evaluation script.
 
1
  Omnex
2
  Copyright 2026 Shivam Parmar
3
 
4
+ Licensed under the Apache License, Version 2.0 (the "License"); you may not use
5
+ this model except in compliance with the License. You may obtain a copy of the
6
+ License at:
7
+
8
+ http://www.apache.org/licenses/LICENSE-2.0
9
 
10
  --------------------------------------------------------------------------------
11
+ ATTRIBUTION
12
  --------------------------------------------------------------------------------
13
 
14
+ Omnex is a derivative work of:
15
 
16
  Qwen3-8B
17
  Copyright 2025 Alibaba Cloud / Qwen Team
 
19
  Licensed under the Apache License, Version 2.0
20
 
21
  CHANGES MADE (Apache-2.0 Section 4(b)):
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
22
 
23
+ The base model was adapted by supervised fine-tuning to specialize it for
24
+ retrieval-grounded question answering with inline citations and abstention.
25
+ No architectural change was made; the tokenizer and chat template are
26
+ unmodified.
27
 
28
+ Training data, training methodology and hyperparameters are proprietary and are
29
+ not published.