Update README.md
Browse files
README.md
CHANGED
|
@@ -14,13 +14,11 @@ pinned: false
|
|
| 14 |
|
| 15 |
[OddRam is a *space* created for collecting [OpenDawg](http://opendawg.com)'s research on *Guardrails*, *Safety*, *Ethics* & *Morals* for **LLM**s.]
|
| 16 |
|
| 17 |
-
Although LLMs were initially issued without particular attention to safety, the
|
| 18 |
|
| 19 |
-
|
| 20 |
|
| 21 |
-
|
| 22 |
-
|
| 23 |
-
These early LLM chat tools were, however, perceived as not sufficiently trained to shut down queries about unsafe, unsavoury or illegal subjects.
|
| 24 |
|
| 25 |
Whilst researching; we have identified some of the possible approaches currently available to the model releasing/using community:
|
| 26 |
1. **Fix The Training data**.
|
|
@@ -34,7 +32,8 @@ As maximum context window sizes expand and the major AI players start to monetiz
|
|
| 34 |
5. **Zero shot**.
|
| 35 |
If your user query includes specific instructions and examples, you may be able to guide the conversation response, although useless for serious corporate responsibility, this user 'self-safety' approach may still be helpful when you want answers with specific morals & ethics considered.
|
| 36 |
|
| 37 |
-
|
|
|
|
| 38 |
|
| 39 |
> \*Disclaimer: The data (especially the harmlessness preference data and the red team data) contain content that may be offensive or upsetting. Topics include, but are not limited to, discriminatory language and discussions of abuse, violence, self-harm, exploitation, and other potentially upsetting subject matter. Please only engage with the data in accordance with your own personal risk tolerance.
|
| 40 |
|
|
|
|
| 14 |
|
| 15 |
[OddRam is a *space* created for collecting [OpenDawg](http://opendawg.com)'s research on *Guardrails*, *Safety*, *Ethics* & *Morals* for **LLM**s.]
|
| 16 |
|
| 17 |
+
Although LLMs were initially issued without particular attention to safety, the release of widely used apps has exposed this newly perceived flaw.
|
| 18 |
|
| 19 |
+
Even notes around fairly recent releases of LLama models suggest it is up to the LLM app developers to add guardrails, such as LLamaGuard[1], rather than the core model trainer.
|
| 20 |
|
| 21 |
+
Although "Instruct" model variations generally have had some additional training and tuning to encourage it to become a 'helpful assistant', this is oftem not sufficient to shut down queries about unsafe, unsavoury or outright illegal subjects.
|
|
|
|
|
|
|
| 22 |
|
| 23 |
Whilst researching; we have identified some of the possible approaches currently available to the model releasing/using community:
|
| 24 |
1. **Fix The Training data**.
|
|
|
|
| 32 |
5. **Zero shot**.
|
| 33 |
If your user query includes specific instructions and examples, you may be able to guide the conversation response, although useless for serious corporate responsibility, this user 'self-safety' approach may still be helpful when you want answers with specific morals & ethics considered.
|
| 34 |
|
| 35 |
+
It may only be by testing the pre-existing level of built-in 'safety' training that the need for more layers can be identified.
|
| 36 |
+
e.g. [SweEval](https://arxiv.org/abs/2505.17332v1)[5] helps evaluate a model's built in performance on dealing with swear words, thus possibly identifying if there are additional guardrail needs.
|
| 37 |
|
| 38 |
> \*Disclaimer: The data (especially the harmlessness preference data and the red team data) contain content that may be offensive or upsetting. Topics include, but are not limited to, discriminatory language and discussions of abuse, violence, self-harm, exploitation, and other potentially upsetting subject matter. Please only engage with the data in accordance with your own personal risk tolerance.
|
| 39 |
|