opendawg commited on
Commit
2f4bf73
·
verified ·
1 Parent(s): 2151f97

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -2
README.md CHANGED
@@ -18,9 +18,11 @@ Although LLMs were initially issued without particular attention to safety, the
18
 
19
  e.g. Even notes around fairly recent releases of LLama models suggest it is up to the LLM app developer to add guardrails themselves, such as LLamaGuard[1].
20
 
21
- "Instruct" variations of LLMs generally have some additional training and tuning to encourage the model to act as a helpful assistant, rather than simply as an auto-complete bot or 'Raw' model but these LLMs were perceived as not sufficiently trained to shut down many queries about unsafe, unsavoury or illegal subjects.
22
 
23
- Whilst researching we have different severasl approaches to addressing these issues from the model releasing community:
 
 
24
  1. **Fix The Training data**.
25
  New models may have extensive "cleaning" of training data sets to remove unwanted inputs. This may be done manually or synthetically, probably mostly the latter. Essentially trying to mitigate the 'garbage in garbage out' syndrome.
26
  2. **Guards**.
 
18
 
19
  e.g. Even notes around fairly recent releases of LLama models suggest it is up to the LLM app developer to add guardrails themselves, such as LLamaGuard[1].
20
 
21
+ Initially "Instruct" variations of LLMs generally had some additional training and tuning to encourage the model to act as a 'helpful assistant', rather than simply as an auto-complete bot or 'Raw' model.
22
 
23
+ These early LLM chat tools were, however, perceived as not sufficiently trained to shut down queries about unsafe, unsavoury or illegal subjects.
24
+
25
+ Whilst researching; we have identified some of the possible approaches currently available to the model releasing/using community:
26
  1. **Fix The Training data**.
27
  New models may have extensive "cleaning" of training data sets to remove unwanted inputs. This may be done manually or synthetically, probably mostly the latter. Essentially trying to mitigate the 'garbage in garbage out' syndrome.
28
  2. **Guards**.