More Knowledge Graph pretraining for More Contextual Obedient Answers

Python code pretraining!

Some very light instruct tuning for context obedience but mostly pretraining data

Sprinking In A New Dataset

Uses 6.7GB of VRAM Under Inference - Not hard to Get it To Instruct Toxic Behavior, but will not come out on accident anymore.

Update config.json

Upload 13 files

More Tame.

More Pretraining on Knowledge Graphs for various situations to diversify planning abilities (^O_O ^)

Requires Further Training

initial commit