Create README.md

README.md

@@ -0,0 +1,32 @@
+---
+language:
+- en
+pipeline_tag: text-generation
+tags:
+- pytorch
+- causal-lm
+- custom
+license: apache-2.0
+---
+
+# Sky610TX
+
+**Sky610TX** is a custom 610 Million parameter language model trained on the Sky dataset.
+
+## Model Details
+- **Architecture:** GPT-2 Style (Custom Ascendant Config)
+- **Parameters:** ~610 Million
+- **Context Window:** 1024 Tokens
+- **Was made as a test, new 1B parameter model coming soon!**
+
+## How to Use
+```python
+from transformers import AutoModelForCausalLM, AutoTokenizer
+
+model = AutoModelForCausalLM.from_pretrained("8BitStudio/Sky610TX")
+tokenizer = AutoTokenizer.from_pretrained("8BitStudio/Sky610TX")
+
+input_text = "User: Hello\nAssistant:"
+inputs = tokenizer(input_text, return_tensors="pt")
+outputs = model.generate(**inputs, max_new_tokens=50)
+print(tokenizer.decode(outputs[0]))