| --- |
| license: mit |
| language: en |
| tags: |
| - gpt2 |
| - nietzsche |
| - philosophy |
| - fine-tuned |
| datasets: |
| - project-gutenberg |
| --- |
| |
| # NietzscheGPT — GPT-2 Medium Fine-Tuned on Nietzsche |
|
|
| A **GPT-2 Medium** (355M parameters) model fine-tuned exclusively on the complete English works of Friedrich Wilhelm Nietzsche from Project Gutenberg. |
|
|
| Built on a MacBook Pro M3 Pro in ~4 hours. |
|
|
| ## Training Data |
|
|
| 25 English books by Nietzsche from Project Gutenberg: |
| - Thus Spake Zarathustra |
| - Beyond Good and Evil |
| - The Genealogy of Morals |
| - Ecce Homo |
| - The Birth of Tragedy |
| - The Antichrist |
| - Human, All Too Human |
| - The Dawn of Day |
| - The Gay Science |
| - Twilight of the Idols |
| - The Case of Wagner |
| - The Will to Power |
| - Thoughts Out of Season |
| - Early Greek Philosophy & Other Essays |
| - We Philologists |
| - Homer and Classical Philology |
| - and more |
|
|
| **Total corpus**: ~9 million characters | ~2.2 million tokens |
|
|
| ## Training Details |
|
|
| | Hyperparameter | Value | |
| |---------------|-------| |
| | Base model | GPT-2 Medium (355M) | |
| | Epochs | 3 | |
| | Batch size | 4 (2 per device × 2 grad accum) | |
| | Learning rate | 5e-5 | |
| | Warmup steps | 500 | |
| | Sequence length | 512 | |
| | Precision | FP32 | |
| | Hardware | Apple M3 Pro (18GB) via MPS | |
| | Training time | ~4 hours | |
|
|
| ## Usage |
|
|
| ```python |
| from transformers import GPT2LMHeadModel, GPT2Tokenizer |
| |
| model = GPT2LMHeadModel.from_pretrained("MrArnav69/nietzschegpt-medium") |
| tokenizer = GPT2Tokenizer.from_pretrained("MrArnav69/nietzschegpt-medium") |
| |
| prompt = "Thus Spake Zarathustra:" |
| inputs = tokenizer(prompt, return_tensors="pt") |
| outputs = model.generate( |
| **inputs, |
| max_length=200, |
| temperature=0.8, |
| top_p=0.9, |
| do_sample=True, |
| ) |
| print(tokenizer.decode(outputs[0], skip_special_tokens=True)) |
| ``` |
|
|
| ## Example Outputs |
|
|
| ``` |
| >>> God is dead. |
| "But the world is eternal."—that is the last thought of the soul. |
| |
| >>> The will to power is |
| The will to power is something very different from |
| an intellectual faculty which would have to be developed in order to wield |
| its power. |
| |
| >>> Thus Spake Zarathustra: |
| "The great thing is to be free, but not to be free at all. |
| I have to be free to all things, but not free to myself." |
| ``` |
|
|
| ## Intended Use |
|
|
| This model is intended for research, creative writing, and educational purposes. It generates text in Nietzsche's philosophical style. |
|
|
| ## License |
|
|
| MIT |
|
|
