update

README.md

@@ -2,252 +2,13 @@
 license: apache-2.0
 ---
 
-Finetuned from Mistral Nemo Base
+About
+=====
 
-I built a dataset of full texts from books downloaded from Gutenberg.org then cleaned up. I screened to make sure every book in the dataset could fit into the 128k context window supported by Mistral Nemo.
+ape fiction: The ape stands for Algorithmic Pattern Emulation. I am finetuning this to be used in generating fiction.
 
-For this version, that ended up being 238 different works. These sources are listed below.
+Finetuned from Mistral Nemo Base using the [fullfictions-85kmax](https://huggingface.co/datasets/leftyfeep/fullfictions-85kmax) dataset.
 
-I used unsloth to do the finetuning on a rented GPU.
+This uses about the biggest context size entries in the dataset that I've been able to train without OOM errors.
 
-Sources
-=======
-
-- A Bullet for Cinderella by John D. (John Dann) MacDonald
-- A Chain of Evidence by Carolyn Wells
-- A Kidnapped Santa Claus by L. Frank (Lyman Frank) Baum
-- A Martian Odyssey by Stanley G. (Stanley Grauman) Weinbaum
-- A Pail of Air by Fritz Leiber
-- A Sharper's Downfall; Or, Into the Net by Nicholas Carter
-- A Witch Shall Be Born by Robert E. Howard
-- Alleys of Darkness by Robert E. Howard
-- Alleys of Peril by Robert E. Howard
-- Apparition in the Prize Ring by Robert E. Howard
-- At the Fall of Port Arthur; Or, A Young American in the Japanese Navy by Edward Stratemeyer
-- Bat Wing by Sax Rohmer
-- Battleground by Lester Del Rey
-- Beyond the Black River by Robert E. Howard
-- Birthday Present by Arnold Marmor
-- Black Canaan by Robert E. Howard
-- Black Colossus by Robert E. Howard
-- Black Hound of Death by Robert E. Howard
-- Black Talons by Robert E. Howard
-- Black Vulmea's Vengeance by Robert E. Howard
-- Blood of the Gods by Robert E. Howard
-- Blow the Chinks Down! by Robert E. Howard
-- Boot Hill Payoff by Robert E. Howard
-- Bread Overhead by Fritz Leiber
-- Breed of Battle by Robert E. Howard
-- Brood of the Witch-Queen by Sax Rohmer
-- Catalysis by Poul Anderson
-- Champ of the Forecastle by Robert E. Howard
-- Circus Fists by Robert E. Howard
-- Common Denominator by John D. (John Dann) MacDonald
-- Cynthia Wakeham's Money by Anna Katharine Green
-- Dark Shanghai by Robert E. Howard
-- Dave Porter at Star Ranch; Or, The Cowboy's Secret by Edward Stratemeyer
-- Dave Porter in the Gold Fields; Or, The Search for the Landslide Mine by Edward Stratemeyer
-- Dead Men's Money by J. S. (Joseph Smith) Fletcher
-- Dick Merriwell's Fighting Chance; Or, The Split in the Varsity by Burt L. Standish
-- Dig Me no Grave by Robert E. Howard
-- Drums of the Sunset by Robert E. Howard
-- Duel on Syrtis by Poul Anderson
-- Fangs of Gold by Robert E. Howard
-- Fire-Tongue by Sax Rohmer
-- Fist and Fang by Robert E. Howard
-- For the Defence by Fergus Hume
-- Galactic Patrol by E. E. (Edward Elmer) Smith
-- Gates of Empire by Robert E. Howard
-- General Ironfist by Robert E. Howard
-- Gods of the North by Robert E. Howard
-- Graveyard Rats by Robert E. Howard
-- Halt! Who Goes There by Robert E. Howard
-- Hawk of the Hills by Robert E. Howard
-- Hawks of Outremer by Robert E. Howard
-- Hilda Wade, a Woman with Tenacity of Purpose by Grant Allen
-- Horsesense Hank does his bit by Nelson S. Bond
-- Hour of the Dragon by Robert E. Howard
-- In Queer Street by Fergus Hume
-- In the Forest of Villefère by Robert E. Howard
-- In the year 2889 by Michel Verne, Jules Verne
-- Industrial Revolution by Poul Anderson
-- Jewels of Gwahlur by Robert E. Howard
-- Jonah of the Jove-Run by Ray Bradbury
-- Key Out of Time by Andre Norton
-- Later Than You Think by Fritz Leiber
-- Let 'Em Breathe Space! by Lester Del Rey
-- Lord of Samarcand by Robert E. Howard
-- Lord of a Thousand Suns by Poul Anderson
-- Love and Mr. Lewisham by H. G. (Herbert George) Wells
-- Marjorie's Vacation by Carolyn Wells
-- Masters of Space by E. E. (Edward Elmer) Smith, E. Everett (Edward Everett) Evans
-- Men of Iron by Howard Pyle
-- Meridiana: The Adventures of Three Englishmen and Three Russians - In  South Africa by Jules Verne
-- Midnight In Beauchamp Row - 1895 by Anna Katharine Green
-- Mr. Spaceship by Philip K. Dick
-- My Lord Duke by E. W. (Ernest William) Hornung
-- Names in the Black Book by Robert E. Howard
-- Night of Battle by Robert E. Howard
-- Oomphel in the Sky by H. Beam Piper
-- Operation R.S.V.P. by H. Beam Piper
-- Out of the Iron Womb! by Poul Anderson
-- Patty and Azalea by Carolyn Wells
-- People of the Black Circle by Robert E. Howard
-- Police Operation by H. Beam Piper
-- Queen of the Black Coast by Robert E. Howard
-- Rattle of Bones by Robert E. Howard
-- Rebel Raider by H. Beam Piper
-- Red Blades of Black Cathay by Robert E. Howard
-- Red Nails by Robert E. Howard
-- Red Shadows by Robert E. Howard
-- Revolt on Io by Nelson S. Bond
-- Richard Dare's Venture; Or, Striking Out for Himself by Edward Stratemeyer
-- Rip Foster Rides the Gray Planet by Harold L. (Harold Leland) Goodwin
-- Rogues in the House by Robert E. Howard
-- Sailors' Grudge by Robert E. Howard
-- Sea-Curse by Robert E. Howard
-- Shadows in Zamboula by Robert E. Howard
-- Shadows in the Moonlight by Robert E. Howard
-- She Devil by Robert E. Howard
-- Skull-face by Robert E. Howard
-- Skulls in the Stars by Robert E. Howard
-- Sluggers on the Beach by Robert E. Howard
-- Son of the White Wolf by Robert E. Howard
-- Spacehounds of IPC by E. E. (Edward Elmer) Smith
-- Spies Die Hard! by Arnold Marmor
-- Swords of the Red Brotherhood by Robert E. Howard
-- Tarzan and the Ant Men by Edgar Rice Burroughs
-- Tarzan and the City of Gold by Edgar Rice Burroughs
-- Tarzan at the Earth's core by Edgar Rice Burroughs
-- Texas Fists by Robert E. Howard
-- The Amethyst Cross by Fergus Hume
-- The Answer by H. Beam Piper
-- The Ashiel mystery :  a detective story by Bryce
-- The Babbington case; Or, Nick Carter's strange quest by Carter
-- The Big Engine by Fritz Leiber
-- The Blood of Belshazzar by Robert E. Howard
-- The Blue Ghost Mystery: A Rick Brant Science-Adventure Story by Harold L. (Harold Leland) Goodwin
-- The Boss of Taroomba by E. W. (Ernest William) Hornung
-- The Bronze Hand - 1897 by Anna Katharine Green
-- The Bull Dog Breed by Robert E. Howard
-- The Cairn on the Headland by Robert E. Howard
-- The Chessmen of Mars by Edgar Rice Burroughs
-- The Circular Study by Anna Katharine Green
-- The Come Back by Carolyn Wells
-- The Country of the Knife by Robert E. Howard
-- The Crock of Gold by James Stephens
-- The Dark Other by Stanley G. (Stanley Grauman) Weinbaum
-- The Daughter of Erlik Khan by Robert E. Howard
-- The Defenders by Philip K. Dick
-- The Defiant Agents by Andre Norton
-- The Devil in Iron by Robert E. Howard
-- The Dragon of Kao Tsu by Robert E. Howard
-- The Dream Snake by Robert E. Howard
-- The Fearsome Touch of Death by Robert E. Howard
-- The Food of the Gods and How It Came to Earth by H. G. (Herbert George) Wells
-- The Galaxy Primes by E. E. (Edward Elmer) Smith
-- The Garden of Fear by Robert E. Howard
-- The Gates of Dawn by Fergus Hume
-- The Gentleman Who Vanished: A Psychological Phantasy by Fergus Hume
-- The Goose Girl by Harold MacGrath
-- The Green Millennium by Fritz Leiber
-- The Grisly Horror by Robert E. Howard
-- The Gun Club boys of Lakeport :  or, The island camp by Edward Stratemeyer
-- The Hanging Stranger by Philip K. Dick
-- The Haunter of the Ring by Robert E. Howard
-- The Hollow Land by William Morris
-- The House of Whispers by William Le Queux
-- The House of the Wolfings - A Tale of the House of the Wolfings and All the Kindreds of the Mark Written in Prose and in Verse by William Morris
-- The House on the Borderland by William Hope Hodgson
-- The Hyena by Robert E. Howard
-- The Insidious Dr. Fu Manchu by Sax Rohmer
-- The Isle of Pirate's Doom by Robert E. Howard
-- The K-Factor by Harry Harrison
-- The King's Service by Robert E. Howard
-- The King of the Golden River by John Ruskin
-- The Land That Time Forgot by Edgar Rice Burroughs
-- The Life and Adventures of Santa Claus by L. Frank (Lyman Frank) Baum
-- The Lion of Tiberias by Robert E. Howard
-- The Lost Race by Robert E. Howard
-- The Lost Valley of Iskander by Robert E. Howard
-- The Man Who Knew Too Much by G. K. (Gilbert Keith) Chesterton
-- The Man Without a Conscience; Or, From Rogue to Convict by Carter
-- The Man in the Brown Suit by Agatha Christie
-- The Mercenaries by H. Beam Piper
-- The Middle of Things by J. S. (Joseph Smith) Fletcher
-- The Million Dollar Mystery - Novelized from the Scenario of F. Lonergan by Harold MacGrath, Lonergan
-- The Mirrors of Tuzun Thune by Robert E. Howard
-- The Moon Maid by Edgar Rice Burroughs
-- The Mystery Boys and the Inca Gold by Van Powell
-- The Mystery Girl by Carolyn Wells
-- The Mystery Queen by Fergus Hume
-- The Pagan Madonna by Harold MacGrath
-- The People That Time Forgot by Edgar Rice Burroughs
-- The Phoenix on the Sword by Robert E. Howard
-- The Pink Shop by Fergus Hume
-- The Pit of the Serpent by Robert E. Howard
-- The Plot That Failed; or, When Men Conspire by Carter
-- The Pool of the Black One by Robert E. Howard
-- The Postmaster's Daughter by Louis Tracy
-- The Princess and Curdie by George MacDonald
-- The Princess and the Goblin by George MacDonald
-- The Purple Heart of Erlik by Robert E. Howard
-- The Return of Tarzan by Edgar Rice Burroughs
-- The Rover Boys Shipwrecked; or, A Thrilling Hunt for Pirates' Gold by Edward Stratemeyer
-- The Rover Boys at Big Bear Lake; or, The Camps of the Rival Cadets by Edward Stratemeyer
-- The Rover Boys at Big Horn Ranch; Or, The Cowboys' Double Round-Up by Edward Stratemeyer
-- The Rover Boys in the Land of Luck; Or, Stirring Adventures in the Oil Fields by Edward Stratemeyer
-- The Scarlet Citadel by Robert E. Howard
-- The Sea Lady by H. G. (Herbert George) Wells
-- The Secret of the Island by Jules Verne
-- The Shadow Kingdom by Robert E. Howard
-- The Shadow of the Vulture by Robert E. Howard
-- The Sign of the Snake by Robert E. Howard
-- The Silent Alarm by Roy J. (Roy Judson) Snell
-- The Skull by Philip K. Dick
-- The Slithering Shadow by Robert E. Howard
-- The Slugger's Game by Robert E. Howard
-- The Sowers of Thunder by Robert E. Howard
-- The Story of the Glittering Plain - Which Has Been Also Called the Land of Living Men or the Acre of the Undying by William Morris
-- The Strange Case of Mortimer Fenley by Louis Tracy
-- The Street of Seven Stars by Mary Roberts Rinehart
-- The TNT Punch by Robert E. Howard
-- The Tomb's Secret by Robert E. Howard
-- The Tower of the Elephant by Robert E. Howard
-- The Treasure of Tartary by Robert E. Howard
-- The Twin Mystery; Or, A Dashing Rescue by Carter
-- The Ultimate Salient by Nelson S. Bond
-- The Underground City; Or, The Black Indies - (Sometimes Called The Child of the Cavern) by Jules Verne
-- The Valley of the Worm by Robert E. Howard
-- The Valor of Cappen Varra by Poul Anderson
-- The Vanishing of Betty Varian by Carolyn Wells
-- The Velvet Glove by Harry Harrison
-- The Vortex Blaster by E. E. (Edward Elmer) Smith
-- The Vultures of Whapeton by Robert E. Howard
-- The Wonderful Wizard of Oz by L. Frank (Lyman Frank) Baum
-- The Wooden Hand: A Detective Story by Fergus Hume
-- The World's Desire by H. Rider (Henry Rider) Haggard, Andrew Lang
-- The Worlds of If by Stanley G. (Stanley Grauman) Weinbaum
-- The Cave Girl by Edgar Rice Burroughs
-- The fire of Asshurbanipal by Robert E. Howard
-- The land of hidden men by Edgar Rice Burroughs
-- The madness of Lancelot Biggs by Nelson S. Bond
-- The Ordeal of Lancelot Biggs by Nelson S. Bond
-- The Scientific Pioneer Returns by Nelson S. Bond
-- The Stainless Steel Rat by Harry Harrison
-- Time In the Round by Fritz Leiber
-- Trent's Last Case by E. C. (Edmund Clerihew) Bentley
-- Trouble on Tycho by Nelson S. Bond
-- Two Little Women and Treasure House by Carolyn Wells
-- Under the Tiger's Claws; Or, A Struggle for the Right by Nicholas Carter
-- Valley of Dreams by Stanley G. (Stanley Grauman) Weinbaum
-- Vikings of the Gloves by Robert E. Howard
-- Voice from the Cave by Mildred A. (Mildred Augustine) Wirt
-- Waterfront Fists by Robert E. Howard
-- Where There's a Will by Mary Roberts Rinehart
-- While the Smoke Rolled by Robert E. Howard
-- Whose Body? A Lord Peter Wimsey Novel by Dorothy L. (Dorothy Leigh) Sayers
-- Winner Take All by Robert E. Howard
-- Witch of the Demon Seas by Poul Anderson
-- Wolfshead by Robert E. Howard
-- X Marks the Pedwalk by Fritz Leiber
+I used unsloth to do the finetuning on a rented GPU (H100) for 2 epochs. Thanks to everybody who made this possible: the unsloth brothers, folks behind KoboldCPP, team behind Mistral Nemo, organizers and volunteers from Gutenberg.org... there's probably more. Thanks everybody.