Add inference results README

inference/README.md

@@ -0,0 +1,138 @@
+# AGILLM-3 Inference Results
+
+## Checkpoint: `pretrain_step10176997.pt`
+- **Step**: 10,176,997
+- **Tokens seen**: 8,367,019,023
+- **Model params**: 698.39M (698,389,088)
+- **Architecture**: AGILLM-3 (d=1024, layers=24, heads=16, rank=128, ALiBi, ReLU FFN 4x)
+- **Tokenizer**: deepseek-ai/DeepSeek-V3.2
+- **Device**: NVIDIA RTX 3090 24GB
+- **Date**: 2026-02-28T22:31:44Z
+- **Mode**: AR (autoregressive)
+- **Temperature**: 0.7
+- **Max new tokens**: 300
+
+## Samples
+
+### Prompt 1: `The meaning of life is`
+- Tokens: 300 | Speed: 13.7 tok/s | Time: 21.87s
+
+```
+ a given, but there are already reports of people being killed in the area.
+
+One woman living with asthma has said it is "not legally permitted to go to hospital".
+
+Paul Robeson was a superstar of the stage and screen, a talented football player and a music hitmaker. Then came a dramatic fall from grace.
+
+In a statement, the Spanish singer says the allegations are "absolutely false and deeply sadden me".
+
+Labour's Anna Perrett takes on why she object Podium girls to charity.
+
+Police say they hav
+```
+
+---
+
+### Prompt 2: `In a shocking discovery, scientists announced`
+- Tokens: 300 | Speed: 13.9 tok/s | Time: 21.63s
+
+```
+ the construction of a new building on West Africa's north-west border.
+
+The Oscar-winning actor sat down with Stafford after he was warned that 20 or 30 years of fighting for seizing white supremacy in South Sudan.
+
+A BBC programme shows councillors there are only a few minutes to stop the return of weapons - but they have been fans in Turkey's capital cities.
+
+Raphael Dean is sentenced to count income for ultrasounds as part of ongoing operations near Oban and at St Luke's School Glasgow city 
+```
+
+---
+
+### Prompt 3: `def quicksort(arr):`
+- Tokens: 300 | Speed: 14.0 tok/s | Time: 21.42s
+
+```
+ Se crea el maquillaje de la escena urbana. En algunos momentos, cuando se habla del coronavirus, es muy probable que la gente conozca si se preste a todas las leyes de la cabeza, especialmente en las zonas rurales.
+
+Soy redactora de LIFE en El HuffPost España, esa sección siempre necesaria en la que mostramos otro lado de la vida más amable y los temas que quizá no tienen cabida y comentarios sobre ella.
+
+Escribo sobre todo tipo de temas de actualidad y de temas que te interesan por su magnitud
+```
+
+---
+
+### Prompt 4: `The Great Wall of China was built`
+- Tokens: 300 | Speed: 13.8 tok/s | Time: 21.74s
+
+```
+ by the late Tiananmens, and each day its AI interactive assistant built to simulate human reasoning and optimizing them through simple-sounding navigation.
+
+"At every stage we celebrate this as well, and for the next generation of AI agents, that will be used in complex tech and manufacturing tasks, from city actors to industrial clusters such as art craftspeople or even influencers providing social support."
+
+Former New Zealand PM Samirphos Zardagala , who is also an Uber investor, has been on
+```
+
+---
+
+### Prompt 5: `Dear Mr. President, I am writing to`
+- Tokens: 300 | Speed: 13.9 tok/s | Time: 21.61s
+
+```
+ you the first line of that. We have a long history of being present but also a clear and robust woman.
+
+"Here is really great fun. Everyone who's listening and even looking forward to our new show," he said in an Instagram post.
+
+"We love it all. The good news is that we are doing it when you see your family."
+
+The Aida Novochen Foundation says it has been important for people to remember their stress levels.
+
+Researchers say more than 350 customers can reverse the effects of direct payments on
+```
+
+---
+
+### Prompt 6: `Breaking news: astronomers have detected`
+- Tokens: 300 | Speed: 13.9 tok/s | Time: 21.56s
+
+```
+ a mass number of cases of infectious diseases in the US.
+
+The woman, who was formerly infected for several months, told BBC Radio's Good Morning Scotland programme she had been pregnant with her child.
+
+Some say they will be "overwhelmed" and not yet trying to get an appointment.El presidente de Estados Unidos, Donald Trump , ha firmado este lunes un decreto para la venta ilegal y ordenada de fara adquisición de Estado Islámico (ISIS por sus siglas en inglés) por el que el republicano no ha fir
+```
+
+---
+
+### Prompt 7: `Recipe for chocolate cake: Ingredients:`
+- Tokens: 300 | Speed: 13.9 tok/s | Time: 21.56s
+
+```
+ becomes the healthiest person, including unhealthy and sweet. All of these products will have an emotional impact on your health.
+
+Your family's favorite beverage will contain a variety of foods, especially sugar. When you’re under their control, you're at increased risk for low blood sugar levels , which can cause reactions to unwanted side effects or overdose.
+
+There are plenty of good reasons to eat too much orange juice. If you decide to drink orange juice for weight-plus instead of frozen 
+```
+
+---
+
+### Prompt 8: `Once upon a time, a young dragon`
+- Tokens: 300 | Speed: 13.8 tok/s | Time: 21.74s
+
+```
+ was allowed into her house. She and her husband were separated at the age of 12.
+
+As soon as she arrived with her baby, she left behind multiple rooms, and by that point they had saved their lives. They hadn’t seen anything.
+
+The United States saw cases followed in other countries. In Italy, the Red Cross finally opened to authorities in Germany over Christmas Eve, but following an attack by police forces for citizens aged between two and four days, according to reports from Austria and Finland
+```
+
+---
+
+## Notes
+- This is a **pure pre-training checkpoint** (no SFT/RLHF)
+- The model generates fluent text but does not follow prompts coherently
+- Language mixing (English/Spanish) reflects multilingual crawl data
+- Strong bias toward news/editorial text from training distribution
+- Code prompts produce natural language, not code