Instructions to use AppleMind-AI/AppleMind-1.0-Mini with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use AppleMind-AI/AppleMind-1.0-Mini with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="AppleMind-AI/AppleMind-1.0-Mini")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("AppleMind-AI/AppleMind-1.0-Mini")
model = AutoModelForCausalLM.from_pretrained("AppleMind-AI/AppleMind-1.0-Mini", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use AppleMind-AI/AppleMind-1.0-Mini with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "AppleMind-AI/AppleMind-1.0-Mini"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "AppleMind-AI/AppleMind-1.0-Mini",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/AppleMind-AI/AppleMind-1.0-Mini

SGLang

How to use AppleMind-AI/AppleMind-1.0-Mini with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "AppleMind-AI/AppleMind-1.0-Mini" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "AppleMind-AI/AppleMind-1.0-Mini",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "AppleMind-AI/AppleMind-1.0-Mini" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "AppleMind-AI/AppleMind-1.0-Mini",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use AppleMind-AI/AppleMind-1.0-Mini with Docker Model Runner:
```
docker model run hf.co/AppleMind-AI/AppleMind-1.0-Mini
```

AppleMind-1.0-Mini / LOGS.md

GGUFGuy

Create LOGS.md

02508d4 verified about 5 hours ago

preview code

Raw

History Blame Contribute Delete

53.9 kB

device1JHU-54EFWaiting for authorization...Login successful. Logged in as GGUFGuy (token: oauth-GGUFGuy).This token will be refreshed automatically when it expires.

AppleMind 1.0 Mini Colab L4 High-RAM 300M TOKEN PRETRAINING

Device: cuda GPU: NVIDIA L4 VRAM: 22.03 GB CUDA: 12.8

Total training tokens: 300,000,000 Target ratio: ~300:1

====================================================================== DATASET MIXTURE

FineWeb-Edu sample-10BT : 100,000,000 FineWeb-HQ : 100,000,000 SmolLM-Corpus : 100,000,000

TOTAL : 300,000,000

TinyStories: REMOVED WikiText: REMOVED Local datasets: REMOVED Dataset cycling: DISABLED

====================================================================== LOADING GPT-2 TOKENIZER

tokenizer_config.json: 100% 26.0/26.0 [00:00<00:00, 3.04kB/s]vocab.json: 100% 1.04M/1.04M [00:00<00:00, 15.7MB/s]merges.txt: 100% 456k/456k [00:00<00:00, 5.83MB/s]tokenizer.json: 100% 1.36M/1.36M [00:00<00:00, 28.9MB/s] Vocabulary: 50,260 Special tokens added: 3

====================================================================== CREATING APPLEMIND

Parameters: 1,020,480 Trainable: 1,020,480

Target tokens: 300,000,000 Target token/parameter ratio: 293.98:1

====================================================================== SETTING UP HUGGING FACE

Logged in as: GGUFGuy

Checkpoint repository ready: https://huggingface.co/AppleMind-AI/AppleMind-1.0-Mini-Checkpoints

Final model repository ready: https://huggingface.co/AppleMind-AI/AppleMind-1.0-Mini Precision: BF16

====================================================================== TRAINING CONFIGURATION

Parameters: 1,020,480 Training tokens: 300,000,000 Tokens/parameter: 293.98:1

Micro batch size: 64 Gradient accumulation: 8 Effective batch: 512 Context length: 256 Tokens/micro batch: 16,384 Tokens/optimizer step: 131,072 Optimizer steps: 2,289 Warmup steps: 114

FineWeb-Edu: 100M FineWeb-HQ: 100M SmolLM: 100M

Checkpoint repository: AppleMind-AI/AppleMind-1.0-Mini-Checkpoints

Final repository: AppleMind-AI/AppleMind-1.0-Mini

====================================================================== STARTING 300M-TOKEN PRETRAINING

Opening FineWeb-Edu sample-10BT... README.md: 100% 26.4k/26.4k [00:00<00:00, 2.88MB/s]Resolving data files: 100% 2410/2410 [00:00<00:00, 23346.46it/s]

STREAMING FineWeb-Edu

Target tokens: 100,000,000 Progress state: 0

[transformers] loss_type=None was set in the config but it is unrecognized. Using the default loss: ForCausalLMLoss. FineWeb-Edu: 1,000,131 / 100,000,000 tokens FineWeb-Edu: 2,001,441 / 100,000,000 tokens FineWeb-Edu: 3,001,677 / 100,000,000 tokens FineWeb-Edu: 4,003,530 / 100,000,000 tokens FineWeb-Edu: 5,003,864 / 100,000,000 tokens FineWeb-Edu: 6,014,497 / 100,000,000 tokens FineWeb-Edu: 7,014,690 / 100,000,000 tokens FineWeb-Edu: 8,014,892 / 100,000,000 tokens FineWeb-Edu: 9,015,759 / 100,000,000 tokens FineWeb-Edu: 10,016,701 / 100,000,000 tokens FineWeb-Edu: 11,042,613 / 100,000,000 tokens FineWeb-Edu: 12,043,456 / 100,000,000 tokens FineWeb-Edu: 13,044,297 / 100,000,000 tokens

Saving checkpoint-100... Writing model shards: 100% 1/1 [00:00<00:00, 19.95it/s]

UPLOADING CHECKPOINT 100

No files have been modified since last commit. Skipping to prevent empty commit. WARNING:huggingface_hub._upload_pipeline:No files have been modified since last commit. Skipping to prevent empty commit.

Checkpoint uploaded to: https://huggingface.co/AppleMind-AI/AppleMind-1.0-Mini-Checkpoints/tree/main/checkpoint-100 FineWeb-Edu: 14,051,468 / 100,000,000 tokens FineWeb-Edu: 15,057,858 / 100,000,000 tokens FineWeb-Edu: 16,058,350 / 100,000,000 tokens FineWeb-Edu: 17,058,910 / 100,000,000 tokens FineWeb-Edu: 18,059,120 / 100,000,000 tokens FineWeb-Edu: 19,059,214 / 100,000,000 tokens FineWeb-Edu: 20,060,034 / 100,000,000 tokens FineWeb-Edu: 21,061,034 / 100,000,000 tokens FineWeb-Edu: 22,061,243 / 100,000,000 tokens FineWeb-Edu: 23,061,857 / 100,000,000 tokens FineWeb-Edu: 24,068,376 / 100,000,000 tokens FineWeb-Edu: 25,068,451 / 100,000,000 tokens FineWeb-Edu: 26,069,133 / 100,000,000 tokens

Saving checkpoint-200... Writing model shards: 100% 1/1 [00:00<00:00, 11.00it/s]

UPLOADING CHECKPOINT 200

Checkpoint uploaded to: https://huggingface.co/AppleMind-AI/AppleMind-1.0-Mini-Checkpoints/tree/main/checkpoint-200 FineWeb-Edu: 27,075,071 / 100,000,000 tokens FineWeb-Edu: 28,080,714 / 100,000,000 tokens FineWeb-Edu: 29,080,972 / 100,000,000 tokens FineWeb-Edu: 30,085,136 / 100,000,000 tokens FineWeb-Edu: 31,085,689 / 100,000,000 tokens FineWeb-Edu: 32,086,415 / 100,000,000 tokens FineWeb-Edu: 33,095,884 / 100,000,000 tokens FineWeb-Edu: 34,096,837 / 100,000,000 tokens FineWeb-Edu: 35,097,143 / 100,000,000 tokens FineWeb-Edu: 36,097,343 / 100,000,000 tokens FineWeb-Edu: 37,104,064 / 100,000,000 tokens FineWeb-Edu: 38,104,207 / 100,000,000 tokens FineWeb-Edu: 39,105,073 / 100,000,000 tokens

Saving checkpoint-300... Writing model shards: 100% 1/1 [00:00<00:00, 10.94it/s]

UPLOADING CHECKPOINT 300

Checkpoint uploaded to: https://huggingface.co/AppleMind-AI/AppleMind-1.0-Mini-Checkpoints/tree/main/checkpoint-300 Removing old local checkpoint: /content/applemind-1.0-mini-checkpoints/checkpoint-100 FineWeb-Edu: 40,107,907 / 100,000,000 tokens FineWeb-Edu: 41,108,319 / 100,000,000 tokens FineWeb-Edu: 42,108,687 / 100,000,000 tokens FineWeb-Edu: 43,108,744 / 100,000,000 tokens FineWeb-Edu: 44,109,584 / 100,000,000 tokens FineWeb-Edu: 45,109,641 / 100,000,000 tokens FineWeb-Edu: 46,110,333 / 100,000,000 tokens FineWeb-Edu: 47,110,722 / 100,000,000 tokens FineWeb-Edu: 48,111,125 / 100,000,000 tokens FineWeb-Edu: 49,111,530 / 100,000,000 tokens FineWeb-Edu: 50,113,218 / 100,000,000 tokens FineWeb-Edu: 51,113,865 / 100,000,000 tokens FineWeb-Edu: 52,114,128 / 100,000,000 tokens

Saving checkpoint-400... Writing model shards: 100% 1/1 [00:00<00:00, 10.91it/s]

UPLOADING CHECKPOINT 400

Checkpoint uploaded to: https://huggingface.co/AppleMind-AI/AppleMind-1.0-Mini-Checkpoints/tree/main/checkpoint-400 Removing old local checkpoint: /content/applemind-1.0-mini-checkpoints/checkpoint-200 FineWeb-Edu: 53,114,351 / 100,000,000 tokens FineWeb-Edu: 54,115,268 / 100,000,000 tokens FineWeb-Edu: 55,115,867 / 100,000,000 tokens FineWeb-Edu: 56,118,747 / 100,000,000 tokens FineWeb-Edu: 57,118,792 / 100,000,000 tokens FineWeb-Edu: 58,129,696 / 100,000,000 tokens FineWeb-Edu: 59,129,772 / 100,000,000 tokens FineWeb-Edu: 60,130,463 / 100,000,000 tokens FineWeb-Edu: 61,130,846 / 100,000,000 tokens FineWeb-Edu: 62,131,974 / 100,000,000 tokens FineWeb-Edu: 63,145,958 / 100,000,000 tokens FineWeb-Edu: 64,146,051 / 100,000,000 tokens FineWeb-Edu: 65,146,257 / 100,000,000 tokens

Saving checkpoint-500... Writing model shards: 100% 1/1 [00:00<00:00, 10.95it/s]

UPLOADING CHECKPOINT 500

Checkpoint uploaded to: https://huggingface.co/AppleMind-AI/AppleMind-1.0-Mini-Checkpoints/tree/main/checkpoint-500 Removing old local checkpoint: /content/applemind-1.0-mini-checkpoints/checkpoint-300 FineWeb-Edu: 66,147,176 / 100,000,000 tokens FineWeb-Edu: 67,153,903 / 100,000,000 tokens FineWeb-Edu: 68,163,652 / 100,000,000 tokens FineWeb-Edu: 69,164,783 / 100,000,000 tokens FineWeb-Edu: 70,166,355 / 100,000,000 tokens FineWeb-Edu: 71,166,545 / 100,000,000 tokens FineWeb-Edu: 72,167,733 / 100,000,000 tokens FineWeb-Edu: 73,168,881 / 100,000,000 tokens FineWeb-Edu: 74,175,780 / 100,000,000 tokens FineWeb-Edu: 75,176,435 / 100,000,000 tokens FineWeb-Edu: 76,177,413 / 100,000,000 tokens FineWeb-Edu: 77,177,431 / 100,000,000 tokens FineWeb-Edu: 78,179,729 / 100,000,000 tokens

Saving checkpoint-600... Writing model shards: 100% 1/1 [00:00<00:00, 10.96it/s]

UPLOADING CHECKPOINT 600

Checkpoint uploaded to: https://huggingface.co/AppleMind-AI/AppleMind-1.0-Mini-Checkpoints/tree/main/checkpoint-600 Removing old local checkpoint: /content/applemind-1.0-mini-checkpoints/checkpoint-400 FineWeb-Edu: 79,187,841 / 100,000,000 tokens FineWeb-Edu: 80,187,924 / 100,000,000 tokens FineWeb-Edu: 81,188,888 / 100,000,000 tokens FineWeb-Edu: 82,189,255 / 100,000,000 tokens FineWeb-Edu: 83,189,443 / 100,000,000 tokens FineWeb-Edu: 84,192,547 / 100,000,000 tokens FineWeb-Edu: 85,192,626 / 100,000,000 tokens FineWeb-Edu: 86,193,916 / 100,000,000 tokens FineWeb-Edu: 87,194,129 / 100,000,000 tokens FineWeb-Edu: 88,196,386 / 100,000,000 tokens FineWeb-Edu: 89,203,193 / 100,000,000 tokens FineWeb-Edu: 90,203,499 / 100,000,000 tokens FineWeb-Edu: 91,204,016 / 100,000,000 tokens

Saving checkpoint-700... Writing model shards: 100% 1/1 [00:00<00:00, 10.96it/s]

UPLOADING CHECKPOINT 700

Checkpoint uploaded to: https://huggingface.co/AppleMind-AI/AppleMind-1.0-Mini-Checkpoints/tree/main/checkpoint-700 Removing old local checkpoint: /content/applemind-1.0-mini-checkpoints/checkpoint-500 FineWeb-Edu: 92,205,445 / 100,000,000 tokens FineWeb-Edu: 93,206,406 / 100,000,000 tokens FineWeb-Edu: 94,215,721 / 100,000,000 tokens FineWeb-Edu: 95,216,609 / 100,000,000 tokens FineWeb-Edu: 96,218,844 / 100,000,000 tokens FineWeb-Edu: 97,219,420 / 100,000,000 tokens FineWeb-Edu: 98,219,961 / 100,000,000 tokens FineWeb-Edu: 99,220,378 / 100,000,000 tokens

FineWeb-Edu complete: 100,000,000 tokens Opening FineWeb-HQ... README.md: 100% 4.65k/4.65k [00:00<00:00, 385kB/s]Resolving data files: 100% 9246/9246 [00:00<00:00, 25238.04it/s]

STREAMING FineWeb-HQ

Target tokens: 100,000,000 Progress state: 0

FineWeb-HQ: 1,000,237 / 100,000,000 tokens FineWeb-HQ: 2,000,353 / 100,000,000 tokens FineWeb-HQ: 3,000,648 / 100,000,000 tokens FineWeb-HQ: 4,001,578 / 100,000,000 tokens

Saving checkpoint-800... Writing model shards: 100% 1/1 [00:00<00:00, 10.89it/s]

UPLOADING CHECKPOINT 800

Checkpoint uploaded to: https://huggingface.co/AppleMind-AI/AppleMind-1.0-Mini-Checkpoints/tree/main/checkpoint-800 Removing old local checkpoint: /content/applemind-1.0-mini-checkpoints/checkpoint-600 FineWeb-HQ: 5,003,165 / 100,000,000 tokens FineWeb-HQ: 6,003,192 / 100,000,000 tokens FineWeb-HQ: 7,003,245 / 100,000,000 tokens FineWeb-HQ: 8,005,095 / 100,000,000 tokens FineWeb-HQ: 9,005,500 / 100,000,000 tokens FineWeb-HQ: 10,005,995 / 100,000,000 tokens FineWeb-HQ: 11,006,275 / 100,000,000 tokens FineWeb-HQ: 12,006,703 / 100,000,000 tokens FineWeb-HQ: 13,008,348 / 100,000,000 tokens FineWeb-HQ: 14,039,910 / 100,000,000 tokens FineWeb-HQ: 15,040,042 / 100,000,000 tokens FineWeb-HQ: 16,040,179 / 100,000,000 tokens FineWeb-HQ: 17,040,530 / 100,000,000 tokens

Saving checkpoint-900... Writing model shards: 100% 1/1 [00:00<00:00, 10.94it/s]

UPLOADING CHECKPOINT 900

Checkpoint uploaded to: https://huggingface.co/AppleMind-AI/AppleMind-1.0-Mini-Checkpoints/tree/main/checkpoint-900 Removing old local checkpoint: /content/applemind-1.0-mini-checkpoints/checkpoint-700 FineWeb-HQ: 18,045,133 / 100,000,000 tokens FineWeb-HQ: 19,053,155 / 100,000,000 tokens FineWeb-HQ: 20,053,155 / 100,000,000 tokens FineWeb-HQ: 21,053,631 / 100,000,000 tokens FineWeb-HQ: 22,061,664 / 100,000,000 tokens FineWeb-HQ: 23,061,940 / 100,000,000 tokens FineWeb-HQ: 24,062,978 / 100,000,000 tokens FineWeb-HQ: 25,063,229 / 100,000,000 tokens FineWeb-HQ: 26,073,081 / 100,000,000 tokens FineWeb-HQ: 27,073,220 / 100,000,000 tokens FineWeb-HQ: 28,073,681 / 100,000,000 tokens FineWeb-HQ: 29,073,966 / 100,000,000 tokens FineWeb-HQ: 30,074,272 / 100,000,000 tokens

Saving checkpoint-1000... Writing model shards: 100% 1/1 [00:00<00:00, 10.99it/s]

UPLOADING CHECKPOINT 1000

Checkpoint uploaded to: https://huggingface.co/AppleMind-AI/AppleMind-1.0-Mini-Checkpoints/tree/main/checkpoint-1000 Removing old local checkpoint: /content/applemind-1.0-mini-checkpoints/checkpoint-800 FineWeb-HQ: 31,075,196 / 100,000,000 tokens FineWeb-HQ: 32,075,679 / 100,000,000 tokens FineWeb-HQ: 33,077,041 / 100,000,000 tokens FineWeb-HQ: 34,077,283 / 100,000,000 tokens FineWeb-HQ: 35,077,442 / 100,000,000 tokens FineWeb-HQ: 36,078,144 / 100,000,000 tokens FineWeb-HQ: 37,078,751 / 100,000,000 tokens FineWeb-HQ: 38,080,143 / 100,000,000 tokens FineWeb-HQ: 39,082,841 / 100,000,000 tokens FineWeb-HQ: 40,083,517 / 100,000,000 tokens FineWeb-HQ: 41,084,347 / 100,000,000 tokens FineWeb-HQ: 42,087,132 / 100,000,000 tokens FineWeb-HQ: 43,087,302 / 100,000,000 tokens FineWeb-HQ: 44,087,920 / 100,000,000 tokens

Saving checkpoint-1100... Writing model shards: 100% 1/1 [00:00<00:00, 10.97it/s]

UPLOADING CHECKPOINT 1100

Checkpoint uploaded to: https://huggingface.co/AppleMind-AI/AppleMind-1.0-Mini-Checkpoints/tree/main/checkpoint-1100 Removing old local checkpoint: /content/applemind-1.0-mini-checkpoints/checkpoint-900 FineWeb-HQ: 45,091,588 / 100,000,000 tokens FineWeb-HQ: 46,091,666 / 100,000,000 tokens FineWeb-HQ: 47,091,765 / 100,000,000 tokens FineWeb-HQ: 48,093,667 / 100,000,000 tokens FineWeb-HQ: 49,095,400 / 100,000,000 tokens FineWeb-HQ: 50,100,158 / 100,000,000 tokens FineWeb-HQ: 51,103,033 / 100,000,000 tokens FineWeb-HQ: 52,103,833 / 100,000,000 tokens FineWeb-HQ: 53,103,842 / 100,000,000 tokens FineWeb-HQ: 54,105,589 / 100,000,000 tokens FineWeb-HQ: 55,106,976 / 100,000,000 tokens FineWeb-HQ: 56,108,077 / 100,000,000 tokens FineWeb-HQ: 57,108,658 / 100,000,000 tokens

Saving checkpoint-1200... Writing model shards: 100% 1/1 [00:00<00:00, 10.94it/s]

UPLOADING CHECKPOINT 1200

Checkpoint uploaded to: https://huggingface.co/AppleMind-AI/AppleMind-1.0-Mini-Checkpoints/tree/main/checkpoint-1200 Removing old local checkpoint: /content/applemind-1.0-mini-checkpoints/checkpoint-1000 FineWeb-HQ: 58,108,705 / 100,000,000 tokens FineWeb-HQ: 59,109,817 / 100,000,000 tokens FineWeb-HQ: 60,115,751 / 100,000,000 tokens FineWeb-HQ: 61,116,056 / 100,000,000 tokens FineWeb-HQ: 62,116,477 / 100,000,000 tokens FineWeb-HQ: 63,116,951 / 100,000,000 tokens FineWeb-HQ: 64,118,012 / 100,000,000 tokens FineWeb-HQ: 65,122,172 / 100,000,000 tokens FineWeb-HQ: 66,122,389 / 100,000,000 tokens FineWeb-HQ: 67,124,930 / 100,000,000 tokens FineWeb-HQ: 68,124,933 / 100,000,000 tokens FineWeb-HQ: 69,126,235 / 100,000,000 tokens FineWeb-HQ: 70,127,674 / 100,000,000 tokens

Saving checkpoint-1300... Writing model shards: 100% 1/1 [00:00<00:00, 10.95it/s]

UPLOADING CHECKPOINT 1300

Checkpoint uploaded to: https://huggingface.co/AppleMind-AI/AppleMind-1.0-Mini-Checkpoints/tree/main/checkpoint-1300 Removing old local checkpoint: /content/applemind-1.0-mini-checkpoints/checkpoint-1100 FineWeb-HQ: 71,128,320 / 100,000,000 tokens FineWeb-HQ: 72,130,508 / 100,000,000 tokens FineWeb-HQ: 73,131,425 / 100,000,000 tokens FineWeb-HQ: 74,145,259 / 100,000,000 tokens FineWeb-HQ: 75,168,512 / 100,000,000 tokens FineWeb-HQ: 76,169,236 / 100,000,000 tokens FineWeb-HQ: 77,170,751 / 100,000,000 tokens FineWeb-HQ: 78,171,712 / 100,000,000 tokens FineWeb-HQ: 79,171,903 / 100,000,000 tokens FineWeb-HQ: 80,172,653 / 100,000,000 tokens FineWeb-HQ: 81,180,767 / 100,000,000 tokens FineWeb-HQ: 82,209,091 / 100,000,000 tokens FineWeb-HQ: 83,210,028 / 100,000,000 tokens

Saving checkpoint-1400... Writing model shards: 100% 1/1 [00:00<00:00, 10.83it/s]

UPLOADING CHECKPOINT 1400

Checkpoint uploaded to: https://huggingface.co/AppleMind-AI/AppleMind-1.0-Mini-Checkpoints/tree/main/checkpoint-1400 Removing old local checkpoint: /content/applemind-1.0-mini-checkpoints/checkpoint-1200 FineWeb-HQ: 84,221,481 / 100,000,000 tokens FineWeb-HQ: 85,221,902 / 100,000,000 tokens FineWeb-HQ: 86,221,927 / 100,000,000 tokens FineWeb-HQ: 87,224,781 / 100,000,000 tokens FineWeb-HQ: 88,226,957 / 100,000,000 tokens FineWeb-HQ: 89,227,905 / 100,000,000 tokens FineWeb-HQ: 90,230,257 / 100,000,000 tokens FineWeb-HQ: 91,234,535 / 100,000,000 tokens FineWeb-HQ: 92,235,135 / 100,000,000 tokens FineWeb-HQ: 93,235,228 / 100,000,000 tokens FineWeb-HQ: 94,235,284 / 100,000,000 tokens FineWeb-HQ: 95,242,150 / 100,000,000 tokens FineWeb-HQ: 96,254,650 / 100,000,000 tokens

Saving checkpoint-1500... Writing model shards: 100% 1/1 [00:00<00:00, 10.86it/s]

UPLOADING CHECKPOINT 1500

Checkpoint uploaded to: https://huggingface.co/AppleMind-AI/AppleMind-1.0-Mini-Checkpoints/tree/main/checkpoint-1500 Removing old local checkpoint: /content/applemind-1.0-mini-checkpoints/checkpoint-1300 FineWeb-HQ: 97,258,984 / 100,000,000 tokens FineWeb-HQ: 98,259,041 / 100,000,000 tokens FineWeb-HQ: 99,263,648 / 100,000,000 tokens

FineWeb-HQ complete: 100,000,000 tokens Opening SmolLM-Corpus cosmopedia-v2... README.md: 100% 7.05k/7.05k [00:00<00:00, 847kB/s]Resolving data files: 100% 104/104 [00:00<00:00, 6458.13it/s]Resolving data files: 100% 104/104 [00:00<00:00, 7784.83it/s]

STREAMING SmolLM-Corpus

Target tokens: 100,000,000 Progress state: 0

SmolLM-Corpus: 1,000,389 / 100,000,000 tokens SmolLM-Corpus: 2,000,612 / 100,000,000 tokens SmolLM-Corpus: 3,000,937 / 100,000,000 tokens SmolLM-Corpus: 4,001,355 / 100,000,000 tokens SmolLM-Corpus: 5,001,629 / 100,000,000 tokens SmolLM-Corpus: 6,002,147 / 100,000,000 tokens SmolLM-Corpus: 7,002,160 / 100,000,000 tokens SmolLM-Corpus: 8,002,233 / 100,000,000 tokens SmolLM-Corpus: 9,002,382 / 100,000,000 tokens

Saving checkpoint-1600... Writing model shards: 100% 1/1 [00:00<00:00, 10.94it/s]

UPLOADING CHECKPOINT 1600

Checkpoint uploaded to: https://huggingface.co/AppleMind-AI/AppleMind-1.0-Mini-Checkpoints/tree/main/checkpoint-1600 Removing old local checkpoint: /content/applemind-1.0-mini-checkpoints/checkpoint-1400 SmolLM-Corpus: 10,002,523 / 100,000,000 tokens SmolLM-Corpus: 11,002,661 / 100,000,000 tokens SmolLM-Corpus: 12,003,098 / 100,000,000 tokens SmolLM-Corpus: 13,003,147 / 100,000,000 tokens SmolLM-Corpus: 14,004,159 / 100,000,000 tokens SmolLM-Corpus: 15,004,183 / 100,000,000 tokens SmolLM-Corpus: 16,004,330 / 100,000,000 tokens SmolLM-Corpus: 17,005,124 / 100,000,000 tokens SmolLM-Corpus: 18,005,586 / 100,000,000 tokens SmolLM-Corpus: 19,006,013 / 100,000,000 tokens SmolLM-Corpus: 20,006,056 / 100,000,000 tokens SmolLM-Corpus: 21,006,417 / 100,000,000 tokens SmolLM-Corpus: 22,006,642 / 100,000,000 tokens

Saving checkpoint-1700... Writing model shards: 100% 1/1 [00:00<00:00, 11.01it/s]

UPLOADING CHECKPOINT 1700

Checkpoint uploaded to: https://huggingface.co/AppleMind-AI/AppleMind-1.0-Mini-Checkpoints/tree/main/checkpoint-1700 Removing old local checkpoint: /content/applemind-1.0-mini-checkpoints/checkpoint-1500 SmolLM-Corpus: 23,007,410 / 100,000,000 tokens SmolLM-Corpus: 24,007,513 / 100,000,000 tokens SmolLM-Corpus: 25,008,024 / 100,000,000 tokens SmolLM-Corpus: 26,008,152 / 100,000,000 tokens SmolLM-Corpus: 27,008,820 / 100,000,000 tokens SmolLM-Corpus: 28,009,655 / 100,000,000 tokens SmolLM-Corpus: 29,009,777 / 100,000,000 tokens SmolLM-Corpus: 30,010,160 / 100,000,000 tokens SmolLM-Corpus: 31,010,762 / 100,000,000 tokens SmolLM-Corpus: 32,010,887 / 100,000,000 tokens SmolLM-Corpus: 33,011,339 / 100,000,000 tokens SmolLM-Corpus: 34,011,816 / 100,000,000 tokens SmolLM-Corpus: 35,012,785 / 100,000,000 tokens

Saving checkpoint-1800... Writing model shards: 100% 1/1 [00:00<00:00, 11.00it/s]

UPLOADING CHECKPOINT 1800

Checkpoint uploaded to: https://huggingface.co/AppleMind-AI/AppleMind-1.0-Mini-Checkpoints/tree/main/checkpoint-1800 Removing old local checkpoint: /content/applemind-1.0-mini-checkpoints/checkpoint-1600 SmolLM-Corpus: 36,013,511 / 100,000,000 tokens SmolLM-Corpus: 37,013,686 / 100,000,000 tokens SmolLM-Corpus: 38,015,046 / 100,000,000 tokens SmolLM-Corpus: 39,015,520 / 100,000,000 tokens SmolLM-Corpus: 40,016,051 / 100,000,000 tokens SmolLM-Corpus: 41,016,215 / 100,000,000 tokens SmolLM-Corpus: 42,016,528 / 100,000,000 tokens SmolLM-Corpus: 43,016,537 / 100,000,000 tokens SmolLM-Corpus: 44,016,544 / 100,000,000 tokens SmolLM-Corpus: 45,017,221 / 100,000,000 tokens SmolLM-Corpus: 46,017,703 / 100,000,000 tokens SmolLM-Corpus: 47,017,830 / 100,000,000 tokens SmolLM-Corpus: 48,018,530 / 100,000,000 tokens SmolLM-Corpus: 49,019,055 / 100,000,000 tokens

Saving checkpoint-1900... Writing model shards: 100% 1/1 [00:00<00:00, 11.07it/s]

UPLOADING CHECKPOINT 1900

Checkpoint uploaded to: https://huggingface.co/AppleMind-AI/AppleMind-1.0-Mini-Checkpoints/tree/main/checkpoint-1900 Removing old local checkpoint: /content/applemind-1.0-mini-checkpoints/checkpoint-1700 SmolLM-Corpus: 50,019,088 / 100,000,000 tokens SmolLM-Corpus: 51,019,166 / 100,000,000 tokens SmolLM-Corpus: 52,019,182 / 100,000,000 tokens SmolLM-Corpus: 53,019,341 / 100,000,000 tokens SmolLM-Corpus: 54,019,557 / 100,000,000 tokens SmolLM-Corpus: 55,019,622 / 100,000,000 tokens SmolLM-Corpus: 56,020,576 / 100,000,000 tokens SmolLM-Corpus: 57,021,061 / 100,000,000 tokens SmolLM-Corpus: 58,021,198 / 100,000,000 tokens SmolLM-Corpus: 59,022,144 / 100,000,000 tokens SmolLM-Corpus: 60,022,635 / 100,000,000 tokens SmolLM-Corpus: 61,022,949 / 100,000,000 tokens SmolLM-Corpus: 62,023,318 / 100,000,000 tokens

Saving checkpoint-2000... Writing model shards: 100% 1/1 [00:00<00:00, 10.99it/s]

UPLOADING CHECKPOINT 2000

Checkpoint uploaded to: https://huggingface.co/AppleMind-AI/AppleMind-1.0-Mini-Checkpoints/tree/main/checkpoint-2000 Removing old local checkpoint: /content/applemind-1.0-mini-checkpoints/checkpoint-1800 SmolLM-Corpus: 63,024,246 / 100,000,000 tokens SmolLM-Corpus: 64,024,602 / 100,000,000 tokens SmolLM-Corpus: 65,025,944 / 100,000,000 tokens SmolLM-Corpus: 66,027,471 / 100,000,000 tokens SmolLM-Corpus: 67,027,613 / 100,000,000 tokens SmolLM-Corpus: 68,028,290 / 100,000,000 tokens SmolLM-Corpus: 69,028,776 / 100,000,000 tokens SmolLM-Corpus: 70,028,797 / 100,000,000 tokens SmolLM-Corpus: 71,030,241 / 100,000,000 tokens SmolLM-Corpus: 72,030,477 / 100,000,000 tokens SmolLM-Corpus: 73,030,534 / 100,000,000 tokens SmolLM-Corpus: 74,030,705 / 100,000,000 tokens SmolLM-Corpus: 75,030,996 / 100,000,000 tokens

Saving checkpoint-2100... Writing model shards: 100% 1/1 [00:00<00:00, 10.96it/s]

UPLOADING CHECKPOINT 2100

Checkpoint uploaded to: https://huggingface.co/AppleMind-AI/AppleMind-1.0-Mini-Checkpoints/tree/main/checkpoint-2100 Removing old local checkpoint: /content/applemind-1.0-mini-checkpoints/checkpoint-1900 SmolLM-Corpus: 76,031,414 / 100,000,000 tokens SmolLM-Corpus: 77,031,466 / 100,000,000 tokens SmolLM-Corpus: 78,032,243 / 100,000,000 tokens SmolLM-Corpus: 79,032,688 / 100,000,000 tokens SmolLM-Corpus: 80,032,933 / 100,000,000 tokens SmolLM-Corpus: 81,033,099 / 100,000,000 tokens SmolLM-Corpus: 82,034,041 / 100,000,000 tokens SmolLM-Corpus: 83,034,272 / 100,000,000 tokens SmolLM-Corpus: 84,035,283 / 100,000,000 tokens SmolLM-Corpus: 85,035,460 / 100,000,000 tokens SmolLM-Corpus: 86,035,589 / 100,000,000 tokens SmolLM-Corpus: 87,036,259 / 100,000,000 tokens SmolLM-Corpus: 88,036,685 / 100,000,000 tokens

Saving checkpoint-2200... Writing model shards: 100% 1/1 [00:00<00:00, 10.98it/s]

UPLOADING CHECKPOINT 2200

Checkpoint uploaded to: https://huggingface.co/AppleMind-AI/AppleMind-1.0-Mini-Checkpoints/tree/main/checkpoint-2200 Removing old local checkpoint: /content/applemind-1.0-mini-checkpoints/checkpoint-2000 SmolLM-Corpus: 89,036,736 / 100,000,000 tokens SmolLM-Corpus: 90,037,952 / 100,000,000 tokens SmolLM-Corpus: 91,038,162 / 100,000,000 tokens SmolLM-Corpus: 92,038,464 / 100,000,000 tokens SmolLM-Corpus: 93,038,712 / 100,000,000 tokens SmolLM-Corpus: 94,038,967 / 100,000,000 tokens SmolLM-Corpus: 95,039,446 / 100,000,000 tokens SmolLM-Corpus: 96,039,542 / 100,000,000 tokens SmolLM-Corpus: 97,040,355 / 100,000,000 tokens SmolLM-Corpus: 98,041,440 / 100,000,000 tokens SmolLM-Corpus: 99,041,658 / 100,000,000 tokens

SmolLM-Corpus complete: 100,000,000 tokens

====================================================================== DATASET STREAM EXHAUSTED

Final dataset batch was incomplete. Stopping without an incomplete optimizer step.

====================================================================== TRAINING LOOP FINISHED

Completed optimizer steps: 2,288 Configured optimizer steps: 2,289

Dataset progress: FineWeb-Edu: 100,000,000 / 100,000,000 FineWeb-HQ: 100,000,000 / 100,000,000 SmolLM: 100,000,000 / 100,000,000

====================================================================== PRETRAINING FINISHED

Final steps: 2,288 Final tokens: 299,892,736 Target tokens: 300,000,000

Actual tokens/parameter: 293.87:1

====================================================================== SAVING FINAL MODEL

Writing model shards: 100% 1/1 [00:00<00:00, 21.09it/s]

UPLOADING COMPLETE MODEL TO HUGGING FACE

FINAL MODEL UPLOAD SUCCESSFUL!

Final model: https://huggingface.co/AppleMind-AI/AppleMind-1.0-Mini

====================================================================== CHAT TEMPLATE TEST

====================================================================== GENERATION TEST

Prompt: Once upon a time

Once upon a time It the several times- nowThis, does to form provide from find another times work not atl The couldWhen on all be way H It lives among times always, worked its G during work used after several There and at there b known came be very that It thought It betweenIn course does. case other It 5?: or often I at's the: enough could in many

Prompt: The little boy

The little boy's form among. I and H be from� used. still all- G, lives take same always often its find amonged provide- number because: another now? then there among use course not thought case work usel result It between 5 It well atWhen new.: thatThis work on think 3 interestB then It does could do the among Ire use among now does to and many

Prompt: In the forest

In the forest often form and times on during severall find, several The then number between: well work take there provide, times among anotherWhen same Ged but lives could the to times its- course same enough and same I used to same other not thought There H think� same 2 I body nowe cameb 5- do among's and several? same after- still,This- interest but

====================================================================== APPLE MIND 1.0 MINI COMPLETE

Parameters: 1,020,480 Tokens: 299,892,736 Tokens/parameter: 293.87:1

Dataset mixture: FineWeb-Edu: 100M FineWeb-HQ: 100M SmolLM: 100M

Checkpoint repository: https://huggingface.co/AppleMind-AI/AppleMind-1.0-Mini-Checkpoints

Final model repository: https://huggingface.co/AppleMind-AI/AppleMind-1.0-Mini

AppleMind 1.0 Mini complete!