GoodDavid commited on
Commit
5d151b9
·
verified ·
1 Parent(s): 41a41c6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +39 -42
README.md CHANGED
@@ -13,86 +13,83 @@ tags:
13
  - offline
14
  - local-ai
15
  - multilingual
 
16
  pipeline_tag: text-generation
17
  library_name: llama.cpp
18
  ---
19
 
20
  # Offline AI 2.1 – EuroLLM-9B-Q8_0 (GGUF)
21
 
22
- Offline AI 2.1 is the next evolution of the OfflineAI.online project.
23
 
24
- Version 1 proved a simple idea:
25
- AI can run completely offline.
26
  No cloud.
 
27
  No tracking.
28
- No data collection.
29
 
30
- Version 2.1 expands this concept into a lightweight private AI workspace designed for independent work, experimentation, and digital sovereignty.
31
-
32
- Everything runs locally.
33
- No internet connection required.
34
- No data leaves your device.
35
-
36
- This repository distributes a **quantized GGUF Q8_0 variant of the EuroLLM-9B model** for efficient offline inference via llama.cpp.
37
- The original model weights are unmodified and not fine-tuned as part of this project.
38
 
39
  ---
40
 
41
- ## 🖥️ PLATFORM
42
 
43
- macOS / Windows
44
 
45
- - No installation required
46
- - No external dependencies
47
- - No account needed
48
- - Launch and use
49
 
50
- (Platform-specific instructions remain the same as in Version 1.)
 
 
 
 
 
 
51
 
52
  ---
53
 
54
  ## 🔧 TECHNICAL INFORMATION
55
 
56
- Base model: EuroLLM-9B (quantized Q8_0 for offline execution)
57
- Format: GGUF (llama.cpp compatible)
 
58
  Runtime: llama.cpp
59
  Offline AI Version: 2.1
60
  Recommended RAM: 16 GB
61
  Platforms: macOS, Windows
62
 
63
- The EuroLLM model provides strong multilingual performance (Czech, Slovak, English, German), optimized for European language contexts. :contentReference[oaicite:2]{index=2}
 
64
 
65
  ---
66
 
67
- ## 🧠 WHAT CHANGED IN 2.1
68
 
69
  - Refined CLI architecture
 
70
  - Improved response handling
71
  - More stable execution
72
- - Cleaner interaction flow
73
- - Stronger project identity and structure
74
- - Designed as a private AI workspace rather than a simple launcher
75
 
76
- Offline AI 2.1 is not just “run model chat exit”.
77
- It is built as a foundation for future expansion while remaining minimal and fully local.
78
 
79
  ---
80
 
81
  ## 🔐 PROJECT PHILOSOPHY
82
 
83
- Offline AI exists to demonstrate that:
84
 
85
- - Modern AI does not require cloud infrastructure
86
- - Open-source models can operate independently
87
- - Digital tools can respect user privacy
88
- - AI can be used without surveillance economics
89
 
90
- This project promotes:
91
 
92
  - Digital independence
93
- - Transparency
94
- - Local-first computing
95
- - Educational experimentation
96
 
97
  ---
98
 
@@ -101,11 +98,11 @@ This project promotes:
101
  Model: EuroLLM-9B
102
  Original authors: EuroLLM Project consortium
103
  Funded by: European Union research initiatives
104
- Base model license: Apache License 2.0
105
 
106
- Quantized distribution: GGUF Q8_0 (for offline inference)
107
  Runtime: llama.cpp (MIT License)
108
- Offline AI interface and wrapper: © David Káninský
109
 
110
  All components are used in compliance with their respective licenses.
111
 
@@ -125,5 +122,5 @@ Use beyond personal, research, or educational purposes is at your own responsibi
125
  ## 🌍 PROJECT
126
 
127
  Website: https://OfflineAI.online
128
- Localizations: .cz / .sk / .de
129
- Author: David Káninský
 
13
  - offline
14
  - local-ai
15
  - multilingual
16
+ - cli-runtime
17
  pipeline_tag: text-generation
18
  library_name: llama.cpp
19
  ---
20
 
21
  # Offline AI 2.1 – EuroLLM-9B-Q8_0 (GGUF)
22
 
23
+ Offline AI 2.1 is a fully local AI runtime built around digital sovereignty, privacy, and system autonomy.
24
 
 
 
25
  No cloud.
26
+ No telemetry.
27
  No tracking.
28
+ No external dependencies.
29
 
30
+ Everything runs locally via llama.cpp.
 
 
 
 
 
 
 
31
 
32
  ---
33
 
34
+ ## 🖥️ CLI Preview
35
 
36
+ Below is the Offline AI runtime interface:
37
 
38
+ ![Offline AI CLI Help Menu](cli_help_menu.png)
 
 
 
39
 
40
+ Offline AI is not just a model launcher — it is a structured local AI workspace with:
41
+
42
+ - Profile handling
43
+ - Runtime status inspection
44
+ - Controlled execution flow
45
+ - Modular architecture foundation
46
+ - Admin mode (locked access for advanced system control)
47
 
48
  ---
49
 
50
  ## 🔧 TECHNICAL INFORMATION
51
 
52
+ Base model: EuroLLM-9B
53
+ Quantization: Q8_0 (GGUF)
54
+ Format: llama.cpp compatible
55
  Runtime: llama.cpp
56
  Offline AI Version: 2.1
57
  Recommended RAM: 16 GB
58
  Platforms: macOS, Windows
59
 
60
+ This repository distributes a quantized GGUF Q8_0 variant of the EuroLLM-9B model for efficient offline inference.
61
+ The original model weights are unmodified and not fine-tuned as part of this project.
62
 
63
  ---
64
 
65
+ ## 🧠 WHAT'S NEW IN 2.1
66
 
67
  - Refined CLI architecture
68
+ - Structured command system
69
  - Improved response handling
70
  - More stable execution
71
+ - Admin access layer (locked system control mode)
72
+ - Cleaner internal logic separation
 
73
 
74
+ Offline AI 2.1 transitions from a simple launcher to a structured local runtime environment.
 
75
 
76
  ---
77
 
78
  ## 🔐 PROJECT PHILOSOPHY
79
 
80
+ Offline AI demonstrates that:
81
 
82
+ - Modern AI can operate without cloud infrastructure
83
+ - Open models can run independently
84
+ - AI tools can respect user privacy
85
+ - Local-first computing is viable
86
 
87
+ The project promotes:
88
 
89
  - Digital independence
90
+ - Transparent system design
91
+ - Offline experimentation
92
+ - User-controlled AI environments
93
 
94
  ---
95
 
 
98
  Model: EuroLLM-9B
99
  Original authors: EuroLLM Project consortium
100
  Funded by: European Union research initiatives
101
+ Base model license: Apache License 2.0
102
 
103
+ Quantized distribution: GGUF Q8_0
104
  Runtime: llama.cpp (MIT License)
105
+ Offline AI interface and wrapper: © David Káninský
106
 
107
  All components are used in compliance with their respective licenses.
108
 
 
122
  ## 🌍 PROJECT
123
 
124
  Website: https://OfflineAI.online
125
+ Domains: .cz / .sk / .de
126
+ Author: David Káninský