Commit History

new model
8c74008

ajazhs commited on

new model: Mythos-nano-heretic.Q4_K_M.gguf
0239f37

ajazhs commited on

new model
942a2fb

ajazhs commited on

new model: bartowski/AGI-0_Art-Skynet-3B-GGUF
f9ccb26

ajazhs commited on

new model: mradermacher/Phi-4-mini-instruct-HERETIC-UNCENSORED-GGUF
473ad7d

ajazhs commited on

new model: bartowski/Llama-3.2-3B-Instruct-uncensored-GGUF
b88021f

ajazhs commited on

fix model name: HauhauCS/Qwen3.5-4B-Uncensored-HauhauCS-Aggressive
655a462

ajazhs commited on

new model: julien-c/Qwen3.5-4B-uncensored-GGUF
ede24f7

ajazhs commited on

remove logger from openai endpoint
992bf4b

ajazhs commited on

fix quotes syntaxerror
f0176e4

ajazhs commited on

chunks logging
3e5aac8

ajazhs commited on

model response log
329b01d

ajazhs commited on

N_THREADS_BATCH type annotation error fix
ba3b7c3

ajazhs commited on

speedup: N_THREAD_BATCH in config
85ce634

ajazhs commited on

tune n_thread back to 2 and n_thread_batch=2
572b115

ajazhs commited on

Stop tracking VS Code and notebook checkpoints
ed68e9d

ajazhs commited on

try n_thread=4
87f5717

ajazhs commited on

model loading and warmup
85f04bd

ajazhs commited on

llama model
eae3828

ajazhs commited on

Docker cmake update
bca9395

ajazhs commited on

docker update: CMAKE_ARGS=
f8745c4

ajazhs commited on

API_KEY fix, model permission fixed, request locking fix
92ba935

ajazhs commited on

prod: implement thread-safe locking, bearer token auth, loguru, and eager model loading
058b748

ajazhs commited on

multiple call handling and Docker model source change to config file
ffb2e46

ajazhs commited on

fix: resolve OOM 137 by limiting cmake build threads
8eb42e6

ajazhs commited on

readme update
f7211e3

ajazhs commited on

feat: implement modular dual-endpoint FastAPI streaming service
e51d84f

ajazhs commited on