shadow_brain_core/scratch/server_startup.log

[Imperial Debug] Starting jarvis_run.py...
python : INFO:JarvisBrain:[STATUS] Imperial Brain Synchronized with key: Imperial..._KEY
At line:1 char:44
+ ... NG='utf-8'; python shadow_brain_core\jarvis_run.py > shadow_brain_cor ...
+                 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : NotSpecified: (INFO:JarvisBrai...Imperial..._KEY:String) [], RemoteException
    + FullyQualifiedErrorId : NativeCommandError
 
INFO:JarvisBrain:[OpenRouter] API Key recovered from Imperial Vault.
INFO:JarvisBrain:[STATUS] Imperial Brain Configured: Primary=gemini-3.1-flash-lite-preview, Port=18799, WebSearch=True
INFO:telegram_service:🧠 [Imperial Brain] Gemini Client initialized for Shadow Bot.
INFO:web_server:🔱 Imperial Neural Log Stream Integrated.
🔑 [Imperial] Fetching Gemini API Key from Bitwarden...
✅ [Imperial] Gemini API Key initialized for SDK 2.0+.
🛰️ [Imperial Fleet] Cluster Configuration Path: D:\Git_Work\jarvis_taemin\docker_data\shared_workspace\JarvisRun\JARVIS_CLUSTER.json
📡 [Imperial Fleet] Local IPs detected for self-filtering: ['192.168.182.1', '172.28.16.1', '127.0.0.1', '172.27.112.1', '192.168.85.1', '192.168.0.71']
[Imperial Fleet] Orchestration Node started. Host:ga403wr IP:192.168.0.71
[14:30:23] SYSTEM: Cleaning up sessions on port 18700...
📡 [Imperial Fleet] UDP Discovery Active on port 18791 (Broadcast to 192.168.1.255, 172.28.16.255, 192.168.182.255, 192.168.0.255, 192.168.85.255, 192.168.56.255, 172.27.112.255, 255.255.255.255, 172.16.0.255)
[14:30:27] SENTINEL: 🔱 황실 테스크 감시 루프 가동 시작...
INFO:JarvisBrain:[STATUS] Imperial Brain Synchronized with key: Imperial..._KEY
INFO:JarvisBrain:[STATUS] Imperial Brain Synchronized with key: Imperial..._KEY
[Imperial UI] Heimdall Observer Activated (serving from D:\Git_Work\jarvis_taemin\portal-heimdall\build\web)
[14:30:27] SYSTEM: 📡 Signal monitor active.
[Orpheus] Starting Windows Native TTS Server with model: local-nvfp4
D:\Git_Work\jarvis_taemin\venv_nvfp4\Lib\site-packages\torch\cuda\__init__.py:61: FutureWarning: The pynvml package is 
deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the main
tainers of the package that installed pynvml for you.
  import pynvml  # type: ignore[import]
INFO:JarvisBrain:[OpenRouter] API Key recovered from Imperial Vault.
INFO:JarvisBrain:[STATUS] Imperial Brain Configured: Primary=gemini-3.1-flash-lite-preview, Port=18799, WebSearch=True
INFO:JarvisBrain:[STATUS] Imperial Brain Synchronized with key: Imperial..._KEY
INFO:JarvisBrain:[OpenRouter] API Key recovered from Imperial Vault.
INFO:JarvisBrain:[STATUS] Imperial Brain Configured: Primary=gemini-3.1-flash-lite-preview, Port=18799, WebSearch=True
INFO:JarvisBrain:[OpenRouter] API Key recovered from Imperial Vault.
INFO:JarvisBrain:[STATUS] Imperial Brain Configured: Primary=gemini-3.1-flash-lite-preview, Port=18799, WebSearch=True
Exception in thread Thread-16 (_launch_api):
Traceback (most recent call last):
  File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.13_3.13.3312.0_x64__qbz5n2kfra8p0\Lib\threading.
py", line 1044, in _bootstrap_inner
    self.run()
    ~~~~~~~~^^
  File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.13_3.13.3312.0_x64__qbz5n2kfra8p0\Lib\threading.
py", line 995, in run
    self._target(*self._args, **self._kwargs)
    ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\Git_Work\jarvis_taemin\shadow_brain_core\jarvis_run.py", line 306, in _launch_api
    app = create_web_server(PROJECT_ROOT, self.engine, self.cluster)
  File "D:\Git_Work\jarvis_taemin\shadow_brain_core\web_server.py", line 5868, in create_web_server
    init_chat_logic(app, project_root, db_url, lambda: _load_session_user(), compaction_engine, memory_write_vector)
    ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TypeError: init_chat_logic() missing 1 required positional argument: 'rag_save_func'
D:\Git_Work\jarvis_taemin\venv_nvfp4\Lib\site-packages\transformers\modeling_utils.py:1984: FutureWarning: torch._dynam
o.allow_in_graph is deprecated and will be removed in a future version. Use torch._dynamo.nonstrict_trace instead.
  @torch._dynamo.allow_in_graph
'sox' is not recognized as an internal or external command,
operable program or batch file.
SoX could not be found!

    If you do not have SoX, proceed here:
     - - - http://sox.sourceforge.net/ - - -

    If you do (or think that you should) have SoX, double-check your
    path variables.
    
`torch_dtype` is deprecated! Use `dtype` instead!
Some weights of the model checkpoint at D:\Git_Work\jarvis_taemin\models\Qwen3-TTS-NVFP4 were not used when initializin
g Qwen3TTSForConditionalGeneration: ['talker.code_predictor.lm_head.0.input_global_scale', 'talker.code_predictor.lm_he
ad.0.input_zero_point', 'talker.code_predictor.lm_head.0.weight_global_scale', 'talker.code_predictor.lm_head.0.weight_
scale', 'talker.code_predictor.lm_head.0.weight_zero_point', 'talker.code_predictor.lm_head.1.input_global_scale', 'tal
ker.code_predictor.lm_head.1.input_zero_point', 'talker.code_predictor.lm_head.1.weight_global_scale', 'talker.code_pre
dictor.lm_head.1.weight_scale', 'talker.code_predictor.lm_head.1.weight_zero_point', 'talker.code_predictor.lm_head.10.
input_global_scale', 'talker.code_predictor.lm_head.10.input_zero_point', 'talker.code_predictor.lm_head.10.weight_glob
al_scale', 'talker.code_predictor.lm_head.10.weight_scale', 'talker.code_predictor.lm_head.10.weight_zero_point', 'talk
er.code_predictor.lm_head.11.input_global_scale', 'talker.code_predictor.lm_head.11.input_zero_point', 'talker.code_pre
dictor.lm_head.11.weight_global_scale', 'talker.code_predictor.lm_head.11.weight_scale', 'talker.code_predictor.lm_head
.11.weight_zero_point', 'talker.code_predictor.lm_head.12.input_global_scale', 'talker.code_predictor.lm_head.12.input_
zero_point', 'talker.code_predictor.lm_head.12.weight_global_scale', 'talker.code_predictor.lm_head.12.weight_scale', '
talker.code_predictor.lm_head.12.weight_zero_point', 'talker.code_predictor.lm_head.13.input_global_scale', 'talker.cod
e_predictor.lm_head.13.input_zero_point', 'talker.code_predictor.lm_head.13.weight_global_scale', 'talker.code_predicto
r.lm_head.13.weight_scale', 'talker.code_predictor.lm_head.13.weight_zero_point', 'talker.code_predictor.lm_head.14.inp
ut_global_scale', 'talker.code_predictor.lm_head.14.input_zero_point', 'talker.code_predictor.lm_head.14.weight_global_
scale', 'talker.code_predictor.lm_head.14.weight_scale', 'talker.code_predictor.lm_head.14.weight_zero_point', 'talker.
code_predictor.lm_head.2.input_global_scale', 'talker.code_predictor.lm_head.2.input_zero_point', 'talker.code_predicto
r.lm_head.2.weight_global_scale', 'talker.code_predictor.lm_head.2.weight_scale', 'talker.code_predictor.lm_head.2.weig
ht_zero_point', 'talker.code_predictor.lm_head.3.input_global_scale', 'talker.code_predictor.lm_head.3.input_zero_point
', 'talker.code_predictor.lm_head.3.weight_global_scale', 'talker.code_predictor.lm_head.3.weight_scale', 'talker.code_
predictor.lm_head.3.weight_zero_point', 'talker.code_predictor.lm_head.4.input_global_scale', 'talker.code_predictor.lm
_head.4.input_zero_point', 'talker.code_predictor.lm_head.4.weight_global_scale', 'talker.code_predictor.lm_head.4.weig
ht_scale', 'talker.code_predictor.lm_head.4.weight_zero_point', 'talker.code_predictor.lm_head.5.input_global_scale', '
talker.code_predictor.lm_head.5.input_zero_point', 'talker.code_predictor.lm_head.5.weight_global_scale', 'talker.code_
predictor.lm_head.5.weight_scale', 'talker.code_predictor.lm_head.5.weight_zero_point', 'talker.code_predictor.lm_head.
6.input_global_scale', 'talker.code_predictor.lm_head.6.input_zero_point', 'talker.code_predictor.lm_head.6.weight_glob
al_scale', 'talker.code_predictor.lm_head.6.weight_scale', 'talker.code_predictor.lm_head.6.weight_zero_point', 'talker
.code_predictor.lm_head.7.input_global_scale', 'talker.code_predictor.lm_head.7.input_zero_point', 'talker.code_predict
or.lm_head.7.weight_global_scale', 'talker.code_predictor.lm_head.7.weight_scale', 'talker.code_predictor.lm_head.7.wei
ght_zero_point', 'talker.code_predictor.lm_head.8.input_global_scale', 'talker.code_predictor.lm_head.8.input_zero_poin
t', 'talker.code_predictor.lm_head.8.weight_global_scale', 'talker.code_predictor.lm_head.8.weight_scale', 'talker.code
_predictor.lm_head.8.weight_zero_point', 'talker.code_predictor.lm_head.9.input_global_scale', 'talker.code_predictor.l
m_head.9.input_zero_point', 'talker.code_predictor.lm_head.9.weight_global_scale', 'talker.code_predictor.lm_head.9.wei
ght_scale', 'talker.code_predictor.lm_head.9.weight_zero_point', 'talker.code_predictor.lm_head_fused.input_global_scal
e', 'talker.code_predictor.lm_head_fused.input_zero_point', 'talker.code_predictor.lm_head_fused.weight_global_scale', 
'talker.code_predictor.lm_head_fused.weight_scale', 'talker.code_predictor.lm_head_fused.weight_zero_point', 'talker.co
de_predictor.model.layers.0.mlp.down_proj.input_global_scale', 'talker.code_predictor.model.layers.0.mlp.down_proj.inpu
t_zero_point', 'talker.code_predictor.model.layers.0.mlp.down_proj.weight_global_scale', 'talker.code_predictor.model.l
ayers.0.mlp.down_proj.weight_scale', 'talker.code_predictor.model.layers.0.mlp.down_proj.weight_zero_point', 'talker.co
de_predictor.model.layers.0.mlp.gate_proj.input_global_scale', 'talker.code_predictor.model.layers.0.mlp.gate_proj.inpu
t_zero_point', 'talker.code_predictor.model.layers.0.mlp.gate_proj.weight_global_scale', 'talker.code_predictor.model.l
ayers.0.mlp.gate_proj.weight_scale', 'talker.code_predictor.model.layers.0.mlp.gate_proj.weight_zero_point', 'talker.co
de_predictor.model.layers.0.mlp.up_proj.input_global_scale', 'talker.code_predictor.model.layers.0.mlp.up_proj.input_ze
ro_point', 'talker.code_predictor.model.layers.0.mlp.up_proj.weight_global_scale', 'talker.code_predictor.model.layers.
0.mlp.up_proj.weight_scale', 'talker.code_predictor.model.layers.0.mlp.up_proj.weight_zero_point', 'talker.code_predict
or.model.layers.0.self_attn.k_proj.input_global_scale', 'talker.code_predictor.model.layers.0.self_attn.k_proj.input_ze
ro_point', 'talker.code_predictor.model.layers.0.self_attn.k_proj.weight_global_scale', 'talker.code_predictor.model.la
yers.0.self_attn.k_proj.weight_scale', 'talker.code_predictor.model.layers.0.self_attn.k_proj.weight_zero_point', 'talk
er.code_predictor.model.layers.0.self_attn.o_proj.input_global_scale', 'talker.code_predictor.model.layers.0.self_attn.
o_proj.input_zero_point', 'talker.code_predictor.model.layers.0.self_attn.o_proj.weight_global_scale', 'talker.code_pre
dictor.model.layers.0.self_attn.o_proj.weight_scale', 'talker.code_predictor.model.layers.0.self_attn.o_proj.weight_zer
o_point', 'talker.code_predictor.model.layers.0.self_attn.q_proj.input_global_scale', 'talker.code_predictor.model.laye
rs.0.self_attn.q_proj.input_zero_point', 'talker.code_predictor.model.layers.0.self_attn.q_proj.weight_global_scale', '
talker.code_predictor.model.layers.0.self_attn.q_proj.weight_scale', 'talker.code_predictor.model.layers.0.self_attn.q_
proj.weight_zero_point', 'talker.code_predictor.model.layers.0.self_attn.v_proj.input_global_scale', 'talker.code_predi
ctor.model.layers.0.self_attn.v_proj.input_zero_point', 'talker.code_predictor.model.layers.0.self_attn.v_proj.weight_g
lobal_scale', 'talker.code_predictor.model.layers.0.self_attn.v_proj.weight_scale', 'talker.code_predictor.model.layers
.0.self_attn.v_proj.weight_zero_point', 'talker.code_predictor.model.layers.1.mlp.down_proj.input_global_scale', 'talke
r.code_predictor.model.layers.1.mlp.down_proj.input_zero_point', 'talker.code_predictor.model.layers.1.mlp.down_proj.we
ight_global_scale', 'talker.code_predictor.model.layers.1.mlp.down_proj.weight_scale', 'talker.code_predictor.model.lay
ers.1.mlp.down_proj.weight_zero_point', 'talker.code_predictor.model.layers.1.mlp.gate_proj.input_global_scale', 'talke
r.code_predictor.model.layers.1.mlp.gate_proj.input_zero_point', 'talker.code_predictor.model.layers.1.mlp.gate_proj.we
ight_global_scale', 'talker.code_predictor.model.layers.1.mlp.gate_proj.weight_scale', 'talker.code_predictor.model.lay
ers.1.mlp.gate_proj.weight_zero_point', 'talker.code_predictor.model.layers.1.mlp.up_proj.input_global_scale', 'talker.
code_predictor.model.layers.1.mlp.up_proj.input_zero_point', 'talker.code_predictor.model.layers.1.mlp.up_proj.weight_g
lobal_scale', 'talker.code_predictor.model.layers.1.mlp.up_proj.weight_scale', 'talker.code_predictor.model.layers.1.ml
p.up_proj.weight_zero_point', 'talker.code_predictor.model.layers.1.self_attn.k_proj.input_global_scale', 'talker.code_
predictor.model.layers.1.self_attn.k_proj.input_zero_point', 'talker.code_predictor.model.layers.1.self_attn.k_proj.wei
ght_global_scale', 'talker.code_predictor.model.layers.1.self_attn.k_proj.weight_scale', 'talker.code_predictor.model.l
ayers.1.self_attn.k_proj.weight_zero_point', 'talker.code_predictor.model.layers.1.self_attn.o_proj.input_global_scale'
, 'talker.code_predictor.model.layers.1.self_attn.o_proj.input_zero_point', 'talker.code_predictor.model.layers.1.self_
attn.o_proj.weight_global_scale', 'talker.code_predictor.model.layers.1.self_attn.o_proj.weight_scale', 'talker.code_pr
edictor.model.layers.1.self_attn.o_proj.weight_zero_point', 'talker.code_predictor.model.layers.1.self_attn.q_proj.inpu
t_global_scale', 'talker.code_predictor.model.layers.1.self_attn.q_proj.input_zero_point', 'talker.code_predictor.model
.layers.1.self_attn.q_proj.weight_global_scale', 'talker.code_predictor.model.layers.1.self_attn.q_proj.weight_scale', 
'talker.code_predictor.model.layers.1.self_attn.q_proj.weight_zero_point', 'talker.code_predictor.model.layers.1.self_a
ttn.v_proj.input_global_scale', 'talker.code_predictor.model.layers.1.self_attn.v_proj.input_zero_point', 'talker.code_
predictor.model.layers.1.self_attn.v_proj.weight_global_scale', 'talker.code_predictor.model.layers.1.self_attn.v_proj.
weight_scale', 'talker.code_predictor.model.layers.1.self_attn.v_proj.weight_zero_point', 'talker.code_predictor.model.
layers.2.mlp.down_proj.input_global_scale', 'talker.code_predictor.model.layers.2.mlp.down_proj.input_zero_point', 'tal
ker.code_predictor.model.layers.2.mlp.down_proj.weight_global_scale', 'talker.code_predictor.model.layers.2.mlp.down_pr
oj.weight_scale', 'talker.code_predictor.model.layers.2.mlp.down_proj.weight_zero_point', 'talker.code_predictor.model.
layers.2.mlp.gate_proj.input_global_scale', 'talker.code_predictor.model.layers.2.mlp.gate_proj.input_zero_point', 'tal
ker.code_predictor.model.layers.2.mlp.gate_proj.weight_global_scale', 'talker.code_predictor.model.layers.2.mlp.gate_pr
oj.weight_scale', 'talker.code_predictor.model.layers.2.mlp.gate_proj.weight_zero_point', 'talker.code_predictor.model.
layers.2.mlp.up_proj.input_global_scale', 'talker.code_predictor.model.layers.2.mlp.up_proj.input_zero_point', 'talker.
code_predictor.model.layers.2.mlp.up_proj.weight_global_scale', 'talker.code_predictor.model.layers.2.mlp.up_proj.weigh
t_scale', 'talker.code_predictor.model.layers.2.mlp.up_proj.weight_zero_point', 'talker.code_predictor.model.layers.2.s
elf_attn.k_proj.input_global_scale', 'talker.code_predictor.model.layers.2.self_attn.k_proj.input_zero_point', 'talker.
code_predictor.model.layers.2.self_attn.k_proj.weight_global_scale', 'talker.code_predictor.model.layers.2.self_attn.k_
proj.weight_scale', 'talker.code_predictor.model.layers.2.self_attn.k_proj.weight_zero_point', 'talker.code_predictor.m
odel.layers.2.self_attn.o_proj.input_global_scale', 'talker.code_predictor.model.layers.2.self_attn.o_proj.input_zero_p
oint', 'talker.code_predictor.model.layers.2.self_attn.o_proj.weight_global_scale', 'talker.code_predictor.model.layers
.2.self_attn.o_proj.weight_scale', 'talker.code_predictor.model.layers.2.self_attn.o_proj.weight_zero_point', 'talker.c
ode_predictor.model.layers.2.self_attn.q_proj.input_global_scale', 'talker.code_predictor.model.layers.2.self_attn.q_pr
oj.input_zero_point', 'talker.code_predictor.model.layers.2.self_attn.q_proj.weight_global_scale', 'talker.code_predict
or.model.layers.2.self_attn.q_proj.weight_scale', 'talker.code_predictor.model.layers.2.self_attn.q_proj.weight_zero_po
int', 'talker.code_predictor.model.layers.2.self_attn.v_proj.input_global_scale', 'talker.code_predictor.model.layers.2
.self_attn.v_proj.input_zero_point', 'talker.code_predictor.model.layers.2.self_attn.v_proj.weight_global_scale', 'talk
er.code_predictor.model.layers.2.self_attn.v_proj.weight_scale', 'talker.code_predictor.model.layers.2.self_attn.v_proj
.weight_zero_point', 'talker.code_predictor.model.layers.3.mlp.down_proj.input_global_scale', 'talker.code_predictor.mo
del.layers.3.mlp.down_proj.input_zero_point', 'talker.code_predictor.model.layers.3.mlp.down_proj.weight_global_scale',
 'talker.code_predictor.model.layers.3.mlp.down_proj.weight_scale', 'talker.code_predictor.model.layers.3.mlp.down_proj
.weight_zero_point', 'talker.code_predictor.model.layers.3.mlp.gate_proj.input_global_scale', 'talker.code_predictor.mo
del.layers.3.mlp.gate_proj.input_zero_point', 'talker.code_predictor.model.layers.3.mlp.gate_proj.weight_global_scale',
 'talker.code_predictor.model.layers.3.mlp.gate_proj.weight_scale', 'talker.code_predictor.model.layers.3.mlp.gate_proj
.weight_zero_point', 'talker.code_predictor.model.layers.3.mlp.up_proj.input_global_scale', 'talker.code_predictor.mode
l.layers.3.mlp.up_proj.input_zero_point', 'talker.code_predictor.model.layers.3.mlp.up_proj.weight_global_scale', 'talk
er.code_predictor.model.layers.3.mlp.up_proj.weight_scale', 'talker.code_predictor.model.layers.3.mlp.up_proj.weight_ze
ro_point', 'talker.code_predictor.model.layers.3.self_attn.k_proj.input_global_scale', 'talker.code_predictor.model.lay
ers.3.self_attn.k_proj.input_zero_point', 'talker.code_predictor.model.layers.3.self_attn.k_proj.weight_global_scale', 
'talker.code_predictor.model.layers.3.self_attn.k_proj.weight_scale', 'talker.code_predictor.model.layers.3.self_attn.k
_proj.weight_zero_point', 'talker.code_predictor.model.layers.3.self_attn.o_proj.input_global_scale', 'talker.code_pred
ictor.model.layers.3.self_attn.o_proj.input_zero_point', 'talker.code_predictor.model.layers.3.self_attn.o_proj.weight_
global_scale', 'talker.code_predictor.model.layers.3.self_attn.o_proj.weight_scale', 'talker.code_predictor.model.layer
s.3.self_attn.o_proj.weight_zero_point', 'talker.code_predictor.model.layers.3.self_attn.q_proj.input_global_scale', 't
alker.code_predictor.model.layers.3.self_attn.q_proj.input_zero_point', 'talker.code_predictor.model.layers.3.self_attn
.q_proj.weight_global_scale', 'talker.code_predictor.model.layers.3.self_attn.q_proj.weight_scale', 'talker.code_predic
tor.model.layers.3.self_attn.q_proj.weight_zero_point', 'talker.code_predictor.model.layers.3.self_attn.v_proj.input_gl
obal_scale', 'talker.code_predictor.model.layers.3.self_attn.v_proj.input_zero_point', 'talker.code_predictor.model.lay
ers.3.self_attn.v_proj.weight_global_scale', 'talker.code_predictor.model.layers.3.self_attn.v_proj.weight_scale', 'tal
ker.code_predictor.model.layers.3.self_attn.v_proj.weight_zero_point', 'talker.code_predictor.model.layers.4.mlp.down_p
roj.input_global_scale', 'talker.code_predictor.model.layers.4.mlp.down_proj.input_zero_point', 'talker.code_predictor.
model.layers.4.mlp.down_proj.weight_global_scale', 'talker.code_predictor.model.layers.4.mlp.down_proj.weight_scale', '
talker.code_predictor.model.layers.4.mlp.down_proj.weight_zero_point', 'talker.code_predictor.model.layers.4.mlp.gate_p
roj.input_global_scale', 'talker.code_predictor.model.layers.4.mlp.gate_proj.input_zero_point', 'talker.code_predictor.
model.layers.4.mlp.gate_proj.weight_global_scale', 'talker.code_predictor.model.layers.4.mlp.gate_proj.weight_scale', '
talker.code_predictor.model.layers.4.mlp.gate_proj.weight_zero_point', 'talker.code_predictor.model.layers.4.mlp.up_pro
j.input_global_scale', 'talker.code_predictor.model.layers.4.mlp.up_proj.input_zero_point', 'talker.code_predictor.mode
l.layers.4.mlp.up_proj.weight_global_scale', 'talker.code_predictor.model.layers.4.mlp.up_proj.weight_scale', 'talker.c
ode_predictor.model.layers.4.mlp.up_proj.weight_zero_point', 'talker.code_predictor.model.layers.4.self_attn.k_proj.inp
ut_global_scale', 'talker.code_predictor.model.layers.4.self_attn.k_proj.input_zero_point', 'talker.code_predictor.mode
l.layers.4.self_attn.k_proj.weight_global_scale', 'talker.code_predictor.model.layers.4.self_attn.k_proj.weight_scale',
 'talker.code_predictor.model.layers.4.self_attn.k_proj.weight_zero_point', 'talker.code_predictor.model.layers.4.self_
attn.o_proj.input_global_scale', 'talker.code_predictor.model.layers.4.self_attn.o_proj.input_zero_point', 'talker.code
_predictor.model.layers.4.self_attn.o_proj.weight_global_scale', 'talker.code_predictor.model.layers.4.self_attn.o_proj
.weight_scale', 'talker.code_predictor.model.layers.4.self_attn.o_proj.weight_zero_point', 'talker.code_predictor.model
.layers.4.self_attn.q_proj.input_global_scale', 'talker.code_predictor.model.layers.4.self_attn.q_proj.input_zero_point
', 'talker.code_predictor.model.layers.4.self_attn.q_proj.weight_global_scale', 'talker.code_predictor.model.layers.4.s
elf_attn.q_proj.weight_scale', 'talker.code_predictor.model.layers.4.self_attn.q_proj.weight_zero_point', 'talker.code_
predictor.model.layers.4.self_attn.v_proj.input_global_scale', 'talker.code_predictor.model.layers.4.self_attn.v_proj.i
nput_zero_point', 'talker.code_predictor.model.layers.4.self_attn.v_proj.weight_global_scale', 'talker.code_predictor.m
odel.layers.4.self_attn.v_proj.weight_scale', 'talker.code_predictor.model.layers.4.self_attn.v_proj.weight_zero_point'
, 'talker.codec_head.input_global_scale', 'talker.codec_head.input_zero_point', 'talker.codec_head.weight_global_scale'
, 'talker.codec_head.weight_scale', 'talker.codec_head.weight_zero_point', 'talker.model.layers.0.mlp.down_proj.input_g
lobal_scale', 'talker.model.layers.0.mlp.down_proj.input_zero_point', 'talker.model.layers.0.mlp.down_proj.weight_globa
l_scale', 'talker.model.layers.0.mlp.down_proj.weight_scale', 'talker.model.layers.0.mlp.down_proj.weight_zero_point', 
'talker.model.layers.0.mlp.gate_proj.input_global_scale', 'talker.model.layers.0.mlp.gate_proj.input_zero_point', 'talk
er.model.layers.0.mlp.gate_proj.weight_global_scale', 'talker.model.layers.0.mlp.gate_proj.weight_scale', 'talker.model
.layers.0.mlp.gate_proj.weight_zero_point', 'talker.model.layers.0.mlp.up_proj.input_global_scale', 'talker.model.layer
s.0.mlp.up_proj.input_zero_point', 'talker.model.layers.0.mlp.up_proj.weight_global_scale', 'talker.model.layers.0.mlp.
up_proj.weight_scale', 'talker.model.layers.0.mlp.up_proj.weight_zero_point', 'talker.model.layers.0.self_attn.k_proj.i
nput_global_scale', 'talker.model.layers.0.self_attn.k_proj.input_zero_point', 'talker.model.layers.0.self_attn.k_proj.
weight_global_scale', 'talker.model.layers.0.self_attn.k_proj.weight_scale', 'talker.model.layers.0.self_attn.k_proj.we
ight_zero_point', 'talker.model.layers.0.self_attn.o_proj.input_global_scale', 'talker.model.layers.0.self_attn.o_proj.
input_zero_point', 'talker.model.layers.0.self_attn.o_proj.weight_global_scale', 'talker.model.layers.0.self_attn.o_pro
j.weight_scale', 'talker.model.layers.0.self_attn.o_proj.weight_zero_point', 'talker.model.layers.0.self_attn.q_proj.in
put_global_scale', 'talker.model.layers.0.self_attn.q_proj.input_zero_point', 'talker.model.layers.0.self_attn.q_proj.w
eight_global_scale', 'talker.model.layers.0.self_attn.q_proj.weight_scale', 'talker.model.layers.0.self_attn.q_proj.wei
ght_zero_point', 'talker.model.layers.0.self_attn.v_proj.input_global_scale', 'talker.model.layers.0.self_attn.v_proj.i
nput_zero_point', 'talker.model.layers.0.self_attn.v_proj.weight_global_scale', 'talker.model.layers.0.self_attn.v_proj
.weight_scale', 'talker.model.layers.0.self_attn.v_proj.weight_zero_point', 'talker.model.layers.1.mlp.down_proj.input_
global_scale', 'talker.model.layers.1.mlp.down_proj.input_zero_point', 'talker.model.layers.1.mlp.down_proj.weight_glob
al_scale', 'talker.model.layers.1.mlp.down_proj.weight_scale', 'talker.model.layers.1.mlp.down_proj.weight_zero_point',
 'talker.model.layers.1.mlp.gate_proj.input_global_scale', 'talker.model.layers.1.mlp.gate_proj.input_zero_point', 'tal
ker.model.layers.1.mlp.gate_proj.weight_global_scale', 'talker.model.layers.1.mlp.gate_proj.weight_scale', 'talker.mode
l.layers.1.mlp.gate_proj.weight_zero_point', 'talker.model.layers.1.mlp.up_proj.input_global_scale', 'talker.model.laye
rs.1.mlp.up_proj.input_zero_point', 'talker.model.layers.1.mlp.up_proj.weight_global_scale', 'talker.model.layers.1.mlp
.up_proj.weight_scale', 'talker.model.layers.1.mlp.up_proj.weight_zero_point', 'talker.model.layers.1.self_attn.k_proj.
input_global_scale', 'talker.model.layers.1.self_attn.k_proj.input_zero_point', 'talker.model.layers.1.self_attn.k_proj
.weight_global_scale', 'talker.model.layers.1.self_attn.k_proj.weight_scale', 'talker.model.layers.1.self_attn.k_proj.w
eight_zero_point', 'talker.model.layers.1.self_attn.o_proj.input_global_scale', 'talker.model.layers.1.self_attn.o_proj
.input_zero_point', 'talker.model.layers.1.self_attn.o_proj.weight_global_scale', 'talker.model.layers.1.self_attn.o_pr
oj.weight_scale', 'talker.model.layers.1.self_attn.o_proj.weight_zero_point', 'talker.model.layers.1.self_attn.q_proj.i
nput_global_scale', 'talker.model.layers.1.self_attn.q_proj.input_zero_point', 'talker.model.layers.1.self_attn.q_proj.
weight_global_scale', 'talker.model.layers.1.self_attn.q_proj.weight_scale', 'talker.model.layers.1.self_attn.q_proj.we
ight_zero_point', 'talker.model.layers.1.self_attn.v_proj.input_global_scale', 'talker.model.layers.1.self_attn.v_proj.
input_zero_point', 'talker.model.layers.1.self_attn.v_proj.weight_global_scale', 'talker.model.layers.1.self_attn.v_pro
j.weight_scale', 'talker.model.layers.1.self_attn.v_proj.weight_zero_point', 'talker.model.layers.10.mlp.down_proj.inpu
t_global_scale', 'talker.model.layers.10.mlp.down_proj.input_zero_point', 'talker.model.layers.10.mlp.down_proj.weight_
global_scale', 'talker.model.layers.10.mlp.down_proj.weight_scale', 'talker.model.layers.10.mlp.down_proj.weight_zero_p
oint', 'talker.model.layers.10.mlp.gate_proj.input_global_scale', 'talker.model.layers.10.mlp.gate_proj.input_zero_poin
t', 'talker.model.layers.10.mlp.gate_proj.weight_global_scale', 'talker.model.layers.10.mlp.gate_proj.weight_scale', 't
alker.model.layers.10.mlp.gate_proj.weight_zero_point', 'talker.model.layers.10.mlp.up_proj.input_global_scale', 'talke
r.model.layers.10.mlp.up_proj.input_zero_point', 'talker.model.layers.10.mlp.up_proj.weight_global_scale', 'talker.mode
l.layers.10.mlp.up_proj.weight_scale', 'talker.model.layers.10.mlp.up_proj.weight_zero_point', 'talker.model.layers.10.
self_attn.k_proj.input_global_scale', 'talker.model.layers.10.self_attn.k_proj.input_zero_point', 'talker.model.layers.
10.self_attn.k_proj.weight_global_scale', 'talker.model.layers.10.self_attn.k_proj.weight_scale', 'talker.model.layers.
10.self_attn.k_proj.weight_zero_point', 'talker.model.layers.10.self_attn.o_proj.input_global_scale', 'talker.model.lay
ers.10.self_attn.o_proj.input_zero_point', 'talker.model.layers.10.self_attn.o_proj.weight_global_scale', 'talker.model
.layers.10.self_attn.o_proj.weight_scale', 'talker.model.layers.10.self_attn.o_proj.weight_zero_point', 'talker.model.l
ayers.10.self_attn.q_proj.input_global_scale', 'talker.model.layers.10.self_attn.q_proj.input_zero_point', 'talker.mode
l.layers.10.self_attn.q_proj.weight_global_scale', 'talker.model.layers.10.self_attn.q_proj.weight_scale', 'talker.mode
l.layers.10.self_attn.q_proj.weight_zero_point', 'talker.model.layers.10.self_attn.v_proj.input_global_scale', 'talker.
model.layers.10.self_attn.v_proj.input_zero_point', 'talker.model.layers.10.self_attn.v_proj.weight_global_scale', 'tal
ker.model.layers.10.self_attn.v_proj.weight_scale', 'talker.model.layers.10.self_attn.v_proj.weight_zero_point', 'talke
r.model.layers.11.mlp.down_proj.input_global_scale', 'talker.model.layers.11.mlp.down_proj.input_zero_point', 'talker.m
odel.layers.11.mlp.down_proj.weight_global_scale', 'talker.model.layers.11.mlp.down_proj.weight_scale', 'talker.model.l
ayers.11.mlp.down_proj.weight_zero_point', 'talker.model.layers.11.mlp.gate_proj.input_global_scale', 'talker.model.lay
ers.11.mlp.gate_proj.input_zero_point', 'talker.model.layers.11.mlp.gate_proj.weight_global_scale', 'talker.model.layer
s.11.mlp.gate_proj.weight_scale', 'talker.model.layers.11.mlp.gate_proj.weight_zero_point', 'talker.model.layers.11.mlp
.up_proj.input_global_scale', 'talker.model.layers.11.mlp.up_proj.input_zero_point', 'talker.model.layers.11.mlp.up_pro
j.weight_global_scale', 'talker.model.layers.11.mlp.up_proj.weight_scale', 'talker.model.layers.11.mlp.up_proj.weight_z
ero_point', 'talker.model.layers.11.self_attn.k_proj.input_global_scale', 'talker.model.layers.11.self_attn.k_proj.inpu
t_zero_point', 'talker.model.layers.11.self_attn.k_proj.weight_global_scale', 'talker.model.layers.11.self_attn.k_proj.
weight_scale', 'talker.model.layers.11.self_attn.k_proj.weight_zero_point', 'talker.model.layers.11.self_attn.o_proj.in
put_global_scale', 'talker.model.layers.11.self_attn.o_proj.input_zero_point', 'talker.model.layers.11.self_attn.o_proj
.weight_global_scale', 'talker.model.layers.11.self_attn.o_proj.weight_scale', 'talker.model.layers.11.self_attn.o_proj
.weight_zero_point', 'talker.model.layers.11.self_attn.q_proj.input_global_scale', 'talker.model.layers.11.self_attn.q_
proj.input_zero_point', 'talker.model.layers.11.self_attn.q_proj.weight_global_scale', 'talker.model.layers.11.self_att
n.q_proj.weight_scale', 'talker.model.layers.11.self_attn.q_proj.weight_zero_point', 'talker.model.layers.11.self_attn.
v_proj.input_global_scale', 'talker.model.layers.11.self_attn.v_proj.input_zero_point', 'talker.model.layers.11.self_at
tn.v_proj.weight_global_scale', 'talker.model.layers.11.self_attn.v_proj.weight_scale', 'talker.model.layers.11.self_at
tn.v_proj.weight_zero_point', 'talker.model.layers.12.mlp.down_proj.input_global_scale', 'talker.model.layers.12.mlp.do
wn_proj.input_zero_point', 'talker.model.layers.12.mlp.down_proj.weight_global_scale', 'talker.model.layers.12.mlp.down
_proj.weight_scale', 'talker.model.layers.12.mlp.down_proj.weight_zero_point', 'talker.model.layers.12.mlp.gate_proj.in
put_global_scale', 'talker.model.layers.12.mlp.gate_proj.input_zero_point', 'talker.model.layers.12.mlp.gate_proj.weigh
t_global_scale', 'talker.model.layers.12.mlp.gate_proj.weight_scale', 'talker.model.layers.12.mlp.gate_proj.weight_zero
_point', 'talker.model.layers.12.mlp.up_proj.input_global_scale', 'talker.model.layers.12.mlp.up_proj.input_zero_point'
, 'talker.model.layers.12.mlp.up_proj.weight_global_scale', 'talker.model.layers.12.mlp.up_proj.weight_scale', 'talker.
model.layers.12.mlp.up_proj.weight_zero_point', 'talker.model.layers.12.self_attn.k_proj.input_global_scale', 'talker.m
odel.layers.12.self_attn.k_proj.input_zero_point', 'talker.model.layers.12.self_attn.k_proj.weight_global_scale', 'talk
er.model.layers.12.self_attn.k_proj.weight_scale', 'talker.model.layers.12.self_attn.k_proj.weight_zero_point', 'talker
.model.layers.12.self_attn.o_proj.input_global_scale', 'talker.model.layers.12.self_attn.o_proj.input_zero_point', 'tal
ker.model.layers.12.self_attn.o_proj.weight_global_scale', 'talker.model.layers.12.self_attn.o_proj.weight_scale', 'tal
ker.model.layers.12.self_attn.o_proj.weight_zero_point', 'talker.model.layers.12.self_attn.q_proj.input_global_scale', 
'talker.model.layers.12.self_attn.q_proj.input_zero_point', 'talker.model.layers.12.self_attn.q_proj.weight_global_scal
e', 'talker.model.layers.12.self_attn.q_proj.weight_scale', 'talker.model.layers.12.self_attn.q_proj.weight_zero_point'
, 'talker.model.layers.12.self_attn.v_proj.input_global_scale', 'talker.model.layers.12.self_attn.v_proj.input_zero_poi
nt', 'talker.model.layers.12.self_attn.v_proj.weight_global_scale', 'talker.model.layers.12.self_attn.v_proj.weight_sca
le', 'talker.model.layers.12.self_attn.v_proj.weight_zero_point', 'talker.model.layers.13.mlp.down_proj.input_global_sc
ale', 'talker.model.layers.13.mlp.down_proj.input_zero_point', 'talker.model.layers.13.mlp.down_proj.weight_global_scal
e', 'talker.model.layers.13.mlp.down_proj.weight_scale', 'talker.model.layers.13.mlp.down_proj.weight_zero_point', 'tal
ker.model.layers.13.mlp.gate_proj.input_global_scale', 'talker.model.layers.13.mlp.gate_proj.input_zero_point', 'talker
.model.layers.13.mlp.gate_proj.weight_global_scale', 'talker.model.layers.13.mlp.gate_proj.weight_scale', 'talker.model
.layers.13.mlp.gate_proj.weight_zero_point', 'talker.model.layers.13.mlp.up_proj.input_global_scale', 'talker.model.lay
ers.13.mlp.up_proj.input_zero_point', 'talker.model.layers.13.mlp.up_proj.weight_global_scale', 'talker.model.layers.13
.mlp.up_proj.weight_scale', 'talker.model.layers.13.mlp.up_proj.weight_zero_point', 'talker.model.layers.13.self_attn.k
_proj.input_global_scale', 'talker.model.layers.13.self_attn.k_proj.input_zero_point', 'talker.model.layers.13.self_att
n.k_proj.weight_global_scale', 'talker.model.layers.13.self_attn.k_proj.weight_scale', 'talker.model.layers.13.self_att
n.k_proj.weight_zero_point', 'talker.model.layers.13.self_attn.o_proj.input_global_scale', 'talker.model.layers.13.self
_attn.o_proj.input_zero_point', 'talker.model.layers.13.self_attn.o_proj.weight_global_scale', 'talker.model.layers.13.
self_attn.o_proj.weight_scale', 'talker.model.layers.13.self_attn.o_proj.weight_zero_point', 'talker.model.layers.13.se
lf_attn.q_proj.input_global_scale', 'talker.model.layers.13.self_attn.q_proj.input_zero_point', 'talker.model.layers.13
.self_attn.q_proj.weight_global_scale', 'talker.model.layers.13.self_attn.q_proj.weight_scale', 'talker.model.layers.13
.self_attn.q_proj.weight_zero_point', 'talker.model.layers.13.self_attn.v_proj.input_global_scale', 'talker.model.layer
s.13.self_attn.v_proj.input_zero_point', 'talker.model.layers.13.self_attn.v_proj.weight_global_scale', 'talker.model.l
ayers.13.self_attn.v_proj.weight_scale', 'talker.model.layers.13.self_attn.v_proj.weight_zero_point', 'talker.model.lay
ers.14.mlp.down_proj.input_global_scale', 'talker.model.layers.14.mlp.down_proj.input_zero_point', 'talker.model.layers
.14.mlp.down_proj.weight_global_scale', 'talker.model.layers.14.mlp.down_proj.weight_scale', 'talker.model.layers.14.ml
p.down_proj.weight_zero_point', 'talker.model.layers.14.mlp.gate_proj.input_global_scale', 'talker.model.layers.14.mlp.
gate_proj.input_zero_point', 'talker.model.layers.14.mlp.gate_proj.weight_global_scale', 'talker.model.layers.14.mlp.ga
te_proj.weight_scale', 'talker.model.layers.14.mlp.gate_proj.weight_zero_point', 'talker.model.layers.14.mlp.up_proj.in
put_global_scale', 'talker.model.layers.14.mlp.up_proj.input_zero_point', 'talker.model.layers.14.mlp.up_proj.weight_gl
obal_scale', 'talker.model.layers.14.mlp.up_proj.weight_scale', 'talker.model.layers.14.mlp.up_proj.weight_zero_point',
 'talker.model.layers.14.self_attn.k_proj.input_global_scale', 'talker.model.layers.14.self_attn.k_proj.input_zero_poin
t', 'talker.model.layers.14.self_attn.k_proj.weight_global_scale', 'talker.model.layers.14.self_attn.k_proj.weight_scal
e', 'talker.model.layers.14.self_attn.k_proj.weight_zero_point', 'talker.model.layers.14.self_attn.o_proj.input_global_
scale', 'talker.model.layers.14.self_attn.o_proj.input_zero_point', 'talker.model.layers.14.self_attn.o_proj.weight_glo
bal_scale', 'talker.model.layers.14.self_attn.o_proj.weight_scale', 'talker.model.layers.14.self_attn.o_proj.weight_zer
o_point', 'talker.model.layers.14.self_attn.q_proj.input_global_scale', 'talker.model.layers.14.self_attn.q_proj.input_
zero_point', 'talker.model.layers.14.self_attn.q_proj.weight_global_scale', 'talker.model.layers.14.self_attn.q_proj.we
ight_scale', 'talker.model.layers.14.self_attn.q_proj.weight_zero_point', 'talker.model.layers.14.self_attn.v_proj.inpu
t_global_scale', 'talker.model.layers.14.self_attn.v_proj.input_zero_point', 'talker.model.layers.14.self_attn.v_proj.w
eight_global_scale', 'talker.model.layers.14.self_attn.v_proj.weight_scale', 'talker.model.layers.14.self_attn.v_proj.w
eight_zero_point', 'talker.model.layers.15.mlp.down_proj.input_global_scale', 'talker.model.layers.15.mlp.down_proj.inp
ut_zero_point', 'talker.model.layers.15.mlp.down_proj.weight_global_scale', 'talker.model.layers.15.mlp.down_proj.weigh
t_scale', 'talker.model.layers.15.mlp.down_proj.weight_zero_point', 'talker.model.layers.15.mlp.gate_proj.input_global_
scale', 'talker.model.layers.15.mlp.gate_proj.input_zero_point', 'talker.model.layers.15.mlp.gate_proj.weight_global_sc
ale', 'talker.model.layers.15.mlp.gate_proj.weight_scale', 'talker.model.layers.15.mlp.gate_proj.weight_zero_point', 't
alker.model.layers.15.mlp.up_proj.input_global_scale', 'talker.model.layers.15.mlp.up_proj.input_zero_point', 'talker.m
odel.layers.15.mlp.up_proj.weight_global_scale', 'talker.model.layers.15.mlp.up_proj.weight_scale', 'talker.model.layer
s.15.mlp.up_proj.weight_zero_point', 'talker.model.layers.15.self_attn.k_proj.input_global_scale', 'talker.model.layers
.15.self_attn.k_proj.input_zero_point', 'talker.model.layers.15.self_attn.k_proj.weight_global_scale', 'talker.model.la
yers.15.self_attn.k_proj.weight_scale', 'talker.model.layers.15.self_attn.k_proj.weight_zero_point', 'talker.model.laye
rs.15.self_attn.o_proj.input_global_scale', 'talker.model.layers.15.self_attn.o_proj.input_zero_point', 'talker.model.l
ayers.15.self_attn.o_proj.weight_global_scale', 'talker.model.layers.15.self_attn.o_proj.weight_scale', 'talker.model.l
ayers.15.self_attn.o_proj.weight_zero_point', 'talker.model.layers.15.self_attn.q_proj.input_global_scale', 'talker.mod
el.layers.15.self_attn.q_proj.input_zero_point', 'talker.model.layers.15.self_attn.q_proj.weight_global_scale', 'talker
.model.layers.15.self_attn.q_proj.weight_scale', 'talker.model.layers.15.self_attn.q_proj.weight_zero_point', 'talker.m
odel.layers.15.self_attn.v_proj.input_global_scale', 'talker.model.layers.15.self_attn.v_proj.input_zero_point', 'talke
r.model.layers.15.self_attn.v_proj.weight_global_scale', 'talker.model.layers.15.self_attn.v_proj.weight_scale', 'talke
r.model.layers.15.self_attn.v_proj.weight_zero_point', 'talker.model.layers.16.mlp.down_proj.input_global_scale', 'talk
er.model.layers.16.mlp.down_proj.input_zero_point', 'talker.model.layers.16.mlp.down_proj.weight_global_scale', 'talker
.model.layers.16.mlp.down_proj.weight_scale', 'talker.model.layers.16.mlp.down_proj.weight_zero_point', 'talker.model.l
ayers.16.mlp.gate_proj.input_global_scale', 'talker.model.layers.16.mlp.gate_proj.input_zero_point', 'talker.model.laye
rs.16.mlp.gate_proj.weight_global_scale', 'talker.model.layers.16.mlp.gate_proj.weight_scale', 'talker.model.layers.16.
mlp.gate_proj.weight_zero_point', 'talker.model.layers.16.mlp.up_proj.input_global_scale', 'talker.model.layers.16.mlp.
up_proj.input_zero_point', 'talker.model.layers.16.mlp.up_proj.weight_global_scale', 'talker.model.layers.16.mlp.up_pro
j.weight_scale', 'talker.model.layers.16.mlp.up_proj.weight_zero_point', 'talker.model.layers.16.self_attn.k_proj.input
_global_scale', 'talker.model.layers.16.self_attn.k_proj.input_zero_point', 'talker.model.layers.16.self_attn.k_proj.we
ight_global_scale', 'talker.model.layers.16.self_attn.k_proj.weight_scale', 'talker.model.layers.16.self_attn.k_proj.we
ight_zero_point', 'talker.model.layers.16.self_attn.o_proj.input_global_scale', 'talker.model.layers.16.self_attn.o_pro
j.input_zero_point', 'talker.model.layers.16.self_attn.o_proj.weight_global_scale', 'talker.model.layers.16.self_attn.o
_proj.weight_scale', 'talker.model.layers.16.self_attn.o_proj.weight_zero_point', 'talker.model.layers.16.self_attn.q_p
roj.input_global_scale', 'talker.model.layers.16.self_attn.q_proj.input_zero_point', 'talker.model.layers.16.self_attn.
q_proj.weight_global_scale', 'talker.model.layers.16.self_attn.q_proj.weight_scale', 'talker.model.layers.16.self_attn.
q_proj.weight_zero_point', 'talker.model.layers.16.self_attn.v_proj.input_global_scale', 'talker.model.layers.16.self_a
ttn.v_proj.input_zero_point', 'talker.model.layers.16.self_attn.v_proj.weight_global_scale', 'talker.model.layers.16.se
lf_attn.v_proj.weight_scale', 'talker.model.layers.16.self_attn.v_proj.weight_zero_point', 'talker.model.layers.17.mlp.
down_proj.input_global_scale', 'talker.model.layers.17.mlp.down_proj.input_zero_point', 'talker.model.layers.17.mlp.dow
n_proj.weight_global_scale', 'talker.model.layers.17.mlp.down_proj.weight_scale', 'talker.model.layers.17.mlp.down_proj
.weight_zero_point', 'talker.model.layers.17.mlp.gate_proj.input_global_scale', 'talker.model.layers.17.mlp.gate_proj.i
nput_zero_point', 'talker.model.layers.17.mlp.gate_proj.weight_global_scale', 'talker.model.layers.17.mlp.gate_proj.wei
ght_scale', 'talker.model.layers.17.mlp.gate_proj.weight_zero_point', 'talker.model.layers.17.mlp.up_proj.input_global_
scale', 'talker.model.layers.17.mlp.up_proj.input_zero_point', 'talker.model.layers.17.mlp.up_proj.weight_global_scale'
, 'talker.model.layers.17.mlp.up_proj.weight_scale', 'talker.model.layers.17.mlp.up_proj.weight_zero_point', 'talker.mo
del.layers.17.self_attn.k_proj.input_global_scale', 'talker.model.layers.17.self_attn.k_proj.input_zero_point', 'talker
.model.layers.17.self_attn.k_proj.weight_global_scale', 'talker.model.layers.17.self_attn.k_proj.weight_scale', 'talker
.model.layers.17.self_attn.k_proj.weight_zero_point', 'talker.model.layers.17.self_attn.o_proj.input_global_scale', 'ta
lker.model.layers.17.self_attn.o_proj.input_zero_point', 'talker.model.layers.17.self_attn.o_proj.weight_global_scale',
 'talker.model.layers.17.self_attn.o_proj.weight_scale', 'talker.model.layers.17.self_attn.o_proj.weight_zero_point', '
talker.model.layers.17.self_attn.q_proj.input_global_scale', 'talker.model.layers.17.self_attn.q_proj.input_zero_point'
, 'talker.model.layers.17.self_attn.q_proj.weight_global_scale', 'talker.model.layers.17.self_attn.q_proj.weight_scale'
, 'talker.model.layers.17.self_attn.q_proj.weight_zero_point', 'talker.model.layers.17.self_attn.v_proj.input_global_sc
ale', 'talker.model.layers.17.self_attn.v_proj.input_zero_point', 'talker.model.layers.17.self_attn.v_proj.weight_globa
l_scale', 'talker.model.layers.17.self_attn.v_proj.weight_scale', 'talker.model.layers.17.self_attn.v_proj.weight_zero_
point', 'talker.model.layers.18.mlp.down_proj.input_global_scale', 'talker.model.layers.18.mlp.down_proj.input_zero_poi
nt', 'talker.model.layers.18.mlp.down_proj.weight_global_scale', 'talker.model.layers.18.mlp.down_proj.weight_scale', '
talker.model.layers.18.mlp.down_proj.weight_zero_point', 'talker.model.layers.18.mlp.gate_proj.input_global_scale', 'ta
lker.model.layers.18.mlp.gate_proj.input_zero_point', 'talker.model.layers.18.mlp.gate_proj.weight_global_scale', 'talk
er.model.layers.18.mlp.gate_proj.weight_scale', 'talker.model.layers.18.mlp.gate_proj.weight_zero_point', 'talker.model
.layers.18.mlp.up_proj.input_global_scale', 'talker.model.layers.18.mlp.up_proj.input_zero_point', 'talker.model.layers
.18.mlp.up_proj.weight_global_scale', 'talker.model.layers.18.mlp.up_proj.weight_scale', 'talker.model.layers.18.mlp.up
_proj.weight_zero_point', 'talker.model.layers.18.self_attn.k_proj.input_global_scale', 'talker.model.layers.18.self_at
tn.k_proj.input_zero_point', 'talker.model.layers.18.self_attn.k_proj.weight_global_scale', 'talker.model.layers.18.sel
f_attn.k_proj.weight_scale', 'talker.model.layers.18.self_attn.k_proj.weight_zero_point', 'talker.model.layers.18.self_
attn.o_proj.input_global_scale', 'talker.model.layers.18.self_attn.o_proj.input_zero_point', 'talker.model.layers.18.se
lf_attn.o_proj.weight_global_scale', 'talker.model.layers.18.self_attn.o_proj.weight_scale', 'talker.model.layers.18.se
lf_attn.o_proj.weight_zero_point', 'talker.model.layers.18.self_attn.q_proj.input_global_scale', 'talker.model.layers.1
8.self_attn.q_proj.input_zero_point', 'talker.model.layers.18.self_attn.q_proj.weight_global_scale', 'talker.model.laye
rs.18.self_attn.q_proj.weight_scale', 'talker.model.layers.18.self_attn.q_proj.weight_zero_point', 'talker.model.layers
.18.self_attn.v_proj.input_global_scale', 'talker.model.layers.18.self_attn.v_proj.input_zero_point', 'talker.model.lay
ers.18.self_attn.v_proj.weight_global_scale', 'talker.model.layers.18.self_attn.v_proj.weight_scale', 'talker.model.lay
ers.18.self_attn.v_proj.weight_zero_point', 'talker.model.layers.19.mlp.down_proj.input_global_scale', 'talker.model.la
yers.19.mlp.down_proj.input_zero_point', 'talker.model.layers.19.mlp.down_proj.weight_global_scale', 'talker.model.laye
rs.19.mlp.down_proj.weight_scale', 'talker.model.layers.19.mlp.down_proj.weight_zero_point', 'talker.model.layers.19.ml
p.gate_proj.input_global_scale', 'talker.model.layers.19.mlp.gate_proj.input_zero_point', 'talker.model.layers.19.mlp.g
ate_proj.weight_global_scale', 'talker.model.layers.19.mlp.gate_proj.weight_scale', 'talker.model.layers.19.mlp.gate_pr
oj.weight_zero_point', 'talker.model.layers.19.mlp.up_proj.input_global_scale', 'talker.model.layers.19.mlp.up_proj.inp
ut_zero_point', 'talker.model.layers.19.mlp.up_proj.weight_global_scale', 'talker.model.layers.19.mlp.up_proj.weight_sc
ale', 'talker.model.layers.19.mlp.up_proj.weight_zero_point', 'talker.model.layers.19.self_attn.k_proj.input_global_sca
le', 'talker.model.layers.19.self_attn.k_proj.input_zero_point', 'talker.model.layers.19.self_attn.k_proj.weight_global
_scale', 'talker.model.layers.19.self_attn.k_proj.weight_scale', 'talker.model.layers.19.self_attn.k_proj.weight_zero_p
oint', 'talker.model.layers.19.self_attn.o_proj.input_global_scale', 'talker.model.layers.19.self_attn.o_proj.input_zer
o_point', 'talker.model.layers.19.self_attn.o_proj.weight_global_scale', 'talker.model.layers.19.self_attn.o_proj.weigh
t_scale', 'talker.model.layers.19.self_attn.o_proj.weight_zero_point', 'talker.model.layers.19.self_attn.q_proj.input_g
lobal_scale', 'talker.model.layers.19.self_attn.q_proj.input_zero_point', 'talker.model.layers.19.self_attn.q_proj.weig
ht_global_scale', 'talker.model.layers.19.self_attn.q_proj.weight_scale', 'talker.model.layers.19.self_attn.q_proj.weig
ht_zero_point', 'talker.model.layers.19.self_attn.v_proj.input_global_scale', 'talker.model.layers.19.self_attn.v_proj.
input_zero_point', 'talker.model.layers.19.self_attn.v_proj.weight_global_scale', 'talker.model.layers.19.self_attn.v_p
roj.weight_scale', 'talker.model.layers.19.self_attn.v_proj.weight_zero_point', 'talker.model.layers.2.mlp.down_proj.in
put_global_scale', 'talker.model.layers.2.mlp.down_proj.input_zero_point', 'talker.model.layers.2.mlp.down_proj.weight_
global_scale', 'talker.model.layers.2.mlp.down_proj.weight_scale', 'talker.model.layers.2.mlp.down_proj.weight_zero_poi
nt', 'talker.model.layers.2.mlp.gate_proj.input_global_scale', 'talker.model.layers.2.mlp.gate_proj.input_zero_point', 
'talker.model.layers.2.mlp.gate_proj.weight_global_scale', 'talker.model.layers.2.mlp.gate_proj.weight_scale', 'talker.
model.layers.2.mlp.gate_proj.weight_zero_point', 'talker.model.layers.2.mlp.up_proj.input_global_scale', 'talker.model.
layers.2.mlp.up_proj.input_zero_point', 'talker.model.layers.2.mlp.up_proj.weight_global_scale', 'talker.model.layers.2
.mlp.up_proj.weight_scale', 'talker.model.layers.2.mlp.up_proj.weight_zero_point', 'talker.model.layers.2.self_attn.k_p
roj.input_global_scale', 'talker.model.layers.2.self_attn.k_proj.input_zero_point', 'talker.model.layers.2.self_attn.k_
proj.weight_global_scale', 'talker.model.layers.2.self_attn.k_proj.weight_scale', 'talker.model.layers.2.self_attn.k_pr
oj.weight_zero_point', 'talker.model.layers.2.self_attn.o_proj.input_global_scale', 'talker.model.layers.2.self_attn.o_
proj.input_zero_point', 'talker.model.layers.2.self_attn.o_proj.weight_global_scale', 'talker.model.layers.2.self_attn.
o_proj.weight_scale', 'talker.model.layers.2.self_attn.o_proj.weight_zero_point', 'talker.model.layers.2.self_attn.q_pr
oj.input_global_scale', 'talker.model.layers.2.self_attn.q_proj.input_zero_point', 'talker.model.layers.2.self_attn.q_p
roj.weight_global_scale', 'talker.model.layers.2.self_attn.q_proj.weight_scale', 'talker.model.layers.2.self_attn.q_pro
j.weight_zero_point', 'talker.model.layers.2.self_attn.v_proj.input_global_scale', 'talker.model.layers.2.self_attn.v_p
roj.input_zero_point', 'talker.model.layers.2.self_attn.v_proj.weight_global_scale', 'talker.model.layers.2.self_attn.v
_proj.weight_scale', 'talker.model.layers.2.self_attn.v_proj.weight_zero_point', 'talker.model.layers.20.mlp.down_proj.
input_global_scale', 'talker.model.layers.20.mlp.down_proj.input_zero_point', 'talker.model.layers.20.mlp.down_proj.wei
ght_global_scale', 'talker.model.layers.20.mlp.down_proj.weight_scale', 'talker.model.layers.20.mlp.down_proj.weight_ze
ro_point', 'talker.model.layers.20.mlp.gate_proj.input_global_scale', 'talker.model.layers.20.mlp.gate_proj.input_zero_
point', 'talker.model.layers.20.mlp.gate_proj.weight_global_scale', 'talker.model.layers.20.mlp.gate_proj.weight_scale'
, 'talker.model.layers.20.mlp.gate_proj.weight_zero_point', 'talker.model.layers.20.mlp.up_proj.input_global_scale', 't
alker.model.layers.20.mlp.up_proj.input_zero_point', 'talker.model.layers.20.mlp.up_proj.weight_global_scale', 'talker.
model.layers.20.mlp.up_proj.weight_scale', 'talker.model.layers.20.mlp.up_proj.weight_zero_point', 'talker.model.layers
.20.self_attn.k_proj.input_global_scale', 'talker.model.layers.20.self_attn.k_proj.input_zero_point', 'talker.model.lay
ers.20.self_attn.k_proj.weight_global_scale', 'talker.model.layers.20.self_attn.k_proj.weight_scale', 'talker.model.lay
ers.20.self_attn.k_proj.weight_zero_point', 'talker.model.layers.20.self_attn.o_proj.input_global_scale', 'talker.model
.layers.20.self_attn.o_proj.input_zero_point', 'talker.model.layers.20.self_attn.o_proj.weight_global_scale', 'talker.m
odel.layers.20.self_attn.o_proj.weight_scale', 'talker.model.layers.20.self_attn.o_proj.weight_zero_point', 'talker.mod
el.layers.20.self_attn.q_proj.input_global_scale', 'talker.model.layers.20.self_attn.q_proj.input_zero_point', 'talker.
model.layers.20.self_attn.q_proj.weight_global_scale', 'talker.model.layers.20.self_attn.q_proj.weight_scale', 'talker.
model.layers.20.self_attn.q_proj.weight_zero_point', 'talker.model.layers.20.self_attn.v_proj.input_global_scale', 'tal
ker.model.layers.20.self_attn.v_proj.input_zero_point', 'talker.model.layers.20.self_attn.v_proj.weight_global_scale', 
'talker.model.layers.20.self_attn.v_proj.weight_scale', 'talker.model.layers.20.self_attn.v_proj.weight_zero_point', 't
alker.model.layers.21.mlp.down_proj.input_global_scale', 'talker.model.layers.21.mlp.down_proj.input_zero_point', 'talk
er.model.layers.21.mlp.down_proj.weight_global_scale', 'talker.model.layers.21.mlp.down_proj.weight_scale', 'talker.mod
el.layers.21.mlp.down_proj.weight_zero_point', 'talker.model.layers.21.mlp.gate_proj.input_global_scale', 'talker.model
.layers.21.mlp.gate_proj.input_zero_point', 'talker.model.layers.21.mlp.gate_proj.weight_global_scale', 'talker.model.l
ayers.21.mlp.gate_proj.weight_scale', 'talker.model.layers.21.mlp.gate_proj.weight_zero_point', 'talker.model.layers.21
.mlp.up_proj.input_global_scale', 'talker.model.layers.21.mlp.up_proj.input_zero_point', 'talker.model.layers.21.mlp.up
_proj.weight_global_scale', 'talker.model.layers.21.mlp.up_proj.weight_scale', 'talker.model.layers.21.mlp.up_proj.weig
ht_zero_point', 'talker.model.layers.21.self_attn.k_proj.input_global_scale', 'talker.model.layers.21.self_attn.k_proj.
input_zero_point', 'talker.model.layers.21.self_attn.k_proj.weight_global_scale', 'talker.model.layers.21.self_attn.k_p
roj.weight_scale', 'talker.model.layers.21.self_attn.k_proj.weight_zero_point', 'talker.model.layers.21.self_attn.o_pro
j.input_global_scale', 'talker.model.layers.21.self_attn.o_proj.input_zero_point', 'talker.model.layers.21.self_attn.o_
proj.weight_global_scale', 'talker.model.layers.21.self_attn.o_proj.weight_scale', 'talker.model.layers.21.self_attn.o_
proj.weight_zero_point', 'talker.model.layers.21.self_attn.q_proj.input_global_scale', 'talker.model.layers.21.self_att
n.q_proj.input_zero_point', 'talker.model.layers.21.self_attn.q_proj.weight_global_scale', 'talker.model.layers.21.self
_attn.q_proj.weight_scale', 'talker.model.layers.21.self_attn.q_proj.weight_zero_point', 'talker.model.layers.21.self_a
ttn.v_proj.input_global_scale', 'talker.model.layers.21.self_attn.v_proj.input_zero_point', 'talker.model.layers.21.sel
f_attn.v_proj.weight_global_scale', 'talker.model.layers.21.self_attn.v_proj.weight_scale', 'talker.model.layers.21.sel
f_attn.v_proj.weight_zero_point', 'talker.model.layers.22.mlp.down_proj.input_global_scale', 'talker.model.layers.22.ml
p.down_proj.input_zero_point', 'talker.model.layers.22.mlp.down_proj.weight_global_scale', 'talker.model.layers.22.mlp.
down_proj.weight_scale', 'talker.model.layers.22.mlp.down_proj.weight_zero_point', 'talker.model.layers.22.mlp.gate_pro
j.input_global_scale', 'talker.model.layers.22.mlp.gate_proj.input_zero_point', 'talker.model.layers.22.mlp.gate_proj.w
eight_global_scale', 'talker.model.layers.22.mlp.gate_proj.weight_scale', 'talker.model.layers.22.mlp.gate_proj.weight_
zero_point', 'talker.model.layers.22.mlp.up_proj.input_global_scale', 'talker.model.layers.22.mlp.up_proj.input_zero_po
int', 'talker.model.layers.22.mlp.up_proj.weight_global_scale', 'talker.model.layers.22.mlp.up_proj.weight_scale', 'tal
ker.model.layers.22.mlp.up_proj.weight_zero_point', 'talker.model.layers.22.self_attn.k_proj.input_global_scale', 'talk
er.model.layers.22.self_attn.k_proj.input_zero_point', 'talker.model.layers.22.self_attn.k_proj.weight_global_scale', '
talker.model.layers.22.self_attn.k_proj.weight_scale', 'talker.model.layers.22.self_attn.k_proj.weight_zero_point', 'ta
lker.model.layers.22.self_attn.o_proj.input_global_scale', 'talker.model.layers.22.self_attn.o_proj.input_zero_point', 
'talker.model.layers.22.self_attn.o_proj.weight_global_scale', 'talker.model.layers.22.self_attn.o_proj.weight_scale', 
'talker.model.layers.22.self_attn.o_proj.weight_zero_point', 'talker.model.layers.22.self_attn.q_proj.input_global_scal
e', 'talker.model.layers.22.self_attn.q_proj.input_zero_point', 'talker.model.layers.22.self_attn.q_proj.weight_global_
scale', 'talker.model.layers.22.self_attn.q_proj.weight_scale', 'talker.model.layers.22.self_attn.q_proj.weight_zero_po
int', 'talker.model.layers.22.self_attn.v_proj.input_global_scale', 'talker.model.layers.22.self_attn.v_proj.input_zero
_point', 'talker.model.layers.22.self_attn.v_proj.weight_global_scale', 'talker.model.layers.22.self_attn.v_proj.weight
_scale', 'talker.model.layers.22.self_attn.v_proj.weight_zero_point', 'talker.model.layers.23.mlp.down_proj.input_globa
l_scale', 'talker.model.layers.23.mlp.down_proj.input_zero_point', 'talker.model.layers.23.mlp.down_proj.weight_global_
scale', 'talker.model.layers.23.mlp.down_proj.weight_scale', 'talker.model.layers.23.mlp.down_proj.weight_zero_point', 
'talker.model.layers.23.mlp.gate_proj.input_global_scale', 'talker.model.layers.23.mlp.gate_proj.input_zero_point', 'ta
lker.model.layers.23.mlp.gate_proj.weight_global_scale', 'talker.model.layers.23.mlp.gate_proj.weight_scale', 'talker.m
odel.layers.23.mlp.gate_proj.weight_zero_point', 'talker.model.layers.23.mlp.up_proj.input_global_scale', 'talker.model
.layers.23.mlp.up_proj.input_zero_point', 'talker.model.layers.23.mlp.up_proj.weight_global_scale', 'talker.model.layer
s.23.mlp.up_proj.weight_scale', 'talker.model.layers.23.mlp.up_proj.weight_zero_point', 'talker.model.layers.23.self_at
tn.k_proj.input_global_scale', 'talker.model.layers.23.self_attn.k_proj.input_zero_point', 'talker.model.layers.23.self
_attn.k_proj.weight_global_scale', 'talker.model.layers.23.self_attn.k_proj.weight_scale', 'talker.model.layers.23.self
_attn.k_proj.weight_zero_point', 'talker.model.layers.23.self_attn.o_proj.input_global_scale', 'talker.model.layers.23.
self_attn.o_proj.input_zero_point', 'talker.model.layers.23.self_attn.o_proj.weight_global_scale', 'talker.model.layers
.23.self_attn.o_proj.weight_scale', 'talker.model.layers.23.self_attn.o_proj.weight_zero_point', 'talker.model.layers.2
3.self_attn.q_proj.input_global_scale', 'talker.model.layers.23.self_attn.q_proj.input_zero_point', 'talker.model.layer
s.23.self_attn.q_proj.weight_global_scale', 'talker.model.layers.23.self_attn.q_proj.weight_scale', 'talker.model.layer
s.23.self_attn.q_proj.weight_zero_point', 'talker.model.layers.23.self_attn.v_proj.input_global_scale', 'talker.model.l
ayers.23.self_attn.v_proj.input_zero_point', 'talker.model.layers.23.self_attn.v_proj.weight_global_scale', 'talker.mod
el.layers.23.self_attn.v_proj.weight_scale', 'talker.model.layers.23.self_attn.v_proj.weight_zero_point', 'talker.model
.layers.24.mlp.down_proj.input_global_scale', 'talker.model.layers.24.mlp.down_proj.input_zero_point', 'talker.model.la
yers.24.mlp.down_proj.weight_global_scale', 'talker.model.layers.24.mlp.down_proj.weight_scale', 'talker.model.layers.2
4.mlp.down_proj.weight_zero_point', 'talker.model.layers.24.mlp.gate_proj.input_global_scale', 'talker.model.layers.24.
mlp.gate_proj.input_zero_point', 'talker.model.layers.24.mlp.gate_proj.weight_global_scale', 'talker.model.layers.24.ml
p.gate_proj.weight_scale', 'talker.model.layers.24.mlp.gate_proj.weight_zero_point', 'talker.model.layers.24.mlp.up_pro
j.input_global_scale', 'talker.model.layers.24.mlp.up_proj.input_zero_point', 'talker.model.layers.24.mlp.up_proj.weigh
t_global_scale', 'talker.model.layers.24.mlp.up_proj.weight_scale', 'talker.model.layers.24.mlp.up_proj.weight_zero_poi
nt', 'talker.model.layers.24.self_attn.k_proj.input_global_scale', 'talker.model.layers.24.self_attn.k_proj.input_zero_
point', 'talker.model.layers.24.self_attn.k_proj.weight_global_scale', 'talker.model.layers.24.self_attn.k_proj.weight_
scale', 'talker.model.layers.24.self_attn.k_proj.weight_zero_point', 'talker.model.layers.24.self_attn.o_proj.input_glo
bal_scale', 'talker.model.layers.24.self_attn.o_proj.input_zero_point', 'talker.model.layers.24.self_attn.o_proj.weight
_global_scale', 'talker.model.layers.24.self_attn.o_proj.weight_scale', 'talker.model.layers.24.self_attn.o_proj.weight
_zero_point', 'talker.model.layers.24.self_attn.q_proj.input_global_scale', 'talker.model.layers.24.self_attn.q_proj.in
put_zero_point', 'talker.model.layers.24.self_attn.q_proj.weight_global_scale', 'talker.model.layers.24.self_attn.q_pro
j.weight_scale', 'talker.model.layers.24.self_attn.q_proj.weight_zero_point', 'talker.model.layers.24.self_attn.v_proj.
input_global_scale', 'talker.model.layers.24.self_attn.v_proj.input_zero_point', 'talker.model.layers.24.self_attn.v_pr
oj.weight_global_scale', 'talker.model.layers.24.self_attn.v_proj.weight_scale', 'talker.model.layers.24.self_attn.v_pr
oj.weight_zero_point', 'talker.model.layers.25.mlp.down_proj.input_global_scale', 'talker.model.layers.25.mlp.down_proj
.input_zero_point', 'talker.model.layers.25.mlp.down_proj.weight_global_scale', 'talker.model.layers.25.mlp.down_proj.w
eight_scale', 'talker.model.layers.25.mlp.down_proj.weight_zero_point', 'talker.model.layers.25.mlp.gate_proj.input_glo
bal_scale', 'talker.model.layers.25.mlp.gate_proj.input_zero_point', 'talker.model.layers.25.mlp.gate_proj.weight_globa
l_scale', 'talker.model.layers.25.mlp.gate_proj.weight_scale', 'talker.model.layers.25.mlp.gate_proj.weight_zero_point'
, 'talker.model.layers.25.mlp.up_proj.input_global_scale', 'talker.model.layers.25.mlp.up_proj.input_zero_point', 'talk
er.model.layers.25.mlp.up_proj.weight_global_scale', 'talker.model.layers.25.mlp.up_proj.weight_scale', 'talker.model.l
ayers.25.mlp.up_proj.weight_zero_point', 'talker.model.layers.25.self_attn.k_proj.input_global_scale', 'talker.model.la
yers.25.self_attn.k_proj.input_zero_point', 'talker.model.layers.25.self_attn.k_proj.weight_global_scale', 'talker.mode
l.layers.25.self_attn.k_proj.weight_scale', 'talker.model.layers.25.self_attn.k_proj.weight_zero_point', 'talker.model.
layers.25.self_attn.o_proj.input_global_scale', 'talker.model.layers.25.self_attn.o_proj.input_zero_point', 'talker.mod
el.layers.25.self_attn.o_proj.weight_global_scale', 'talker.model.layers.25.self_attn.o_proj.weight_scale', 'talker.mod
el.layers.25.self_attn.o_proj.weight_zero_point', 'talker.model.layers.25.self_attn.q_proj.input_global_scale', 'talker
.model.layers.25.self_attn.q_proj.input_zero_point', 'talker.model.layers.25.self_attn.q_proj.weight_global_scale', 'ta
lker.model.layers.25.self_attn.q_proj.weight_scale', 'talker.model.layers.25.self_attn.q_proj.weight_zero_point', 'talk
er.model.layers.25.self_attn.v_proj.input_global_scale', 'talker.model.layers.25.self_attn.v_proj.input_zero_point', 't
alker.model.layers.25.self_attn.v_proj.weight_global_scale', 'talker.model.layers.25.self_attn.v_proj.weight_scale', 't
alker.model.layers.25.self_attn.v_proj.weight_zero_point', 'talker.model.layers.26.mlp.down_proj.input_global_scale', '
talker.model.layers.26.mlp.down_proj.input_zero_point', 'talker.model.layers.26.mlp.down_proj.weight_global_scale', 'ta
lker.model.layers.26.mlp.down_proj.weight_scale', 'talker.model.layers.26.mlp.down_proj.weight_zero_point', 'talker.mod
el.layers.26.mlp.gate_proj.input_global_scale', 'talker.model.layers.26.mlp.gate_proj.input_zero_point', 'talker.model.
layers.26.mlp.gate_proj.weight_global_scale', 'talker.model.layers.26.mlp.gate_proj.weight_scale', 'talker.model.layers
.26.mlp.gate_proj.weight_zero_point', 'talker.model.layers.26.mlp.up_proj.input_global_scale', 'talker.model.layers.26.
mlp.up_proj.input_zero_point', 'talker.model.layers.26.mlp.up_proj.weight_global_scale', 'talker.model.layers.26.mlp.up
_proj.weight_scale', 'talker.model.layers.26.mlp.up_proj.weight_zero_point', 'talker.model.layers.26.self_attn.k_proj.i
nput_global_scale', 'talker.model.layers.26.self_attn.k_proj.input_zero_point', 'talker.model.layers.26.self_attn.k_pro
j.weight_global_scale', 'talker.model.layers.26.self_attn.k_proj.weight_scale', 'talker.model.layers.26.self_attn.k_pro
j.weight_zero_point', 'talker.model.layers.26.self_attn.o_proj.input_global_scale', 'talker.model.layers.26.self_attn.o
_proj.input_zero_point', 'talker.model.layers.26.self_attn.o_proj.weight_global_scale', 'talker.model.layers.26.self_at
tn.o_proj.weight_scale', 'talker.model.layers.26.self_attn.o_proj.weight_zero_point', 'talker.model.layers.26.self_attn
.q_proj.input_global_scale', 'talker.model.layers.26.self_attn.q_proj.input_zero_point', 'talker.model.layers.26.self_a
ttn.q_proj.weight_global_scale', 'talker.model.layers.26.self_attn.q_proj.weight_scale', 'talker.model.layers.26.self_a
ttn.q_proj.weight_zero_point', 'talker.model.layers.26.self_attn.v_proj.input_global_scale', 'talker.model.layers.26.se
lf_attn.v_proj.input_zero_point', 'talker.model.layers.26.self_attn.v_proj.weight_global_scale', 'talker.model.layers.2
6.self_attn.v_proj.weight_scale', 'talker.model.layers.26.self_attn.v_proj.weight_zero_point', 'talker.model.layers.27.
mlp.down_proj.input_global_scale', 'talker.model.layers.27.mlp.down_proj.input_zero_point', 'talker.model.layers.27.mlp
.down_proj.weight_global_scale', 'talker.model.layers.27.mlp.down_proj.weight_scale', 'talker.model.layers.27.mlp.down_
proj.weight_zero_point', 'talker.model.layers.27.mlp.gate_proj.input_global_scale', 'talker.model.layers.27.mlp.gate_pr
oj.input_zero_point', 'talker.model.layers.27.mlp.gate_proj.weight_global_scale', 'talker.model.layers.27.mlp.gate_proj
.weight_scale', 'talker.model.layers.27.mlp.gate_proj.weight_zero_point', 'talker.model.layers.27.mlp.up_proj.input_glo
bal_scale', 'talker.model.layers.27.mlp.up_proj.input_zero_point', 'talker.model.layers.27.mlp.up_proj.weight_global_sc
ale', 'talker.model.layers.27.mlp.up_proj.weight_scale', 'talker.model.layers.27.mlp.up_proj.weight_zero_point', 'talke
r.model.layers.27.self_attn.k_proj.input_global_scale', 'talker.model.layers.27.self_attn.k_proj.input_zero_point', 'ta
lker.model.layers.27.self_attn.k_proj.weight_global_scale', 'talker.model.layers.27.self_attn.k_proj.weight_scale', 'ta
lker.model.layers.27.self_attn.k_proj.weight_zero_point', 'talker.model.layers.27.self_attn.o_proj.input_global_scale',
 'talker.model.layers.27.self_attn.o_proj.input_zero_point', 'talker.model.layers.27.self_attn.o_proj.weight_global_sca
le', 'talker.model.layers.27.self_attn.o_proj.weight_scale', 'talker.model.layers.27.self_attn.o_proj.weight_zero_point
', 'talker.model.layers.27.self_attn.q_proj.input_global_scale', 'talker.model.layers.27.self_attn.q_proj.input_zero_po
int', 'talker.model.layers.27.self_attn.q_proj.weight_global_scale', 'talker.model.layers.27.self_attn.q_proj.weight_sc
ale', 'talker.model.layers.27.self_attn.q_proj.weight_zero_point', 'talker.model.layers.27.self_attn.v_proj.input_globa
l_scale', 'talker.model.layers.27.self_attn.v_proj.input_zero_point', 'talker.model.layers.27.self_attn.v_proj.weight_g
lobal_scale', 'talker.model.layers.27.self_attn.v_proj.weight_scale', 'talker.model.layers.27.self_attn.v_proj.weight_z
ero_point', 'talker.model.layers.3.mlp.down_proj.input_global_scale', 'talker.model.layers.3.mlp.down_proj.input_zero_p
oint', 'talker.model.layers.3.mlp.down_proj.weight_global_scale', 'talker.model.layers.3.mlp.down_proj.weight_scale', '
talker.model.layers.3.mlp.down_proj.weight_zero_point', 'talker.model.layers.3.mlp.gate_proj.input_global_scale', 'talk
er.model.layers.3.mlp.gate_proj.input_zero_point', 'talker.model.layers.3.mlp.gate_proj.weight_global_scale', 'talker.m
odel.layers.3.mlp.gate_proj.weight_scale', 'talker.model.layers.3.mlp.gate_proj.weight_zero_point', 'talker.model.layer
s.3.mlp.up_proj.input_global_scale', 'talker.model.layers.3.mlp.up_proj.input_zero_point', 'talker.model.layers.3.mlp.u
p_proj.weight_global_scale', 'talker.model.layers.3.mlp.up_proj.weight_scale', 'talker.model.layers.3.mlp.up_proj.weigh
t_zero_point', 'talker.model.layers.3.self_attn.k_proj.input_global_scale', 'talker.model.layers.3.self_attn.k_proj.inp
ut_zero_point', 'talker.model.layers.3.self_attn.k_proj.weight_global_scale', 'talker.model.layers.3.self_attn.k_proj.w
eight_scale', 'talker.model.layers.3.self_attn.k_proj.weight_zero_point', 'talker.model.layers.3.self_attn.o_proj.input
_global_scale', 'talker.model.layers.3.self_attn.o_proj.input_zero_point', 'talker.model.layers.3.self_attn.o_proj.weig
ht_global_scale', 'talker.model.layers.3.self_attn.o_proj.weight_scale', 'talker.model.layers.3.self_attn.o_proj.weight
_zero_point', 'talker.model.layers.3.self_attn.q_proj.input_global_scale', 'talker.model.layers.3.self_attn.q_proj.inpu
t_zero_point', 'talker.model.layers.3.self_attn.q_proj.weight_global_scale', 'talker.model.layers.3.self_attn.q_proj.we
ight_scale', 'talker.model.layers.3.self_attn.q_proj.weight_zero_point', 'talker.model.layers.3.self_attn.v_proj.input_
global_scale', 'talker.model.layers.3.self_attn.v_proj.input_zero_point', 'talker.model.layers.3.self_attn.v_proj.weigh
t_global_scale', 'talker.model.layers.3.self_attn.v_proj.weight_scale', 'talker.model.layers.3.self_attn.v_proj.weight_
zero_point', 'talker.model.layers.4.mlp.down_proj.input_global_scale', 'talker.model.layers.4.mlp.down_proj.input_zero_
point', 'talker.model.layers.4.mlp.down_proj.weight_global_scale', 'talker.model.layers.4.mlp.down_proj.weight_scale', 
'talker.model.layers.4.mlp.down_proj.weight_zero_point', 'talker.model.layers.4.mlp.gate_proj.input_global_scale', 'tal
ker.model.layers.4.mlp.gate_proj.input_zero_point', 'talker.model.layers.4.mlp.gate_proj.weight_global_scale', 'talker.
model.layers.4.mlp.gate_proj.weight_scale', 'talker.model.layers.4.mlp.gate_proj.weight_zero_point', 'talker.model.laye
rs.4.mlp.up_proj.input_global_scale', 'talker.model.layers.4.mlp.up_proj.input_zero_point', 'talker.model.layers.4.mlp.
up_proj.weight_global_scale', 'talker.model.layers.4.mlp.up_proj.weight_scale', 'talker.model.layers.4.mlp.up_proj.weig
ht_zero_point', 'talker.model.layers.4.self_attn.k_proj.input_global_scale', 'talker.model.layers.4.self_attn.k_proj.in
put_zero_point', 'talker.model.layers.4.self_attn.k_proj.weight_global_scale', 'talker.model.layers.4.self_attn.k_proj.
weight_scale', 'talker.model.layers.4.self_attn.k_proj.weight_zero_point', 'talker.model.layers.4.self_attn.o_proj.inpu
t_global_scale', 'talker.model.layers.4.self_attn.o_proj.input_zero_point', 'talker.model.layers.4.self_attn.o_proj.wei
ght_global_scale', 'talker.model.layers.4.self_attn.o_proj.weight_scale', 'talker.model.layers.4.self_attn.o_proj.weigh
t_zero_point', 'talker.model.layers.4.self_attn.q_proj.input_global_scale', 'talker.model.layers.4.self_attn.q_proj.inp
ut_zero_point', 'talker.model.layers.4.self_attn.q_proj.weight_global_scale', 'talker.model.layers.4.self_attn.q_proj.w
eight_scale', 'talker.model.layers.4.self_attn.q_proj.weight_zero_point', 'talker.model.layers.4.self_attn.v_proj.input
_global_scale', 'talker.model.layers.4.self_attn.v_proj.input_zero_point', 'talker.model.layers.4.self_attn.v_proj.weig
ht_global_scale', 'talker.model.layers.4.self_attn.v_proj.weight_scale', 'talker.model.layers.4.self_attn.v_proj.weight
_zero_point', 'talker.model.layers.5.mlp.down_proj.input_global_scale', 'talker.model.layers.5.mlp.down_proj.input_zero
_point', 'talker.model.layers.5.mlp.down_proj.weight_global_scale', 'talker.model.layers.5.mlp.down_proj.weight_scale',
 'talker.model.layers.5.mlp.down_proj.weight_zero_point', 'talker.model.layers.5.mlp.gate_proj.input_global_scale', 'ta
lker.model.layers.5.mlp.gate_proj.input_zero_point', 'talker.model.layers.5.mlp.gate_proj.weight_global_scale', 'talker
.model.layers.5.mlp.gate_proj.weight_scale', 'talker.model.layers.5.mlp.gate_proj.weight_zero_point', 'talker.model.lay
ers.5.mlp.up_proj.input_global_scale', 'talker.model.layers.5.mlp.up_proj.input_zero_point', 'talker.model.layers.5.mlp
.up_proj.weight_global_scale', 'talker.model.layers.5.mlp.up_proj.weight_scale', 'talker.model.layers.5.mlp.up_proj.wei
ght_zero_point', 'talker.model.layers.5.self_attn.k_proj.input_global_scale', 'talker.model.layers.5.self_attn.k_proj.i
nput_zero_point', 'talker.model.layers.5.self_attn.k_proj.weight_global_scale', 'talker.model.layers.5.self_attn.k_proj
.weight_scale', 'talker.model.layers.5.self_attn.k_proj.weight_zero_point', 'talker.model.layers.5.self_attn.o_proj.inp
ut_global_scale', 'talker.model.layers.5.self_attn.o_proj.input_zero_point', 'talker.model.layers.5.self_attn.o_proj.we
ight_global_scale', 'talker.model.layers.5.self_attn.o_proj.weight_scale', 'talker.model.layers.5.self_attn.o_proj.weig
ht_zero_point', 'talker.model.layers.5.self_attn.q_proj.input_global_scale', 'talker.model.layers.5.self_attn.q_proj.in
put_zero_point', 'talker.model.layers.5.self_attn.q_proj.weight_global_scale', 'talker.model.layers.5.self_attn.q_proj.
weight_scale', 'talker.model.layers.5.self_attn.q_proj.weight_zero_point', 'talker.model.layers.5.self_attn.v_proj.inpu
t_global_scale', 'talker.model.layers.5.self_attn.v_proj.input_zero_point', 'talker.model.layers.5.self_attn.v_proj.wei
ght_global_scale', 'talker.model.layers.5.self_attn.v_proj.weight_scale', 'talker.model.layers.5.self_attn.v_proj.weigh
t_zero_point', 'talker.model.layers.6.mlp.down_proj.input_global_scale', 'talker.model.layers.6.mlp.down_proj.input_zer
o_point', 'talker.model.layers.6.mlp.down_proj.weight_global_scale', 'talker.model.layers.6.mlp.down_proj.weight_scale'
, 'talker.model.layers.6.mlp.down_proj.weight_zero_point', 'talker.model.layers.6.mlp.gate_proj.input_global_scale', 't
alker.model.layers.6.mlp.gate_proj.input_zero_point', 'talker.model.layers.6.mlp.gate_proj.weight_global_scale', 'talke
r.model.layers.6.mlp.gate_proj.weight_scale', 'talker.model.layers.6.mlp.gate_proj.weight_zero_point', 'talker.model.la
yers.6.mlp.up_proj.input_global_scale', 'talker.model.layers.6.mlp.up_proj.input_zero_point', 'talker.model.layers.6.ml
p.up_proj.weight_global_scale', 'talker.model.layers.6.mlp.up_proj.weight_scale', 'talker.model.layers.6.mlp.up_proj.we
ight_zero_point', 'talker.model.layers.6.self_attn.k_proj.input_global_scale', 'talker.model.layers.6.self_attn.k_proj.
input_zero_point', 'talker.model.layers.6.self_attn.k_proj.weight_global_scale', 'talker.model.layers.6.self_attn.k_pro
j.weight_scale', 'talker.model.layers.6.self_attn.k_proj.weight_zero_point', 'talker.model.layers.6.self_attn.o_proj.in
put_global_scale', 'talker.model.layers.6.self_attn.o_proj.input_zero_point', 'talker.model.layers.6.self_attn.o_proj.w
eight_global_scale', 'talker.model.layers.6.self_attn.o_proj.weight_scale', 'talker.model.layers.6.self_attn.o_proj.wei
ght_zero_point', 'talker.model.layers.6.self_attn.q_proj.input_global_scale', 'talker.model.layers.6.self_attn.q_proj.i
nput_zero_point', 'talker.model.layers.6.self_attn.q_proj.weight_global_scale', 'talker.model.layers.6.self_attn.q_proj
.weight_scale', 'talker.model.layers.6.self_attn.q_proj.weight_zero_point', 'talker.model.layers.6.self_attn.v_proj.inp
ut_global_scale', 'talker.model.layers.6.self_attn.v_proj.input_zero_point', 'talker.model.layers.6.self_attn.v_proj.we
ight_global_scale', 'talker.model.layers.6.self_attn.v_proj.weight_scale', 'talker.model.layers.6.self_attn.v_proj.weig
ht_zero_point', 'talker.model.layers.7.mlp.down_proj.input_global_scale', 'talker.model.layers.7.mlp.down_proj.input_ze
ro_point', 'talker.model.layers.7.mlp.down_proj.weight_global_scale', 'talker.model.layers.7.mlp.down_proj.weight_scale
', 'talker.model.layers.7.mlp.down_proj.weight_zero_point', 'talker.model.layers.7.mlp.gate_proj.input_global_scale', '
talker.model.layers.7.mlp.gate_proj.input_zero_point', 'talker.model.layers.7.mlp.gate_proj.weight_global_scale', 'talk
er.model.layers.7.mlp.gate_proj.weight_scale', 'talker.model.layers.7.mlp.gate_proj.weight_zero_point', 'talker.model.l
ayers.7.mlp.up_proj.input_global_scale', 'talker.model.layers.7.mlp.up_proj.input_zero_point', 'talker.model.layers.7.m
lp.up_proj.weight_global_scale', 'talker.model.layers.7.mlp.up_proj.weight_scale', 'talker.model.layers.7.mlp.up_proj.w
eight_zero_point', 'talker.model.layers.7.self_attn.k_proj.input_global_scale', 'talker.model.layers.7.self_attn.k_proj
.input_zero_point', 'talker.model.layers.7.self_attn.k_proj.weight_global_scale', 'talker.model.layers.7.self_attn.k_pr
oj.weight_scale', 'talker.model.layers.7.self_attn.k_proj.weight_zero_point', 'talker.model.layers.7.self_attn.o_proj.i
nput_global_scale', 'talker.model.layers.7.self_attn.o_proj.input_zero_point', 'talker.model.layers.7.self_attn.o_proj.
weight_global_scale', 'talker.model.layers.7.self_attn.o_proj.weight_scale', 'talker.model.layers.7.self_attn.o_proj.we
ight_zero_point', 'talker.model.layers.7.self_attn.q_proj.input_global_scale', 'talker.model.layers.7.self_attn.q_proj.
input_zero_point', 'talker.model.layers.7.self_attn.q_proj.weight_global_scale', 'talker.model.layers.7.self_attn.q_pro
j.weight_scale', 'talker.model.layers.7.self_attn.q_proj.weight_zero_point', 'talker.model.layers.7.self_attn.v_proj.in
put_global_scale', 'talker.model.layers.7.self_attn.v_proj.input_zero_point', 'talker.model.layers.7.self_attn.v_proj.w
eight_global_scale', 'talker.model.layers.7.self_attn.v_proj.weight_scale', 'talker.model.layers.7.self_attn.v_proj.wei
ght_zero_point', 'talker.model.layers.8.mlp.down_proj.input_global_scale', 'talker.model.layers.8.mlp.down_proj.input_z
ero_point', 'talker.model.layers.8.mlp.down_proj.weight_global_scale', 'talker.model.layers.8.mlp.down_proj.weight_scal
e', 'talker.model.layers.8.mlp.down_proj.weight_zero_point', 'talker.model.layers.8.mlp.gate_proj.input_global_scale', 
'talker.model.layers.8.mlp.gate_proj.input_zero_point', 'talker.model.layers.8.mlp.gate_proj.weight_global_scale', 'tal
ker.model.layers.8.mlp.gate_proj.weight_scale', 'talker.model.layers.8.mlp.gate_proj.weight_zero_point', 'talker.model.
layers.8.mlp.up_proj.input_global_scale', 'talker.model.layers.8.mlp.up_proj.input_zero_point', 'talker.model.layers.8.
mlp.up_proj.weight_global_scale', 'talker.model.layers.8.mlp.up_proj.weight_scale', 'talker.model.layers.8.mlp.up_proj.
weight_zero_point', 'talker.model.layers.8.self_attn.k_proj.input_global_scale', 'talker.model.layers.8.self_attn.k_pro
j.input_zero_point', 'talker.model.layers.8.self_attn.k_proj.weight_global_scale', 'talker.model.layers.8.self_attn.k_p
roj.weight_scale', 'talker.model.layers.8.self_attn.k_proj.weight_zero_point', 'talker.model.layers.8.self_attn.o_proj.
input_global_scale', 'talker.model.layers.8.self_attn.o_proj.input_zero_point', 'talker.model.layers.8.self_attn.o_proj
.weight_global_scale', 'talker.model.layers.8.self_attn.o_proj.weight_scale', 'talker.model.layers.8.self_attn.o_proj.w
eight_zero_point', 'talker.model.layers.8.self_attn.q_proj.input_global_scale', 'talker.model.layers.8.self_attn.q_proj
.input_zero_point', 'talker.model.layers.8.self_attn.q_proj.weight_global_scale', 'talker.model.layers.8.self_attn.q_pr
oj.weight_scale', 'talker.model.layers.8.self_attn.q_proj.weight_zero_point', 'talker.model.layers.8.self_attn.v_proj.i
nput_global_scale', 'talker.model.layers.8.self_attn.v_proj.input_zero_point', 'talker.model.layers.8.self_attn.v_proj.
weight_global_scale', 'talker.model.layers.8.self_attn.v_proj.weight_scale', 'talker.model.layers.8.self_attn.v_proj.we
ight_zero_point', 'talker.model.layers.9.mlp.down_proj.input_global_scale', 'talker.model.layers.9.mlp.down_proj.input_
zero_point', 'talker.model.layers.9.mlp.down_proj.weight_global_scale', 'talker.model.layers.9.mlp.down_proj.weight_sca
le', 'talker.model.layers.9.mlp.down_proj.weight_zero_point', 'talker.model.layers.9.mlp.gate_proj.input_global_scale',
 'talker.model.layers.9.mlp.gate_proj.input_zero_point', 'talker.model.layers.9.mlp.gate_proj.weight_global_scale', 'ta
lker.model.layers.9.mlp.gate_proj.weight_scale', 'talker.model.layers.9.mlp.gate_proj.weight_zero_point', 'talker.model
.layers.9.mlp.up_proj.input_global_scale', 'talker.model.layers.9.mlp.up_proj.input_zero_point', 'talker.model.layers.9
.mlp.up_proj.weight_global_scale', 'talker.model.layers.9.mlp.up_proj.weight_scale', 'talker.model.layers.9.mlp.up_proj
.weight_zero_point', 'talker.model.layers.9.self_attn.k_proj.input_global_scale', 'talker.model.layers.9.self_attn.k_pr
oj.input_zero_point', 'talker.model.layers.9.self_attn.k_proj.weight_global_scale', 'talker.model.layers.9.self_attn.k_
proj.weight_scale', 'talker.model.layers.9.self_attn.k_proj.weight_zero_point', 'talker.model.layers.9.self_attn.o_proj
.input_global_scale', 'talker.model.layers.9.self_attn.o_proj.input_zero_point', 'talker.model.layers.9.self_attn.o_pro
j.weight_global_scale', 'talker.model.layers.9.self_attn.o_proj.weight_scale', 'talker.model.layers.9.self_attn.o_proj.
weight_zero_point', 'talker.model.layers.9.self_attn.q_proj.input_global_scale', 'talker.model.layers.9.self_attn.q_pro
j.input_zero_point', 'talker.model.layers.9.self_attn.q_proj.weight_global_scale', 'talker.model.layers.9.self_attn.q_p
roj.weight_scale', 'talker.model.layers.9.self_attn.q_proj.weight_zero_point', 'talker.model.layers.9.self_attn.v_proj.
input_global_scale', 'talker.model.layers.9.self_attn.v_proj.input_zero_point', 'talker.model.layers.9.self_attn.v_proj
.weight_global_scale', 'talker.model.layers.9.self_attn.v_proj.weight_scale', 'talker.model.layers.9.self_attn.v_proj.w
eight_zero_point', 'talker.text_projection.linear_fc1.input_global_scale', 'talker.text_projection.linear_fc1.input_zer
o_point', 'talker.text_projection.linear_fc1.weight_global_scale', 'talker.text_projection.linear_fc1.weight_scale', 't
alker.text_projection.linear_fc1.weight_zero_point', 'talker.text_projection.linear_fc2.input_global_scale', 'talker.te
xt_projection.linear_fc2.input_zero_point', 'talker.text_projection.linear_fc2.weight_global_scale', 'talker.text_proje
ction.linear_fc2.weight_scale', 'talker.text_projection.linear_fc2.weight_zero_point']
- This IS expected if you are initializing Qwen3TTSForConditionalGeneration from the checkpoint of a model trained on a
nother task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTrai
ning model).
- This IS NOT expected if you are initializing Qwen3TTSForConditionalGeneration from the checkpoint of a model that you
 expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassificatio
n model).
The tokenizer you are loading from 'D:\Git_Work\jarvis_taemin\models\Qwen3-TTS-NVFP4' with an incorrect regex pattern: 
https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will
 lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix th
is issue.
 * Tip: There are .env files present. Install python-dotenv to use them.
================================================================
Orpheus (오르페우스) - Imperial Voice: Windows Native TTS Server
================================================================

********
Warning: flash-attn is not installed. Will only run the manual PyTorch version. Please install flash-attn for faster inference.
********
 
[*] Loading model from: D:\Git_Work\jarvis_taemin\models\Qwen3-TTS-NVFP4
[*] Torch dtype selected: torch.bfloat16
[*] Post-load Weight Surgery: Syncing 15 heads into lm_head_fused...
[*] Weight Surgery: Fused Head Synced Successfully.
✅ Model ready! (Qwen3-TTS-NVFP4)
[*] Orpheus listening on port 8000...
 * Serving Flask app 'orpheus_server'
 * Debug mode: off
WARNING: This is a development server. Do not use it in a production deployment. Use a production WSGI server instead.
 * Running on all addresses (0.0.0.0)
 * Running on http://127.0.0.1:8000
 * Running on http://192.168.0.71:8000
Press CTRL+C to quit