shadow_brain_core/scratch/server_startup.log

[Imperial Debug] Starting jarvis_run.py...
python : INFO:JarvisBrain:[STATUS] Imperial Brain Synchronized with key: Imperial..._KEY
At line:1 char:44
+ ... NG='utf-8'; python shadow_brain_core\jarvis_run.py > shadow_brain_cor ...
+                 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : NotSpecified: (INFO:JarvisBrai...Imperial..._KEY:String) [], RemoteException
    + FullyQualifiedErrorId : NativeCommandError
 
INFO:JarvisBrain:[OpenRouter] API Key recovered from Imperial Vault.
INFO:JarvisBrain:[STATUS] Imperial Brain Configured: Primary=gemini-3.1-flash-lite-preview, Port=18799, WebSearch=True
INFO:telegram_service:🧠 [Imperial Brain] Gemini Client initialized for Shadow Bot.
INFO:web_server:🔱 Imperial Neural Log Stream Integrated.
🔑 [Imperial] Fetching Gemini API Key from Bitwarden...
✅ [Imperial] Gemini API Key initialized for SDK 2.0+.
🛰️ [Imperial Fleet] Cluster Configuration Path: D:\Git_Work\jarvis_taemin\docker_data\shared_workspace\JarvisRun\JARVIS_CLUSTER.json
📡 [Imperial Fleet] Local IPs detected for self-filtering: ['192.168.182.1', '172.28.16.1', '127.0.0.1', '172.27.112.1', '192.168.85.1', '192.168.0.71']
[Imperial Fleet] Orchestration Node started. Host:ga403wr IP:192.168.0.71
[14:30:23] SYSTEM: Cleaning up sessions on port 18700...
📡 [Imperial Fleet] UDP Discovery Active on port 18791 (Broadcast to 192.168.1.255, 172.28.16.255, 192.168.182.255, 192.168.0.255, 192.168.85.255, 192.168.56.255, 172.27.112.255, 255.255.255.255, 172.16.0.255)
[14:30:27] SENTINEL: 🔱 황실 테스크 감시 루프 가동 시작...
INFO:JarvisBrain:[STATUS] Imperial Brain Synchronized with key: Imperial..._KEY
INFO:JarvisBrain:[STATUS] Imperial Brain Synchronized with key: Imperial..._KEY
[Imperial UI] Heimdall Observer Activated (serving from D:\Git_Work\jarvis_taemin\portal-heimdall\build\web)
[14:30:27] SYSTEM: 📡 Signal monitor active.
[Orpheus] Starting Windows Native TTS Server with model: local-nvfp4
D:\Git_Work\jarvis_taemin\venv_nvfp4\Lib\site-packages\torch\cuda\__init__.py:61: FutureWarning: The pynvml package is 
deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the main
tainers of the package that installed pynvml for you.
  import pynvml  # type: ignore[import]
INFO:JarvisBrain:[OpenRouter] API Key recovered from Imperial Vault.
INFO:JarvisBrain:[STATUS] Imperial Brain Configured: Primary=gemini-3.1-flash-lite-preview, Port=18799, WebSearch=True
INFO:JarvisBrain:[STATUS] Imperial Brain Synchronized with key: Imperial..._KEY
INFO:JarvisBrain:[OpenRouter] API Key recovered from Imperial Vault.
INFO:JarvisBrain:[STATUS] Imperial Brain Configured: Primary=gemini-3.1-flash-lite-preview, Port=18799, WebSearch=True
INFO:JarvisBrain:[OpenRouter] API Key recovered from Imperial Vault.
INFO:JarvisBrain:[STATUS] Imperial Brain Configured: Primary=gemini-3.1-flash-lite-preview, Port=18799, WebSearch=True
Exception in thread Thread-16 (_launch_api):
Traceback (most recent call last):
  File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.13_3.13.3312.0_x64__qbz5n2kfra8p0\Lib\threading.

py", line 1044, in _bootstrap_inner
    self.run()
    ~~~~~~~~^^
  File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.13_3.13.3312.0_x64__qbz5n2kfra8p0\Lib\threading.

py", line 995, in run
    self._target(*self._args, **self._kwargs)
    ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\Git_Work\jarvis_taemin\shadow_brain_core\jarvis_run.py", line 306, in _launch_api
    app = create_web_server(PROJECT_ROOT, self.engine, self.cluster)
  File "D:\Git_Work\jarvis_taemin\shadow_brain_core\web_server.py", line 5868, in create_web_server
    init_chat_logic(app, project_root, db_url, lambda: _load_session_user(), compaction_engine, memory_write_vector)
    ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TypeError: init_chat_logic() missing 1 required positional argument: 'rag_save_func'
D:\Git_Work\jarvis_taemin\venv_nvfp4\Lib\site-packages\transformers\modeling_utils.py:1984: FutureWarning: torch._dynam
o.allow_in_graph is deprecated and will be removed in a future version. Use torch._dynamo.nonstrict_trace instead.
  @torch._dynamo.allow_in_graph
'sox' is not recognized as an internal or external command,
operable program or batch file.
SoX could not be found!

    If you do not have SoX, proceed here:
     - - - http://sox.sourceforge.net/ - - -

    If you do (or think that you should) have SoX, double-check your
    path variables.
    
`torch_dtype` is deprecated! Use `dtype` instead!
Some weights of the model checkpoint at D:\Git_Work\jarvis_taemin\models\Qwen3-TTS-NVFP4 were not used when initializin
g Qwen3TTSForConditionalGeneration: ['talker.code_predictor.lm_head.0.input_global_scale', 'talker.code_predictor.lm_he

ad.0.input_zero_point', 'talker.code_predictor.lm_head.0.weight_global_scale', 'talker.code_predictor.lm_head.0.weight_

scale', 'talker.code_predictor.lm_head.0.weight_zero_point', 'talker.code_predictor.lm_head.1.input_global_scale', 'tal

ker.code_predictor.lm_head.1.input_zero_point', 'talker.code_predictor.lm_head.1.weight_global_scale', 'talker.code_pre

dictor.lm_head.1.weight_scale', 'talker.code_predictor.lm_head.1.weight_zero_point', 'talker.code_predictor.lm_head.10.

input_global_scale', 'talker.code_predictor.lm_head.10.input_zero_point', 'talker.code_predictor.lm_head.10.weight_glob

al_scale', 'talker.code_predictor.lm_head.10.weight_scale', 'talker.code_predictor.lm_head.10.weight_zero_point', 'talk

er.code_predictor.lm_head.11.input_global_scale', 'talker.code_predictor.lm_head.11.input_zero_point', 'talker.code_pre

dictor.lm_head.11.weight_global_scale', 'talker.code_predictor.lm_head.11.weight_scale', 'talker.code_predictor.lm_head

.11.weight_zero_point', 'talker.code_predictor.lm_head.12.input_global_scale', 'talker.code_predictor.lm_head.12.input_

zero_point', 'talker.code_predictor.lm_head.12.weight_global_scale', 'talker.code_predictor.lm_head.12.weight_scale', '

talker.code_predictor.lm_head.12.weight_zero_point', 'talker.code_predictor.lm_head.13.input_global_scale', 'talker.cod

e_predictor.lm_head.13.input_zero_point', 'talker.code_predictor.lm_head.13.weight_global_scale', 'talker.code_predicto

r.lm_head.13.weight_scale', 'talker.code_predictor.lm_head.13.weight_zero_point', 'talker.code_predictor.lm_head.14.inp

ut_global_scale', 'talker.code_predictor.lm_head.14.input_zero_point', 'talker.code_predictor.lm_head.14.weight_global_

scale', 'talker.code_predictor.lm_head.14.weight_scale', 'talker.code_predictor.lm_head.14.weight_zero_point', 'talker.

code_predictor.lm_head.2.input_global_scale', 'talker.code_predictor.lm_head.2.input_zero_point', 'talker.code_predicto

r.lm_head.2.weight_global_scale', 'talker.code_predictor.lm_head.2.weight_scale', 'talker.code_predictor.lm_head.2.weig

ht_zero_point', 'talker.code_predictor.lm_head.3.input_global_scale', 'talker.code_predictor.lm_head.3.input_zero_point

', 'talker.code_predictor.lm_head.3.weight_global_scale', 'talker.code_predictor.lm_head.3.weight_scale', 'talker.code_

predictor.lm_head.3.weight_zero_point', 'talker.code_predictor.lm_head.4.input_global_scale', 'talker.code_predictor.lm

_head.4.input_zero_point', 'talker.code_predictor.lm_head.4.weight_global_scale', 'talker.code_predictor.lm_head.4.weig

ht_scale', 'talker.code_predictor.lm_head.4.weight_zero_point', 'talker.code_predictor.lm_head.5.input_global_scale', '

talker.code_predictor.lm_head.5.input_zero_point', 'talker.code_predictor.lm_head.5.weight_global_scale', 'talker.code_

predictor.lm_head.5.weight_scale', 'talker.code_predictor.lm_head.5.weight_zero_point', 'talker.code_predictor.lm_head.

6.input_global_scale', 'talker.code_predictor.lm_head.6.input_zero_point', 'talker.code_predictor.lm_head.6.weight_glob

al_scale', 'talker.code_predictor.lm_head.6.weight_scale', 'talker.code_predictor.lm_head.6.weight_zero_point', 'talker

.code_predictor.lm_head.7.input_global_scale', 'talker.code_predictor.lm_head.7.input_zero_point', 'talker.code_predict

or.lm_head.7.weight_global_scale', 'talker.code_predictor.lm_head.7.weight_scale', 'talker.code_predictor.lm_head.7.wei

ght_zero_point', 'talker.code_predictor.lm_head.8.input_global_scale', 'talker.code_predictor.lm_head.8.input_zero_poin

t', 'talker.code_predictor.lm_head.8.weight_global_scale', 'talker.code_predictor.lm_head.8.weight_scale', 'talker.code

_predictor.lm_head.8.weight_zero_point', 'talker.code_predictor.lm_head.9.input_global_scale', 'talker.code_predictor.l

m_head.9.input_zero_point', 'talker.code_predictor.lm_head.9.weight_global_scale', 'talker.code_predictor.lm_head.9.wei

ght_scale', 'talker.code_predictor.lm_head.9.weight_zero_point', 'talker.code_predictor.lm_head_fused.input_global_scal

e', 'talker.code_predictor.lm_head_fused.input_zero_point', 'talker.code_predictor.lm_head_fused.weight_global_scale', 
'talker.code_predictor.lm_head_fused.weight_scale', 'talker.code_predictor.lm_head_fused.weight_zero_point', 'talker.co

de_predictor.model.layers.0.mlp.down_proj.input_global_scale', 'talker.code_predictor.model.layers.0.mlp.down_proj.inpu

t_zero_point', 'talker.code_predictor.model.layers.0.mlp.down_proj.weight_global_scale', 'talker.code_predictor.model.l

ayers.0.mlp.down_proj.weight_scale', 'talker.code_predictor.model.layers.0.mlp.down_proj.weight_zero_point', 'talker.co

de_predictor.model.layers.0.mlp.gate_proj.input_global_scale', 'talker.code_predictor.model.layers.0.mlp.gate_proj.inpu

t_zero_point', 'talker.code_predictor.model.layers.0.mlp.gate_proj.weight_global_scale', 'talker.code_predictor.model.l

ayers.0.mlp.gate_proj.weight_scale', 'talker.code_predictor.model.layers.0.mlp.gate_proj.weight_zero_point', 'talker.co

de_predictor.model.layers.0.mlp.up_proj.input_global_scale', 'talker.code_predictor.model.layers.0.mlp.up_proj.input_ze

ro_point', 'talker.code_predictor.model.layers.0.mlp.up_proj.weight_global_scale', 'talker.code_predictor.model.layers.

0.mlp.up_proj.weight_scale', 'talker.code_predictor.model.layers.0.mlp.up_proj.weight_zero_point', 'talker.code_predict

or.model.layers.0.self_attn.k_proj.input_global_scale', 'talker.code_predictor.model.layers.0.self_attn.k_proj.input_ze

ro_point', 'talker.code_predictor.model.layers.0.self_attn.k_proj.weight_global_scale', 'talker.code_predictor.model.la

yers.0.self_attn.k_proj.weight_scale', 'talker.code_predictor.model.layers.0.self_attn.k_proj.weight_zero_point', 'talk

er.code_predictor.model.layers.0.self_attn.o_proj.input_global_scale', 'talker.code_predictor.model.layers.0.self_attn.

o_proj.input_zero_point', 'talker.code_predictor.model.layers.0.self_attn.o_proj.weight_global_scale', 'talker.code_pre

dictor.model.layers.0.self_attn.o_proj.weight_scale', 'talker.code_predictor.model.layers.0.self_attn.o_proj.weight_zer

o_point', 'talker.code_predictor.model.layers.0.self_attn.q_proj.input_global_scale', 'talker.code_predictor.model.laye

rs.0.self_attn.q_proj.input_zero_point', 'talker.code_predictor.model.layers.0.self_attn.q_proj.weight_global_scale', '

talker.code_predictor.model.layers.0.self_attn.q_proj.weight_scale', 'talker.code_predictor.model.layers.0.self_attn.q_

proj.weight_zero_point', 'talker.code_predictor.model.layers.0.self_attn.v_proj.input_global_scale', 'talker.code_predi

ctor.model.layers.0.self_attn.v_proj.input_zero_point', 'talker.code_predictor.model.layers.0.self_attn.v_proj.weight_g

lobal_scale', 'talker.code_predictor.model.layers.0.self_attn.v_proj.weight_scale', 'talker.code_predictor.model.layers

.0.self_attn.v_proj.weight_zero_point', 'talker.code_predictor.model.layers.1.mlp.down_proj.input_global_scale', 'talke

r.code_predictor.model.layers.1.mlp.down_proj.input_zero_point', 'talker.code_predictor.model.layers.1.mlp.down_proj.we

ight_global_scale', 'talker.code_predictor.model.layers.1.mlp.down_proj.weight_scale', 'talker.code_predictor.model.lay

ers.1.mlp.down_proj.weight_zero_point', 'talker.code_predictor.model.layers.1.mlp.gate_proj.input_global_scale', 'talke

r.code_predictor.model.layers.1.mlp.gate_proj.input_zero_point', 'talker.code_predictor.model.layers.1.mlp.gate_proj.we

ight_global_scale', 'talker.code_predictor.model.layers.1.mlp.gate_proj.weight_scale', 'talker.code_predictor.model.lay

ers.1.mlp.gate_proj.weight_zero_point', 'talker.code_predictor.model.layers.1.mlp.up_proj.input_global_scale', 'talker.

code_predictor.model.layers.1.mlp.up_proj.input_zero_point', 'talker.code_predictor.model.layers.1.mlp.up_proj.weight_g

lobal_scale', 'talker.code_predictor.model.layers.1.mlp.up_proj.weight_scale', 'talker.code_predictor.model.layers.1.ml

p.up_proj.weight_zero_point', 'talker.code_predictor.model.layers.1.self_attn.k_proj.input_global_scale', 'talker.code_

predictor.model.layers.1.self_attn.k_proj.input_zero_point', 'talker.code_predictor.model.layers.1.self_attn.k_proj.wei

ght_global_scale', 'talker.code_predictor.model.layers.1.self_attn.k_proj.weight_scale', 'talker.code_predictor.model.l

ayers.1.self_attn.k_proj.weight_zero_point', 'talker.code_predictor.model.layers.1.self_attn.o_proj.input_global_scale'
, 'talker.code_predictor.model.layers.1.self_attn.o_proj.input_zero_point', 'talker.code_predictor.model.layers.1.self_

attn.o_proj.weight_global_scale', 'talker.code_predictor.model.layers.1.self_attn.o_proj.weight_scale', 'talker.code_pr

edictor.model.layers.1.self_attn.o_proj.weight_zero_point', 'talker.code_predictor.model.layers.1.self_attn.q_proj.inpu

t_global_scale', 'talker.code_predictor.model.layers.1.self_attn.q_proj.input_zero_point', 'talker.code_predictor.model

.layers.1.self_attn.q_proj.weight_global_scale', 'talker.code_predictor.model.layers.1.self_attn.q_proj.weight_scale', 
'talker.code_predictor.model.layers.1.self_attn.q_proj.weight_zero_point', 'talker.code_predictor.model.layers.1.self_a

ttn.v_proj.input_global_scale', 'talker.code_predictor.model.layers.1.self_attn.v_proj.input_zero_point', 'talker.code_

predictor.model.layers.1.self_attn.v_proj.weight_global_scale', 'talker.code_predictor.model.layers.1.self_attn.v_proj.

weight_scale', 'talker.code_predictor.model.layers.1.self_attn.v_proj.weight_zero_point', 'talker.code_predictor.model.

layers.2.mlp.down_proj.input_global_scale', 'talker.code_predictor.model.layers.2.mlp.down_proj.input_zero_point', 'tal

ker.code_predictor.model.layers.2.mlp.down_proj.weight_global_scale', 'talker.code_predictor.model.layers.2.mlp.down_pr

oj.weight_scale', 'talker.code_predictor.model.layers.2.mlp.down_proj.weight_zero_point', 'talker.code_predictor.model.

layers.2.mlp.gate_proj.input_global_scale', 'talker.code_predictor.model.layers.2.mlp.gate_proj.input_zero_point', 'tal

ker.code_predictor.model.layers.2.mlp.gate_proj.weight_global_scale', 'talker.code_predictor.model.layers.2.mlp.gate_pr

oj.weight_scale', 'talker.code_predictor.model.layers.2.mlp.gate_proj.weight_zero_point', 'talker.code_predictor.model.

layers.2.mlp.up_proj.input_global_scale', 'talker.code_predictor.model.layers.2.mlp.up_proj.input_zero_point', 'talker.

code_predictor.model.layers.2.mlp.up_proj.weight_global_scale', 'talker.code_predictor.model.layers.2.mlp.up_proj.weigh

t_scale', 'talker.code_predictor.model.layers.2.mlp.up_proj.weight_zero_point', 'talker.code_predictor.model.layers.2.s

elf_attn.k_proj.input_global_scale', 'talker.code_predictor.model.layers.2.self_attn.k_proj.input_zero_point', 'talker.

code_predictor.model.layers.2.self_attn.k_proj.weight_global_scale', 'talker.code_predictor.model.layers.2.self_attn.k_

proj.weight_scale', 'talker.code_predictor.model.layers.2.self_attn.k_proj.weight_zero_point', 'talker.code_predictor.m

odel.layers.2.self_attn.o_proj.input_global_scale', 'talker.code_predictor.model.layers.2.self_attn.o_proj.input_zero_p

oint', 'talker.code_predictor.model.layers.2.self_attn.o_proj.weight_global_scale', 'talker.code_predictor.model.layers

.2.self_attn.o_proj.weight_scale', 'talker.code_predictor.model.layers.2.self_attn.o_proj.weight_zero_point', 'talker.c

ode_predictor.model.layers.2.self_attn.q_proj.input_global_scale', 'talker.code_predictor.model.layers.2.self_attn.q_pr

oj.input_zero_point', 'talker.code_predictor.model.layers.2.self_attn.q_proj.weight_global_scale', 'talker.code_predict

or.model.layers.2.self_attn.q_proj.weight_scale', 'talker.code_predictor.model.layers.2.self_attn.q_proj.weight_zero_po

int', 'talker.code_predictor.model.layers.2.self_attn.v_proj.input_global_scale', 'talker.code_predictor.model.layers.2

.self_attn.v_proj.input_zero_point', 'talker.code_predictor.model.layers.2.self_attn.v_proj.weight_global_scale', 'talk

er.code_predictor.model.layers.2.self_attn.v_proj.weight_scale', 'talker.code_predictor.model.layers.2.self_attn.v_proj

.weight_zero_point', 'talker.code_predictor.model.layers.3.mlp.down_proj.input_global_scale', 'talker.code_predictor.mo

del.layers.3.mlp.down_proj.input_zero_point', 'talker.code_predictor.model.layers.3.mlp.down_proj.weight_global_scale',
 'talker.code_predictor.model.layers.3.mlp.down_proj.weight_scale', 'talker.code_predictor.model.layers.3.mlp.down_proj

.weight_zero_point', 'talker.code_predictor.model.layers.3.mlp.gate_proj.input_global_scale', 'talker.code_predictor.mo

del.layers.3.mlp.gate_proj.input_zero_point', 'talker.code_predictor.model.layers.3.mlp.gate_proj.weight_global_scale',
 'talker.code_predictor.model.layers.3.mlp.gate_proj.weight_scale', 'talker.code_predictor.model.layers.3.mlp.gate_proj

.weight_zero_point', 'talker.code_predictor.model.layers.3.mlp.up_proj.input_global_scale', 'talker.code_predictor.mode

l.layers.3.mlp.up_proj.input_zero_point', 'talker.code_predictor.model.layers.3.mlp.up_proj.weight_global_scale', 'talk

er.code_predictor.model.layers.3.mlp.up_proj.weight_scale', 'talker.code_predictor.model.layers.3.mlp.up_proj.weight_ze

ro_point', 'talker.code_predictor.model.layers.3.self_attn.k_proj.input_global_scale', 'talker.code_predictor.model.lay

ers.3.self_attn.k_proj.input_zero_point', 'talker.code_predictor.model.layers.3.self_attn.k_proj.weight_global_scale', 
'talker.code_predictor.model.layers.3.self_attn.k_proj.weight_scale', 'talker.code_predictor.model.layers.3.self_attn.k

_proj.weight_zero_point', 'talker.code_predictor.model.layers.3.self_attn.o_proj.input_global_scale', 'talker.code_pred

ictor.model.layers.3.self_attn.o_proj.input_zero_point', 'talker.code_predictor.model.layers.3.self_attn.o_proj.weight_

global_scale', 'talker.code_predictor.model.layers.3.self_attn.o_proj.weight_scale', 'talker.code_predictor.model.layer

s.3.self_attn.o_proj.weight_zero_point', 'talker.code_predictor.model.layers.3.self_attn.q_proj.input_global_scale', 't

alker.code_predictor.model.layers.3.self_attn.q_proj.input_zero_point', 'talker.code_predictor.model.layers.3.self_attn

.q_proj.weight_global_scale', 'talker.code_predictor.model.layers.3.self_attn.q_proj.weight_scale', 'talker.code_predic

tor.model.layers.3.self_attn.q_proj.weight_zero_point', 'talker.code_predictor.model.layers.3.self_attn.v_proj.input_gl

obal_scale', 'talker.code_predictor.model.layers.3.self_attn.v_proj.input_zero_point', 'talker.code_predictor.model.lay

ers.3.self_attn.v_proj.weight_global_scale', 'talker.code_predictor.model.layers.3.self_attn.v_proj.weight_scale', 'tal

ker.code_predictor.model.layers.3.self_attn.v_proj.weight_zero_point', 'talker.code_predictor.model.layers.4.mlp.down_p

roj.input_global_scale', 'talker.code_predictor.model.layers.4.mlp.down_proj.input_zero_point', 'talker.code_predictor.

model.layers.4.mlp.down_proj.weight_global_scale', 'talker.code_predictor.model.layers.4.mlp.down_proj.weight_scale', '

talker.code_predictor.model.layers.4.mlp.down_proj.weight_zero_point', 'talker.code_predictor.model.layers.4.mlp.gate_p

roj.input_global_scale', 'talker.code_predictor.model.layers.4.mlp.gate_proj.input_zero_point', 'talker.code_predictor.

model.layers.4.mlp.gate_proj.weight_global_scale', 'talker.code_predictor.model.layers.4.mlp.gate_proj.weight_scale', '

talker.code_predictor.model.layers.4.mlp.gate_proj.weight_zero_point', 'talker.code_predictor.model.layers.4.mlp.up_pro

j.input_global_scale', 'talker.code_predictor.model.layers.4.mlp.up_proj.input_zero_point', 'talker.code_predictor.mode

l.layers.4.mlp.up_proj.weight_global_scale', 'talker.code_predictor.model.layers.4.mlp.up_proj.weight_scale', 'talker.c

ode_predictor.model.layers.4.mlp.up_proj.weight_zero_point', 'talker.code_predictor.model.layers.4.self_attn.k_proj.inp

ut_global_scale', 'talker.code_predictor.model.layers.4.self_attn.k_proj.input_zero_point', 'talker.code_predictor.mode

l.layers.4.self_attn.k_proj.weight_global_scale', 'talker.code_predictor.model.layers.4.self_attn.k_proj.weight_scale',
 'talker.code_predictor.model.layers.4.self_attn.k_proj.weight_zero_point', 'talker.code_predictor.model.layers.4.self_

attn.o_proj.input_global_scale', 'talker.code_predictor.model.layers.4.self_attn.o_proj.input_zero_point', 'talker.code

_predictor.model.layers.4.self_attn.o_proj.weight_global_scale', 'talker.code_predictor.model.layers.4.self_attn.o_proj

.weight_scale', 'talker.code_predictor.model.layers.4.self_attn.o_proj.weight_zero_point', 'talker.code_predictor.model

.layers.4.self_attn.q_proj.input_global_scale', 'talker.code_predictor.model.layers.4.self_attn.q_proj.input_zero_point

', 'talker.code_predictor.model.layers.4.self_attn.q_proj.weight_global_scale', 'talker.code_predictor.model.layers.4.s

elf_attn.q_proj.weight_scale', 'talker.code_predictor.model.layers.4.self_attn.q_proj.weight_zero_point', 'talker.code_

predictor.model.layers.4.self_attn.v_proj.input_global_scale', 'talker.code_predictor.model.layers.4.self_attn.v_proj.i

nput_zero_point', 'talker.code_predictor.model.layers.4.self_attn.v_proj.weight_global_scale', 'talker.code_predictor.m

odel.layers.4.self_attn.v_proj.weight_scale', 'talker.code_predictor.model.layers.4.self_attn.v_proj.weight_zero_point'
, 'talker.codec_head.input_global_scale', 'talker.codec_head.input_zero_point', 'talker.codec_head.weight_global_scale'
, 'talker.codec_head.weight_scale', 'talker.codec_head.weight_zero_point', 'talker.model.layers.0.mlp.down_proj.input_g

lobal_scale', 'talker.model.layers.0.mlp.down_proj.input_zero_point', 'talker.model.layers.0.mlp.down_proj.weight_globa

l_scale', 'talker.model.layers.0.mlp.down_proj.weight_scale', 'talker.model.layers.0.mlp.down_proj.weight_zero_point', 
'talker.model.layers.0.mlp.gate_proj.input_global_scale', 'talker.model.layers.0.mlp.gate_proj.input_zero_point', 'talk

er.model.layers.0.mlp.gate_proj.weight_global_scale', 'talker.model.layers.0.mlp.gate_proj.weight_scale', 'talker.model

.layers.0.mlp.gate_proj.weight_zero_point', 'talker.model.layers.0.mlp.up_proj.input_global_scale', 'talker.model.layer

s.0.mlp.up_proj.input_zero_point', 'talker.model.layers.0.mlp.up_proj.weight_global_scale', 'talker.model.layers.0.mlp.

up_proj.weight_scale', 'talker.model.layers.0.mlp.up_proj.weight_zero_point', 'talker.model.layers.0.self_attn.k_proj.i

nput_global_scale', 'talker.model.layers.0.self_attn.k_proj.input_zero_point', 'talker.model.layers.0.self_attn.k_proj.

weight_global_scale', 'talker.model.layers.0.self_attn.k_proj.weight_scale', 'talker.model.layers.0.self_attn.k_proj.we

ight_zero_point', 'talker.model.layers.0.self_attn.o_proj.input_global_scale', 'talker.model.layers.0.self_attn.o_proj.

input_zero_point', 'talker.model.layers.0.self_attn.o_proj.weight_global_scale', 'talker.model.layers.0.self_attn.o_pro

j.weight_scale', 'talker.model.layers.0.self_attn.o_proj.weight_zero_point', 'talker.model.layers.0.self_attn.q_proj.in

put_global_scale', 'talker.model.layers.0.self_attn.q_proj.input_zero_point', 'talker.model.layers.0.self_attn.q_proj.w

eight_global_scale', 'talker.model.layers.0.self_attn.q_proj.weight_scale', 'talker.model.layers.0.self_attn.q_proj.wei

ght_zero_point', 'talker.model.layers.0.self_attn.v_proj.input_global_scale', 'talker.model.layers.0.self_attn.v_proj.i

nput_zero_point', 'talker.model.layers.0.self_attn.v_proj.weight_global_scale', 'talker.model.layers.0.self_attn.v_proj

.weight_scale', 'talker.model.layers.0.self_attn.v_proj.weight_zero_point', 'talker.model.layers.1.mlp.down_proj.input_

global_scale', 'talker.model.layers.1.mlp.down_proj.input_zero_point', 'talker.model.layers.1.mlp.down_proj.weight_glob

al_scale', 'talker.model.layers.1.mlp.down_proj.weight_scale', 'talker.model.layers.1.mlp.down_proj.weight_zero_point',
 'talker.model.layers.1.mlp.gate_proj.input_global_scale', 'talker.model.layers.1.mlp.gate_proj.input_zero_point', 'tal

ker.model.layers.1.mlp.gate_proj.weight_global_scale', 'talker.model.layers.1.mlp.gate_proj.weight_scale', 'talker.mode

l.layers.1.mlp.gate_proj.weight_zero_point', 'talker.model.layers.1.mlp.up_proj.input_global_scale', 'talker.model.laye

rs.1.mlp.up_proj.input_zero_point', 'talker.model.layers.1.mlp.up_proj.weight_global_scale', 'talker.model.layers.1.mlp

.up_proj.weight_scale', 'talker.model.layers.1.mlp.up_proj.weight_zero_point', 'talker.model.layers.1.self_attn.k_proj.

input_global_scale', 'talker.model.layers.1.self_attn.k_proj.input_zero_point', 'talker.model.layers.1.self_attn.k_proj

.weight_global_scale', 'talker.model.layers.1.self_attn.k_proj.weight_scale', 'talker.model.layers.1.self_attn.k_proj.w

eight_zero_point', 'talker.model.layers.1.self_attn.o_proj.input_global_scale', 'talker.model.layers.1.self_attn.o_proj

.input_zero_point', 'talker.model.layers.1.self_attn.o_proj.weight_global_scale', 'talker.model.layers.1.self_attn.o_pr

oj.weight_scale', 'talker.model.layers.1.self_attn.o_proj.weight_zero_point', 'talker.model.layers.1.self_attn.q_proj.i

nput_global_scale', 'talker.model.layers.1.self_attn.q_proj.input_zero_point', 'talker.model.layers.1.self_attn.q_proj.

weight_global_scale', 'talker.model.layers.1.self_attn.q_proj.weight_scale', 'talker.model.layers.1.self_attn.q_proj.we

ight_zero_point', 'talker.model.layers.1.self_attn.v_proj.input_global_scale', 'talker.model.layers.1.self_attn.v_proj.

input_zero_point', 'talker.model.layers.1.self_attn.v_proj.weight_global_scale', 'talker.model.layers.1.self_attn.v_pro

j.weight_scale', 'talker.model.layers.1.self_attn.v_proj.weight_zero_point', 'talker.model.layers.10.mlp.down_proj.inpu

t_global_scale', 'talker.model.layers.10.mlp.down_proj.input_zero_point', 'talker.model.layers.10.mlp.down_proj.weight_

global_scale', 'talker.model.layers.10.mlp.down_proj.weight_scale', 'talker.model.layers.10.mlp.down_proj.weight_zero_p

oint', 'talker.model.layers.10.mlp.gate_proj.input_global_scale', 'talker.model.layers.10.mlp.gate_proj.input_zero_poin

t', 'talker.model.layers.10.mlp.gate_proj.weight_global_scale', 'talker.model.layers.10.mlp.gate_proj.weight_scale', 't

alker.model.layers.10.mlp.gate_proj.weight_zero_point', 'talker.model.layers.10.mlp.up_proj.input_global_scale', 'talke

r.model.layers.10.mlp.up_proj.input_zero_point', 'talker.model.layers.10.mlp.up_proj.weight_global_scale', 'talker.mode

l.layers.10.mlp.up_proj.weight_scale', 'talker.model.layers.10.mlp.up_proj.weight_zero_point', 'talker.model.layers.10.

self_attn.k_proj.input_global_scale', 'talker.model.layers.10.self_attn.k_proj.input_zero_point', 'talker.model.layers.

10.self_attn.k_proj.weight_global_scale', 'talker.model.layers.10.self_attn.k_proj.weight_scale', 'talker.model.layers.

10.self_attn.k_proj.weight_zero_point', 'talker.model.layers.10.self_attn.o_proj.input_global_scale', 'talker.model.lay

ers.10.self_attn.o_proj.input_zero_point', 'talker.model.layers.10.self_attn.o_proj.weight_global_scale', 'talker.model

.layers.10.self_attn.o_proj.weight_scale', 'talker.model.layers.10.self_attn.o_proj.weight_zero_point', 'talker.model.l

ayers.10.self_attn.q_proj.input_global_scale', 'talker.model.layers.10.self_attn.q_proj.input_zero_point', 'talker.mode

l.layers.10.self_attn.q_proj.weight_global_scale', 'talker.model.layers.10.self_attn.q_proj.weight_scale', 'talker.mode

l.layers.10.self_attn.q_proj.weight_zero_point', 'talker.model.layers.10.self_attn.v_proj.input_global_scale', 'talker.

model.layers.10.self_attn.v_proj.input_zero_point', 'talker.model.layers.10.self_attn.v_proj.weight_global_scale', 'tal

ker.model.layers.10.self_attn.v_proj.weight_scale', 'talker.model.layers.10.self_attn.v_proj.weight_zero_point', 'talke

r.model.layers.11.mlp.down_proj.input_global_scale', 'talker.model.layers.11.mlp.down_proj.input_zero_point', 'talker.m

odel.layers.11.mlp.down_proj.weight_global_scale', 'talker.model.layers.11.mlp.down_proj.weight_scale', 'talker.model.l

ayers.11.mlp.down_proj.weight_zero_point', 'talker.model.layers.11.mlp.gate_proj.input_global_scale', 'talker.model.lay

ers.11.mlp.gate_proj.input_zero_point', 'talker.model.layers.11.mlp.gate_proj.weight_global_scale', 'talker.model.layer

s.11.mlp.gate_proj.weight_scale', 'talker.model.layers.11.mlp.gate_proj.weight_zero_point', 'talker.model.layers.11.mlp

.up_proj.input_global_scale', 'talker.model.layers.11.mlp.up_proj.input_zero_point', 'talker.model.layers.11.mlp.up_pro

j.weight_global_scale', 'talker.model.layers.11.mlp.up_proj.weight_scale', 'talker.model.layers.11.mlp.up_proj.weight_z

ero_point', 'talker.model.layers.11.self_attn.k_proj.input_global_scale', 'talker.model.layers.11.self_attn.k_proj.inpu

t_zero_point', 'talker.model.layers.11.self_attn.k_proj.weight_global_scale', 'talker.model.layers.11.self_attn.k_proj.

weight_scale', 'talker.model.layers.11.self_attn.k_proj.weight_zero_point', 'talker.model.layers.11.self_attn.o_proj.in

put_global_scale', 'talker.model.layers.11.self_attn.o_proj.input_zero_point', 'talker.model.layers.11.self_attn.o_proj

.weight_global_scale', 'talker.model.layers.11.self_attn.o_proj.weight_scale', 'talker.model.layers.11.self_attn.o_proj

.weight_zero_point', 'talker.model.layers.11.self_attn.q_proj.input_global_scale', 'talker.model.layers.11.self_attn.q_

proj.input_zero_point', 'talker.model.layers.11.self_attn.q_proj.weight_global_scale', 'talker.model.layers.11.self_att

n.q_proj.weight_scale', 'talker.model.layers.11.self_attn.q_proj.weight_zero_point', 'talker.model.layers.11.self_attn.

v_proj.input_global_scale', 'talker.model.layers.11.self_attn.v_proj.input_zero_point', 'talker.model.layers.11.self_at

tn.v_proj.weight_global_scale', 'talker.model.layers.11.self_attn.v_proj.weight_scale', 'talker.model.layers.11.self_at

tn.v_proj.weight_zero_point', 'talker.model.layers.12.mlp.down_proj.input_global_scale', 'talker.model.layers.12.mlp.do

wn_proj.input_zero_point', 'talker.model.layers.12.mlp.down_proj.weight_global_scale', 'talker.model.layers.12.mlp.down

_proj.weight_scale', 'talker.model.layers.12.mlp.down_proj.weight_zero_point', 'talker.model.layers.12.mlp.gate_proj.in

put_global_scale', 'talker.model.layers.12.mlp.gate_proj.input_zero_point', 'talker.model.layers.12.mlp.gate_proj.weigh

t_global_scale', 'talker.model.layers.12.mlp.gate_proj.weight_scale', 'talker.model.layers.12.mlp.gate_proj.weight_zero

_point', 'talker.model.layers.12.mlp.up_proj.input_global_scale', 'talker.model.layers.12.mlp.up_proj.input_zero_point'
, 'talker.model.layers.12.mlp.up_proj.weight_global_scale', 'talker.model.layers.12.mlp.up_proj.weight_scale', 'talker.

model.layers.12.mlp.up_proj.weight_zero_point', 'talker.model.layers.12.self_attn.k_proj.input_global_scale', 'talker.m

odel.layers.12.self_attn.k_proj.input_zero_point', 'talker.model.layers.12.self_attn.k_proj.weight_global_scale', 'talk

er.model.layers.12.self_attn.k_proj.weight_scale', 'talker.model.layers.12.self_attn.k_proj.weight_zero_point', 'talker

.model.layers.12.self_attn.o_proj.input_global_scale', 'talker.model.layers.12.self_attn.o_proj.input_zero_point', 'tal

ker.model.layers.12.self_attn.o_proj.weight_global_scale', 'talker.model.layers.12.self_attn.o_proj.weight_scale', 'tal

ker.model.layers.12.self_attn.o_proj.weight_zero_point', 'talker.model.layers.12.self_attn.q_proj.input_global_scale', 
'talker.model.layers.12.self_attn.q_proj.input_zero_point', 'talker.model.layers.12.self_attn.q_proj.weight_global_scal

e', 'talker.model.layers.12.self_attn.q_proj.weight_scale', 'talker.model.layers.12.self_attn.q_proj.weight_zero_point'
, 'talker.model.layers.12.self_attn.v_proj.input_global_scale', 'talker.model.layers.12.self_attn.v_proj.input_zero_poi

nt', 'talker.model.layers.12.self_attn.v_proj.weight_global_scale', 'talker.model.layers.12.self_attn.v_proj.weight_sca

le', 'talker.model.layers.12.self_attn.v_proj.weight_zero_point', 'talker.model.layers.13.mlp.down_proj.input_global_sc

ale', 'talker.model.layers.13.mlp.down_proj.input_zero_point', 'talker.model.layers.13.mlp.down_proj.weight_global_scal

e', 'talker.model.layers.13.mlp.down_proj.weight_scale', 'talker.model.layers.13.mlp.down_proj.weight_zero_point', 'tal

ker.model.layers.13.mlp.gate_proj.input_global_scale', 'talker.model.layers.13.mlp.gate_proj.input_zero_point', 'talker

.model.layers.13.mlp.gate_proj.weight_global_scale', 'talker.model.layers.13.mlp.gate_proj.weight_scale', 'talker.model

.layers.13.mlp.gate_proj.weight_zero_point', 'talker.model.layers.13.mlp.up_proj.input_global_scale', 'talker.model.lay

ers.13.mlp.up_proj.input_zero_point', 'talker.model.layers.13.mlp.up_proj.weight_global_scale', 'talker.model.layers.13

.mlp.up_proj.weight_scale', 'talker.model.layers.13.mlp.up_proj.weight_zero_point', 'talker.model.layers.13.self_attn.k

_proj.input_global_scale', 'talker.model.layers.13.self_attn.k_proj.input_zero_point', 'talker.model.layers.13.self_att

n.k_proj.weight_global_scale', 'talker.model.layers.13.self_attn.k_proj.weight_scale', 'talker.model.layers.13.self_att

n.k_proj.weight_zero_point', 'talker.model.layers.13.self_attn.o_proj.input_global_scale', 'talker.model.layers.13.self

_attn.o_proj.input_zero_point', 'talker.model.layers.13.self_attn.o_proj.weight_global_scale', 'talker.model.layers.13.

self_attn.o_proj.weight_scale', 'talker.model.layers.13.self_attn.o_proj.weight_zero_point', 'talker.model.layers.13.se

lf_attn.q_proj.input_global_scale', 'talker.model.layers.13.self_attn.q_proj.input_zero_point', 'talker.model.layers.13

.self_attn.q_proj.weight_global_scale', 'talker.model.layers.13.self_attn.q_proj.weight_scale', 'talker.model.layers.13

.self_attn.q_proj.weight_zero_point', 'talker.model.layers.13.self_attn.v_proj.input_global_scale', 'talker.model.layer

s.13.self_attn.v_proj.input_zero_point', 'talker.model.layers.13.self_attn.v_proj.weight_global_scale', 'talker.model.l

ayers.13.self_attn.v_proj.weight_scale', 'talker.model.layers.13.self_attn.v_proj.weight_zero_point', 'talker.model.lay

ers.14.mlp.down_proj.input_global_scale', 'talker.model.layers.14.mlp.down_proj.input_zero_point', 'talker.model.layers

.14.mlp.down_proj.weight_global_scale', 'talker.model.layers.14.mlp.down_proj.weight_scale', 'talker.model.layers.14.ml

p.down_proj.weight_zero_point', 'talker.model.layers.14.mlp.gate_proj.input_global_scale', 'talker.model.layers.14.mlp.

gate_proj.input_zero_point', 'talker.model.layers.14.mlp.gate_proj.weight_global_scale', 'talker.model.layers.14.mlp.ga

te_proj.weight_scale', 'talker.model.layers.14.mlp.gate_proj.weight_zero_point', 'talker.model.layers.14.mlp.up_proj.in

put_global_scale', 'talker.model.layers.14.mlp.up_proj.input_zero_point', 'talker.model.layers.14.mlp.up_proj.weight_gl

obal_scale', 'talker.model.layers.14.mlp.up_proj.weight_scale', 'talker.model.layers.14.mlp.up_proj.weight_zero_point',
 'talker.model.layers.14.self_attn.k_proj.input_global_scale', 'talker.model.layers.14.self_attn.k_proj.input_zero_poin

t', 'talker.model.layers.14.self_attn.k_proj.weight_global_scale', 'talker.model.layers.14.self_attn.k_proj.weight_scal

e', 'talker.model.layers.14.self_attn.k_proj.weight_zero_point', 'talker.model.layers.14.self_attn.o_proj.input_global_

scale', 'talker.model.layers.14.self_attn.o_proj.input_zero_point', 'talker.model.layers.14.self_attn.o_proj.weight_glo

bal_scale', 'talker.model.layers.14.self_attn.o_proj.weight_scale', 'talker.model.layers.14.self_attn.o_proj.weight_zer

o_point', 'talker.model.layers.14.self_attn.q_proj.input_global_scale', 'talker.model.layers.14.self_attn.q_proj.input_

zero_point', 'talker.model.layers.14.self_attn.q_proj.weight_global_scale', 'talker.model.layers.14.self_attn.q_proj.we

ight_scale', 'talker.model.layers.14.self_attn.q_proj.weight_zero_point', 'talker.model.layers.14.self_attn.v_proj.inpu

t_global_scale', 'talker.model.layers.14.self_attn.v_proj.input_zero_point', 'talker.model.layers.14.self_attn.v_proj.w

eight_global_scale', 'talker.model.layers.14.self_attn.v_proj.weight_scale', 'talker.model.layers.14.self_attn.v_proj.w

eight_zero_point', 'talker.model.layers.15.mlp.down_proj.input_global_scale', 'talker.model.layers.15.mlp.down_proj.inp

ut_zero_point', 'talker.model.layers.15.mlp.down_proj.weight_global_scale', 'talker.model.layers.15.mlp.down_proj.weigh

t_scale', 'talker.model.layers.15.mlp.down_proj.weight_zero_point', 'talker.model.layers.15.mlp.gate_proj.input_global_

scale', 'talker.model.layers.15.mlp.gate_proj.input_zero_point', 'talker.model.layers.15.mlp.gate_proj.weight_global_sc

ale', 'talker.model.layers.15.mlp.gate_proj.weight_scale', 'talker.model.layers.15.mlp.gate_proj.weight_zero_point', 't

alker.model.layers.15.mlp.up_proj.input_global_scale', 'talker.model.layers.15.mlp.up_proj.input_zero_point', 'talker.m

odel.layers.15.mlp.up_proj.weight_global_scale', 'talker.model.layers.15.mlp.up_proj.weight_scale', 'talker.model.layer

s.15.mlp.up_proj.weight_zero_point', 'talker.model.layers.15.self_attn.k_proj.input_global_scale', 'talker.model.layers

.15.self_attn.k_proj.input_zero_point', 'talker.model.layers.15.self_attn.k_proj.weight_global_scale', 'talker.model.la

yers.15.self_attn.k_proj.weight_scale', 'talker.model.layers.15.self_attn.k_proj.weight_zero_point', 'talker.model.laye

rs.15.self_attn.o_proj.input_global_scale', 'talker.model.layers.15.self_attn.o_proj.input_zero_point', 'talker.model.l

ayers.15.self_attn.o_proj.weight_global_scale', 'talker.model.layers.15.self_attn.o_proj.weight_scale', 'talker.model.l

ayers.15.self_attn.o_proj.weight_zero_point', 'talker.model.layers.15.self_attn.q_proj.input_global_scale', 'talker.mod

el.layers.15.self_attn.q_proj.input_zero_point', 'talker.model.layers.15.self_attn.q_proj.weight_global_scale', 'talker

.model.layers.15.self_attn.q_proj.weight_scale', 'talker.model.layers.15.self_attn.q_proj.weight_zero_point', 'talker.m

odel.layers.15.self_attn.v_proj.input_global_scale', 'talker.model.layers.15.self_attn.v_proj.input_zero_point', 'talke

r.model.layers.15.self_attn.v_proj.weight_global_scale', 'talker.model.layers.15.self_attn.v_proj.weight_scale', 'talke

r.model.layers.15.self_attn.v_proj.weight_zero_point', 'talker.model.layers.16.mlp.down_proj.input_global_scale', 'talk

er.model.layers.16.mlp.down_proj.input_zero_point', 'talker.model.layers.16.mlp.down_proj.weight_global_scale', 'talker

.model.layers.16.mlp.down_proj.weight_scale', 'talker.model.layers.16.mlp.down_proj.weight_zero_point', 'talker.model.l

ayers.16.mlp.gate_proj.input_global_scale', 'talker.model.layers.16.mlp.gate_proj.input_zero_point', 'talker.model.laye

rs.16.mlp.gate_proj.weight_global_scale', 'talker.model.layers.16.mlp.gate_proj.weight_scale', 'talker.model.layers.16.

mlp.gate_proj.weight_zero_point', 'talker.model.layers.16.mlp.up_proj.input_global_scale', 'talker.model.layers.16.mlp.

up_proj.input_zero_point', 'talker.model.layers.16.mlp.up_proj.weight_global_scale', 'talker.model.layers.16.mlp.up_pro

j.weight_scale', 'talker.model.layers.16.mlp.up_proj.weight_zero_point', 'talker.model.layers.16.self_attn.k_proj.input

_global_scale', 'talker.model.layers.16.self_attn.k_proj.input_zero_point', 'talker.model.layers.16.self_attn.k_proj.we

ight_global_scale', 'talker.model.layers.16.self_attn.k_proj.weight_scale', 'talker.model.layers.16.self_attn.k_proj.we

ight_zero_point', 'talker.model.layers.16.self_attn.o_proj.input_global_scale', 'talker.model.layers.16.self_attn.o_pro

j.input_zero_point', 'talker.model.layers.16.self_attn.o_proj.weight_global_scale', 'talker.model.layers.16.self_attn.o

_proj.weight_scale', 'talker.model.layers.16.self_attn.o_proj.weight_zero_point', 'talker.model.layers.16.self_attn.q_p

roj.input_global_scale', 'talker.model.layers.16.self_attn.q_proj.input_zero_point', 'talker.model.layers.16.self_attn.

q_proj.weight_global_scale', 'talker.model.layers.16.self_attn.q_proj.weight_scale', 'talker.model.layers.16.self_attn.

q_proj.weight_zero_point', 'talker.model.layers.16.self_attn.v_proj.input_global_scale', 'talker.model.layers.16.self_a

ttn.v_proj.input_zero_point', 'talker.model.layers.16.self_attn.v_proj.weight_global_scale', 'talker.model.layers.16.se

lf_attn.v_proj.weight_scale', 'talker.model.layers.16.self_attn.v_proj.weight_zero_point', 'talker.model.layers.17.mlp.

down_proj.input_global_scale', 'talker.model.layers.17.mlp.down_proj.input_zero_point', 'talker.model.layers.17.mlp.dow

n_proj.weight_global_scale', 'talker.model.layers.17.mlp.down_proj.weight_scale', 'talker.model.layers.17.mlp.down_proj

.weight_zero_point', 'talker.model.layers.17.mlp.gate_proj.input_global_scale', 'talker.model.layers.17.mlp.gate_proj.i

nput_zero_point', 'talker.model.layers.17.mlp.gate_proj.weight_global_scale', 'talker.model.layers.17.mlp.gate_proj.wei

ght_scale', 'talker.model.layers.17.mlp.gate_proj.weight_zero_point', 'talker.model.layers.17.mlp.up_proj.input_global_

scale', 'talker.model.layers.17.mlp.up_proj.input_zero_point', 'talker.model.layers.17.mlp.up_proj.weight_global_scale'
, 'talker.model.layers.17.mlp.up_proj.weight_scale', 'talker.model.layers.17.mlp.up_proj.weight_zero_point', 'talker.mo

del.layers.17.self_attn.k_proj.input_global_scale', 'talker.model.layers.17.self_attn.k_proj.input_zero_point', 'talker

.model.layers.17.self_attn.k_proj.weight_global_scale', 'talker.model.layers.17.self_attn.k_proj.weight_scale', 'talker

.model.layers.17.self_attn.k_proj.weight_zero_point', 'talker.model.layers.17.self_attn.o_proj.input_global_scale', 'ta

lker.model.layers.17.self_attn.o_proj.input_zero_point', 'talker.model.layers.17.self_attn.o_proj.weight_global_scale',
 'talker.model.layers.17.self_attn.o_proj.weight_scale', 'talker.model.layers.17.self_attn.o_proj.weight_zero_point', '

talker.model.layers.17.self_attn.q_proj.input_global_scale', 'talker.model.layers.17.self_attn.q_proj.input_zero_point'
, 'talker.model.layers.17.self_attn.q_proj.weight_global_scale', 'talker.model.layers.17.self_attn.q_proj.weight_scale'
, 'talker.model.layers.17.self_attn.q_proj.weight_zero_point', 'talker.model.layers.17.self_attn.v_proj.input_global_sc

ale', 'talker.model.layers.17.self_attn.v_proj.input_zero_point', 'talker.model.layers.17.self_attn.v_proj.weight_globa

l_scale', 'talker.model.layers.17.self_attn.v_proj.weight_scale', 'talker.model.layers.17.self_attn.v_proj.weight_zero_

point', 'talker.model.layers.18.mlp.down_proj.input_global_scale', 'talker.model.layers.18.mlp.down_proj.input_zero_poi

nt', 'talker.model.layers.18.mlp.down_proj.weight_global_scale', 'talker.model.layers.18.mlp.down_proj.weight_scale', '

talker.model.layers.18.mlp.down_proj.weight_zero_point', 'talker.model.layers.18.mlp.gate_proj.input_global_scale', 'ta

lker.model.layers.18.mlp.gate_proj.input_zero_point', 'talker.model.layers.18.mlp.gate_proj.weight_global_scale', 'talk

er.model.layers.18.mlp.gate_proj.weight_scale', 'talker.model.layers.18.mlp.gate_proj.weight_zero_point', 'talker.model

.layers.18.mlp.up_proj.input_global_scale', 'talker.model.layers.18.mlp.up_proj.input_zero_point', 'talker.model.layers

.18.mlp.up_proj.weight_global_scale', 'talker.model.layers.18.mlp.up_proj.weight_scale', 'talker.model.layers.18.mlp.up

_proj.weight_zero_point', 'talker.model.layers.18.self_attn.k_proj.input_global_scale', 'talker.model.layers.18.self_at

tn.k_proj.input_zero_point', 'talker.model.layers.18.self_attn.k_proj.weight_global_scale', 'talker.model.layers.18.sel

f_attn.k_proj.weight_scale', 'talker.model.layers.18.self_attn.k_proj.weight_zero_point', 'talker.model.layers.18.self_

attn.o_proj.input_global_scale', 'talker.model.layers.18.self_attn.o_proj.input_zero_point', 'talker.model.layers.18.se

lf_attn.o_proj.weight_global_scale', 'talker.model.layers.18.self_attn.o_proj.weight_scale', 'talker.model.layers.18.se

lf_attn.o_proj.weight_zero_point', 'talker.model.layers.18.self_attn.q_proj.input_global_scale', 'talker.model.layers.1

8.self_attn.q_proj.input_zero_point', 'talker.model.layers.18.self_attn.q_proj.weight_global_scale', 'talker.model.laye

rs.18.self_attn.q_proj.weight_scale', 'talker.model.layers.18.self_attn.q_proj.weight_zero_point', 'talker.model.layers

.18.self_attn.v_proj.input_global_scale', 'talker.model.layers.18.self_attn.v_proj.input_zero_point', 'talker.model.lay

ers.18.self_attn.v_proj.weight_global_scale', 'talker.model.layers.18.self_attn.v_proj.weight_scale', 'talker.model.lay

ers.18.self_attn.v_proj.weight_zero_point', 'talker.model.layers.19.mlp.down_proj.input_global_scale', 'talker.model.la

yers.19.mlp.down_proj.input_zero_point', 'talker.model.layers.19.mlp.down_proj.weight_global_scale', 'talker.model.laye

rs.19.mlp.down_proj.weight_scale', 'talker.model.layers.19.mlp.down_proj.weight_zero_point', 'talker.model.layers.19.ml

p.gate_proj.input_global_scale', 'talker.model.layers.19.mlp.gate_proj.input_zero_point', 'talker.model.layers.19.mlp.g

ate_proj.weight_global_scale', 'talker.model.layers.19.mlp.gate_proj.weight_scale', 'talker.model.layers.19.mlp.gate_pr

oj.weight_zero_point', 'talker.model.layers.19.mlp.up_proj.input_global_scale', 'talker.model.layers.19.mlp.up_proj.inp

ut_zero_point', 'talker.model.layers.19.mlp.up_proj.weight_global_scale', 'talker.model.layers.19.mlp.up_proj.weight_sc

ale', 'talker.model.layers.19.mlp.up_proj.weight_zero_point', 'talker.model.layers.19.self_attn.k_proj.input_global_sca

le', 'talker.model.layers.19.self_attn.k_proj.input_zero_point', 'talker.model.layers.19.self_attn.k_proj.weight_global

_scale', 'talker.model.layers.19.self_attn.k_proj.weight_scale', 'talker.model.layers.19.self_attn.k_proj.weight_zero_p

oint', 'talker.model.layers.19.self_attn.o_proj.input_global_scale', 'talker.model.layers.19.self_attn.o_proj.input_zer

o_point', 'talker.model.layers.19.self_attn.o_proj.weight_global_scale', 'talker.model.layers.19.self_attn.o_proj.weigh

t_scale', 'talker.model.layers.19.self_attn.o_proj.weight_zero_point', 'talker.model.layers.19.self_attn.q_proj.input_g

lobal_scale', 'talker.model.layers.19.self_attn.q_proj.input_zero_point', 'talker.model.layers.19.self_attn.q_proj.weig

ht_global_scale', 'talker.model.layers.19.self_attn.q_proj.weight_scale', 'talker.model.layers.19.self_attn.q_proj.weig

ht_zero_point', 'talker.model.layers.19.self_attn.v_proj.input_global_scale', 'talker.model.layers.19.self_attn.v_proj.

input_zero_point', 'talker.model.layers.19.self_attn.v_proj.weight_global_scale', 'talker.model.layers.19.self_attn.v_p

roj.weight_scale', 'talker.model.layers.19.self_attn.v_proj.weight_zero_point', 'talker.model.layers.2.mlp.down_proj.in

put_global_scale', 'talker.model.layers.2.mlp.down_proj.input_zero_point', 'talker.model.layers.2.mlp.down_proj.weight_

global_scale', 'talker.model.layers.2.mlp.down_proj.weight_scale', 'talker.model.layers.2.mlp.down_proj.weight_zero_poi

nt', 'talker.model.layers.2.mlp.gate_proj.input_global_scale', 'talker.model.layers.2.mlp.gate_proj.input_zero_point', 
'talker.model.layers.2.mlp.gate_proj.weight_global_scale', 'talker.model.layers.2.mlp.gate_proj.weight_scale', 'talker.

model.layers.2.mlp.gate_proj.weight_zero_point', 'talker.model.layers.2.mlp.up_proj.input_global_scale', 'talker.model.

layers.2.mlp.up_proj.input_zero_point', 'talker.model.layers.2.mlp.up_proj.weight_global_scale', 'talker.model.layers.2

.mlp.up_proj.weight_scale', 'talker.model.layers.2.mlp.up_proj.weight_zero_point', 'talker.model.layers.2.self_attn.k_p

roj.input_global_scale', 'talker.model.layers.2.self_attn.k_proj.input_zero_point', 'talker.model.layers.2.self_attn.k_

proj.weight_global_scale', 'talker.model.layers.2.self_attn.k_proj.weight_scale', 'talker.model.layers.2.self_attn.k_pr

oj.weight_zero_point', 'talker.model.layers.2.self_attn.o_proj.input_global_scale', 'talker.model.layers.2.self_attn.o_

proj.input_zero_point', 'talker.model.layers.2.self_attn.o_proj.weight_global_scale', 'talker.model.layers.2.self_attn.

o_proj.weight_scale', 'talker.model.layers.2.self_attn.o_proj.weight_zero_point', 'talker.model.layers.2.self_attn.q_pr

oj.input_global_scale', 'talker.model.layers.2.self_attn.q_proj.input_zero_point', 'talker.model.layers.2.self_attn.q_p

roj.weight_global_scale', 'talker.model.layers.2.self_attn.q_proj.weight_scale', 'talker.model.layers.2.self_attn.q_pro

j.weight_zero_point', 'talker.model.layers.2.self_attn.v_proj.input_global_scale', 'talker.model.layers.2.self_attn.v_p

roj.input_zero_point', 'talker.model.layers.2.self_attn.v_proj.weight_global_scale', 'talker.model.layers.2.self_attn.v

_proj.weight_scale', 'talker.model.layers.2.self_attn.v_proj.weight_zero_point', 'talker.model.layers.20.mlp.down_proj.

input_global_scale', 'talker.model.layers.20.mlp.down_proj.input_zero_point', 'talker.model.layers.20.mlp.down_proj.wei

ght_global_scale', 'talker.model.layers.20.mlp.down_proj.weight_scale', 'talker.model.layers.20.mlp.down_proj.weight_ze

ro_point', 'talker.model.layers.20.mlp.gate_proj.input_global_scale', 'talker.model.layers.20.mlp.gate_proj.input_zero_

point', 'talker.model.layers.20.mlp.gate_proj.weight_global_scale', 'talker.model.layers.20.mlp.gate_proj.weight_scale'
, 'talker.model.layers.20.mlp.gate_proj.weight_zero_point', 'talker.model.layers.20.mlp.up_proj.input_global_scale', 't

alker.model.layers.20.mlp.up_proj.input_zero_point', 'talker.model.layers.20.mlp.up_proj.weight_global_scale', 'talker.

model.layers.20.mlp.up_proj.weight_scale', 'talker.model.layers.20.mlp.up_proj.weight_zero_point', 'talker.model.layers

.20.self_attn.k_proj.input_global_scale', 'talker.model.layers.20.self_attn.k_proj.input_zero_point', 'talker.model.lay

ers.20.self_attn.k_proj.weight_global_scale', 'talker.model.layers.20.self_attn.k_proj.weight_scale', 'talker.model.lay

ers.20.self_attn.k_proj.weight_zero_point', 'talker.model.layers.20.self_attn.o_proj.input_global_scale', 'talker.model

.layers.20.self_attn.o_proj.input_zero_point', 'talker.model.layers.20.self_attn.o_proj.weight_global_scale', 'talker.m

odel.layers.20.self_attn.o_proj.weight_scale', 'talker.model.layers.20.self_attn.o_proj.weight_zero_point', 'talker.mod

el.layers.20.self_attn.q_proj.input_global_scale', 'talker.model.layers.20.self_attn.q_proj.input_zero_point', 'talker.

model.layers.20.self_attn.q_proj.weight_global_scale', 'talker.model.layers.20.self_attn.q_proj.weight_scale', 'talker.

model.layers.20.self_attn.q_proj.weight_zero_point', 'talker.model.layers.20.self_attn.v_proj.input_global_scale', 'tal

ker.model.layers.20.self_attn.v_proj.input_zero_point', 'talker.model.layers.20.self_attn.v_proj.weight_global_scale', 
'talker.model.layers.20.self_attn.v_proj.weight_scale', 'talker.model.layers.20.self_attn.v_proj.weight_zero_point', 't

alker.model.layers.21.mlp.down_proj.input_global_scale', 'talker.model.layers.21.mlp.down_proj.input_zero_point', 'talk

er.model.layers.21.mlp.down_proj.weight_global_scale', 'talker.model.layers.21.mlp.down_proj.weight_scale', 'talker.mod

el.layers.21.mlp.down_proj.weight_zero_point', 'talker.model.layers.21.mlp.gate_proj.input_global_scale', 'talker.model

.layers.21.mlp.gate_proj.input_zero_point', 'talker.model.layers.21.mlp.gate_proj.weight_global_scale', 'talker.model.l

ayers.21.mlp.gate_proj.weight_scale', 'talker.model.layers.21.mlp.gate_proj.weight_zero_point', 'talker.model.layers.21

.mlp.up_proj.input_global_scale', 'talker.model.layers.21.mlp.up_proj.input_zero_point', 'talker.model.layers.21.mlp.up

_proj.weight_global_scale', 'talker.model.layers.21.mlp.up_proj.weight_scale', 'talker.model.layers.21.mlp.up_proj.weig

ht_zero_point', 'talker.model.layers.21.self_attn.k_proj.input_global_scale', 'talker.model.layers.21.self_attn.k_proj.

input_zero_point', 'talker.model.layers.21.self_attn.k_proj.weight_global_scale', 'talker.model.layers.21.self_attn.k_p

roj.weight_scale', 'talker.model.layers.21.self_attn.k_proj.weight_zero_point', 'talker.model.layers.21.self_attn.o_pro

j.input_global_scale', 'talker.model.layers.21.self_attn.o_proj.input_zero_point', 'talker.model.layers.21.self_attn.o_

proj.weight_global_scale', 'talker.model.layers.21.self_attn.o_proj.weight_scale', 'talker.model.layers.21.self_attn.o_

proj.weight_zero_point', 'talker.model.layers.21.self_attn.q_proj.input_global_scale', 'talker.model.layers.21.self_att

n.q_proj.input_zero_point', 'talker.model.layers.21.self_attn.q_proj.weight_global_scale', 'talker.model.layers.21.self

_attn.q_proj.weight_scale', 'talker.model.layers.21.self_attn.q_proj.weight_zero_point', 'talker.model.layers.21.self_a

ttn.v_proj.input_global_scale', 'talker.model.layers.21.self_attn.v_proj.input_zero_point', 'talker.model.layers.21.sel

f_attn.v_proj.weight_global_scale', 'talker.model.layers.21.self_attn.v_proj.weight_scale', 'talker.model.layers.21.sel

f_attn.v_proj.weight_zero_point', 'talker.model.layers.22.mlp.down_proj.input_global_scale', 'talker.model.layers.22.ml

p.down_proj.input_zero_point', 'talker.model.layers.22.mlp.down_proj.weight_global_scale', 'talker.model.layers.22.mlp.

down_proj.weight_scale', 'talker.model.layers.22.mlp.down_proj.weight_zero_point', 'talker.model.layers.22.mlp.gate_pro

j.input_global_scale', 'talker.model.layers.22.mlp.gate_proj.input_zero_point', 'talker.model.layers.22.mlp.gate_proj.w

eight_global_scale', 'talker.model.layers.22.mlp.gate_proj.weight_scale', 'talker.model.layers.22.mlp.gate_proj.weight_

zero_point', 'talker.model.layers.22.mlp.up_proj.input_global_scale', 'talker.model.layers.22.mlp.up_proj.input_zero_po

int', 'talker.model.layers.22.mlp.up_proj.weight_global_scale', 'talker.model.layers.22.mlp.up_proj.weight_scale', 'tal

ker.model.layers.22.mlp.up_proj.weight_zero_point', 'talker.model.layers.22.self_attn.k_proj.input_global_scale', 'talk

er.model.layers.22.self_attn.k_proj.input_zero_point', 'talker.model.layers.22.self_attn.k_proj.weight_global_scale', '

talker.model.layers.22.self_attn.k_proj.weight_scale', 'talker.model.layers.22.self_attn.k_proj.weight_zero_point', 'ta

lker.model.layers.22.self_attn.o_proj.input_global_scale', 'talker.model.layers.22.self_attn.o_proj.input_zero_point', 
'talker.model.layers.22.self_attn.o_proj.weight_global_scale', 'talker.model.layers.22.self_attn.o_proj.weight_scale', 
'talker.model.layers.22.self_attn.o_proj.weight_zero_point', 'talker.model.layers.22.self_attn.q_proj.input_global_scal

e', 'talker.model.layers.22.self_attn.q_proj.input_zero_point', 'talker.model.layers.22.self_attn.q_proj.weight_global_

scale', 'talker.model.layers.22.self_attn.q_proj.weight_scale', 'talker.model.layers.22.self_attn.q_proj.weight_zero_po

int', 'talker.model.layers.22.self_attn.v_proj.input_global_scale', 'talker.model.layers.22.self_attn.v_proj.input_zero

_point', 'talker.model.layers.22.self_attn.v_proj.weight_global_scale', 'talker.model.layers.22.self_attn.v_proj.weight

_scale', 'talker.model.layers.22.self_attn.v_proj.weight_zero_point', 'talker.model.layers.23.mlp.down_proj.input_globa

l_scale', 'talker.model.layers.23.mlp.down_proj.input_zero_point', 'talker.model.layers.23.mlp.down_proj.weight_global_

scale', 'talker.model.layers.23.mlp.down_proj.weight_scale', 'talker.model.layers.23.mlp.down_proj.weight_zero_point', 
'talker.model.layers.23.mlp.gate_proj.input_global_scale', 'talker.model.layers.23.mlp.gate_proj.input_zero_point', 'ta

lker.model.layers.23.mlp.gate_proj.weight_global_scale', 'talker.model.layers.23.mlp.gate_proj.weight_scale', 'talker.m

odel.layers.23.mlp.gate_proj.weight_zero_point', 'talker.model.layers.23.mlp.up_proj.input_global_scale', 'talker.model

.layers.23.mlp.up_proj.input_zero_point', 'talker.model.layers.23.mlp.up_proj.weight_global_scale', 'talker.model.layer

s.23.mlp.up_proj.weight_scale', 'talker.model.layers.23.mlp.up_proj.weight_zero_point', 'talker.model.layers.23.self_at

tn.k_proj.input_global_scale', 'talker.model.layers.23.self_attn.k_proj.input_zero_point', 'talker.model.layers.23.self

_attn.k_proj.weight_global_scale', 'talker.model.layers.23.self_attn.k_proj.weight_scale', 'talker.model.layers.23.self

_attn.k_proj.weight_zero_point', 'talker.model.layers.23.self_attn.o_proj.input_global_scale', 'talker.model.layers.23.

self_attn.o_proj.input_zero_point', 'talker.model.layers.23.self_attn.o_proj.weight_global_scale', 'talker.model.layers

.23.self_attn.o_proj.weight_scale', 'talker.model.layers.23.self_attn.o_proj.weight_zero_point', 'talker.model.layers.2

3.self_attn.q_proj.input_global_scale', 'talker.model.layers.23.self_attn.q_proj.input_zero_point', 'talker.model.layer

s.23.self_attn.q_proj.weight_global_scale', 'talker.model.layers.23.self_attn.q_proj.weight_scale', 'talker.model.layer

s.23.self_attn.q_proj.weight_zero_point', 'talker.model.layers.23.self_attn.v_proj.input_global_scale', 'talker.model.l

ayers.23.self_attn.v_proj.input_zero_point', 'talker.model.layers.23.self_attn.v_proj.weight_global_scale', 'talker.mod

el.layers.23.self_attn.v_proj.weight_scale', 'talker.model.layers.23.self_attn.v_proj.weight_zero_point', 'talker.model

.layers.24.mlp.down_proj.input_global_scale', 'talker.model.layers.24.mlp.down_proj.input_zero_point', 'talker.model.la

yers.24.mlp.down_proj.weight_global_scale', 'talker.model.layers.24.mlp.down_proj.weight_scale', 'talker.model.layers.2

4.mlp.down_proj.weight_zero_point', 'talker.model.layers.24.mlp.gate_proj.input_global_scale', 'talker.model.layers.24.

mlp.gate_proj.input_zero_point', 'talker.model.layers.24.mlp.gate_proj.weight_global_scale', 'talker.model.layers.24.ml

p.gate_proj.weight_scale', 'talker.model.layers.24.mlp.gate_proj.weight_zero_point', 'talker.model.layers.24.mlp.up_pro

j.input_global_scale', 'talker.model.layers.24.mlp.up_proj.input_zero_point', 'talker.model.layers.24.mlp.up_proj.weigh

t_global_scale', 'talker.model.layers.24.mlp.up_proj.weight_scale', 'talker.model.layers.24.mlp.up_proj.weight_zero_poi

nt', 'talker.model.layers.24.self_attn.k_proj.input_global_scale', 'talker.model.layers.24.self_attn.k_proj.input_zero_

point', 'talker.model.layers.24.self_attn.k_proj.weight_global_scale', 'talker.model.layers.24.self_attn.k_proj.weight_

scale', 'talker.model.layers.24.self_attn.k_proj.weight_zero_point', 'talker.model.layers.24.self_attn.o_proj.input_glo

bal_scale', 'talker.model.layers.24.self_attn.o_proj.input_zero_point', 'talker.model.layers.24.self_attn.o_proj.weight

_global_scale', 'talker.model.layers.24.self_attn.o_proj.weight_scale', 'talker.model.layers.24.self_attn.o_proj.weight

_zero_point', 'talker.model.layers.24.self_attn.q_proj.input_global_scale', 'talker.model.layers.24.self_attn.q_proj.in

put_zero_point', 'talker.model.layers.24.self_attn.q_proj.weight_global_scale', 'talker.model.layers.24.self_attn.q_pro

j.weight_scale', 'talker.model.layers.24.self_attn.q_proj.weight_zero_point', 'talker.model.layers.24.self_attn.v_proj.

input_global_scale', 'talker.model.layers.24.self_attn.v_proj.input_zero_point', 'talker.model.layers.24.self_attn.v_pr

oj.weight_global_scale', 'talker.model.layers.24.self_attn.v_proj.weight_scale', 'talker.model.layers.24.self_attn.v_pr

oj.weight_zero_point', 'talker.model.layers.25.mlp.down_proj.input_global_scale', 'talker.model.layers.25.mlp.down_proj

.input_zero_point', 'talker.model.layers.25.mlp.down_proj.weight_global_scale', 'talker.model.layers.25.mlp.down_proj.w

eight_scale', 'talker.model.layers.25.mlp.down_proj.weight_zero_point', 'talker.model.layers.25.mlp.gate_proj.input_glo

bal_scale', 'talker.model.layers.25.mlp.gate_proj.input_zero_point', 'talker.model.layers.25.mlp.gate_proj.weight_globa

l_scale', 'talker.model.layers.25.mlp.gate_proj.weight_scale', 'talker.model.layers.25.mlp.gate_proj.weight_zero_point'
, 'talker.model.layers.25.mlp.up_proj.input_global_scale', 'talker.model.layers.25.mlp.up_proj.input_zero_point', 'talk

er.model.layers.25.mlp.up_proj.weight_global_scale', 'talker.model.layers.25.mlp.up_proj.weight_scale', 'talker.model.l

ayers.25.mlp.up_proj.weight_zero_point', 'talker.model.layers.25.self_attn.k_proj.input_global_scale', 'talker.model.la

yers.25.self_attn.k_proj.input_zero_point', 'talker.model.layers.25.self_attn.k_proj.weight_global_scale', 'talker.mode

l.layers.25.self_attn.k_proj.weight_scale', 'talker.model.layers.25.self_attn.k_proj.weight_zero_point', 'talker.model.

layers.25.self_attn.o_proj.input_global_scale', 'talker.model.layers.25.self_attn.o_proj.input_zero_point', 'talker.mod

el.layers.25.self_attn.o_proj.weight_global_scale', 'talker.model.layers.25.self_attn.o_proj.weight_scale', 'talker.mod

el.layers.25.self_attn.o_proj.weight_zero_point', 'talker.model.layers.25.self_attn.q_proj.input_global_scale', 'talker

.model.layers.25.self_attn.q_proj.input_zero_point', 'talker.model.layers.25.self_attn.q_proj.weight_global_scale', 'ta

lker.model.layers.25.self_attn.q_proj.weight_scale', 'talker.model.layers.25.self_attn.q_proj.weight_zero_point', 'talk

er.model.layers.25.self_attn.v_proj.input_global_scale', 'talker.model.layers.25.self_attn.v_proj.input_zero_point', 't

alker.model.layers.25.self_attn.v_proj.weight_global_scale', 'talker.model.layers.25.self_attn.v_proj.weight_scale', 't

alker.model.layers.25.self_attn.v_proj.weight_zero_point', 'talker.model.layers.26.mlp.down_proj.input_global_scale', '

talker.model.layers.26.mlp.down_proj.input_zero_point', 'talker.model.layers.26.mlp.down_proj.weight_global_scale', 'ta

lker.model.layers.26.mlp.down_proj.weight_scale', 'talker.model.layers.26.mlp.down_proj.weight_zero_point', 'talker.mod

el.layers.26.mlp.gate_proj.input_global_scale', 'talker.model.layers.26.mlp.gate_proj.input_zero_point', 'talker.model.

layers.26.mlp.gate_proj.weight_global_scale', 'talker.model.layers.26.mlp.gate_proj.weight_scale', 'talker.model.layers

.26.mlp.gate_proj.weight_zero_point', 'talker.model.layers.26.mlp.up_proj.input_global_scale', 'talker.model.layers.26.

mlp.up_proj.input_zero_point', 'talker.model.layers.26.mlp.up_proj.weight_global_scale', 'talker.model.layers.26.mlp.up

_proj.weight_scale', 'talker.model.layers.26.mlp.up_proj.weight_zero_point', 'talker.model.layers.26.self_attn.k_proj.i

nput_global_scale', 'talker.model.layers.26.self_attn.k_proj.input_zero_point', 'talker.model.layers.26.self_attn.k_pro

j.weight_global_scale', 'talker.model.layers.26.self_attn.k_proj.weight_scale', 'talker.model.layers.26.self_attn.k_pro

j.weight_zero_point', 'talker.model.layers.26.self_attn.o_proj.input_global_scale', 'talker.model.layers.26.self_attn.o

_proj.input_zero_point', 'talker.model.layers.26.self_attn.o_proj.weight_global_scale', 'talker.model.layers.26.self_at

tn.o_proj.weight_scale', 'talker.model.layers.26.self_attn.o_proj.weight_zero_point', 'talker.model.layers.26.self_attn

.q_proj.input_global_scale', 'talker.model.layers.26.self_attn.q_proj.input_zero_point', 'talker.model.layers.26.self_a

ttn.q_proj.weight_global_scale', 'talker.model.layers.26.self_attn.q_proj.weight_scale', 'talker.model.layers.26.self_a

ttn.q_proj.weight_zero_point', 'talker.model.layers.26.self_attn.v_proj.input_global_scale', 'talker.model.layers.26.se

lf_attn.v_proj.input_zero_point', 'talker.model.layers.26.self_attn.v_proj.weight_global_scale', 'talker.model.layers.2

6.self_attn.v_proj.weight_scale', 'talker.model.layers.26.self_attn.v_proj.weight_zero_point', 'talker.model.layers.27.

mlp.down_proj.input_global_scale', 'talker.model.layers.27.mlp.down_proj.input_zero_point', 'talker.model.layers.27.mlp

.down_proj.weight_global_scale', 'talker.model.layers.27.mlp.down_proj.weight_scale', 'talker.model.layers.27.mlp.down_

proj.weight_zero_point', 'talker.model.layers.27.mlp.gate_proj.input_global_scale', 'talker.model.layers.27.mlp.gate_pr

oj.input_zero_point', 'talker.model.layers.27.mlp.gate_proj.weight_global_scale', 'talker.model.layers.27.mlp.gate_proj

.weight_scale', 'talker.model.layers.27.mlp.gate_proj.weight_zero_point', 'talker.model.layers.27.mlp.up_proj.input_glo

bal_scale', 'talker.model.layers.27.mlp.up_proj.input_zero_point', 'talker.model.layers.27.mlp.up_proj.weight_global_sc

ale', 'talker.model.layers.27.mlp.up_proj.weight_scale', 'talker.model.layers.27.mlp.up_proj.weight_zero_point', 'talke

r.model.layers.27.self_attn.k_proj.input_global_scale', 'talker.model.layers.27.self_attn.k_proj.input_zero_point', 'ta

lker.model.layers.27.self_attn.k_proj.weight_global_scale', 'talker.model.layers.27.self_attn.k_proj.weight_scale', 'ta

lker.model.layers.27.self_attn.k_proj.weight_zero_point', 'talker.model.layers.27.self_attn.o_proj.input_global_scale',
 'talker.model.layers.27.self_attn.o_proj.input_zero_point', 'talker.model.layers.27.self_attn.o_proj.weight_global_sca

le', 'talker.model.layers.27.self_attn.o_proj.weight_scale', 'talker.model.layers.27.self_attn.o_proj.weight_zero_point

', 'talker.model.layers.27.self_attn.q_proj.input_global_scale', 'talker.model.layers.27.self_attn.q_proj.input_zero_po

int', 'talker.model.layers.27.self_attn.q_proj.weight_global_scale', 'talker.model.layers.27.self_attn.q_proj.weight_sc

ale', 'talker.model.layers.27.self_attn.q_proj.weight_zero_point', 'talker.model.layers.27.self_attn.v_proj.input_globa

l_scale', 'talker.model.layers.27.self_attn.v_proj.input_zero_point', 'talker.model.layers.27.self_attn.v_proj.weight_g

lobal_scale', 'talker.model.layers.27.self_attn.v_proj.weight_scale', 'talker.model.layers.27.self_attn.v_proj.weight_z

ero_point', 'talker.model.layers.3.mlp.down_proj.input_global_scale', 'talker.model.layers.3.mlp.down_proj.input_zero_p

oint', 'talker.model.layers.3.mlp.down_proj.weight_global_scale', 'talker.model.layers.3.mlp.down_proj.weight_scale', '

talker.model.layers.3.mlp.down_proj.weight_zero_point', 'talker.model.layers.3.mlp.gate_proj.input_global_scale', 'talk

er.model.layers.3.mlp.gate_proj.input_zero_point', 'talker.model.layers.3.mlp.gate_proj.weight_global_scale', 'talker.m

odel.layers.3.mlp.gate_proj.weight_scale', 'talker.model.layers.3.mlp.gate_proj.weight_zero_point', 'talker.model.layer

s.3.mlp.up_proj.input_global_scale', 'talker.model.layers.3.mlp.up_proj.input_zero_point', 'talker.model.layers.3.mlp.u

p_proj.weight_global_scale', 'talker.model.layers.3.mlp.up_proj.weight_scale', 'talker.model.layers.3.mlp.up_proj.weigh

t_zero_point', 'talker.model.layers.3.self_attn.k_proj.input_global_scale', 'talker.model.layers.3.self_attn.k_proj.inp

ut_zero_point', 'talker.model.layers.3.self_attn.k_proj.weight_global_scale', 'talker.model.layers.3.self_attn.k_proj.w

eight_scale', 'talker.model.layers.3.self_attn.k_proj.weight_zero_point', 'talker.model.layers.3.self_attn.o_proj.input

_global_scale', 'talker.model.layers.3.self_attn.o_proj.input_zero_point', 'talker.model.layers.3.self_attn.o_proj.weig

ht_global_scale', 'talker.model.layers.3.self_attn.o_proj.weight_scale', 'talker.model.layers.3.self_attn.o_proj.weight

_zero_point', 'talker.model.layers.3.self_attn.q_proj.input_global_scale', 'talker.model.layers.3.self_attn.q_proj.inpu

t_zero_point', 'talker.model.layers.3.self_attn.q_proj.weight_global_scale', 'talker.model.layers.3.self_attn.q_proj.we

ight_scale', 'talker.model.layers.3.self_attn.q_proj.weight_zero_point', 'talker.model.layers.3.self_attn.v_proj.input_

global_scale', 'talker.model.layers.3.self_attn.v_proj.input_zero_point', 'talker.model.layers.3.self_attn.v_proj.weigh

t_global_scale', 'talker.model.layers.3.self_attn.v_proj.weight_scale', 'talker.model.layers.3.self_attn.v_proj.weight_

zero_point', 'talker.model.layers.4.mlp.down_proj.input_global_scale', 'talker.model.layers.4.mlp.down_proj.input_zero_

point', 'talker.model.layers.4.mlp.down_proj.weight_global_scale', 'talker.model.layers.4.mlp.down_proj.weight_scale', 
'talker.model.layers.4.mlp.down_proj.weight_zero_point', 'talker.model.layers.4.mlp.gate_proj.input_global_scale', 'tal

ker.model.layers.4.mlp.gate_proj.input_zero_point', 'talker.model.layers.4.mlp.gate_proj.weight_global_scale', 'talker.

model.layers.4.mlp.gate_proj.weight_scale', 'talker.model.layers.4.mlp.gate_proj.weight_zero_point', 'talker.model.laye

rs.4.mlp.up_proj.input_global_scale', 'talker.model.layers.4.mlp.up_proj.input_zero_point', 'talker.model.layers.4.mlp.

up_proj.weight_global_scale', 'talker.model.layers.4.mlp.up_proj.weight_scale', 'talker.model.layers.4.mlp.up_proj.weig

ht_zero_point', 'talker.model.layers.4.self_attn.k_proj.input_global_scale', 'talker.model.layers.4.self_attn.k_proj.in

put_zero_point', 'talker.model.layers.4.self_attn.k_proj.weight_global_scale', 'talker.model.layers.4.self_attn.k_proj.

weight_scale', 'talker.model.layers.4.self_attn.k_proj.weight_zero_point', 'talker.model.layers.4.self_attn.o_proj.inpu

t_global_scale', 'talker.model.layers.4.self_attn.o_proj.input_zero_point', 'talker.model.layers.4.self_attn.o_proj.wei

ght_global_scale', 'talker.model.layers.4.self_attn.o_proj.weight_scale', 'talker.model.layers.4.self_attn.o_proj.weigh

t_zero_point', 'talker.model.layers.4.self_attn.q_proj.input_global_scale', 'talker.model.layers.4.self_attn.q_proj.inp

ut_zero_point', 'talker.model.layers.4.self_attn.q_proj.weight_global_scale', 'talker.model.layers.4.self_attn.q_proj.w

eight_scale', 'talker.model.layers.4.self_attn.q_proj.weight_zero_point', 'talker.model.layers.4.self_attn.v_proj.input

_global_scale', 'talker.model.layers.4.self_attn.v_proj.input_zero_point', 'talker.model.layers.4.self_attn.v_proj.weig

ht_global_scale', 'talker.model.layers.4.self_attn.v_proj.weight_scale', 'talker.model.layers.4.self_attn.v_proj.weight

_zero_point', 'talker.model.layers.5.mlp.down_proj.input_global_scale', 'talker.model.layers.5.mlp.down_proj.input_zero

_point', 'talker.model.layers.5.mlp.down_proj.weight_global_scale', 'talker.model.layers.5.mlp.down_proj.weight_scale',
 'talker.model.layers.5.mlp.down_proj.weight_zero_point', 'talker.model.layers.5.mlp.gate_proj.input_global_scale', 'ta

lker.model.layers.5.mlp.gate_proj.input_zero_point', 'talker.model.layers.5.mlp.gate_proj.weight_global_scale', 'talker

.model.layers.5.mlp.gate_proj.weight_scale', 'talker.model.layers.5.mlp.gate_proj.weight_zero_point', 'talker.model.lay

ers.5.mlp.up_proj.input_global_scale', 'talker.model.layers.5.mlp.up_proj.input_zero_point', 'talker.model.layers.5.mlp

.up_proj.weight_global_scale', 'talker.model.layers.5.mlp.up_proj.weight_scale', 'talker.model.layers.5.mlp.up_proj.wei

ght_zero_point', 'talker.model.layers.5.self_attn.k_proj.input_global_scale', 'talker.model.layers.5.self_attn.k_proj.i

nput_zero_point', 'talker.model.layers.5.self_attn.k_proj.weight_global_scale', 'talker.model.layers.5.self_attn.k_proj

.weight_scale', 'talker.model.layers.5.self_attn.k_proj.weight_zero_point', 'talker.model.layers.5.self_attn.o_proj.inp

ut_global_scale', 'talker.model.layers.5.self_attn.o_proj.input_zero_point', 'talker.model.layers.5.self_attn.o_proj.we

ight_global_scale', 'talker.model.layers.5.self_attn.o_proj.weight_scale', 'talker.model.layers.5.self_attn.o_proj.weig

ht_zero_point', 'talker.model.layers.5.self_attn.q_proj.input_global_scale', 'talker.model.layers.5.self_attn.q_proj.in

put_zero_point', 'talker.model.layers.5.self_attn.q_proj.weight_global_scale', 'talker.model.layers.5.self_attn.q_proj.

weight_scale', 'talker.model.layers.5.self_attn.q_proj.weight_zero_point', 'talker.model.layers.5.self_attn.v_proj.inpu

t_global_scale', 'talker.model.layers.5.self_attn.v_proj.input_zero_point', 'talker.model.layers.5.self_attn.v_proj.wei

ght_global_scale', 'talker.model.layers.5.self_attn.v_proj.weight_scale', 'talker.model.layers.5.self_attn.v_proj.weigh

t_zero_point', 'talker.model.layers.6.mlp.down_proj.input_global_scale', 'talker.model.layers.6.mlp.down_proj.input_zer

o_point', 'talker.model.layers.6.mlp.down_proj.weight_global_scale', 'talker.model.layers.6.mlp.down_proj.weight_scale'
, 'talker.model.layers.6.mlp.down_proj.weight_zero_point', 'talker.model.layers.6.mlp.gate_proj.input_global_scale', 't

alker.model.layers.6.mlp.gate_proj.input_zero_point', 'talker.model.layers.6.mlp.gate_proj.weight_global_scale', 'talke

r.model.layers.6.mlp.gate_proj.weight_scale', 'talker.model.layers.6.mlp.gate_proj.weight_zero_point', 'talker.model.la

yers.6.mlp.up_proj.input_global_scale', 'talker.model.layers.6.mlp.up_proj.input_zero_point', 'talker.model.layers.6.ml

p.up_proj.weight_global_scale', 'talker.model.layers.6.mlp.up_proj.weight_scale', 'talker.model.layers.6.mlp.up_proj.we

ight_zero_point', 'talker.model.layers.6.self_attn.k_proj.input_global_scale', 'talker.model.layers.6.self_attn.k_proj.

input_zero_point', 'talker.model.layers.6.self_attn.k_proj.weight_global_scale', 'talker.model.layers.6.self_attn.k_pro

j.weight_scale', 'talker.model.layers.6.self_attn.k_proj.weight_zero_point', 'talker.model.layers.6.self_attn.o_proj.in

put_global_scale', 'talker.model.layers.6.self_attn.o_proj.input_zero_point', 'talker.model.layers.6.self_attn.o_proj.w

eight_global_scale', 'talker.model.layers.6.self_attn.o_proj.weight_scale', 'talker.model.layers.6.self_attn.o_proj.wei

ght_zero_point', 'talker.model.layers.6.self_attn.q_proj.input_global_scale', 'talker.model.layers.6.self_attn.q_proj.i

nput_zero_point', 'talker.model.layers.6.self_attn.q_proj.weight_global_scale', 'talker.model.layers.6.self_attn.q_proj

.weight_scale', 'talker.model.layers.6.self_attn.q_proj.weight_zero_point', 'talker.model.layers.6.self_attn.v_proj.inp

ut_global_scale', 'talker.model.layers.6.self_attn.v_proj.input_zero_point', 'talker.model.layers.6.self_attn.v_proj.we

ight_global_scale', 'talker.model.layers.6.self_attn.v_proj.weight_scale', 'talker.model.layers.6.self_attn.v_proj.weig

ht_zero_point', 'talker.model.layers.7.mlp.down_proj.input_global_scale', 'talker.model.layers.7.mlp.down_proj.input_ze

ro_point', 'talker.model.layers.7.mlp.down_proj.weight_global_scale', 'talker.model.layers.7.mlp.down_proj.weight_scale

', 'talker.model.layers.7.mlp.down_proj.weight_zero_point', 'talker.model.layers.7.mlp.gate_proj.input_global_scale', '

talker.model.layers.7.mlp.gate_proj.input_zero_point', 'talker.model.layers.7.mlp.gate_proj.weight_global_scale', 'talk

er.model.layers.7.mlp.gate_proj.weight_scale', 'talker.model.layers.7.mlp.gate_proj.weight_zero_point', 'talker.model.l

ayers.7.mlp.up_proj.input_global_scale', 'talker.model.layers.7.mlp.up_proj.input_zero_point', 'talker.model.layers.7.m

lp.up_proj.weight_global_scale', 'talker.model.layers.7.mlp.up_proj.weight_scale', 'talker.model.layers.7.mlp.up_proj.w

eight_zero_point', 'talker.model.layers.7.self_attn.k_proj.input_global_scale', 'talker.model.layers.7.self_attn.k_proj

.input_zero_point', 'talker.model.layers.7.self_attn.k_proj.weight_global_scale', 'talker.model.layers.7.self_attn.k_pr

oj.weight_scale', 'talker.model.layers.7.self_attn.k_proj.weight_zero_point', 'talker.model.layers.7.self_attn.o_proj.i

nput_global_scale', 'talker.model.layers.7.self_attn.o_proj.input_zero_point', 'talker.model.layers.7.self_attn.o_proj.

weight_global_scale', 'talker.model.layers.7.self_attn.o_proj.weight_scale', 'talker.model.layers.7.self_attn.o_proj.we

ight_zero_point', 'talker.model.layers.7.self_attn.q_proj.input_global_scale', 'talker.model.layers.7.self_attn.q_proj.

input_zero_point', 'talker.model.layers.7.self_attn.q_proj.weight_global_scale', 'talker.model.layers.7.self_attn.q_pro

j.weight_scale', 'talker.model.layers.7.self_attn.q_proj.weight_zero_point', 'talker.model.layers.7.self_attn.v_proj.in

put_global_scale', 'talker.model.layers.7.self_attn.v_proj.input_zero_point', 'talker.model.layers.7.self_attn.v_proj.w

eight_global_scale', 'talker.model.layers.7.self_attn.v_proj.weight_scale', 'talker.model.layers.7.self_attn.v_proj.wei

ght_zero_point', 'talker.model.layers.8.mlp.down_proj.input_global_scale', 'talker.model.layers.8.mlp.down_proj.input_z

ero_point', 'talker.model.layers.8.mlp.down_proj.weight_global_scale', 'talker.model.layers.8.mlp.down_proj.weight_scal

e', 'talker.model.layers.8.mlp.down_proj.weight_zero_point', 'talker.model.layers.8.mlp.gate_proj.input_global_scale', 
'talker.model.layers.8.mlp.gate_proj.input_zero_point', 'talker.model.layers.8.mlp.gate_proj.weight_global_scale', 'tal

ker.model.layers.8.mlp.gate_proj.weight_scale', 'talker.model.layers.8.mlp.gate_proj.weight_zero_point', 'talker.model.

layers.8.mlp.up_proj.input_global_scale', 'talker.model.layers.8.mlp.up_proj.input_zero_point', 'talker.model.layers.8.

mlp.up_proj.weight_global_scale', 'talker.model.layers.8.mlp.up_proj.weight_scale', 'talker.model.layers.8.mlp.up_proj.

weight_zero_point', 'talker.model.layers.8.self_attn.k_proj.input_global_scale', 'talker.model.layers.8.self_attn.k_pro

j.input_zero_point', 'talker.model.layers.8.self_attn.k_proj.weight_global_scale', 'talker.model.layers.8.self_attn.k_p

roj.weight_scale', 'talker.model.layers.8.self_attn.k_proj.weight_zero_point', 'talker.model.layers.8.self_attn.o_proj.

input_global_scale', 'talker.model.layers.8.self_attn.o_proj.input_zero_point', 'talker.model.layers.8.self_attn.o_proj

.weight_global_scale', 'talker.model.layers.8.self_attn.o_proj.weight_scale', 'talker.model.layers.8.self_attn.o_proj.w

eight_zero_point', 'talker.model.layers.8.self_attn.q_proj.input_global_scale', 'talker.model.layers.8.self_attn.q_proj

.input_zero_point', 'talker.model.layers.8.self_attn.q_proj.weight_global_scale', 'talker.model.layers.8.self_attn.q_pr

oj.weight_scale', 'talker.model.layers.8.self_attn.q_proj.weight_zero_point', 'talker.model.layers.8.self_attn.v_proj.i

nput_global_scale', 'talker.model.layers.8.self_attn.v_proj.input_zero_point', 'talker.model.layers.8.self_attn.v_proj.

weight_global_scale', 'talker.model.layers.8.self_attn.v_proj.weight_scale', 'talker.model.layers.8.self_attn.v_proj.we

ight_zero_point', 'talker.model.layers.9.mlp.down_proj.input_global_scale', 'talker.model.layers.9.mlp.down_proj.input_

zero_point', 'talker.model.layers.9.mlp.down_proj.weight_global_scale', 'talker.model.layers.9.mlp.down_proj.weight_sca

le', 'talker.model.layers.9.mlp.down_proj.weight_zero_point', 'talker.model.layers.9.mlp.gate_proj.input_global_scale',
 'talker.model.layers.9.mlp.gate_proj.input_zero_point', 'talker.model.layers.9.mlp.gate_proj.weight_global_scale', 'ta

lker.model.layers.9.mlp.gate_proj.weight_scale', 'talker.model.layers.9.mlp.gate_proj.weight_zero_point', 'talker.model

.layers.9.mlp.up_proj.input_global_scale', 'talker.model.layers.9.mlp.up_proj.input_zero_point', 'talker.model.layers.9

.mlp.up_proj.weight_global_scale', 'talker.model.layers.9.mlp.up_proj.weight_scale', 'talker.model.layers.9.mlp.up_proj

.weight_zero_point', 'talker.model.layers.9.self_attn.k_proj.input_global_scale', 'talker.model.layers.9.self_attn.k_pr

oj.input_zero_point', 'talker.model.layers.9.self_attn.k_proj.weight_global_scale', 'talker.model.layers.9.self_attn.k_

proj.weight_scale', 'talker.model.layers.9.self_attn.k_proj.weight_zero_point', 'talker.model.layers.9.self_attn.o_proj

.input_global_scale', 'talker.model.layers.9.self_attn.o_proj.input_zero_point', 'talker.model.layers.9.self_attn.o_pro

j.weight_global_scale', 'talker.model.layers.9.self_attn.o_proj.weight_scale', 'talker.model.layers.9.self_attn.o_proj.

weight_zero_point', 'talker.model.layers.9.self_attn.q_proj.input_global_scale', 'talker.model.layers.9.self_attn.q_pro

j.input_zero_point', 'talker.model.layers.9.self_attn.q_proj.weight_global_scale', 'talker.model.layers.9.self_attn.q_p

roj.weight_scale', 'talker.model.layers.9.self_attn.q_proj.weight_zero_point', 'talker.model.layers.9.self_attn.v_proj.

input_global_scale', 'talker.model.layers.9.self_attn.v_proj.input_zero_point', 'talker.model.layers.9.self_attn.v_proj

.weight_global_scale', 'talker.model.layers.9.self_attn.v_proj.weight_scale', 'talker.model.layers.9.self_attn.v_proj.w

eight_zero_point', 'talker.text_projection.linear_fc1.input_global_scale', 'talker.text_projection.linear_fc1.input_zer

o_point', 'talker.text_projection.linear_fc1.weight_global_scale', 'talker.text_projection.linear_fc1.weight_scale', 't

alker.text_projection.linear_fc1.weight_zero_point', 'talker.text_projection.linear_fc2.input_global_scale', 'talker.te

xt_projection.linear_fc2.input_zero_point', 'talker.text_projection.linear_fc2.weight_global_scale', 'talker.text_proje

ction.linear_fc2.weight_scale', 'talker.text_projection.linear_fc2.weight_zero_point']
- This IS expected if you are initializing Qwen3TTSForConditionalGeneration from the checkpoint of a model trained on a
nother task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTrai
ning model).
- This IS NOT expected if you are initializing Qwen3TTSForConditionalGeneration from the checkpoint of a model that you
 expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassificatio
n model).
The tokenizer you are loading from 'D:\Git_Work\jarvis_taemin\models\Qwen3-TTS-NVFP4' with an incorrect regex pattern: 
https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will
 lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix th
is issue.
 * Tip: There are .env files present. Install python-dotenv to use them.
================================================================
Orpheus (오르페우스) - Imperial Voice: Windows Native TTS Server
================================================================

********
Warning: flash-attn is not installed. Will only run the manual PyTorch version. Please install flash-attn for faster inference.
********
 
[*] Loading model from: D:\Git_Work\jarvis_taemin\models\Qwen3-TTS-NVFP4
[*] Torch dtype selected: torch.bfloat16
[*] Post-load Weight Surgery: Syncing 15 heads into lm_head_fused...
[*] Weight Surgery: Fused Head Synced Successfully.
✅ Model ready! (Qwen3-TTS-NVFP4)
[*] Orpheus listening on port 8000...
 * Serving Flask app 'orpheus_server'
 * Debug mode: off
WARNING: This is a development server. Do not use it in a production deployment. Use a production WSGI server instead.
 * Running on all addresses (0.0.0.0)
 * Running on http://127.0.0.1:8000
 * Running on http://192.168.0.71:8000
Press CTRL+C to quit