[Imperial Debug] Starting jarvis_run.py... python : INFO:JarvisBrain:[STATUS] Imperial Brain Synchronized with key: Imperial..._KEY At line:1 char:44 + ... NG='utf-8'; python shadow_brain_core\jarvis_run.py > shadow_brain_cor ... + ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + CategoryInfo : NotSpecified: (INFO:JarvisBrai...Imperial..._KEY:String) [], RemoteException + FullyQualifiedErrorId : NativeCommandError INFO:JarvisBrain:[OpenRouter] API Key recovered from Imperial Vault. INFO:JarvisBrain:[STATUS] Imperial Brain Configured: Primary=gemini-3.1-flash-lite-preview, Port=18799, WebSearch=True INFO:telegram_service:🧠 [Imperial Brain] Gemini Client initialized for Shadow Bot. INFO:web_server:🔱 Imperial Neural Log Stream Integrated. 🔑 [Imperial] Fetching Gemini API Key from Bitwarden... ✅ [Imperial] Gemini API Key initialized for SDK 2.0+. 🛰️ [Imperial Fleet] Cluster Configuration Path: D:\Git_Work\jarvis_taemin\docker_data\shared_workspace\JarvisRun\JARVIS_CLUSTER.json 📡 [Imperial Fleet] Local IPs detected for self-filtering: ['192.168.182.1', '172.28.16.1', '127.0.0.1', '172.27.112.1', '192.168.85.1', '192.168.0.71'] [Imperial Fleet] Orchestration Node started. Host:ga403wr IP:192.168.0.71 [14:30:23] SYSTEM: Cleaning up sessions on port 18700... 📡 [Imperial Fleet] UDP Discovery Active on port 18791 (Broadcast to 192.168.1.255, 172.28.16.255, 192.168.182.255, 192.168.0.255, 192.168.85.255, 192.168.56.255, 172.27.112.255, 255.255.255.255, 172.16.0.255) [14:30:27] SENTINEL: 🔱 황실 테스크 감시 루프 가동 시작... INFO:JarvisBrain:[STATUS] Imperial Brain Synchronized with key: Imperial..._KEY INFO:JarvisBrain:[STATUS] Imperial Brain Synchronized with key: Imperial..._KEY [Imperial UI] Heimdall Observer Activated (serving from D:\Git_Work\jarvis_taemin\portal-heimdall\build\web) [14:30:27] SYSTEM: 📡 Signal monitor active. [Orpheus] Starting Windows Native TTS Server with model: local-nvfp4 D:\Git_Work\jarvis_taemin\venv_nvfp4\Lib\site-packages\torch\cuda\__init__.py:61: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the main tainers of the package that installed pynvml for you. import pynvml # type: ignore[import] INFO:JarvisBrain:[OpenRouter] API Key recovered from Imperial Vault. INFO:JarvisBrain:[STATUS] Imperial Brain Configured: Primary=gemini-3.1-flash-lite-preview, Port=18799, WebSearch=True INFO:JarvisBrain:[STATUS] Imperial Brain Synchronized with key: Imperial..._KEY INFO:JarvisBrain:[OpenRouter] API Key recovered from Imperial Vault. INFO:JarvisBrain:[STATUS] Imperial Brain Configured: Primary=gemini-3.1-flash-lite-preview, Port=18799, WebSearch=True INFO:JarvisBrain:[OpenRouter] API Key recovered from Imperial Vault. INFO:JarvisBrain:[STATUS] Imperial Brain Configured: Primary=gemini-3.1-flash-lite-preview, Port=18799, WebSearch=True Exception in thread Thread-16 (_launch_api): Traceback (most recent call last): File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.13_3.13.3312.0_x64__qbz5n2kfra8p0\Lib\threading. py", line 1044, in _bootstrap_inner self.run() ~~~~~~~~^^ File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.13_3.13.3312.0_x64__qbz5n2kfra8p0\Lib\threading. py", line 995, in run self._target(*self._args, **self._kwargs) ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\Git_Work\jarvis_taemin\shadow_brain_core\jarvis_run.py", line 306, in _launch_api app = create_web_server(PROJECT_ROOT, self.engine, self.cluster) File "D:\Git_Work\jarvis_taemin\shadow_brain_core\web_server.py", line 5868, in create_web_server init_chat_logic(app, project_root, db_url, lambda: _load_session_user(), compaction_engine, memory_write_vector) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ TypeError: init_chat_logic() missing 1 required positional argument: 'rag_save_func' D:\Git_Work\jarvis_taemin\venv_nvfp4\Lib\site-packages\transformers\modeling_utils.py:1984: FutureWarning: torch._dynam o.allow_in_graph is deprecated and will be removed in a future version. Use torch._dynamo.nonstrict_trace instead. @torch._dynamo.allow_in_graph 'sox' is not recognized as an internal or external command, operable program or batch file. SoX could not be found! If you do not have SoX, proceed here: - - - http://sox.sourceforge.net/ - - - If you do (or think that you should) have SoX, double-check your path variables. `torch_dtype` is deprecated! Use `dtype` instead! Some weights of the model checkpoint at D:\Git_Work\jarvis_taemin\models\Qwen3-TTS-NVFP4 were not used when initializin g Qwen3TTSForConditionalGeneration: ['talker.code_predictor.lm_head.0.input_global_scale', 'talker.code_predictor.lm_he ad.0.input_zero_point', 'talker.code_predictor.lm_head.0.weight_global_scale', 'talker.code_predictor.lm_head.0.weight_ scale', 'talker.code_predictor.lm_head.0.weight_zero_point', 'talker.code_predictor.lm_head.1.input_global_scale', 'tal ker.code_predictor.lm_head.1.input_zero_point', 'talker.code_predictor.lm_head.1.weight_global_scale', 'talker.code_pre dictor.lm_head.1.weight_scale', 'talker.code_predictor.lm_head.1.weight_zero_point', 'talker.code_predictor.lm_head.10. input_global_scale', 'talker.code_predictor.lm_head.10.input_zero_point', 'talker.code_predictor.lm_head.10.weight_glob al_scale', 'talker.code_predictor.lm_head.10.weight_scale', 'talker.code_predictor.lm_head.10.weight_zero_point', 'talk er.code_predictor.lm_head.11.input_global_scale', 'talker.code_predictor.lm_head.11.input_zero_point', 'talker.code_pre dictor.lm_head.11.weight_global_scale', 'talker.code_predictor.lm_head.11.weight_scale', 'talker.code_predictor.lm_head .11.weight_zero_point', 'talker.code_predictor.lm_head.12.input_global_scale', 'talker.code_predictor.lm_head.12.input_ zero_point', 'talker.code_predictor.lm_head.12.weight_global_scale', 'talker.code_predictor.lm_head.12.weight_scale', ' talker.code_predictor.lm_head.12.weight_zero_point', 'talker.code_predictor.lm_head.13.input_global_scale', 'talker.cod e_predictor.lm_head.13.input_zero_point', 'talker.code_predictor.lm_head.13.weight_global_scale', 'talker.code_predicto r.lm_head.13.weight_scale', 'talker.code_predictor.lm_head.13.weight_zero_point', 'talker.code_predictor.lm_head.14.inp ut_global_scale', 'talker.code_predictor.lm_head.14.input_zero_point', 'talker.code_predictor.lm_head.14.weight_global_ scale', 'talker.code_predictor.lm_head.14.weight_scale', 'talker.code_predictor.lm_head.14.weight_zero_point', 'talker. code_predictor.lm_head.2.input_global_scale', 'talker.code_predictor.lm_head.2.input_zero_point', 'talker.code_predicto r.lm_head.2.weight_global_scale', 'talker.code_predictor.lm_head.2.weight_scale', 'talker.code_predictor.lm_head.2.weig ht_zero_point', 'talker.code_predictor.lm_head.3.input_global_scale', 'talker.code_predictor.lm_head.3.input_zero_point ', 'talker.code_predictor.lm_head.3.weight_global_scale', 'talker.code_predictor.lm_head.3.weight_scale', 'talker.code_ predictor.lm_head.3.weight_zero_point', 'talker.code_predictor.lm_head.4.input_global_scale', 'talker.code_predictor.lm _head.4.input_zero_point', 'talker.code_predictor.lm_head.4.weight_global_scale', 'talker.code_predictor.lm_head.4.weig ht_scale', 'talker.code_predictor.lm_head.4.weight_zero_point', 'talker.code_predictor.lm_head.5.input_global_scale', ' talker.code_predictor.lm_head.5.input_zero_point', 'talker.code_predictor.lm_head.5.weight_global_scale', 'talker.code_ predictor.lm_head.5.weight_scale', 'talker.code_predictor.lm_head.5.weight_zero_point', 'talker.code_predictor.lm_head. 6.input_global_scale', 'talker.code_predictor.lm_head.6.input_zero_point', 'talker.code_predictor.lm_head.6.weight_glob al_scale', 'talker.code_predictor.lm_head.6.weight_scale', 'talker.code_predictor.lm_head.6.weight_zero_point', 'talker .code_predictor.lm_head.7.input_global_scale', 'talker.code_predictor.lm_head.7.input_zero_point', 'talker.code_predict or.lm_head.7.weight_global_scale', 'talker.code_predictor.lm_head.7.weight_scale', 'talker.code_predictor.lm_head.7.wei ght_zero_point', 'talker.code_predictor.lm_head.8.input_global_scale', 'talker.code_predictor.lm_head.8.input_zero_poin t', 'talker.code_predictor.lm_head.8.weight_global_scale', 'talker.code_predictor.lm_head.8.weight_scale', 'talker.code _predictor.lm_head.8.weight_zero_point', 'talker.code_predictor.lm_head.9.input_global_scale', 'talker.code_predictor.l m_head.9.input_zero_point', 'talker.code_predictor.lm_head.9.weight_global_scale', 'talker.code_predictor.lm_head.9.wei ght_scale', 'talker.code_predictor.lm_head.9.weight_zero_point', 'talker.code_predictor.lm_head_fused.input_global_scal e', 'talker.code_predictor.lm_head_fused.input_zero_point', 'talker.code_predictor.lm_head_fused.weight_global_scale', 'talker.code_predictor.lm_head_fused.weight_scale', 'talker.code_predictor.lm_head_fused.weight_zero_point', 'talker.co de_predictor.model.layers.0.mlp.down_proj.input_global_scale', 'talker.code_predictor.model.layers.0.mlp.down_proj.inpu t_zero_point', 'talker.code_predictor.model.layers.0.mlp.down_proj.weight_global_scale', 'talker.code_predictor.model.l ayers.0.mlp.down_proj.weight_scale', 'talker.code_predictor.model.layers.0.mlp.down_proj.weight_zero_point', 'talker.co de_predictor.model.layers.0.mlp.gate_proj.input_global_scale', 'talker.code_predictor.model.layers.0.mlp.gate_proj.inpu t_zero_point', 'talker.code_predictor.model.layers.0.mlp.gate_proj.weight_global_scale', 'talker.code_predictor.model.l ayers.0.mlp.gate_proj.weight_scale', 'talker.code_predictor.model.layers.0.mlp.gate_proj.weight_zero_point', 'talker.co de_predictor.model.layers.0.mlp.up_proj.input_global_scale', 'talker.code_predictor.model.layers.0.mlp.up_proj.input_ze ro_point', 'talker.code_predictor.model.layers.0.mlp.up_proj.weight_global_scale', 'talker.code_predictor.model.layers. 0.mlp.up_proj.weight_scale', 'talker.code_predictor.model.layers.0.mlp.up_proj.weight_zero_point', 'talker.code_predict or.model.layers.0.self_attn.k_proj.input_global_scale', 'talker.code_predictor.model.layers.0.self_attn.k_proj.input_ze ro_point', 'talker.code_predictor.model.layers.0.self_attn.k_proj.weight_global_scale', 'talker.code_predictor.model.la yers.0.self_attn.k_proj.weight_scale', 'talker.code_predictor.model.layers.0.self_attn.k_proj.weight_zero_point', 'talk er.code_predictor.model.layers.0.self_attn.o_proj.input_global_scale', 'talker.code_predictor.model.layers.0.self_attn. o_proj.input_zero_point', 'talker.code_predictor.model.layers.0.self_attn.o_proj.weight_global_scale', 'talker.code_pre dictor.model.layers.0.self_attn.o_proj.weight_scale', 'talker.code_predictor.model.layers.0.self_attn.o_proj.weight_zer o_point', 'talker.code_predictor.model.layers.0.self_attn.q_proj.input_global_scale', 'talker.code_predictor.model.laye rs.0.self_attn.q_proj.input_zero_point', 'talker.code_predictor.model.layers.0.self_attn.q_proj.weight_global_scale', ' talker.code_predictor.model.layers.0.self_attn.q_proj.weight_scale', 'talker.code_predictor.model.layers.0.self_attn.q_ proj.weight_zero_point', 'talker.code_predictor.model.layers.0.self_attn.v_proj.input_global_scale', 'talker.code_predi ctor.model.layers.0.self_attn.v_proj.input_zero_point', 'talker.code_predictor.model.layers.0.self_attn.v_proj.weight_g lobal_scale', 'talker.code_predictor.model.layers.0.self_attn.v_proj.weight_scale', 'talker.code_predictor.model.layers .0.self_attn.v_proj.weight_zero_point', 'talker.code_predictor.model.layers.1.mlp.down_proj.input_global_scale', 'talke r.code_predictor.model.layers.1.mlp.down_proj.input_zero_point', 'talker.code_predictor.model.layers.1.mlp.down_proj.we ight_global_scale', 'talker.code_predictor.model.layers.1.mlp.down_proj.weight_scale', 'talker.code_predictor.model.lay ers.1.mlp.down_proj.weight_zero_point', 'talker.code_predictor.model.layers.1.mlp.gate_proj.input_global_scale', 'talke r.code_predictor.model.layers.1.mlp.gate_proj.input_zero_point', 'talker.code_predictor.model.layers.1.mlp.gate_proj.we ight_global_scale', 'talker.code_predictor.model.layers.1.mlp.gate_proj.weight_scale', 'talker.code_predictor.model.lay ers.1.mlp.gate_proj.weight_zero_point', 'talker.code_predictor.model.layers.1.mlp.up_proj.input_global_scale', 'talker. code_predictor.model.layers.1.mlp.up_proj.input_zero_point', 'talker.code_predictor.model.layers.1.mlp.up_proj.weight_g lobal_scale', 'talker.code_predictor.model.layers.1.mlp.up_proj.weight_scale', 'talker.code_predictor.model.layers.1.ml p.up_proj.weight_zero_point', 'talker.code_predictor.model.layers.1.self_attn.k_proj.input_global_scale', 'talker.code_ predictor.model.layers.1.self_attn.k_proj.input_zero_point', 'talker.code_predictor.model.layers.1.self_attn.k_proj.wei ght_global_scale', 'talker.code_predictor.model.layers.1.self_attn.k_proj.weight_scale', 'talker.code_predictor.model.l ayers.1.self_attn.k_proj.weight_zero_point', 'talker.code_predictor.model.layers.1.self_attn.o_proj.input_global_scale' , 'talker.code_predictor.model.layers.1.self_attn.o_proj.input_zero_point', 'talker.code_predictor.model.layers.1.self_ attn.o_proj.weight_global_scale', 'talker.code_predictor.model.layers.1.self_attn.o_proj.weight_scale', 'talker.code_pr edictor.model.layers.1.self_attn.o_proj.weight_zero_point', 'talker.code_predictor.model.layers.1.self_attn.q_proj.inpu t_global_scale', 'talker.code_predictor.model.layers.1.self_attn.q_proj.input_zero_point', 'talker.code_predictor.model .layers.1.self_attn.q_proj.weight_global_scale', 'talker.code_predictor.model.layers.1.self_attn.q_proj.weight_scale', 'talker.code_predictor.model.layers.1.self_attn.q_proj.weight_zero_point', 'talker.code_predictor.model.layers.1.self_a ttn.v_proj.input_global_scale', 'talker.code_predictor.model.layers.1.self_attn.v_proj.input_zero_point', 'talker.code_ predictor.model.layers.1.self_attn.v_proj.weight_global_scale', 'talker.code_predictor.model.layers.1.self_attn.v_proj. weight_scale', 'talker.code_predictor.model.layers.1.self_attn.v_proj.weight_zero_point', 'talker.code_predictor.model. layers.2.mlp.down_proj.input_global_scale', 'talker.code_predictor.model.layers.2.mlp.down_proj.input_zero_point', 'tal ker.code_predictor.model.layers.2.mlp.down_proj.weight_global_scale', 'talker.code_predictor.model.layers.2.mlp.down_pr oj.weight_scale', 'talker.code_predictor.model.layers.2.mlp.down_proj.weight_zero_point', 'talker.code_predictor.model. layers.2.mlp.gate_proj.input_global_scale', 'talker.code_predictor.model.layers.2.mlp.gate_proj.input_zero_point', 'tal ker.code_predictor.model.layers.2.mlp.gate_proj.weight_global_scale', 'talker.code_predictor.model.layers.2.mlp.gate_pr oj.weight_scale', 'talker.code_predictor.model.layers.2.mlp.gate_proj.weight_zero_point', 'talker.code_predictor.model. layers.2.mlp.up_proj.input_global_scale', 'talker.code_predictor.model.layers.2.mlp.up_proj.input_zero_point', 'talker. code_predictor.model.layers.2.mlp.up_proj.weight_global_scale', 'talker.code_predictor.model.layers.2.mlp.up_proj.weigh t_scale', 'talker.code_predictor.model.layers.2.mlp.up_proj.weight_zero_point', 'talker.code_predictor.model.layers.2.s elf_attn.k_proj.input_global_scale', 'talker.code_predictor.model.layers.2.self_attn.k_proj.input_zero_point', 'talker. code_predictor.model.layers.2.self_attn.k_proj.weight_global_scale', 'talker.code_predictor.model.layers.2.self_attn.k_ proj.weight_scale', 'talker.code_predictor.model.layers.2.self_attn.k_proj.weight_zero_point', 'talker.code_predictor.m odel.layers.2.self_attn.o_proj.input_global_scale', 'talker.code_predictor.model.layers.2.self_attn.o_proj.input_zero_p oint', 'talker.code_predictor.model.layers.2.self_attn.o_proj.weight_global_scale', 'talker.code_predictor.model.layers .2.self_attn.o_proj.weight_scale', 'talker.code_predictor.model.layers.2.self_attn.o_proj.weight_zero_point', 'talker.c ode_predictor.model.layers.2.self_attn.q_proj.input_global_scale', 'talker.code_predictor.model.layers.2.self_attn.q_pr oj.input_zero_point', 'talker.code_predictor.model.layers.2.self_attn.q_proj.weight_global_scale', 'talker.code_predict or.model.layers.2.self_attn.q_proj.weight_scale', 'talker.code_predictor.model.layers.2.self_attn.q_proj.weight_zero_po int', 'talker.code_predictor.model.layers.2.self_attn.v_proj.input_global_scale', 'talker.code_predictor.model.layers.2 .self_attn.v_proj.input_zero_point', 'talker.code_predictor.model.layers.2.self_attn.v_proj.weight_global_scale', 'talk er.code_predictor.model.layers.2.self_attn.v_proj.weight_scale', 'talker.code_predictor.model.layers.2.self_attn.v_proj .weight_zero_point', 'talker.code_predictor.model.layers.3.mlp.down_proj.input_global_scale', 'talker.code_predictor.mo del.layers.3.mlp.down_proj.input_zero_point', 'talker.code_predictor.model.layers.3.mlp.down_proj.weight_global_scale', 'talker.code_predictor.model.layers.3.mlp.down_proj.weight_scale', 'talker.code_predictor.model.layers.3.mlp.down_proj .weight_zero_point', 'talker.code_predictor.model.layers.3.mlp.gate_proj.input_global_scale', 'talker.code_predictor.mo del.layers.3.mlp.gate_proj.input_zero_point', 'talker.code_predictor.model.layers.3.mlp.gate_proj.weight_global_scale', 'talker.code_predictor.model.layers.3.mlp.gate_proj.weight_scale', 'talker.code_predictor.model.layers.3.mlp.gate_proj .weight_zero_point', 'talker.code_predictor.model.layers.3.mlp.up_proj.input_global_scale', 'talker.code_predictor.mode l.layers.3.mlp.up_proj.input_zero_point', 'talker.code_predictor.model.layers.3.mlp.up_proj.weight_global_scale', 'talk er.code_predictor.model.layers.3.mlp.up_proj.weight_scale', 'talker.code_predictor.model.layers.3.mlp.up_proj.weight_ze ro_point', 'talker.code_predictor.model.layers.3.self_attn.k_proj.input_global_scale', 'talker.code_predictor.model.lay ers.3.self_attn.k_proj.input_zero_point', 'talker.code_predictor.model.layers.3.self_attn.k_proj.weight_global_scale', 'talker.code_predictor.model.layers.3.self_attn.k_proj.weight_scale', 'talker.code_predictor.model.layers.3.self_attn.k _proj.weight_zero_point', 'talker.code_predictor.model.layers.3.self_attn.o_proj.input_global_scale', 'talker.code_pred ictor.model.layers.3.self_attn.o_proj.input_zero_point', 'talker.code_predictor.model.layers.3.self_attn.o_proj.weight_ global_scale', 'talker.code_predictor.model.layers.3.self_attn.o_proj.weight_scale', 'talker.code_predictor.model.layer s.3.self_attn.o_proj.weight_zero_point', 'talker.code_predictor.model.layers.3.self_attn.q_proj.input_global_scale', 't alker.code_predictor.model.layers.3.self_attn.q_proj.input_zero_point', 'talker.code_predictor.model.layers.3.self_attn .q_proj.weight_global_scale', 'talker.code_predictor.model.layers.3.self_attn.q_proj.weight_scale', 'talker.code_predic tor.model.layers.3.self_attn.q_proj.weight_zero_point', 'talker.code_predictor.model.layers.3.self_attn.v_proj.input_gl obal_scale', 'talker.code_predictor.model.layers.3.self_attn.v_proj.input_zero_point', 'talker.code_predictor.model.lay ers.3.self_attn.v_proj.weight_global_scale', 'talker.code_predictor.model.layers.3.self_attn.v_proj.weight_scale', 'tal ker.code_predictor.model.layers.3.self_attn.v_proj.weight_zero_point', 'talker.code_predictor.model.layers.4.mlp.down_p roj.input_global_scale', 'talker.code_predictor.model.layers.4.mlp.down_proj.input_zero_point', 'talker.code_predictor. model.layers.4.mlp.down_proj.weight_global_scale', 'talker.code_predictor.model.layers.4.mlp.down_proj.weight_scale', ' talker.code_predictor.model.layers.4.mlp.down_proj.weight_zero_point', 'talker.code_predictor.model.layers.4.mlp.gate_p roj.input_global_scale', 'talker.code_predictor.model.layers.4.mlp.gate_proj.input_zero_point', 'talker.code_predictor. model.layers.4.mlp.gate_proj.weight_global_scale', 'talker.code_predictor.model.layers.4.mlp.gate_proj.weight_scale', ' talker.code_predictor.model.layers.4.mlp.gate_proj.weight_zero_point', 'talker.code_predictor.model.layers.4.mlp.up_pro j.input_global_scale', 'talker.code_predictor.model.layers.4.mlp.up_proj.input_zero_point', 'talker.code_predictor.mode l.layers.4.mlp.up_proj.weight_global_scale', 'talker.code_predictor.model.layers.4.mlp.up_proj.weight_scale', 'talker.c ode_predictor.model.layers.4.mlp.up_proj.weight_zero_point', 'talker.code_predictor.model.layers.4.self_attn.k_proj.inp ut_global_scale', 'talker.code_predictor.model.layers.4.self_attn.k_proj.input_zero_point', 'talker.code_predictor.mode l.layers.4.self_attn.k_proj.weight_global_scale', 'talker.code_predictor.model.layers.4.self_attn.k_proj.weight_scale', 'talker.code_predictor.model.layers.4.self_attn.k_proj.weight_zero_point', 'talker.code_predictor.model.layers.4.self_ attn.o_proj.input_global_scale', 'talker.code_predictor.model.layers.4.self_attn.o_proj.input_zero_point', 'talker.code _predictor.model.layers.4.self_attn.o_proj.weight_global_scale', 'talker.code_predictor.model.layers.4.self_attn.o_proj .weight_scale', 'talker.code_predictor.model.layers.4.self_attn.o_proj.weight_zero_point', 'talker.code_predictor.model .layers.4.self_attn.q_proj.input_global_scale', 'talker.code_predictor.model.layers.4.self_attn.q_proj.input_zero_point ', 'talker.code_predictor.model.layers.4.self_attn.q_proj.weight_global_scale', 'talker.code_predictor.model.layers.4.s elf_attn.q_proj.weight_scale', 'talker.code_predictor.model.layers.4.self_attn.q_proj.weight_zero_point', 'talker.code_ predictor.model.layers.4.self_attn.v_proj.input_global_scale', 'talker.code_predictor.model.layers.4.self_attn.v_proj.i nput_zero_point', 'talker.code_predictor.model.layers.4.self_attn.v_proj.weight_global_scale', 'talker.code_predictor.m odel.layers.4.self_attn.v_proj.weight_scale', 'talker.code_predictor.model.layers.4.self_attn.v_proj.weight_zero_point' , 'talker.codec_head.input_global_scale', 'talker.codec_head.input_zero_point', 'talker.codec_head.weight_global_scale' , 'talker.codec_head.weight_scale', 'talker.codec_head.weight_zero_point', 'talker.model.layers.0.mlp.down_proj.input_g lobal_scale', 'talker.model.layers.0.mlp.down_proj.input_zero_point', 'talker.model.layers.0.mlp.down_proj.weight_globa l_scale', 'talker.model.layers.0.mlp.down_proj.weight_scale', 'talker.model.layers.0.mlp.down_proj.weight_zero_point', 'talker.model.layers.0.mlp.gate_proj.input_global_scale', 'talker.model.layers.0.mlp.gate_proj.input_zero_point', 'talk er.model.layers.0.mlp.gate_proj.weight_global_scale', 'talker.model.layers.0.mlp.gate_proj.weight_scale', 'talker.model .layers.0.mlp.gate_proj.weight_zero_point', 'talker.model.layers.0.mlp.up_proj.input_global_scale', 'talker.model.layer s.0.mlp.up_proj.input_zero_point', 'talker.model.layers.0.mlp.up_proj.weight_global_scale', 'talker.model.layers.0.mlp. up_proj.weight_scale', 'talker.model.layers.0.mlp.up_proj.weight_zero_point', 'talker.model.layers.0.self_attn.k_proj.i nput_global_scale', 'talker.model.layers.0.self_attn.k_proj.input_zero_point', 'talker.model.layers.0.self_attn.k_proj. weight_global_scale', 'talker.model.layers.0.self_attn.k_proj.weight_scale', 'talker.model.layers.0.self_attn.k_proj.we ight_zero_point', 'talker.model.layers.0.self_attn.o_proj.input_global_scale', 'talker.model.layers.0.self_attn.o_proj. input_zero_point', 'talker.model.layers.0.self_attn.o_proj.weight_global_scale', 'talker.model.layers.0.self_attn.o_pro j.weight_scale', 'talker.model.layers.0.self_attn.o_proj.weight_zero_point', 'talker.model.layers.0.self_attn.q_proj.in put_global_scale', 'talker.model.layers.0.self_attn.q_proj.input_zero_point', 'talker.model.layers.0.self_attn.q_proj.w eight_global_scale', 'talker.model.layers.0.self_attn.q_proj.weight_scale', 'talker.model.layers.0.self_attn.q_proj.wei ght_zero_point', 'talker.model.layers.0.self_attn.v_proj.input_global_scale', 'talker.model.layers.0.self_attn.v_proj.i nput_zero_point', 'talker.model.layers.0.self_attn.v_proj.weight_global_scale', 'talker.model.layers.0.self_attn.v_proj .weight_scale', 'talker.model.layers.0.self_attn.v_proj.weight_zero_point', 'talker.model.layers.1.mlp.down_proj.input_ global_scale', 'talker.model.layers.1.mlp.down_proj.input_zero_point', 'talker.model.layers.1.mlp.down_proj.weight_glob al_scale', 'talker.model.layers.1.mlp.down_proj.weight_scale', 'talker.model.layers.1.mlp.down_proj.weight_zero_point', 'talker.model.layers.1.mlp.gate_proj.input_global_scale', 'talker.model.layers.1.mlp.gate_proj.input_zero_point', 'tal ker.model.layers.1.mlp.gate_proj.weight_global_scale', 'talker.model.layers.1.mlp.gate_proj.weight_scale', 'talker.mode l.layers.1.mlp.gate_proj.weight_zero_point', 'talker.model.layers.1.mlp.up_proj.input_global_scale', 'talker.model.laye rs.1.mlp.up_proj.input_zero_point', 'talker.model.layers.1.mlp.up_proj.weight_global_scale', 'talker.model.layers.1.mlp .up_proj.weight_scale', 'talker.model.layers.1.mlp.up_proj.weight_zero_point', 'talker.model.layers.1.self_attn.k_proj. input_global_scale', 'talker.model.layers.1.self_attn.k_proj.input_zero_point', 'talker.model.layers.1.self_attn.k_proj .weight_global_scale', 'talker.model.layers.1.self_attn.k_proj.weight_scale', 'talker.model.layers.1.self_attn.k_proj.w eight_zero_point', 'talker.model.layers.1.self_attn.o_proj.input_global_scale', 'talker.model.layers.1.self_attn.o_proj .input_zero_point', 'talker.model.layers.1.self_attn.o_proj.weight_global_scale', 'talker.model.layers.1.self_attn.o_pr oj.weight_scale', 'talker.model.layers.1.self_attn.o_proj.weight_zero_point', 'talker.model.layers.1.self_attn.q_proj.i nput_global_scale', 'talker.model.layers.1.self_attn.q_proj.input_zero_point', 'talker.model.layers.1.self_attn.q_proj. weight_global_scale', 'talker.model.layers.1.self_attn.q_proj.weight_scale', 'talker.model.layers.1.self_attn.q_proj.we ight_zero_point', 'talker.model.layers.1.self_attn.v_proj.input_global_scale', 'talker.model.layers.1.self_attn.v_proj. input_zero_point', 'talker.model.layers.1.self_attn.v_proj.weight_global_scale', 'talker.model.layers.1.self_attn.v_pro j.weight_scale', 'talker.model.layers.1.self_attn.v_proj.weight_zero_point', 'talker.model.layers.10.mlp.down_proj.inpu t_global_scale', 'talker.model.layers.10.mlp.down_proj.input_zero_point', 'talker.model.layers.10.mlp.down_proj.weight_ global_scale', 'talker.model.layers.10.mlp.down_proj.weight_scale', 'talker.model.layers.10.mlp.down_proj.weight_zero_p oint', 'talker.model.layers.10.mlp.gate_proj.input_global_scale', 'talker.model.layers.10.mlp.gate_proj.input_zero_poin t', 'talker.model.layers.10.mlp.gate_proj.weight_global_scale', 'talker.model.layers.10.mlp.gate_proj.weight_scale', 't alker.model.layers.10.mlp.gate_proj.weight_zero_point', 'talker.model.layers.10.mlp.up_proj.input_global_scale', 'talke r.model.layers.10.mlp.up_proj.input_zero_point', 'talker.model.layers.10.mlp.up_proj.weight_global_scale', 'talker.mode l.layers.10.mlp.up_proj.weight_scale', 'talker.model.layers.10.mlp.up_proj.weight_zero_point', 'talker.model.layers.10. self_attn.k_proj.input_global_scale', 'talker.model.layers.10.self_attn.k_proj.input_zero_point', 'talker.model.layers. 10.self_attn.k_proj.weight_global_scale', 'talker.model.layers.10.self_attn.k_proj.weight_scale', 'talker.model.layers. 10.self_attn.k_proj.weight_zero_point', 'talker.model.layers.10.self_attn.o_proj.input_global_scale', 'talker.model.lay ers.10.self_attn.o_proj.input_zero_point', 'talker.model.layers.10.self_attn.o_proj.weight_global_scale', 'talker.model .layers.10.self_attn.o_proj.weight_scale', 'talker.model.layers.10.self_attn.o_proj.weight_zero_point', 'talker.model.l ayers.10.self_attn.q_proj.input_global_scale', 'talker.model.layers.10.self_attn.q_proj.input_zero_point', 'talker.mode l.layers.10.self_attn.q_proj.weight_global_scale', 'talker.model.layers.10.self_attn.q_proj.weight_scale', 'talker.mode l.layers.10.self_attn.q_proj.weight_zero_point', 'talker.model.layers.10.self_attn.v_proj.input_global_scale', 'talker. model.layers.10.self_attn.v_proj.input_zero_point', 'talker.model.layers.10.self_attn.v_proj.weight_global_scale', 'tal ker.model.layers.10.self_attn.v_proj.weight_scale', 'talker.model.layers.10.self_attn.v_proj.weight_zero_point', 'talke r.model.layers.11.mlp.down_proj.input_global_scale', 'talker.model.layers.11.mlp.down_proj.input_zero_point', 'talker.m odel.layers.11.mlp.down_proj.weight_global_scale', 'talker.model.layers.11.mlp.down_proj.weight_scale', 'talker.model.l ayers.11.mlp.down_proj.weight_zero_point', 'talker.model.layers.11.mlp.gate_proj.input_global_scale', 'talker.model.lay ers.11.mlp.gate_proj.input_zero_point', 'talker.model.layers.11.mlp.gate_proj.weight_global_scale', 'talker.model.layer s.11.mlp.gate_proj.weight_scale', 'talker.model.layers.11.mlp.gate_proj.weight_zero_point', 'talker.model.layers.11.mlp .up_proj.input_global_scale', 'talker.model.layers.11.mlp.up_proj.input_zero_point', 'talker.model.layers.11.mlp.up_pro j.weight_global_scale', 'talker.model.layers.11.mlp.up_proj.weight_scale', 'talker.model.layers.11.mlp.up_proj.weight_z ero_point', 'talker.model.layers.11.self_attn.k_proj.input_global_scale', 'talker.model.layers.11.self_attn.k_proj.inpu t_zero_point', 'talker.model.layers.11.self_attn.k_proj.weight_global_scale', 'talker.model.layers.11.self_attn.k_proj. weight_scale', 'talker.model.layers.11.self_attn.k_proj.weight_zero_point', 'talker.model.layers.11.self_attn.o_proj.in put_global_scale', 'talker.model.layers.11.self_attn.o_proj.input_zero_point', 'talker.model.layers.11.self_attn.o_proj .weight_global_scale', 'talker.model.layers.11.self_attn.o_proj.weight_scale', 'talker.model.layers.11.self_attn.o_proj .weight_zero_point', 'talker.model.layers.11.self_attn.q_proj.input_global_scale', 'talker.model.layers.11.self_attn.q_ proj.input_zero_point', 'talker.model.layers.11.self_attn.q_proj.weight_global_scale', 'talker.model.layers.11.self_att n.q_proj.weight_scale', 'talker.model.layers.11.self_attn.q_proj.weight_zero_point', 'talker.model.layers.11.self_attn. v_proj.input_global_scale', 'talker.model.layers.11.self_attn.v_proj.input_zero_point', 'talker.model.layers.11.self_at tn.v_proj.weight_global_scale', 'talker.model.layers.11.self_attn.v_proj.weight_scale', 'talker.model.layers.11.self_at tn.v_proj.weight_zero_point', 'talker.model.layers.12.mlp.down_proj.input_global_scale', 'talker.model.layers.12.mlp.do wn_proj.input_zero_point', 'talker.model.layers.12.mlp.down_proj.weight_global_scale', 'talker.model.layers.12.mlp.down _proj.weight_scale', 'talker.model.layers.12.mlp.down_proj.weight_zero_point', 'talker.model.layers.12.mlp.gate_proj.in put_global_scale', 'talker.model.layers.12.mlp.gate_proj.input_zero_point', 'talker.model.layers.12.mlp.gate_proj.weigh t_global_scale', 'talker.model.layers.12.mlp.gate_proj.weight_scale', 'talker.model.layers.12.mlp.gate_proj.weight_zero _point', 'talker.model.layers.12.mlp.up_proj.input_global_scale', 'talker.model.layers.12.mlp.up_proj.input_zero_point' , 'talker.model.layers.12.mlp.up_proj.weight_global_scale', 'talker.model.layers.12.mlp.up_proj.weight_scale', 'talker. model.layers.12.mlp.up_proj.weight_zero_point', 'talker.model.layers.12.self_attn.k_proj.input_global_scale', 'talker.m odel.layers.12.self_attn.k_proj.input_zero_point', 'talker.model.layers.12.self_attn.k_proj.weight_global_scale', 'talk er.model.layers.12.self_attn.k_proj.weight_scale', 'talker.model.layers.12.self_attn.k_proj.weight_zero_point', 'talker .model.layers.12.self_attn.o_proj.input_global_scale', 'talker.model.layers.12.self_attn.o_proj.input_zero_point', 'tal ker.model.layers.12.self_attn.o_proj.weight_global_scale', 'talker.model.layers.12.self_attn.o_proj.weight_scale', 'tal ker.model.layers.12.self_attn.o_proj.weight_zero_point', 'talker.model.layers.12.self_attn.q_proj.input_global_scale', 'talker.model.layers.12.self_attn.q_proj.input_zero_point', 'talker.model.layers.12.self_attn.q_proj.weight_global_scal e', 'talker.model.layers.12.self_attn.q_proj.weight_scale', 'talker.model.layers.12.self_attn.q_proj.weight_zero_point' , 'talker.model.layers.12.self_attn.v_proj.input_global_scale', 'talker.model.layers.12.self_attn.v_proj.input_zero_poi nt', 'talker.model.layers.12.self_attn.v_proj.weight_global_scale', 'talker.model.layers.12.self_attn.v_proj.weight_sca le', 'talker.model.layers.12.self_attn.v_proj.weight_zero_point', 'talker.model.layers.13.mlp.down_proj.input_global_sc ale', 'talker.model.layers.13.mlp.down_proj.input_zero_point', 'talker.model.layers.13.mlp.down_proj.weight_global_scal e', 'talker.model.layers.13.mlp.down_proj.weight_scale', 'talker.model.layers.13.mlp.down_proj.weight_zero_point', 'tal ker.model.layers.13.mlp.gate_proj.input_global_scale', 'talker.model.layers.13.mlp.gate_proj.input_zero_point', 'talker .model.layers.13.mlp.gate_proj.weight_global_scale', 'talker.model.layers.13.mlp.gate_proj.weight_scale', 'talker.model .layers.13.mlp.gate_proj.weight_zero_point', 'talker.model.layers.13.mlp.up_proj.input_global_scale', 'talker.model.lay ers.13.mlp.up_proj.input_zero_point', 'talker.model.layers.13.mlp.up_proj.weight_global_scale', 'talker.model.layers.13 .mlp.up_proj.weight_scale', 'talker.model.layers.13.mlp.up_proj.weight_zero_point', 'talker.model.layers.13.self_attn.k _proj.input_global_scale', 'talker.model.layers.13.self_attn.k_proj.input_zero_point', 'talker.model.layers.13.self_att n.k_proj.weight_global_scale', 'talker.model.layers.13.self_attn.k_proj.weight_scale', 'talker.model.layers.13.self_att n.k_proj.weight_zero_point', 'talker.model.layers.13.self_attn.o_proj.input_global_scale', 'talker.model.layers.13.self _attn.o_proj.input_zero_point', 'talker.model.layers.13.self_attn.o_proj.weight_global_scale', 'talker.model.layers.13. self_attn.o_proj.weight_scale', 'talker.model.layers.13.self_attn.o_proj.weight_zero_point', 'talker.model.layers.13.se lf_attn.q_proj.input_global_scale', 'talker.model.layers.13.self_attn.q_proj.input_zero_point', 'talker.model.layers.13 .self_attn.q_proj.weight_global_scale', 'talker.model.layers.13.self_attn.q_proj.weight_scale', 'talker.model.layers.13 .self_attn.q_proj.weight_zero_point', 'talker.model.layers.13.self_attn.v_proj.input_global_scale', 'talker.model.layer s.13.self_attn.v_proj.input_zero_point', 'talker.model.layers.13.self_attn.v_proj.weight_global_scale', 'talker.model.l ayers.13.self_attn.v_proj.weight_scale', 'talker.model.layers.13.self_attn.v_proj.weight_zero_point', 'talker.model.lay ers.14.mlp.down_proj.input_global_scale', 'talker.model.layers.14.mlp.down_proj.input_zero_point', 'talker.model.layers .14.mlp.down_proj.weight_global_scale', 'talker.model.layers.14.mlp.down_proj.weight_scale', 'talker.model.layers.14.ml p.down_proj.weight_zero_point', 'talker.model.layers.14.mlp.gate_proj.input_global_scale', 'talker.model.layers.14.mlp. gate_proj.input_zero_point', 'talker.model.layers.14.mlp.gate_proj.weight_global_scale', 'talker.model.layers.14.mlp.ga te_proj.weight_scale', 'talker.model.layers.14.mlp.gate_proj.weight_zero_point', 'talker.model.layers.14.mlp.up_proj.in put_global_scale', 'talker.model.layers.14.mlp.up_proj.input_zero_point', 'talker.model.layers.14.mlp.up_proj.weight_gl obal_scale', 'talker.model.layers.14.mlp.up_proj.weight_scale', 'talker.model.layers.14.mlp.up_proj.weight_zero_point', 'talker.model.layers.14.self_attn.k_proj.input_global_scale', 'talker.model.layers.14.self_attn.k_proj.input_zero_poin t', 'talker.model.layers.14.self_attn.k_proj.weight_global_scale', 'talker.model.layers.14.self_attn.k_proj.weight_scal e', 'talker.model.layers.14.self_attn.k_proj.weight_zero_point', 'talker.model.layers.14.self_attn.o_proj.input_global_ scale', 'talker.model.layers.14.self_attn.o_proj.input_zero_point', 'talker.model.layers.14.self_attn.o_proj.weight_glo bal_scale', 'talker.model.layers.14.self_attn.o_proj.weight_scale', 'talker.model.layers.14.self_attn.o_proj.weight_zer o_point', 'talker.model.layers.14.self_attn.q_proj.input_global_scale', 'talker.model.layers.14.self_attn.q_proj.input_ zero_point', 'talker.model.layers.14.self_attn.q_proj.weight_global_scale', 'talker.model.layers.14.self_attn.q_proj.we ight_scale', 'talker.model.layers.14.self_attn.q_proj.weight_zero_point', 'talker.model.layers.14.self_attn.v_proj.inpu t_global_scale', 'talker.model.layers.14.self_attn.v_proj.input_zero_point', 'talker.model.layers.14.self_attn.v_proj.w eight_global_scale', 'talker.model.layers.14.self_attn.v_proj.weight_scale', 'talker.model.layers.14.self_attn.v_proj.w eight_zero_point', 'talker.model.layers.15.mlp.down_proj.input_global_scale', 'talker.model.layers.15.mlp.down_proj.inp ut_zero_point', 'talker.model.layers.15.mlp.down_proj.weight_global_scale', 'talker.model.layers.15.mlp.down_proj.weigh t_scale', 'talker.model.layers.15.mlp.down_proj.weight_zero_point', 'talker.model.layers.15.mlp.gate_proj.input_global_ scale', 'talker.model.layers.15.mlp.gate_proj.input_zero_point', 'talker.model.layers.15.mlp.gate_proj.weight_global_sc ale', 'talker.model.layers.15.mlp.gate_proj.weight_scale', 'talker.model.layers.15.mlp.gate_proj.weight_zero_point', 't alker.model.layers.15.mlp.up_proj.input_global_scale', 'talker.model.layers.15.mlp.up_proj.input_zero_point', 'talker.m odel.layers.15.mlp.up_proj.weight_global_scale', 'talker.model.layers.15.mlp.up_proj.weight_scale', 'talker.model.layer s.15.mlp.up_proj.weight_zero_point', 'talker.model.layers.15.self_attn.k_proj.input_global_scale', 'talker.model.layers .15.self_attn.k_proj.input_zero_point', 'talker.model.layers.15.self_attn.k_proj.weight_global_scale', 'talker.model.la yers.15.self_attn.k_proj.weight_scale', 'talker.model.layers.15.self_attn.k_proj.weight_zero_point', 'talker.model.laye rs.15.self_attn.o_proj.input_global_scale', 'talker.model.layers.15.self_attn.o_proj.input_zero_point', 'talker.model.l ayers.15.self_attn.o_proj.weight_global_scale', 'talker.model.layers.15.self_attn.o_proj.weight_scale', 'talker.model.l ayers.15.self_attn.o_proj.weight_zero_point', 'talker.model.layers.15.self_attn.q_proj.input_global_scale', 'talker.mod el.layers.15.self_attn.q_proj.input_zero_point', 'talker.model.layers.15.self_attn.q_proj.weight_global_scale', 'talker .model.layers.15.self_attn.q_proj.weight_scale', 'talker.model.layers.15.self_attn.q_proj.weight_zero_point', 'talker.m odel.layers.15.self_attn.v_proj.input_global_scale', 'talker.model.layers.15.self_attn.v_proj.input_zero_point', 'talke r.model.layers.15.self_attn.v_proj.weight_global_scale', 'talker.model.layers.15.self_attn.v_proj.weight_scale', 'talke r.model.layers.15.self_attn.v_proj.weight_zero_point', 'talker.model.layers.16.mlp.down_proj.input_global_scale', 'talk er.model.layers.16.mlp.down_proj.input_zero_point', 'talker.model.layers.16.mlp.down_proj.weight_global_scale', 'talker .model.layers.16.mlp.down_proj.weight_scale', 'talker.model.layers.16.mlp.down_proj.weight_zero_point', 'talker.model.l ayers.16.mlp.gate_proj.input_global_scale', 'talker.model.layers.16.mlp.gate_proj.input_zero_point', 'talker.model.laye rs.16.mlp.gate_proj.weight_global_scale', 'talker.model.layers.16.mlp.gate_proj.weight_scale', 'talker.model.layers.16. mlp.gate_proj.weight_zero_point', 'talker.model.layers.16.mlp.up_proj.input_global_scale', 'talker.model.layers.16.mlp. up_proj.input_zero_point', 'talker.model.layers.16.mlp.up_proj.weight_global_scale', 'talker.model.layers.16.mlp.up_pro j.weight_scale', 'talker.model.layers.16.mlp.up_proj.weight_zero_point', 'talker.model.layers.16.self_attn.k_proj.input _global_scale', 'talker.model.layers.16.self_attn.k_proj.input_zero_point', 'talker.model.layers.16.self_attn.k_proj.we ight_global_scale', 'talker.model.layers.16.self_attn.k_proj.weight_scale', 'talker.model.layers.16.self_attn.k_proj.we ight_zero_point', 'talker.model.layers.16.self_attn.o_proj.input_global_scale', 'talker.model.layers.16.self_attn.o_pro j.input_zero_point', 'talker.model.layers.16.self_attn.o_proj.weight_global_scale', 'talker.model.layers.16.self_attn.o _proj.weight_scale', 'talker.model.layers.16.self_attn.o_proj.weight_zero_point', 'talker.model.layers.16.self_attn.q_p roj.input_global_scale', 'talker.model.layers.16.self_attn.q_proj.input_zero_point', 'talker.model.layers.16.self_attn. q_proj.weight_global_scale', 'talker.model.layers.16.self_attn.q_proj.weight_scale', 'talker.model.layers.16.self_attn. q_proj.weight_zero_point', 'talker.model.layers.16.self_attn.v_proj.input_global_scale', 'talker.model.layers.16.self_a ttn.v_proj.input_zero_point', 'talker.model.layers.16.self_attn.v_proj.weight_global_scale', 'talker.model.layers.16.se lf_attn.v_proj.weight_scale', 'talker.model.layers.16.self_attn.v_proj.weight_zero_point', 'talker.model.layers.17.mlp. down_proj.input_global_scale', 'talker.model.layers.17.mlp.down_proj.input_zero_point', 'talker.model.layers.17.mlp.dow n_proj.weight_global_scale', 'talker.model.layers.17.mlp.down_proj.weight_scale', 'talker.model.layers.17.mlp.down_proj .weight_zero_point', 'talker.model.layers.17.mlp.gate_proj.input_global_scale', 'talker.model.layers.17.mlp.gate_proj.i nput_zero_point', 'talker.model.layers.17.mlp.gate_proj.weight_global_scale', 'talker.model.layers.17.mlp.gate_proj.wei ght_scale', 'talker.model.layers.17.mlp.gate_proj.weight_zero_point', 'talker.model.layers.17.mlp.up_proj.input_global_ scale', 'talker.model.layers.17.mlp.up_proj.input_zero_point', 'talker.model.layers.17.mlp.up_proj.weight_global_scale' , 'talker.model.layers.17.mlp.up_proj.weight_scale', 'talker.model.layers.17.mlp.up_proj.weight_zero_point', 'talker.mo del.layers.17.self_attn.k_proj.input_global_scale', 'talker.model.layers.17.self_attn.k_proj.input_zero_point', 'talker .model.layers.17.self_attn.k_proj.weight_global_scale', 'talker.model.layers.17.self_attn.k_proj.weight_scale', 'talker .model.layers.17.self_attn.k_proj.weight_zero_point', 'talker.model.layers.17.self_attn.o_proj.input_global_scale', 'ta lker.model.layers.17.self_attn.o_proj.input_zero_point', 'talker.model.layers.17.self_attn.o_proj.weight_global_scale', 'talker.model.layers.17.self_attn.o_proj.weight_scale', 'talker.model.layers.17.self_attn.o_proj.weight_zero_point', ' talker.model.layers.17.self_attn.q_proj.input_global_scale', 'talker.model.layers.17.self_attn.q_proj.input_zero_point' , 'talker.model.layers.17.self_attn.q_proj.weight_global_scale', 'talker.model.layers.17.self_attn.q_proj.weight_scale' , 'talker.model.layers.17.self_attn.q_proj.weight_zero_point', 'talker.model.layers.17.self_attn.v_proj.input_global_sc ale', 'talker.model.layers.17.self_attn.v_proj.input_zero_point', 'talker.model.layers.17.self_attn.v_proj.weight_globa l_scale', 'talker.model.layers.17.self_attn.v_proj.weight_scale', 'talker.model.layers.17.self_attn.v_proj.weight_zero_ point', 'talker.model.layers.18.mlp.down_proj.input_global_scale', 'talker.model.layers.18.mlp.down_proj.input_zero_poi nt', 'talker.model.layers.18.mlp.down_proj.weight_global_scale', 'talker.model.layers.18.mlp.down_proj.weight_scale', ' talker.model.layers.18.mlp.down_proj.weight_zero_point', 'talker.model.layers.18.mlp.gate_proj.input_global_scale', 'ta lker.model.layers.18.mlp.gate_proj.input_zero_point', 'talker.model.layers.18.mlp.gate_proj.weight_global_scale', 'talk er.model.layers.18.mlp.gate_proj.weight_scale', 'talker.model.layers.18.mlp.gate_proj.weight_zero_point', 'talker.model .layers.18.mlp.up_proj.input_global_scale', 'talker.model.layers.18.mlp.up_proj.input_zero_point', 'talker.model.layers .18.mlp.up_proj.weight_global_scale', 'talker.model.layers.18.mlp.up_proj.weight_scale', 'talker.model.layers.18.mlp.up _proj.weight_zero_point', 'talker.model.layers.18.self_attn.k_proj.input_global_scale', 'talker.model.layers.18.self_at tn.k_proj.input_zero_point', 'talker.model.layers.18.self_attn.k_proj.weight_global_scale', 'talker.model.layers.18.sel f_attn.k_proj.weight_scale', 'talker.model.layers.18.self_attn.k_proj.weight_zero_point', 'talker.model.layers.18.self_ attn.o_proj.input_global_scale', 'talker.model.layers.18.self_attn.o_proj.input_zero_point', 'talker.model.layers.18.se lf_attn.o_proj.weight_global_scale', 'talker.model.layers.18.self_attn.o_proj.weight_scale', 'talker.model.layers.18.se lf_attn.o_proj.weight_zero_point', 'talker.model.layers.18.self_attn.q_proj.input_global_scale', 'talker.model.layers.1 8.self_attn.q_proj.input_zero_point', 'talker.model.layers.18.self_attn.q_proj.weight_global_scale', 'talker.model.laye rs.18.self_attn.q_proj.weight_scale', 'talker.model.layers.18.self_attn.q_proj.weight_zero_point', 'talker.model.layers .18.self_attn.v_proj.input_global_scale', 'talker.model.layers.18.self_attn.v_proj.input_zero_point', 'talker.model.lay ers.18.self_attn.v_proj.weight_global_scale', 'talker.model.layers.18.self_attn.v_proj.weight_scale', 'talker.model.lay ers.18.self_attn.v_proj.weight_zero_point', 'talker.model.layers.19.mlp.down_proj.input_global_scale', 'talker.model.la yers.19.mlp.down_proj.input_zero_point', 'talker.model.layers.19.mlp.down_proj.weight_global_scale', 'talker.model.laye rs.19.mlp.down_proj.weight_scale', 'talker.model.layers.19.mlp.down_proj.weight_zero_point', 'talker.model.layers.19.ml p.gate_proj.input_global_scale', 'talker.model.layers.19.mlp.gate_proj.input_zero_point', 'talker.model.layers.19.mlp.g ate_proj.weight_global_scale', 'talker.model.layers.19.mlp.gate_proj.weight_scale', 'talker.model.layers.19.mlp.gate_pr oj.weight_zero_point', 'talker.model.layers.19.mlp.up_proj.input_global_scale', 'talker.model.layers.19.mlp.up_proj.inp ut_zero_point', 'talker.model.layers.19.mlp.up_proj.weight_global_scale', 'talker.model.layers.19.mlp.up_proj.weight_sc ale', 'talker.model.layers.19.mlp.up_proj.weight_zero_point', 'talker.model.layers.19.self_attn.k_proj.input_global_sca le', 'talker.model.layers.19.self_attn.k_proj.input_zero_point', 'talker.model.layers.19.self_attn.k_proj.weight_global _scale', 'talker.model.layers.19.self_attn.k_proj.weight_scale', 'talker.model.layers.19.self_attn.k_proj.weight_zero_p oint', 'talker.model.layers.19.self_attn.o_proj.input_global_scale', 'talker.model.layers.19.self_attn.o_proj.input_zer o_point', 'talker.model.layers.19.self_attn.o_proj.weight_global_scale', 'talker.model.layers.19.self_attn.o_proj.weigh t_scale', 'talker.model.layers.19.self_attn.o_proj.weight_zero_point', 'talker.model.layers.19.self_attn.q_proj.input_g lobal_scale', 'talker.model.layers.19.self_attn.q_proj.input_zero_point', 'talker.model.layers.19.self_attn.q_proj.weig ht_global_scale', 'talker.model.layers.19.self_attn.q_proj.weight_scale', 'talker.model.layers.19.self_attn.q_proj.weig ht_zero_point', 'talker.model.layers.19.self_attn.v_proj.input_global_scale', 'talker.model.layers.19.self_attn.v_proj. input_zero_point', 'talker.model.layers.19.self_attn.v_proj.weight_global_scale', 'talker.model.layers.19.self_attn.v_p roj.weight_scale', 'talker.model.layers.19.self_attn.v_proj.weight_zero_point', 'talker.model.layers.2.mlp.down_proj.in put_global_scale', 'talker.model.layers.2.mlp.down_proj.input_zero_point', 'talker.model.layers.2.mlp.down_proj.weight_ global_scale', 'talker.model.layers.2.mlp.down_proj.weight_scale', 'talker.model.layers.2.mlp.down_proj.weight_zero_poi nt', 'talker.model.layers.2.mlp.gate_proj.input_global_scale', 'talker.model.layers.2.mlp.gate_proj.input_zero_point', 'talker.model.layers.2.mlp.gate_proj.weight_global_scale', 'talker.model.layers.2.mlp.gate_proj.weight_scale', 'talker. model.layers.2.mlp.gate_proj.weight_zero_point', 'talker.model.layers.2.mlp.up_proj.input_global_scale', 'talker.model. layers.2.mlp.up_proj.input_zero_point', 'talker.model.layers.2.mlp.up_proj.weight_global_scale', 'talker.model.layers.2 .mlp.up_proj.weight_scale', 'talker.model.layers.2.mlp.up_proj.weight_zero_point', 'talker.model.layers.2.self_attn.k_p roj.input_global_scale', 'talker.model.layers.2.self_attn.k_proj.input_zero_point', 'talker.model.layers.2.self_attn.k_ proj.weight_global_scale', 'talker.model.layers.2.self_attn.k_proj.weight_scale', 'talker.model.layers.2.self_attn.k_pr oj.weight_zero_point', 'talker.model.layers.2.self_attn.o_proj.input_global_scale', 'talker.model.layers.2.self_attn.o_ proj.input_zero_point', 'talker.model.layers.2.self_attn.o_proj.weight_global_scale', 'talker.model.layers.2.self_attn. o_proj.weight_scale', 'talker.model.layers.2.self_attn.o_proj.weight_zero_point', 'talker.model.layers.2.self_attn.q_pr oj.input_global_scale', 'talker.model.layers.2.self_attn.q_proj.input_zero_point', 'talker.model.layers.2.self_attn.q_p roj.weight_global_scale', 'talker.model.layers.2.self_attn.q_proj.weight_scale', 'talker.model.layers.2.self_attn.q_pro j.weight_zero_point', 'talker.model.layers.2.self_attn.v_proj.input_global_scale', 'talker.model.layers.2.self_attn.v_p roj.input_zero_point', 'talker.model.layers.2.self_attn.v_proj.weight_global_scale', 'talker.model.layers.2.self_attn.v _proj.weight_scale', 'talker.model.layers.2.self_attn.v_proj.weight_zero_point', 'talker.model.layers.20.mlp.down_proj. input_global_scale', 'talker.model.layers.20.mlp.down_proj.input_zero_point', 'talker.model.layers.20.mlp.down_proj.wei ght_global_scale', 'talker.model.layers.20.mlp.down_proj.weight_scale', 'talker.model.layers.20.mlp.down_proj.weight_ze ro_point', 'talker.model.layers.20.mlp.gate_proj.input_global_scale', 'talker.model.layers.20.mlp.gate_proj.input_zero_ point', 'talker.model.layers.20.mlp.gate_proj.weight_global_scale', 'talker.model.layers.20.mlp.gate_proj.weight_scale' , 'talker.model.layers.20.mlp.gate_proj.weight_zero_point', 'talker.model.layers.20.mlp.up_proj.input_global_scale', 't alker.model.layers.20.mlp.up_proj.input_zero_point', 'talker.model.layers.20.mlp.up_proj.weight_global_scale', 'talker. model.layers.20.mlp.up_proj.weight_scale', 'talker.model.layers.20.mlp.up_proj.weight_zero_point', 'talker.model.layers .20.self_attn.k_proj.input_global_scale', 'talker.model.layers.20.self_attn.k_proj.input_zero_point', 'talker.model.lay ers.20.self_attn.k_proj.weight_global_scale', 'talker.model.layers.20.self_attn.k_proj.weight_scale', 'talker.model.lay ers.20.self_attn.k_proj.weight_zero_point', 'talker.model.layers.20.self_attn.o_proj.input_global_scale', 'talker.model .layers.20.self_attn.o_proj.input_zero_point', 'talker.model.layers.20.self_attn.o_proj.weight_global_scale', 'talker.m odel.layers.20.self_attn.o_proj.weight_scale', 'talker.model.layers.20.self_attn.o_proj.weight_zero_point', 'talker.mod el.layers.20.self_attn.q_proj.input_global_scale', 'talker.model.layers.20.self_attn.q_proj.input_zero_point', 'talker. model.layers.20.self_attn.q_proj.weight_global_scale', 'talker.model.layers.20.self_attn.q_proj.weight_scale', 'talker. model.layers.20.self_attn.q_proj.weight_zero_point', 'talker.model.layers.20.self_attn.v_proj.input_global_scale', 'tal ker.model.layers.20.self_attn.v_proj.input_zero_point', 'talker.model.layers.20.self_attn.v_proj.weight_global_scale', 'talker.model.layers.20.self_attn.v_proj.weight_scale', 'talker.model.layers.20.self_attn.v_proj.weight_zero_point', 't alker.model.layers.21.mlp.down_proj.input_global_scale', 'talker.model.layers.21.mlp.down_proj.input_zero_point', 'talk er.model.layers.21.mlp.down_proj.weight_global_scale', 'talker.model.layers.21.mlp.down_proj.weight_scale', 'talker.mod el.layers.21.mlp.down_proj.weight_zero_point', 'talker.model.layers.21.mlp.gate_proj.input_global_scale', 'talker.model .layers.21.mlp.gate_proj.input_zero_point', 'talker.model.layers.21.mlp.gate_proj.weight_global_scale', 'talker.model.l ayers.21.mlp.gate_proj.weight_scale', 'talker.model.layers.21.mlp.gate_proj.weight_zero_point', 'talker.model.layers.21 .mlp.up_proj.input_global_scale', 'talker.model.layers.21.mlp.up_proj.input_zero_point', 'talker.model.layers.21.mlp.up _proj.weight_global_scale', 'talker.model.layers.21.mlp.up_proj.weight_scale', 'talker.model.layers.21.mlp.up_proj.weig ht_zero_point', 'talker.model.layers.21.self_attn.k_proj.input_global_scale', 'talker.model.layers.21.self_attn.k_proj. input_zero_point', 'talker.model.layers.21.self_attn.k_proj.weight_global_scale', 'talker.model.layers.21.self_attn.k_p roj.weight_scale', 'talker.model.layers.21.self_attn.k_proj.weight_zero_point', 'talker.model.layers.21.self_attn.o_pro j.input_global_scale', 'talker.model.layers.21.self_attn.o_proj.input_zero_point', 'talker.model.layers.21.self_attn.o_ proj.weight_global_scale', 'talker.model.layers.21.self_attn.o_proj.weight_scale', 'talker.model.layers.21.self_attn.o_ proj.weight_zero_point', 'talker.model.layers.21.self_attn.q_proj.input_global_scale', 'talker.model.layers.21.self_att n.q_proj.input_zero_point', 'talker.model.layers.21.self_attn.q_proj.weight_global_scale', 'talker.model.layers.21.self _attn.q_proj.weight_scale', 'talker.model.layers.21.self_attn.q_proj.weight_zero_point', 'talker.model.layers.21.self_a ttn.v_proj.input_global_scale', 'talker.model.layers.21.self_attn.v_proj.input_zero_point', 'talker.model.layers.21.sel f_attn.v_proj.weight_global_scale', 'talker.model.layers.21.self_attn.v_proj.weight_scale', 'talker.model.layers.21.sel f_attn.v_proj.weight_zero_point', 'talker.model.layers.22.mlp.down_proj.input_global_scale', 'talker.model.layers.22.ml p.down_proj.input_zero_point', 'talker.model.layers.22.mlp.down_proj.weight_global_scale', 'talker.model.layers.22.mlp. down_proj.weight_scale', 'talker.model.layers.22.mlp.down_proj.weight_zero_point', 'talker.model.layers.22.mlp.gate_pro j.input_global_scale', 'talker.model.layers.22.mlp.gate_proj.input_zero_point', 'talker.model.layers.22.mlp.gate_proj.w eight_global_scale', 'talker.model.layers.22.mlp.gate_proj.weight_scale', 'talker.model.layers.22.mlp.gate_proj.weight_ zero_point', 'talker.model.layers.22.mlp.up_proj.input_global_scale', 'talker.model.layers.22.mlp.up_proj.input_zero_po int', 'talker.model.layers.22.mlp.up_proj.weight_global_scale', 'talker.model.layers.22.mlp.up_proj.weight_scale', 'tal ker.model.layers.22.mlp.up_proj.weight_zero_point', 'talker.model.layers.22.self_attn.k_proj.input_global_scale', 'talk er.model.layers.22.self_attn.k_proj.input_zero_point', 'talker.model.layers.22.self_attn.k_proj.weight_global_scale', ' talker.model.layers.22.self_attn.k_proj.weight_scale', 'talker.model.layers.22.self_attn.k_proj.weight_zero_point', 'ta lker.model.layers.22.self_attn.o_proj.input_global_scale', 'talker.model.layers.22.self_attn.o_proj.input_zero_point', 'talker.model.layers.22.self_attn.o_proj.weight_global_scale', 'talker.model.layers.22.self_attn.o_proj.weight_scale', 'talker.model.layers.22.self_attn.o_proj.weight_zero_point', 'talker.model.layers.22.self_attn.q_proj.input_global_scal e', 'talker.model.layers.22.self_attn.q_proj.input_zero_point', 'talker.model.layers.22.self_attn.q_proj.weight_global_ scale', 'talker.model.layers.22.self_attn.q_proj.weight_scale', 'talker.model.layers.22.self_attn.q_proj.weight_zero_po int', 'talker.model.layers.22.self_attn.v_proj.input_global_scale', 'talker.model.layers.22.self_attn.v_proj.input_zero _point', 'talker.model.layers.22.self_attn.v_proj.weight_global_scale', 'talker.model.layers.22.self_attn.v_proj.weight _scale', 'talker.model.layers.22.self_attn.v_proj.weight_zero_point', 'talker.model.layers.23.mlp.down_proj.input_globa l_scale', 'talker.model.layers.23.mlp.down_proj.input_zero_point', 'talker.model.layers.23.mlp.down_proj.weight_global_ scale', 'talker.model.layers.23.mlp.down_proj.weight_scale', 'talker.model.layers.23.mlp.down_proj.weight_zero_point', 'talker.model.layers.23.mlp.gate_proj.input_global_scale', 'talker.model.layers.23.mlp.gate_proj.input_zero_point', 'ta lker.model.layers.23.mlp.gate_proj.weight_global_scale', 'talker.model.layers.23.mlp.gate_proj.weight_scale', 'talker.m odel.layers.23.mlp.gate_proj.weight_zero_point', 'talker.model.layers.23.mlp.up_proj.input_global_scale', 'talker.model .layers.23.mlp.up_proj.input_zero_point', 'talker.model.layers.23.mlp.up_proj.weight_global_scale', 'talker.model.layer s.23.mlp.up_proj.weight_scale', 'talker.model.layers.23.mlp.up_proj.weight_zero_point', 'talker.model.layers.23.self_at tn.k_proj.input_global_scale', 'talker.model.layers.23.self_attn.k_proj.input_zero_point', 'talker.model.layers.23.self _attn.k_proj.weight_global_scale', 'talker.model.layers.23.self_attn.k_proj.weight_scale', 'talker.model.layers.23.self _attn.k_proj.weight_zero_point', 'talker.model.layers.23.self_attn.o_proj.input_global_scale', 'talker.model.layers.23. self_attn.o_proj.input_zero_point', 'talker.model.layers.23.self_attn.o_proj.weight_global_scale', 'talker.model.layers .23.self_attn.o_proj.weight_scale', 'talker.model.layers.23.self_attn.o_proj.weight_zero_point', 'talker.model.layers.2 3.self_attn.q_proj.input_global_scale', 'talker.model.layers.23.self_attn.q_proj.input_zero_point', 'talker.model.layer s.23.self_attn.q_proj.weight_global_scale', 'talker.model.layers.23.self_attn.q_proj.weight_scale', 'talker.model.layer s.23.self_attn.q_proj.weight_zero_point', 'talker.model.layers.23.self_attn.v_proj.input_global_scale', 'talker.model.l ayers.23.self_attn.v_proj.input_zero_point', 'talker.model.layers.23.self_attn.v_proj.weight_global_scale', 'talker.mod el.layers.23.self_attn.v_proj.weight_scale', 'talker.model.layers.23.self_attn.v_proj.weight_zero_point', 'talker.model .layers.24.mlp.down_proj.input_global_scale', 'talker.model.layers.24.mlp.down_proj.input_zero_point', 'talker.model.la yers.24.mlp.down_proj.weight_global_scale', 'talker.model.layers.24.mlp.down_proj.weight_scale', 'talker.model.layers.2 4.mlp.down_proj.weight_zero_point', 'talker.model.layers.24.mlp.gate_proj.input_global_scale', 'talker.model.layers.24. mlp.gate_proj.input_zero_point', 'talker.model.layers.24.mlp.gate_proj.weight_global_scale', 'talker.model.layers.24.ml p.gate_proj.weight_scale', 'talker.model.layers.24.mlp.gate_proj.weight_zero_point', 'talker.model.layers.24.mlp.up_pro j.input_global_scale', 'talker.model.layers.24.mlp.up_proj.input_zero_point', 'talker.model.layers.24.mlp.up_proj.weigh t_global_scale', 'talker.model.layers.24.mlp.up_proj.weight_scale', 'talker.model.layers.24.mlp.up_proj.weight_zero_poi nt', 'talker.model.layers.24.self_attn.k_proj.input_global_scale', 'talker.model.layers.24.self_attn.k_proj.input_zero_ point', 'talker.model.layers.24.self_attn.k_proj.weight_global_scale', 'talker.model.layers.24.self_attn.k_proj.weight_ scale', 'talker.model.layers.24.self_attn.k_proj.weight_zero_point', 'talker.model.layers.24.self_attn.o_proj.input_glo bal_scale', 'talker.model.layers.24.self_attn.o_proj.input_zero_point', 'talker.model.layers.24.self_attn.o_proj.weight _global_scale', 'talker.model.layers.24.self_attn.o_proj.weight_scale', 'talker.model.layers.24.self_attn.o_proj.weight _zero_point', 'talker.model.layers.24.self_attn.q_proj.input_global_scale', 'talker.model.layers.24.self_attn.q_proj.in put_zero_point', 'talker.model.layers.24.self_attn.q_proj.weight_global_scale', 'talker.model.layers.24.self_attn.q_pro j.weight_scale', 'talker.model.layers.24.self_attn.q_proj.weight_zero_point', 'talker.model.layers.24.self_attn.v_proj. input_global_scale', 'talker.model.layers.24.self_attn.v_proj.input_zero_point', 'talker.model.layers.24.self_attn.v_pr oj.weight_global_scale', 'talker.model.layers.24.self_attn.v_proj.weight_scale', 'talker.model.layers.24.self_attn.v_pr oj.weight_zero_point', 'talker.model.layers.25.mlp.down_proj.input_global_scale', 'talker.model.layers.25.mlp.down_proj .input_zero_point', 'talker.model.layers.25.mlp.down_proj.weight_global_scale', 'talker.model.layers.25.mlp.down_proj.w eight_scale', 'talker.model.layers.25.mlp.down_proj.weight_zero_point', 'talker.model.layers.25.mlp.gate_proj.input_glo bal_scale', 'talker.model.layers.25.mlp.gate_proj.input_zero_point', 'talker.model.layers.25.mlp.gate_proj.weight_globa l_scale', 'talker.model.layers.25.mlp.gate_proj.weight_scale', 'talker.model.layers.25.mlp.gate_proj.weight_zero_point' , 'talker.model.layers.25.mlp.up_proj.input_global_scale', 'talker.model.layers.25.mlp.up_proj.input_zero_point', 'talk er.model.layers.25.mlp.up_proj.weight_global_scale', 'talker.model.layers.25.mlp.up_proj.weight_scale', 'talker.model.l ayers.25.mlp.up_proj.weight_zero_point', 'talker.model.layers.25.self_attn.k_proj.input_global_scale', 'talker.model.la yers.25.self_attn.k_proj.input_zero_point', 'talker.model.layers.25.self_attn.k_proj.weight_global_scale', 'talker.mode l.layers.25.self_attn.k_proj.weight_scale', 'talker.model.layers.25.self_attn.k_proj.weight_zero_point', 'talker.model. layers.25.self_attn.o_proj.input_global_scale', 'talker.model.layers.25.self_attn.o_proj.input_zero_point', 'talker.mod el.layers.25.self_attn.o_proj.weight_global_scale', 'talker.model.layers.25.self_attn.o_proj.weight_scale', 'talker.mod el.layers.25.self_attn.o_proj.weight_zero_point', 'talker.model.layers.25.self_attn.q_proj.input_global_scale', 'talker .model.layers.25.self_attn.q_proj.input_zero_point', 'talker.model.layers.25.self_attn.q_proj.weight_global_scale', 'ta lker.model.layers.25.self_attn.q_proj.weight_scale', 'talker.model.layers.25.self_attn.q_proj.weight_zero_point', 'talk er.model.layers.25.self_attn.v_proj.input_global_scale', 'talker.model.layers.25.self_attn.v_proj.input_zero_point', 't alker.model.layers.25.self_attn.v_proj.weight_global_scale', 'talker.model.layers.25.self_attn.v_proj.weight_scale', 't alker.model.layers.25.self_attn.v_proj.weight_zero_point', 'talker.model.layers.26.mlp.down_proj.input_global_scale', ' talker.model.layers.26.mlp.down_proj.input_zero_point', 'talker.model.layers.26.mlp.down_proj.weight_global_scale', 'ta lker.model.layers.26.mlp.down_proj.weight_scale', 'talker.model.layers.26.mlp.down_proj.weight_zero_point', 'talker.mod el.layers.26.mlp.gate_proj.input_global_scale', 'talker.model.layers.26.mlp.gate_proj.input_zero_point', 'talker.model. layers.26.mlp.gate_proj.weight_global_scale', 'talker.model.layers.26.mlp.gate_proj.weight_scale', 'talker.model.layers .26.mlp.gate_proj.weight_zero_point', 'talker.model.layers.26.mlp.up_proj.input_global_scale', 'talker.model.layers.26. mlp.up_proj.input_zero_point', 'talker.model.layers.26.mlp.up_proj.weight_global_scale', 'talker.model.layers.26.mlp.up _proj.weight_scale', 'talker.model.layers.26.mlp.up_proj.weight_zero_point', 'talker.model.layers.26.self_attn.k_proj.i nput_global_scale', 'talker.model.layers.26.self_attn.k_proj.input_zero_point', 'talker.model.layers.26.self_attn.k_pro j.weight_global_scale', 'talker.model.layers.26.self_attn.k_proj.weight_scale', 'talker.model.layers.26.self_attn.k_pro j.weight_zero_point', 'talker.model.layers.26.self_attn.o_proj.input_global_scale', 'talker.model.layers.26.self_attn.o _proj.input_zero_point', 'talker.model.layers.26.self_attn.o_proj.weight_global_scale', 'talker.model.layers.26.self_at tn.o_proj.weight_scale', 'talker.model.layers.26.self_attn.o_proj.weight_zero_point', 'talker.model.layers.26.self_attn .q_proj.input_global_scale', 'talker.model.layers.26.self_attn.q_proj.input_zero_point', 'talker.model.layers.26.self_a ttn.q_proj.weight_global_scale', 'talker.model.layers.26.self_attn.q_proj.weight_scale', 'talker.model.layers.26.self_a ttn.q_proj.weight_zero_point', 'talker.model.layers.26.self_attn.v_proj.input_global_scale', 'talker.model.layers.26.se lf_attn.v_proj.input_zero_point', 'talker.model.layers.26.self_attn.v_proj.weight_global_scale', 'talker.model.layers.2 6.self_attn.v_proj.weight_scale', 'talker.model.layers.26.self_attn.v_proj.weight_zero_point', 'talker.model.layers.27. mlp.down_proj.input_global_scale', 'talker.model.layers.27.mlp.down_proj.input_zero_point', 'talker.model.layers.27.mlp .down_proj.weight_global_scale', 'talker.model.layers.27.mlp.down_proj.weight_scale', 'talker.model.layers.27.mlp.down_ proj.weight_zero_point', 'talker.model.layers.27.mlp.gate_proj.input_global_scale', 'talker.model.layers.27.mlp.gate_pr oj.input_zero_point', 'talker.model.layers.27.mlp.gate_proj.weight_global_scale', 'talker.model.layers.27.mlp.gate_proj .weight_scale', 'talker.model.layers.27.mlp.gate_proj.weight_zero_point', 'talker.model.layers.27.mlp.up_proj.input_glo bal_scale', 'talker.model.layers.27.mlp.up_proj.input_zero_point', 'talker.model.layers.27.mlp.up_proj.weight_global_sc ale', 'talker.model.layers.27.mlp.up_proj.weight_scale', 'talker.model.layers.27.mlp.up_proj.weight_zero_point', 'talke r.model.layers.27.self_attn.k_proj.input_global_scale', 'talker.model.layers.27.self_attn.k_proj.input_zero_point', 'ta lker.model.layers.27.self_attn.k_proj.weight_global_scale', 'talker.model.layers.27.self_attn.k_proj.weight_scale', 'ta lker.model.layers.27.self_attn.k_proj.weight_zero_point', 'talker.model.layers.27.self_attn.o_proj.input_global_scale', 'talker.model.layers.27.self_attn.o_proj.input_zero_point', 'talker.model.layers.27.self_attn.o_proj.weight_global_sca le', 'talker.model.layers.27.self_attn.o_proj.weight_scale', 'talker.model.layers.27.self_attn.o_proj.weight_zero_point ', 'talker.model.layers.27.self_attn.q_proj.input_global_scale', 'talker.model.layers.27.self_attn.q_proj.input_zero_po int', 'talker.model.layers.27.self_attn.q_proj.weight_global_scale', 'talker.model.layers.27.self_attn.q_proj.weight_sc ale', 'talker.model.layers.27.self_attn.q_proj.weight_zero_point', 'talker.model.layers.27.self_attn.v_proj.input_globa l_scale', 'talker.model.layers.27.self_attn.v_proj.input_zero_point', 'talker.model.layers.27.self_attn.v_proj.weight_g lobal_scale', 'talker.model.layers.27.self_attn.v_proj.weight_scale', 'talker.model.layers.27.self_attn.v_proj.weight_z ero_point', 'talker.model.layers.3.mlp.down_proj.input_global_scale', 'talker.model.layers.3.mlp.down_proj.input_zero_p oint', 'talker.model.layers.3.mlp.down_proj.weight_global_scale', 'talker.model.layers.3.mlp.down_proj.weight_scale', ' talker.model.layers.3.mlp.down_proj.weight_zero_point', 'talker.model.layers.3.mlp.gate_proj.input_global_scale', 'talk er.model.layers.3.mlp.gate_proj.input_zero_point', 'talker.model.layers.3.mlp.gate_proj.weight_global_scale', 'talker.m odel.layers.3.mlp.gate_proj.weight_scale', 'talker.model.layers.3.mlp.gate_proj.weight_zero_point', 'talker.model.layer s.3.mlp.up_proj.input_global_scale', 'talker.model.layers.3.mlp.up_proj.input_zero_point', 'talker.model.layers.3.mlp.u p_proj.weight_global_scale', 'talker.model.layers.3.mlp.up_proj.weight_scale', 'talker.model.layers.3.mlp.up_proj.weigh t_zero_point', 'talker.model.layers.3.self_attn.k_proj.input_global_scale', 'talker.model.layers.3.self_attn.k_proj.inp ut_zero_point', 'talker.model.layers.3.self_attn.k_proj.weight_global_scale', 'talker.model.layers.3.self_attn.k_proj.w eight_scale', 'talker.model.layers.3.self_attn.k_proj.weight_zero_point', 'talker.model.layers.3.self_attn.o_proj.input _global_scale', 'talker.model.layers.3.self_attn.o_proj.input_zero_point', 'talker.model.layers.3.self_attn.o_proj.weig ht_global_scale', 'talker.model.layers.3.self_attn.o_proj.weight_scale', 'talker.model.layers.3.self_attn.o_proj.weight _zero_point', 'talker.model.layers.3.self_attn.q_proj.input_global_scale', 'talker.model.layers.3.self_attn.q_proj.inpu t_zero_point', 'talker.model.layers.3.self_attn.q_proj.weight_global_scale', 'talker.model.layers.3.self_attn.q_proj.we ight_scale', 'talker.model.layers.3.self_attn.q_proj.weight_zero_point', 'talker.model.layers.3.self_attn.v_proj.input_ global_scale', 'talker.model.layers.3.self_attn.v_proj.input_zero_point', 'talker.model.layers.3.self_attn.v_proj.weigh t_global_scale', 'talker.model.layers.3.self_attn.v_proj.weight_scale', 'talker.model.layers.3.self_attn.v_proj.weight_ zero_point', 'talker.model.layers.4.mlp.down_proj.input_global_scale', 'talker.model.layers.4.mlp.down_proj.input_zero_ point', 'talker.model.layers.4.mlp.down_proj.weight_global_scale', 'talker.model.layers.4.mlp.down_proj.weight_scale', 'talker.model.layers.4.mlp.down_proj.weight_zero_point', 'talker.model.layers.4.mlp.gate_proj.input_global_scale', 'tal ker.model.layers.4.mlp.gate_proj.input_zero_point', 'talker.model.layers.4.mlp.gate_proj.weight_global_scale', 'talker. model.layers.4.mlp.gate_proj.weight_scale', 'talker.model.layers.4.mlp.gate_proj.weight_zero_point', 'talker.model.laye rs.4.mlp.up_proj.input_global_scale', 'talker.model.layers.4.mlp.up_proj.input_zero_point', 'talker.model.layers.4.mlp. up_proj.weight_global_scale', 'talker.model.layers.4.mlp.up_proj.weight_scale', 'talker.model.layers.4.mlp.up_proj.weig ht_zero_point', 'talker.model.layers.4.self_attn.k_proj.input_global_scale', 'talker.model.layers.4.self_attn.k_proj.in put_zero_point', 'talker.model.layers.4.self_attn.k_proj.weight_global_scale', 'talker.model.layers.4.self_attn.k_proj. weight_scale', 'talker.model.layers.4.self_attn.k_proj.weight_zero_point', 'talker.model.layers.4.self_attn.o_proj.inpu t_global_scale', 'talker.model.layers.4.self_attn.o_proj.input_zero_point', 'talker.model.layers.4.self_attn.o_proj.wei ght_global_scale', 'talker.model.layers.4.self_attn.o_proj.weight_scale', 'talker.model.layers.4.self_attn.o_proj.weigh t_zero_point', 'talker.model.layers.4.self_attn.q_proj.input_global_scale', 'talker.model.layers.4.self_attn.q_proj.inp ut_zero_point', 'talker.model.layers.4.self_attn.q_proj.weight_global_scale', 'talker.model.layers.4.self_attn.q_proj.w eight_scale', 'talker.model.layers.4.self_attn.q_proj.weight_zero_point', 'talker.model.layers.4.self_attn.v_proj.input _global_scale', 'talker.model.layers.4.self_attn.v_proj.input_zero_point', 'talker.model.layers.4.self_attn.v_proj.weig ht_global_scale', 'talker.model.layers.4.self_attn.v_proj.weight_scale', 'talker.model.layers.4.self_attn.v_proj.weight _zero_point', 'talker.model.layers.5.mlp.down_proj.input_global_scale', 'talker.model.layers.5.mlp.down_proj.input_zero _point', 'talker.model.layers.5.mlp.down_proj.weight_global_scale', 'talker.model.layers.5.mlp.down_proj.weight_scale', 'talker.model.layers.5.mlp.down_proj.weight_zero_point', 'talker.model.layers.5.mlp.gate_proj.input_global_scale', 'ta lker.model.layers.5.mlp.gate_proj.input_zero_point', 'talker.model.layers.5.mlp.gate_proj.weight_global_scale', 'talker .model.layers.5.mlp.gate_proj.weight_scale', 'talker.model.layers.5.mlp.gate_proj.weight_zero_point', 'talker.model.lay ers.5.mlp.up_proj.input_global_scale', 'talker.model.layers.5.mlp.up_proj.input_zero_point', 'talker.model.layers.5.mlp .up_proj.weight_global_scale', 'talker.model.layers.5.mlp.up_proj.weight_scale', 'talker.model.layers.5.mlp.up_proj.wei ght_zero_point', 'talker.model.layers.5.self_attn.k_proj.input_global_scale', 'talker.model.layers.5.self_attn.k_proj.i nput_zero_point', 'talker.model.layers.5.self_attn.k_proj.weight_global_scale', 'talker.model.layers.5.self_attn.k_proj .weight_scale', 'talker.model.layers.5.self_attn.k_proj.weight_zero_point', 'talker.model.layers.5.self_attn.o_proj.inp ut_global_scale', 'talker.model.layers.5.self_attn.o_proj.input_zero_point', 'talker.model.layers.5.self_attn.o_proj.we ight_global_scale', 'talker.model.layers.5.self_attn.o_proj.weight_scale', 'talker.model.layers.5.self_attn.o_proj.weig ht_zero_point', 'talker.model.layers.5.self_attn.q_proj.input_global_scale', 'talker.model.layers.5.self_attn.q_proj.in put_zero_point', 'talker.model.layers.5.self_attn.q_proj.weight_global_scale', 'talker.model.layers.5.self_attn.q_proj. weight_scale', 'talker.model.layers.5.self_attn.q_proj.weight_zero_point', 'talker.model.layers.5.self_attn.v_proj.inpu t_global_scale', 'talker.model.layers.5.self_attn.v_proj.input_zero_point', 'talker.model.layers.5.self_attn.v_proj.wei ght_global_scale', 'talker.model.layers.5.self_attn.v_proj.weight_scale', 'talker.model.layers.5.self_attn.v_proj.weigh t_zero_point', 'talker.model.layers.6.mlp.down_proj.input_global_scale', 'talker.model.layers.6.mlp.down_proj.input_zer o_point', 'talker.model.layers.6.mlp.down_proj.weight_global_scale', 'talker.model.layers.6.mlp.down_proj.weight_scale' , 'talker.model.layers.6.mlp.down_proj.weight_zero_point', 'talker.model.layers.6.mlp.gate_proj.input_global_scale', 't alker.model.layers.6.mlp.gate_proj.input_zero_point', 'talker.model.layers.6.mlp.gate_proj.weight_global_scale', 'talke r.model.layers.6.mlp.gate_proj.weight_scale', 'talker.model.layers.6.mlp.gate_proj.weight_zero_point', 'talker.model.la yers.6.mlp.up_proj.input_global_scale', 'talker.model.layers.6.mlp.up_proj.input_zero_point', 'talker.model.layers.6.ml p.up_proj.weight_global_scale', 'talker.model.layers.6.mlp.up_proj.weight_scale', 'talker.model.layers.6.mlp.up_proj.we ight_zero_point', 'talker.model.layers.6.self_attn.k_proj.input_global_scale', 'talker.model.layers.6.self_attn.k_proj. input_zero_point', 'talker.model.layers.6.self_attn.k_proj.weight_global_scale', 'talker.model.layers.6.self_attn.k_pro j.weight_scale', 'talker.model.layers.6.self_attn.k_proj.weight_zero_point', 'talker.model.layers.6.self_attn.o_proj.in put_global_scale', 'talker.model.layers.6.self_attn.o_proj.input_zero_point', 'talker.model.layers.6.self_attn.o_proj.w eight_global_scale', 'talker.model.layers.6.self_attn.o_proj.weight_scale', 'talker.model.layers.6.self_attn.o_proj.wei ght_zero_point', 'talker.model.layers.6.self_attn.q_proj.input_global_scale', 'talker.model.layers.6.self_attn.q_proj.i nput_zero_point', 'talker.model.layers.6.self_attn.q_proj.weight_global_scale', 'talker.model.layers.6.self_attn.q_proj .weight_scale', 'talker.model.layers.6.self_attn.q_proj.weight_zero_point', 'talker.model.layers.6.self_attn.v_proj.inp ut_global_scale', 'talker.model.layers.6.self_attn.v_proj.input_zero_point', 'talker.model.layers.6.self_attn.v_proj.we ight_global_scale', 'talker.model.layers.6.self_attn.v_proj.weight_scale', 'talker.model.layers.6.self_attn.v_proj.weig ht_zero_point', 'talker.model.layers.7.mlp.down_proj.input_global_scale', 'talker.model.layers.7.mlp.down_proj.input_ze ro_point', 'talker.model.layers.7.mlp.down_proj.weight_global_scale', 'talker.model.layers.7.mlp.down_proj.weight_scale ', 'talker.model.layers.7.mlp.down_proj.weight_zero_point', 'talker.model.layers.7.mlp.gate_proj.input_global_scale', ' talker.model.layers.7.mlp.gate_proj.input_zero_point', 'talker.model.layers.7.mlp.gate_proj.weight_global_scale', 'talk er.model.layers.7.mlp.gate_proj.weight_scale', 'talker.model.layers.7.mlp.gate_proj.weight_zero_point', 'talker.model.l ayers.7.mlp.up_proj.input_global_scale', 'talker.model.layers.7.mlp.up_proj.input_zero_point', 'talker.model.layers.7.m lp.up_proj.weight_global_scale', 'talker.model.layers.7.mlp.up_proj.weight_scale', 'talker.model.layers.7.mlp.up_proj.w eight_zero_point', 'talker.model.layers.7.self_attn.k_proj.input_global_scale', 'talker.model.layers.7.self_attn.k_proj .input_zero_point', 'talker.model.layers.7.self_attn.k_proj.weight_global_scale', 'talker.model.layers.7.self_attn.k_pr oj.weight_scale', 'talker.model.layers.7.self_attn.k_proj.weight_zero_point', 'talker.model.layers.7.self_attn.o_proj.i nput_global_scale', 'talker.model.layers.7.self_attn.o_proj.input_zero_point', 'talker.model.layers.7.self_attn.o_proj. weight_global_scale', 'talker.model.layers.7.self_attn.o_proj.weight_scale', 'talker.model.layers.7.self_attn.o_proj.we ight_zero_point', 'talker.model.layers.7.self_attn.q_proj.input_global_scale', 'talker.model.layers.7.self_attn.q_proj. input_zero_point', 'talker.model.layers.7.self_attn.q_proj.weight_global_scale', 'talker.model.layers.7.self_attn.q_pro j.weight_scale', 'talker.model.layers.7.self_attn.q_proj.weight_zero_point', 'talker.model.layers.7.self_attn.v_proj.in put_global_scale', 'talker.model.layers.7.self_attn.v_proj.input_zero_point', 'talker.model.layers.7.self_attn.v_proj.w eight_global_scale', 'talker.model.layers.7.self_attn.v_proj.weight_scale', 'talker.model.layers.7.self_attn.v_proj.wei ght_zero_point', 'talker.model.layers.8.mlp.down_proj.input_global_scale', 'talker.model.layers.8.mlp.down_proj.input_z ero_point', 'talker.model.layers.8.mlp.down_proj.weight_global_scale', 'talker.model.layers.8.mlp.down_proj.weight_scal e', 'talker.model.layers.8.mlp.down_proj.weight_zero_point', 'talker.model.layers.8.mlp.gate_proj.input_global_scale', 'talker.model.layers.8.mlp.gate_proj.input_zero_point', 'talker.model.layers.8.mlp.gate_proj.weight_global_scale', 'tal ker.model.layers.8.mlp.gate_proj.weight_scale', 'talker.model.layers.8.mlp.gate_proj.weight_zero_point', 'talker.model. layers.8.mlp.up_proj.input_global_scale', 'talker.model.layers.8.mlp.up_proj.input_zero_point', 'talker.model.layers.8. mlp.up_proj.weight_global_scale', 'talker.model.layers.8.mlp.up_proj.weight_scale', 'talker.model.layers.8.mlp.up_proj. weight_zero_point', 'talker.model.layers.8.self_attn.k_proj.input_global_scale', 'talker.model.layers.8.self_attn.k_pro j.input_zero_point', 'talker.model.layers.8.self_attn.k_proj.weight_global_scale', 'talker.model.layers.8.self_attn.k_p roj.weight_scale', 'talker.model.layers.8.self_attn.k_proj.weight_zero_point', 'talker.model.layers.8.self_attn.o_proj. input_global_scale', 'talker.model.layers.8.self_attn.o_proj.input_zero_point', 'talker.model.layers.8.self_attn.o_proj .weight_global_scale', 'talker.model.layers.8.self_attn.o_proj.weight_scale', 'talker.model.layers.8.self_attn.o_proj.w eight_zero_point', 'talker.model.layers.8.self_attn.q_proj.input_global_scale', 'talker.model.layers.8.self_attn.q_proj .input_zero_point', 'talker.model.layers.8.self_attn.q_proj.weight_global_scale', 'talker.model.layers.8.self_attn.q_pr oj.weight_scale', 'talker.model.layers.8.self_attn.q_proj.weight_zero_point', 'talker.model.layers.8.self_attn.v_proj.i nput_global_scale', 'talker.model.layers.8.self_attn.v_proj.input_zero_point', 'talker.model.layers.8.self_attn.v_proj. weight_global_scale', 'talker.model.layers.8.self_attn.v_proj.weight_scale', 'talker.model.layers.8.self_attn.v_proj.we ight_zero_point', 'talker.model.layers.9.mlp.down_proj.input_global_scale', 'talker.model.layers.9.mlp.down_proj.input_ zero_point', 'talker.model.layers.9.mlp.down_proj.weight_global_scale', 'talker.model.layers.9.mlp.down_proj.weight_sca le', 'talker.model.layers.9.mlp.down_proj.weight_zero_point', 'talker.model.layers.9.mlp.gate_proj.input_global_scale', 'talker.model.layers.9.mlp.gate_proj.input_zero_point', 'talker.model.layers.9.mlp.gate_proj.weight_global_scale', 'ta lker.model.layers.9.mlp.gate_proj.weight_scale', 'talker.model.layers.9.mlp.gate_proj.weight_zero_point', 'talker.model .layers.9.mlp.up_proj.input_global_scale', 'talker.model.layers.9.mlp.up_proj.input_zero_point', 'talker.model.layers.9 .mlp.up_proj.weight_global_scale', 'talker.model.layers.9.mlp.up_proj.weight_scale', 'talker.model.layers.9.mlp.up_proj .weight_zero_point', 'talker.model.layers.9.self_attn.k_proj.input_global_scale', 'talker.model.layers.9.self_attn.k_pr oj.input_zero_point', 'talker.model.layers.9.self_attn.k_proj.weight_global_scale', 'talker.model.layers.9.self_attn.k_ proj.weight_scale', 'talker.model.layers.9.self_attn.k_proj.weight_zero_point', 'talker.model.layers.9.self_attn.o_proj .input_global_scale', 'talker.model.layers.9.self_attn.o_proj.input_zero_point', 'talker.model.layers.9.self_attn.o_pro j.weight_global_scale', 'talker.model.layers.9.self_attn.o_proj.weight_scale', 'talker.model.layers.9.self_attn.o_proj. weight_zero_point', 'talker.model.layers.9.self_attn.q_proj.input_global_scale', 'talker.model.layers.9.self_attn.q_pro j.input_zero_point', 'talker.model.layers.9.self_attn.q_proj.weight_global_scale', 'talker.model.layers.9.self_attn.q_p roj.weight_scale', 'talker.model.layers.9.self_attn.q_proj.weight_zero_point', 'talker.model.layers.9.self_attn.v_proj. input_global_scale', 'talker.model.layers.9.self_attn.v_proj.input_zero_point', 'talker.model.layers.9.self_attn.v_proj .weight_global_scale', 'talker.model.layers.9.self_attn.v_proj.weight_scale', 'talker.model.layers.9.self_attn.v_proj.w eight_zero_point', 'talker.text_projection.linear_fc1.input_global_scale', 'talker.text_projection.linear_fc1.input_zer o_point', 'talker.text_projection.linear_fc1.weight_global_scale', 'talker.text_projection.linear_fc1.weight_scale', 't alker.text_projection.linear_fc1.weight_zero_point', 'talker.text_projection.linear_fc2.input_global_scale', 'talker.te xt_projection.linear_fc2.input_zero_point', 'talker.text_projection.linear_fc2.weight_global_scale', 'talker.text_proje ction.linear_fc2.weight_scale', 'talker.text_projection.linear_fc2.weight_zero_point'] - This IS expected if you are initializing Qwen3TTSForConditionalGeneration from the checkpoint of a model trained on a nother task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTrai ning model). - This IS NOT expected if you are initializing Qwen3TTSForConditionalGeneration from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassificatio n model). The tokenizer you are loading from 'D:\Git_Work\jarvis_taemin\models\Qwen3-TTS-NVFP4' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix th is issue. * Tip: There are .env files present. Install python-dotenv to use them. ================================================================ Orpheus (오르페우스) - Imperial Voice: Windows Native TTS Server ================================================================ ******** Warning: flash-attn is not installed. Will only run the manual PyTorch version. Please install flash-attn for faster inference. ******** [*] Loading model from: D:\Git_Work\jarvis_taemin\models\Qwen3-TTS-NVFP4 [*] Torch dtype selected: torch.bfloat16 [*] Post-load Weight Surgery: Syncing 15 heads into lm_head_fused... [*] Weight Surgery: Fused Head Synced Successfully. ✅ Model ready! (Qwen3-TTS-NVFP4) [*] Orpheus listening on port 8000... * Serving Flask app 'orpheus_server' * Debug mode: off WARNING: This is a development server. Do not use it in a production deployment. Use a production WSGI server instead. * Running on all addresses (0.0.0.0) * Running on http://127.0.0.1:8000 * Running on http://192.168.0.71:8000 Press CTRL+C to quit