model_worker_32af3b.log

2024-09-30 05:18:41 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40000, worker_address='http://localhost:40000', controller_address='http://localhost:20001', model_path='/home/jack/Projects/yixin-llm/merge_med_llava_3', model_base=None, model_name=None, device='cuda', multi_modal=False, limit_model_concurrency=5, stream_interval=1, no_register=False, load_8bit=False, load_4bit=False)
2024-09-30 05:18:41 | INFO | model_worker | Loading the model merge_med_llava_3 on worker 32af3b ...
2024-09-30 05:18:41 | WARNING | transformers.models.llama.tokenization_llama | You are using the legacy behaviour of the <class 'transformers.models.llama.tokenization_llama.LlamaTokenizer'>. This means that tokens that come after special tokens will not be properly handled. We recommend you to read the related pull request available at https://github.com/huggingface/transformers/pull/24565
2024-09-30 05:18:42 | ERROR | stderr | /home/jack/anaconda3/envs/llavaplus/lib/python3.10/site-packages/huggingface_hub/file_download.py:1132: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2024-09-30 05:18:42 | ERROR | stderr |   warnings.warn(
2024-09-30 05:18:42 | ERROR | stderr | 
Loading checkpoint shards:   0%|                                                                                                | 0/2 [00:00<?, ?it/s]
2024-09-30 05:18:49 | ERROR | stderr | 
Loading checkpoint shards:  50%|████████████████████████████████████████████                                            | 1/2 [00:06<00:06,  6.54s/it]
2024-09-30 05:18:51 | ERROR | stderr | 
Loading checkpoint shards: 100%|████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:08<00:00,  3.92s/it]
2024-09-30 05:18:51 | ERROR | stderr | 
Loading checkpoint shards: 100%|████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:08<00:00,  4.32s/it]
2024-09-30 05:18:51 | ERROR | stderr | 
2024-09-30 05:18:53 | INFO | model_worker | Register to controller
2024-09-30 05:18:53 | ERROR | stderr | INFO:     Started server process [1085653]
2024-09-30 05:18:53 | ERROR | stderr | INFO:     Waiting for application startup.
2024-09-30 05:18:53 | ERROR | stderr | INFO:     Application startup complete.
2024-09-30 05:18:53 | ERROR | stderr | INFO:     Uvicorn running on http://0.0.0.0:40000 (Press CTRL+C to quit)
2024-09-30 05:19:08 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:19:23 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:19:38 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:19:53 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:20:08 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:20:23 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:20:38 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:20:53 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:21:08 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:21:23 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:21:39 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:21:54 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:22:09 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:22:24 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:22:39 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:22:54 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:23:09 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:23:24 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:23:39 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:23:54 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:24:09 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:24:24 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:24:39 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:24:54 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:25:09 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:25:24 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:25:39 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:25:54 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:26:09 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:26:24 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:26:39 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:26:54 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:27:09 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:27:24 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:27:39 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:27:54 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:28:09 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:28:24 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:28:39 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:28:54 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:29:09 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:29:24 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:29:39 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:29:54 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:30:09 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:30:24 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:30:39 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:30:54 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:31:09 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:31:24 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:31:39 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:31:54 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:32:09 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:32:24 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:32:39 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:32:55 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:33:10 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:33:25 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:33:40 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:33:55 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:34:10 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:34:25 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:34:40 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:34:55 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:35:10 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:35:25 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:35:40 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:35:55 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:36:10 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:36:25 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:36:40 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:36:55 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:37:10 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:37:25 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:37:40 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:37:55 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:38:10 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:38:25 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:38:40 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:38:55 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:39:10 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:39:25 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:39:40 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:39:55 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:40:10 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:40:25 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:40:40 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:40:55 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:41:10 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:41:25 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:41:40 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:41:55 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:42:10 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:42:25 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:42:40 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:42:55 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:43:10 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:43:25 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:43:40 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:43:56 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:44:11 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:44:26 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:44:41 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:44:56 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:45:11 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:45:26 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:45:41 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:45:56 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:46:11 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:46:26 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:46:41 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:46:56 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:47:11 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:47:26 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:47:41 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:47:56 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:48:11 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:48:26 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:48:41 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:48:56 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:49:11 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:49:26 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:49:41 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:49:56 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:50:11 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:50:26 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:50:41 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:50:56 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:51:11 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:51:26 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:51:41 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:51:56 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:51:59 | INFO | stdout | INFO:     127.0.0.1:54774 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 05:52:11 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:52:26 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:52:41 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:52:56 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:53:01 | INFO | stdout | INFO:     127.0.0.1:52490 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 05:53:11 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:53:26 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:53:41 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:53:56 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 05:53:57 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
2024-09-30 05:53:57 | INFO | stdout | INFO:     127.0.0.1:60234 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-09-30 05:53:57 | ERROR | stderr | /home/jack/anaconda3/envs/llavaplus/lib/python3.10/site-packages/transformers/generation/utils.py:1270: UserWarning: You have modified the pretrained model configuration to control generation. This is a deprecated strategy to control generation and will be removed soon, in a future version. Please use a generation configuration file (see https://huggingface.co/docs/transformers/main_classes/text_generation )
2024-09-30 05:53:57 | ERROR | stderr |   warnings.warn(
2024-09-30 05:54:00 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-09-30 05:54:09 | INFO | stdout | INFO:     127.0.0.1:37086 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 05:54:11 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-09-30 05:54:26 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-09-30 05:54:41 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-09-30 05:54:57 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-09-30 05:55:12 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-09-30 05:55:27 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-09-30 05:55:42 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-09-30 05:55:57 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-09-30 05:56:12 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-09-30 05:56:27 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-09-30 05:56:42 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-09-30 05:56:57 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-09-30 05:57:12 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-09-30 05:57:27 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-09-30 05:57:42 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-09-30 05:57:57 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-09-30 05:58:12 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-09-30 05:58:27 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-09-30 05:58:42 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-09-30 05:58:57 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-09-30 05:59:08 | INFO | stdout | INFO:     127.0.0.1:42876 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 05:59:12 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-09-30 05:59:27 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-09-30 05:59:42 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-09-30 05:59:57 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-09-30 06:00:12 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-09-30 06:00:27 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-09-30 06:00:42 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-09-30 06:00:57 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-09-30 06:01:05 | INFO | stdout | INFO:     127.0.0.1:43058 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 06:01:12 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-09-30 06:01:25 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2
2024-09-30 06:01:25 | INFO | stdout | INFO:     127.0.0.1:42338 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-09-30 06:01:27 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2
2024-09-30 06:01:28 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 06:01:37 | INFO | stdout | INFO:     127.0.0.1:33060 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 06:01:42 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 06:01:57 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 06:02:12 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 06:02:27 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 06:02:42 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 06:02:57 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 06:03:12 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 06:03:15 | INFO | stdout | INFO:     127.0.0.1:59158 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 06:03:27 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 06:03:42 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 06:03:55 | INFO | stdout | INFO:     127.0.0.1:49962 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 06:03:57 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 06:04:08 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=4, locked=False). global_counter: 3
2024-09-30 06:04:08 | INFO | stdout | INFO:     127.0.0.1:33810 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-09-30 06:04:11 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-09-30 06:04:12 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-09-30 06:04:20 | INFO | stdout | INFO:     127.0.0.1:47404 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 06:04:27 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-09-30 06:04:42 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-09-30 06:04:57 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-09-30 06:05:12 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-09-30 06:05:27 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-09-30 06:05:42 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-09-30 06:05:57 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-09-30 06:06:13 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-09-30 06:06:28 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-09-30 06:06:43 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-09-30 06:06:58 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-09-30 06:07:13 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-09-30 06:07:28 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-09-30 06:07:43 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-09-30 06:07:58 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-09-30 06:08:13 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-09-30 06:08:28 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-09-30 06:08:43 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-09-30 06:08:58 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-09-30 06:09:13 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-09-30 06:09:28 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-09-30 06:09:43 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-09-30 06:09:58 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-09-30 06:10:13 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-09-30 06:10:28 | INFO | stdout | INFO:     127.0.0.1:55000 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 06:10:28 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-09-30 06:10:32 | INFO | stdout | INFO:     127.0.0.1:55012 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 06:10:43 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-09-30 06:10:44 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=4, locked=False). global_counter: 4
2024-09-30 06:10:44 | INFO | stdout | INFO:     127.0.0.1:33568 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-09-30 06:10:47 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 06:10:56 | INFO | stdout | INFO:     127.0.0.1:50950 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 06:10:58 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 06:11:13 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 06:11:28 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 06:11:43 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 06:11:58 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 06:12:13 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 06:12:19 | INFO | stdout | INFO:     127.0.0.1:57658 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 06:12:23 | INFO | stdout | INFO:     127.0.0.1:57668 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 06:12:28 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 06:12:34 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=4, locked=False). global_counter: 5
2024-09-30 06:12:34 | INFO | stdout | INFO:     127.0.0.1:38168 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-09-30 06:12:37 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
2024-09-30 06:12:43 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
2024-09-30 06:12:46 | INFO | stdout | INFO:     127.0.0.1:55452 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 06:12:58 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
2024-09-30 06:13:13 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
2024-09-30 06:13:28 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
2024-09-30 06:13:43 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
2024-09-30 06:13:58 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
2024-09-30 06:14:13 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
2024-09-30 06:14:28 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
2024-09-30 06:14:43 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
2024-09-30 06:14:58 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
2024-09-30 06:15:13 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
2024-09-30 06:15:28 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
2024-09-30 06:15:43 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
2024-09-30 06:15:58 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
2024-09-30 06:16:13 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
2024-09-30 06:16:28 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
2024-09-30 06:16:43 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
2024-09-30 06:16:58 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
2024-09-30 06:17:13 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
2024-09-30 06:17:29 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
2024-09-30 06:17:44 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
2024-09-30 06:17:59 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
2024-09-30 06:18:14 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
2024-09-30 06:18:29 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
2024-09-30 06:18:44 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
2024-09-30 06:18:59 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
2024-09-30 06:19:14 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
2024-09-30 06:19:29 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
2024-09-30 06:19:44 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
2024-09-30 06:19:59 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
2024-09-30 06:20:14 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
2024-09-30 06:20:14 | INFO | stdout | INFO:     127.0.0.1:44322 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 06:20:20 | INFO | stdout | INFO:     127.0.0.1:37182 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 06:20:29 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
2024-09-30 06:20:34 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=4, locked=False). global_counter: 6
2024-09-30 06:20:34 | INFO | stdout | INFO:     127.0.0.1:43578 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-09-30 06:20:37 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 6
2024-09-30 06:20:44 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 6
2024-09-30 06:20:46 | INFO | stdout | INFO:     127.0.0.1:38210 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 06:20:59 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 6
2024-09-30 06:21:14 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 6
2024-09-30 06:21:29 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 6
2024-09-30 06:21:44 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 6
2024-09-30 06:21:59 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 6
2024-09-30 06:22:14 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 6
2024-09-30 06:22:29 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 6
2024-09-30 06:22:44 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 6
2024-09-30 06:22:59 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 6
2024-09-30 06:23:14 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 6
2024-09-30 06:23:29 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 6
2024-09-30 06:23:44 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 6
2024-09-30 06:23:59 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 6
2024-09-30 06:24:08 | INFO | stdout | INFO:     127.0.0.1:53114 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 06:24:14 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 6
2024-09-30 06:24:20 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=4, locked=False). global_counter: 7
2024-09-30 06:24:20 | INFO | stdout | INFO:     127.0.0.1:43806 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-09-30 06:24:23 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 7
2024-09-30 06:24:29 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 7
2024-09-30 06:24:32 | INFO | stdout | INFO:     127.0.0.1:42110 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 06:24:44 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 7
2024-09-30 06:24:59 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 7
2024-09-30 06:25:14 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 7
2024-09-30 06:25:29 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 7
2024-09-30 06:25:44 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 7
2024-09-30 06:25:59 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 7
2024-09-30 06:26:14 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 7
2024-09-30 06:26:29 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 7
2024-09-30 06:26:44 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 7
2024-09-30 06:26:59 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 7
2024-09-30 06:27:14 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 7
2024-09-30 06:27:27 | INFO | stdout | INFO:     127.0.0.1:54168 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 06:27:29 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 7
2024-09-30 06:27:38 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=4, locked=False). global_counter: 8
2024-09-30 06:27:38 | INFO | stdout | INFO:     127.0.0.1:54860 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-09-30 06:27:41 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-09-30 06:27:44 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-09-30 06:27:50 | INFO | stdout | INFO:     127.0.0.1:46160 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 06:27:59 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-09-30 06:28:14 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-09-30 06:28:29 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-09-30 06:28:45 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-09-30 06:29:00 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-09-30 06:29:15 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-09-30 06:29:30 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-09-30 06:29:45 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-09-30 06:30:00 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-09-30 06:30:15 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-09-30 06:30:30 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-09-30 06:30:45 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-09-30 06:30:46 | INFO | stdout | INFO:     127.0.0.1:55942 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 06:31:00 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=4, locked=False). global_counter: 9
2024-09-30 06:31:00 | INFO | stdout | INFO:     127.0.0.1:47572 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-09-30 06:31:00 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=4, locked=False). global_counter: 9
2024-09-30 06:31:03 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
2024-09-30 06:31:12 | INFO | stdout | INFO:     127.0.0.1:35650 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 06:31:15 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
2024-09-30 06:31:30 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
2024-09-30 06:31:45 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
2024-09-30 06:32:00 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
2024-09-30 06:32:15 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
2024-09-30 06:32:30 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
2024-09-30 06:32:45 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
2024-09-30 06:33:00 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
2024-09-30 06:33:15 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
2024-09-30 06:33:26 | INFO | stdout | INFO:     127.0.0.1:50742 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 06:33:30 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
2024-09-30 06:33:37 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=4, locked=False). global_counter: 10
2024-09-30 06:33:37 | INFO | stdout | INFO:     127.0.0.1:46858 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-09-30 06:33:40 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
2024-09-30 06:33:45 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
2024-09-30 06:33:49 | INFO | stdout | INFO:     127.0.0.1:57480 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 06:34:00 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
2024-09-30 06:34:15 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
2024-09-30 06:34:30 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
2024-09-30 06:34:45 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
2024-09-30 06:35:00 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
2024-09-30 06:35:15 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
2024-09-30 06:35:30 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
2024-09-30 06:35:45 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
2024-09-30 06:36:00 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
2024-09-30 06:36:15 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
2024-09-30 06:36:30 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
2024-09-30 06:36:45 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
2024-09-30 06:37:00 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
2024-09-30 06:37:15 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
2024-09-30 06:37:30 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
2024-09-30 06:37:45 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
2024-09-30 06:37:59 | INFO | stdout | INFO:     127.0.0.1:43336 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 06:38:00 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
2024-09-30 06:38:11 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=4, locked=False). global_counter: 11
2024-09-30 06:38:11 | INFO | stdout | INFO:     127.0.0.1:43516 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-09-30 06:38:14 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 11
2024-09-30 06:38:15 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 11
2024-09-30 06:38:23 | INFO | stdout | INFO:     127.0.0.1:38400 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 06:38:30 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 11
2024-09-30 06:38:45 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 11
2024-09-30 06:39:00 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 11
2024-09-30 06:39:15 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 11
2024-09-30 06:39:30 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 11
2024-09-30 06:39:45 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 11
2024-09-30 06:40:00 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 11
2024-09-30 06:40:15 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 11
2024-09-30 06:40:31 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 11
2024-09-30 06:40:46 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 11
2024-09-30 06:41:01 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 11
2024-09-30 06:41:16 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 11
2024-09-30 06:41:31 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 11
2024-09-30 06:41:46 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 11
2024-09-30 06:41:46 | INFO | stdout | INFO:     127.0.0.1:51544 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 06:41:57 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=4, locked=False). global_counter: 12
2024-09-30 06:41:57 | INFO | stdout | INFO:     127.0.0.1:51382 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-09-30 06:42:00 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 12
2024-09-30 06:42:01 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 12
2024-09-30 06:42:09 | INFO | stdout | INFO:     127.0.0.1:43582 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 06:42:16 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 12
2024-09-30 06:42:31 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 12
2024-09-30 06:42:46 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 12
2024-09-30 06:43:01 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 12
2024-09-30 06:43:16 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 12
2024-09-30 06:43:31 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 12
2024-09-30 06:43:46 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 12
2024-09-30 06:43:58 | INFO | stdout | INFO:     127.0.0.1:40124 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 06:44:01 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 12
2024-09-30 06:44:16 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 12
2024-09-30 06:44:19 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=4, locked=False). global_counter: 13
2024-09-30 06:44:19 | INFO | stdout | INFO:     127.0.0.1:34882 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-09-30 06:44:22 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 13
2024-09-30 06:44:31 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 13
2024-09-30 06:44:31 | INFO | stdout | INFO:     127.0.0.1:45996 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 06:44:46 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 13
2024-09-30 06:45:01 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 13
2024-09-30 06:45:16 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 13
2024-09-30 06:45:31 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 13
2024-09-30 06:45:46 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 13
2024-09-30 06:46:01 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 13
2024-09-30 06:46:16 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 13
2024-09-30 06:46:31 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 13
2024-09-30 06:46:43 | INFO | stdout | INFO:     127.0.0.1:42276 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 06:46:46 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 13
2024-09-30 06:46:55 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=4, locked=False). global_counter: 14
2024-09-30 06:46:55 | INFO | stdout | INFO:     127.0.0.1:43468 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-09-30 06:46:58 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 14
2024-09-30 06:47:01 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 14
2024-09-30 06:47:07 | INFO | stdout | INFO:     127.0.0.1:54062 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 06:47:16 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 14
2024-09-30 06:47:31 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 14
2024-09-30 06:47:46 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 14
2024-09-30 06:48:01 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 14
2024-09-30 06:48:16 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 14
2024-09-30 06:48:31 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 14
2024-09-30 06:48:46 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 14
2024-09-30 06:49:01 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 14
2024-09-30 06:49:16 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 14
2024-09-30 06:49:31 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 14
2024-09-30 06:49:46 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 14
2024-09-30 06:50:01 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 14
2024-09-30 06:50:16 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 14
2024-09-30 06:50:31 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 14
2024-09-30 06:50:46 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 14
2024-09-30 06:50:55 | INFO | stdout | INFO:     127.0.0.1:36010 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 06:51:01 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 14
2024-09-30 06:51:16 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 14
2024-09-30 06:51:25 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=4, locked=False). global_counter: 15
2024-09-30 06:51:25 | INFO | stdout | INFO:     127.0.0.1:33438 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-09-30 06:51:28 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 15
2024-09-30 06:51:31 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 15
2024-09-30 06:51:37 | INFO | stdout | INFO:     127.0.0.1:50714 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 06:51:46 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 15
2024-09-30 06:52:01 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 15
2024-09-30 06:52:17 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 15
2024-09-30 06:52:32 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 15
2024-09-30 06:52:47 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 15
2024-09-30 06:53:02 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 15
2024-09-30 06:53:17 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 15
2024-09-30 06:53:32 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 15
2024-09-30 06:53:47 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 15
2024-09-30 06:54:02 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 15
2024-09-30 06:54:17 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 15
2024-09-30 06:54:32 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 15
2024-09-30 06:54:47 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 15
2024-09-30 06:55:02 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 15
2024-09-30 06:55:17 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 15
2024-09-30 06:55:32 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 15
2024-09-30 06:55:47 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 15
2024-09-30 06:56:02 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 15
2024-09-30 06:56:03 | INFO | stdout | INFO:     127.0.0.1:34458 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 06:56:15 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=4, locked=False). global_counter: 16
2024-09-30 06:56:15 | INFO | stdout | INFO:     127.0.0.1:51234 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-09-30 06:56:17 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=4, locked=False). global_counter: 16
2024-09-30 06:56:17 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 16
2024-09-30 06:56:27 | INFO | stdout | INFO:     127.0.0.1:42860 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 06:56:32 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 16
2024-09-30 06:56:47 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 16
2024-09-30 06:57:02 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 16
2024-09-30 06:57:17 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 16
2024-09-30 06:57:32 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 16
2024-09-30 06:57:47 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 16
2024-09-30 06:58:02 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 16
2024-09-30 06:58:17 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 16
2024-09-30 06:58:32 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 16
2024-09-30 06:58:47 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 16
2024-09-30 06:59:02 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 16
2024-09-30 06:59:17 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 16
2024-09-30 06:59:32 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 16
2024-09-30 06:59:47 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 16
2024-09-30 07:00:02 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 16
2024-09-30 07:00:17 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 16
2024-09-30 07:00:32 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 16
2024-09-30 07:00:47 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 16
2024-09-30 07:01:02 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 16
2024-09-30 07:01:17 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 16
2024-09-30 07:01:32 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 16
2024-09-30 07:01:47 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 16
2024-09-30 07:02:02 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 16
2024-09-30 07:02:17 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 16
2024-09-30 07:02:32 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 16
2024-09-30 07:02:47 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 16
2024-09-30 07:03:02 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 16
2024-09-30 07:03:17 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 16
2024-09-30 07:03:33 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 16
2024-09-30 07:03:48 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 16
2024-09-30 07:03:55 | INFO | stdout | INFO:     127.0.0.1:34402 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 07:04:03 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 16
2024-09-30 07:04:09 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=4, locked=False). global_counter: 17
2024-09-30 07:04:09 | INFO | stdout | INFO:     127.0.0.1:46130 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-09-30 07:04:12 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 17
2024-09-30 07:04:18 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 17
2024-09-30 07:04:21 | INFO | stdout | INFO:     127.0.0.1:49110 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 07:04:33 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 17
2024-09-30 07:04:48 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 17
2024-09-30 07:05:03 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 17
2024-09-30 07:05:18 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 17
2024-09-30 07:05:33 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 17
2024-09-30 07:05:48 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 17
2024-09-30 07:06:03 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 17
2024-09-30 07:06:18 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 17
2024-09-30 07:06:33 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 17
2024-09-30 07:06:48 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 17
2024-09-30 07:07:03 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 17
2024-09-30 07:07:18 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 17
2024-09-30 07:07:33 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 17
2024-09-30 07:07:48 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 17
2024-09-30 07:08:03 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 17
2024-09-30 07:08:18 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 17
2024-09-30 07:08:33 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 17
2024-09-30 07:08:48 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 17
2024-09-30 07:09:03 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 17
2024-09-30 07:09:18 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 17
2024-09-30 07:09:33 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 17
2024-09-30 07:09:48 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 17
2024-09-30 07:10:03 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 17
2024-09-30 07:10:18 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 17
2024-09-30 07:10:33 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 17
2024-09-30 07:10:48 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 17
2024-09-30 07:11:03 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 17
2024-09-30 07:11:18 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 17
2024-09-30 07:11:33 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 17
2024-09-30 07:11:48 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 17
2024-09-30 07:12:01 | INFO | stdout | INFO:     127.0.0.1:40072 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 07:12:03 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 17
2024-09-30 07:12:13 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=4, locked=False). global_counter: 18
2024-09-30 07:12:13 | INFO | stdout | INFO:     127.0.0.1:53204 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-09-30 07:12:16 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:12:18 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:12:24 | INFO | stdout | INFO:     127.0.0.1:56870 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 07:12:33 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:12:48 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:13:03 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:13:18 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:13:33 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:13:48 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:14:03 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:14:18 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:14:33 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:14:48 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:15:04 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:15:19 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:15:34 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:15:49 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:16:04 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:16:19 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:16:34 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:16:49 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:17:04 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:17:19 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:17:34 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:17:49 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:18:03 | INFO | stdout | INFO:     127.0.0.1:34726 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 07:18:04 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:18:09 | INFO | stdout | INFO:     127.0.0.1:35532 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 07:18:19 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:18:34 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:18:49 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:19:04 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:19:19 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:19:34 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:19:49 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:20:04 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:20:19 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:20:34 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:20:49 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:21:04 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:21:16 | INFO | stdout | INFO:     127.0.0.1:51920 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 07:21:19 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:21:32 | INFO | stdout | INFO:     127.0.0.1:36078 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 07:21:34 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:21:49 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:22:04 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:22:19 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:22:34 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:22:49 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:23:04 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:23:19 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:23:34 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:23:49 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:24:04 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:24:19 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:24:34 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:24:49 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:25:04 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:25:19 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:25:34 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:25:49 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:26:05 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:26:14 | INFO | stdout | INFO:     127.0.0.1:37256 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 07:26:20 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:26:35 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:26:37 | INFO | stdout | INFO:     127.0.0.1:51240 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 07:26:50 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:27:05 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:27:20 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 18
2024-09-30 07:27:22 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=4, locked=False). global_counter: 19
2024-09-30 07:27:22 | INFO | stdout | INFO:     127.0.0.1:34550 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-09-30 07:27:25 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 19
2024-09-30 07:27:34 | INFO | stdout | INFO:     127.0.0.1:52656 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 07:27:35 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 19
2024-09-30 07:27:50 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 19
2024-09-30 07:28:05 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 19
2024-09-30 07:28:20 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 19
2024-09-30 07:28:35 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 19
2024-09-30 07:28:50 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 19
2024-09-30 07:29:05 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 19
2024-09-30 07:29:20 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 19
2024-09-30 07:29:35 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 19
2024-09-30 07:29:48 | INFO | stdout | INFO:     127.0.0.1:59596 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 07:29:50 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 19
2024-09-30 07:30:05 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 19
2024-09-30 07:30:13 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=4, locked=False). global_counter: 20
2024-09-30 07:30:13 | INFO | stdout | INFO:     127.0.0.1:46352 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-09-30 07:30:16 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 20
2024-09-30 07:30:20 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 20
2024-09-30 07:30:26 | INFO | stdout | INFO:     127.0.0.1:38064 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 07:30:35 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 20
2024-09-30 07:30:50 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 20
2024-09-30 07:31:05 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 20
2024-09-30 07:31:20 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 20
2024-09-30 07:31:35 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 20
2024-09-30 07:31:50 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 20
2024-09-30 07:32:05 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 20
2024-09-30 07:32:20 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 20
2024-09-30 07:32:35 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 20
2024-09-30 07:32:50 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 20
2024-09-30 07:33:05 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 20
2024-09-30 07:33:20 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 20
2024-09-30 07:33:35 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 20
2024-09-30 07:33:50 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 20
2024-09-30 07:34:05 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 20
2024-09-30 07:34:20 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 20
2024-09-30 07:34:35 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 20
2024-09-30 07:34:50 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 20
2024-09-30 07:35:04 | INFO | stdout | INFO:     127.0.0.1:34986 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 07:35:05 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 20
2024-09-30 07:35:16 | INFO | stdout | INFO:     127.0.0.1:53162 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 07:35:20 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 20
2024-09-30 07:35:35 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 20
2024-09-30 07:35:36 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=4, locked=False). global_counter: 21
2024-09-30 07:35:36 | INFO | stdout | INFO:     127.0.0.1:33088 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-09-30 07:35:38 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:35:48 | INFO | stdout | INFO:     127.0.0.1:50222 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 07:35:50 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:36:05 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:36:20 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:36:35 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:36:50 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:37:05 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:37:21 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:37:36 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:37:51 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:38:06 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:38:21 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:38:36 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:38:51 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:39:06 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:39:21 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:39:36 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:39:51 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:40:06 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:40:21 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:40:36 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:40:51 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:41:06 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:41:21 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:41:36 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:41:51 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:42:06 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:42:21 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:42:36 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:42:51 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:43:06 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:43:21 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:43:36 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:43:51 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:44:06 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:44:21 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:44:36 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:44:51 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:45:06 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:45:21 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:45:36 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:45:51 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:46:06 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:46:21 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:46:36 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:46:51 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:47:06 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:47:21 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:47:36 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:47:51 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:48:06 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:48:21 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:48:36 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:48:52 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:49:07 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:49:22 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:49:37 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:49:52 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:50:07 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:50:22 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:50:37 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:50:51 | INFO | stdout | INFO:     127.0.0.1:41646 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 07:50:52 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:51:07 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 21
2024-09-30 07:51:13 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=4, locked=False). global_counter: 22
2024-09-30 07:51:13 | INFO | stdout | INFO:     127.0.0.1:37198 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-09-30 07:51:16 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 07:51:22 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 07:51:25 | INFO | stdout | INFO:     127.0.0.1:48006 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 07:51:37 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 07:51:52 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 07:52:07 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 07:52:22 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 07:52:37 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 07:52:52 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 07:53:07 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 07:53:22 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 07:53:37 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 07:53:52 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 07:54:07 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 07:54:22 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 07:54:37 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 07:54:52 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 07:55:07 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 07:55:22 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 07:55:37 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 07:55:52 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 07:56:07 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 07:56:22 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 07:56:37 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 07:56:52 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 07:57:07 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 07:57:22 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 07:57:37 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 07:57:52 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 07:58:07 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 07:58:22 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 07:58:37 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 07:58:52 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 07:59:07 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 07:59:22 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 07:59:37 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 07:59:52 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 08:00:07 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 08:00:23 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 08:00:38 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 08:00:53 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 08:01:08 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 08:01:23 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 08:01:38 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 08:01:53 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 08:02:08 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 08:02:23 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 08:02:38 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 08:02:53 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 08:03:08 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 08:03:23 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 08:03:38 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 08:03:53 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 08:04:08 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 08:04:23 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 08:04:38 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 08:04:53 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 08:05:08 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 08:05:13 | INFO | stdout | INFO:     127.0.0.1:47200 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 08:05:23 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 08:05:38 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 22
2024-09-30 08:05:49 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=4, locked=False). global_counter: 23
2024-09-30 08:05:49 | INFO | stdout | INFO:     127.0.0.1:55362 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-09-30 08:05:52 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:05:53 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:06:01 | INFO | stdout | INFO:     127.0.0.1:48916 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 08:06:08 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:06:23 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:06:38 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:06:53 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:07:08 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:07:23 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:07:38 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:07:53 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:08:08 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:08:23 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:08:38 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:08:53 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:09:08 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:09:23 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:09:38 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:09:53 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:10:08 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:10:23 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:10:38 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:10:53 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:11:08 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:11:23 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:11:38 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:11:54 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:12:09 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:12:24 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:12:39 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:12:54 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:13:09 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:13:24 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:13:39 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:13:54 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:14:09 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:14:24 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:14:39 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:14:54 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:15:09 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:15:24 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:15:39 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:15:54 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:16:09 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:16:24 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:16:39 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:16:54 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:17:09 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:17:24 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:17:39 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:17:54 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:18:09 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:18:24 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:18:39 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:18:54 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:19:09 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:19:24 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:19:39 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:19:54 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:20:09 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:20:24 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:20:39 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:20:54 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:21:09 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:21:24 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:21:39 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:21:54 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:22:09 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:22:24 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:22:39 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:22:54 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:23:09 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:23:24 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:23:40 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:23:55 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:24:10 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:24:25 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:24:40 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:24:55 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:25:10 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:25:25 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:25:40 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:25:55 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:26:10 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:26:25 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:26:40 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:26:55 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:27:10 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:27:25 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:27:40 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:27:55 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:28:10 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:28:25 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:28:40 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:28:55 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:29:10 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:29:25 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:29:40 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:29:55 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:30:10 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:30:25 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:30:40 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:30:55 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:31:10 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:31:25 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:31:40 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:31:55 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:32:10 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:32:25 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:32:40 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:32:55 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:33:10 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:33:25 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:33:40 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:33:55 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:34:10 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:34:25 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:34:40 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:34:55 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:35:11 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:35:26 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:35:41 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:35:56 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:36:11 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:36:26 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:36:41 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:36:56 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:37:11 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:37:26 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:37:41 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:37:56 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:38:11 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:38:26 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:38:41 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:38:56 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:39:11 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:39:26 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:39:41 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:39:56 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:40:11 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:40:26 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:40:41 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:40:56 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23
2024-09-30 08:41:11 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 23