Upload folder using huggingface_hub

inference_20250107_180941.log

@@ -0,0 +1,34 @@
+2025-01-07 18:09:41,871 - INFO - Starting processing with 8 threads
+2025-01-07 18:09:42,547 - INFO - Loaded 10 rows from data/lmsys1m_hf_inference_api.parquet
+2025-01-07 18:09:42,549 - INFO - Processing row 1e53daaab9254029b805bde43e19ce2a with model mistralai/Mixtral-8x7B-Instruct-v0.1
+2025-01-07 18:09:42,550 - INFO - Processing row 34df72c91a3e40e0a51700daf90ed505 with model Qwen/Qwen2.5-72B-Instruct
+2025-01-07 18:09:42,551 - INFO - Processing row a641e9b4115145cebc9fd93f3208b113 with model meta-llama/Llama-3.1-70B-Instruct
+2025-01-07 18:09:42,553 - INFO - Processing row 7c5ada6db2cf4b78900c8d5ad20bbc12 with model 01-ai/Yi-1.5-34B-Chat
+2025-01-07 18:09:42,555 - INFO - Processing row d9410fd37ce54135a4c6e7a808ef037f with model mistralai/Mixtral-8x7B-Instruct-v0.1
+2025-01-07 18:09:42,556 - INFO - Processing row 8d572e08959a4bdb8afc60ee6ef19470 with model meta-llama/Llama-3.3-70B-Instruct
+2025-01-07 18:09:42,557 - INFO - Processing row 3dab91e72476451db0b4a6cd7610d0bc with model meta-llama/Llama-3.1-70B-Instruct
+2025-01-07 18:09:42,558 - INFO - Processing row b12c5aadf1774d68a57090d115c04091 with model Qwen/Qwen2.5-72B-Instruct
+2025-01-07 18:09:42,595 - INFO - Completed row 7c5ada6db2cf4b78900c8d5ad20bbc12 in 0.04s using 01-ai/Yi-1.5-34B-Chat
+2025-01-07 18:09:43,596 - INFO - Processing row 0274a35d3c45462c95ba6f68d9c03c9a with model Qwen/QwQ-32B-Preview
+2025-01-07 18:09:43,597 - INFO - Progress: 1/10 rows completed
+2025-01-07 18:09:43,606 - INFO - Completed row 0274a35d3c45462c95ba6f68d9c03c9a in 0.01s using Qwen/QwQ-32B-Preview
+2025-01-07 18:09:44,257 - INFO - Completed row 8d572e08959a4bdb8afc60ee6ef19470 in 1.70s using meta-llama/Llama-3.3-70B-Instruct
+2025-01-07 18:09:44,607 - INFO - Processing row c129f9ddaea64668a7945254b47c0613 with model 01-ai/Yi-1.5-34B-Chat
+2025-01-07 18:09:44,608 - INFO - Progress: 2/10 rows completed
+2025-01-07 18:09:45,184 - INFO - Completed row c129f9ddaea64668a7945254b47c0613 in 0.58s using 01-ai/Yi-1.5-34B-Chat
+2025-01-07 18:09:45,259 - INFO - Progress: 3/10 rows completed
+2025-01-07 18:09:45,853 - INFO - Completed row d9410fd37ce54135a4c6e7a808ef037f in 3.30s using mistralai/Mixtral-8x7B-Instruct-v0.1
+2025-01-07 18:09:46,185 - INFO - Progress: 4/10 rows completed
+2025-01-07 18:09:46,854 - INFO - Progress: 5/10 rows completed
+2025-01-07 18:09:55,499 - INFO - Completed row 1e53daaab9254029b805bde43e19ce2a in 12.95s using mistralai/Mixtral-8x7B-Instruct-v0.1
+2025-01-07 18:09:56,501 - INFO - Progress: 6/10 rows completed
+2025-01-07 18:09:58,347 - INFO - Completed row b12c5aadf1774d68a57090d115c04091 in 15.79s using Qwen/Qwen2.5-72B-Instruct
+2025-01-07 18:09:59,348 - INFO - Progress: 7/10 rows completed
+2025-01-07 18:09:59,650 - INFO - Completed row 3dab91e72476451db0b4a6cd7610d0bc in 17.09s using meta-llama/Llama-3.1-70B-Instruct
+2025-01-07 18:10:00,651 - INFO - Progress: 8/10 rows completed
+2025-01-07 18:10:23,765 - INFO - Completed row 34df72c91a3e40e0a51700daf90ed505 in 41.22s using Qwen/Qwen2.5-72B-Instruct
+2025-01-07 18:10:24,766 - INFO - Progress: 9/10 rows completed
+2025-01-07 18:10:36,120 - INFO - Completed row a641e9b4115145cebc9fd93f3208b113 in 53.57s using meta-llama/Llama-3.1-70B-Instruct
+2025-01-07 18:10:37,121 - INFO - Progress: 10/10 rows completed
+2025-01-07 18:10:37,125 - INFO - Saved processed data to ./output/lmsys_1m_hf_first_20k.parquet
+2025-01-07 18:10:37,192 - WARNING - Note: Environment variable`HF_TOKEN` is set and is the current active token independently from the token you've just configured.

lmsys_1m_hf_first_20k.parquet

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:91519d44b3a9722fd2a13a35bf4c20723596ced56ff81ea9e805729f76cbe0f7
-size 17259
+oid sha256:c9f60dc5d9d653281af8ae05f937a1fc89004deb769b57a7753148ddf9f2af7d
+size 22045