runtime error
Exit code: 1. Reason: 00:00<00:00, 10.8MB/s] vocab.json: 0%| | 0.00/2.78M [00:00<?, ?B/s][A vocab.json: 100%|ββββββββββ| 2.78M/2.78M [00:00<00:00, 8.25MB/s] merges.txt: 0%| | 0.00/1.67M [00:00<?, ?B/s][A merges.txt: 100%|ββββββββββ| 1.67M/1.67M [00:00<00:00, 12.6MB/s] tokenizer.json: 0%| | 0.00/7.03M [00:00<?, ?B/s][A tokenizer.json: 100%|ββββββββββ| 7.03M/7.03M [00:00<00:00, 55.9MB/s] config.json: 0%| | 0.00/700 [00:00<?, ?B/s][A config.json: 100%|ββββββββββ| 700/700 [00:00<00:00, 4.95MB/s] model.safetensors: 0%| | 0.00/3.09G [00:00<?, ?B/s][A model.safetensors: 0%| | 2.75M/3.09G [00:01<26:33, 1.94MB/s][A model.safetensors: 2%|β | 69.8M/3.09G [00:03<01:56, 25.8MB/s][A model.safetensors: 15%|ββ | 472M/3.09G [00:04<00:20, 126MB/s] [A model.safetensors: 26%|βββ | 807M/3.09G [00:05<00:12, 178MB/s][A model.safetensors: 50%|βββββ | 1.55G/3.09G [00:07<00:04, 331MB/s][A model.safetensors: 93%|ββββββββββ| 2.89G/3.09G [00:08<00:00, 616MB/s][A model.safetensors: 100%|ββββββββββ| 3.09G/3.09G [00:08<00:00, 366MB/s] Traceback (most recent call last): File "/app/app.py", line 286, in <module> cad_recode = CADRecode.from_pretrained( File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 4124, in from_pretrained config = cls._autoset_attn_implementation( File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 1586, in _autoset_attn_implementation cls._check_and_enable_flash_attn_2( File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 1727, in _check_and_enable_flash_attn_2 raise ValueError( ValueError: FlashAttention2 has been toggled on, but it cannot be used due to the following error: Flash Attention 2 is not available on CPU. Please make sure torch can access a CUDA device.
Container logs:
Fetching error logs...