| DEPRECATED: The legacy builder is deprecated and will be removed in a future release. |
| Install the buildx component to build images with BuildKit: |
| https://docs.docker.com/go/buildx/ |
|
|
| Sending build context to Docker daemon 114.7kB
|
| Step 1/9 : ARG PYTORCH_IMAGE=pytorch/pytorch:2.6.0-cuda12.4-cudnn9-devel |
| Step 2/9 : FROM ${PYTORCH_IMAGE} |
| 2.6.0-cuda12.4-cudnn9-devel: Pulling from pytorch/pytorch |
| 0a5030f9ea59: Pulling fs layer |
| b71b637b97c5: Pulling fs layer |
| 7021d1b70935: Pulling fs layer |
| 312a542960e3: Pulling fs layer |
| fd9cc1ad8dee: Pulling fs layer |
| 47b8539d532f: Pulling fs layer |
| 4f4fb700ef54: Pulling fs layer |
| 56dc85502937: Pulling fs layer |
| 8e79813a7b9d: Pulling fs layer |
| 83525caeeb35: Pulling fs layer |
| 0d6448aff889: Pulling fs layer |
| ec6d5f6c9ed9: Pulling fs layer |
| 3e14b472177a: Pulling fs layer |
| e97dfafebbe6: Pulling fs layer |
| 0a7674e3e8fe: Pulling fs layer |
| b71b637b97c5: Download complete |
| 47b8539d532f: Download complete |
| 312a542960e3: Download complete |
| 83525caeeb35: Download complete |
| fd9cc1ad8dee: Download complete |
| 4f4fb700ef54: Download complete |
| 56dc85502937: Download complete |
| 0a5030f9ea59: Download complete |
| 3e14b472177a: Download complete |
| 0d6448aff889: Download complete |
| 7021d1b70935: Download complete |
| 7021d1b70935: Pull complete |
| 0d6448aff889: Pull complete |
| 0a7674e3e8fe: Download complete |
| 0a7674e3e8fe: Pull complete |
| b71b637b97c5: Pull complete |
| 56dc85502937: Pull complete |
| ec6d5f6c9ed9: Download complete |
| ec6d5f6c9ed9: Pull complete |
| 47b8539d532f: Pull complete |
| fd9cc1ad8dee: Pull complete |
| 83525caeeb35: Pull complete |
| 8e79813a7b9d: Download complete |
| e97dfafebbe6: Download complete |
| 312a542960e3: Pull complete |
| 3e14b472177a: Pull complete |
| 8e79813a7b9d: Pull complete |
| 4f4fb700ef54: Pull complete |
| e97dfafebbe6: Pull complete |
| 0a5030f9ea59: Pull complete |
| Digest: sha256:0cf3402e946b7c384ba943ee05c90b4c5a4a05227923921f2b0918c011cfaf56 |
| Status: Downloaded newer image for pytorch/pytorch:2.6.0-cuda12.4-cudnn9-devel |
| ---> 0cf3402e946b |
| Step 3/9 : ENV DEBIAN_FRONTEND=noninteractive |
| ---> Running in 763373b24589 |
| ---> Removed intermediate container 763373b24589 |
| ---> a0a6102cf64c |
| Step 4/9 : ENV PIP_DISABLE_PIP_VERSION_CHECK=1 |
| ---> Running in 801afd576ce4 |
| ---> Removed intermediate container 801afd576ce4 |
| ---> 56ed7d48bc3a |
| Step 5/9 : ENV PYTHONUNBUFFERED=1 |
| ---> Running in 4dd50a0920fe |
| ---> Removed intermediate container 4dd50a0920fe |
| ---> 7c45cea384bc |
| Step 6/9 : RUN apt-get update && apt-get install -y --no-install-recommends git curl ca-certificates && rm -rf /var/lib/apt/lists/* |
| ---> Running in a18056f16af6 |
| Get:1 http://archive.ubuntu.com/ubuntu jammy InRelease [270 kB] |
| Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] |
| Get:3 https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/x86_64 InRelease [1581 B] |
| Get:4 https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/x86_64 Packages [2482 kB] |
| Get:5 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] |
| Get:6 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] |
| Get:7 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [62.6 kB] |
| Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 Packages [1792 kB] |
| Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [6803 kB] |
| Get:10 http://archive.ubuntu.com/ubuntu jammy/multiverse amd64 Packages [266 kB] |
| Get:11 http://archive.ubuntu.com/ubuntu jammy/restricted amd64 Packages [164 kB] |
| Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 Packages [17.5 MB] |
| Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [4219 kB] |
| Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1622 kB] |
| Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [7125 kB] |
| Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [70.9 kB] |
| Get:17 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [35.6 kB] |
| Get:18 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [84.0 kB] |
| Get:19 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [3844 kB] |
| Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1310 kB] |
| Fetched 48.0 MB in 4s (12.9 MB/s) |
| Reading package lists... |
| Reading package lists... |
| Building dependency tree... |
| Reading state information... |
| ca-certificates is already the newest version (20240203~22.04.1). |
| The following additional packages will be installed: |
| git-man libbrotli1 libcurl3-gnutls libcurl4 liberror-perl libexpat1 |
| libnghttp2-14 libpsl5 librtmp1 libssh-4 |
| Suggested packages: |
| gettext-base git-daemon-run | git-daemon-sysvinit git-doc git-email git-gui |
| gitk gitweb git-cvs git-mediawiki git-svn |
| Recommended packages: |
| less ssh-client publicsuffix |
| The following NEW packages will be installed: |
| curl git git-man libbrotli1 libcurl3-gnutls libcurl4 liberror-perl libexpat1 |
| libnghttp2-14 libpsl5 librtmp1 libssh-4 |
| 0 upgraded, 12 newly installed, 0 to remove and 89 not upgraded. |
| Need to get 5711 kB of archives. |
| After this operation, 25.3 MB of additional disk space will be used. |
| Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libexpat1 amd64 2.4.7-1ubuntu0.7 [92.1 kB] |
| Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnghttp2-14 amd64 1.43.0-1ubuntu0.2 [76.9 kB] |
| Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 libpsl5 amd64 0.21.0-1.2build2 [58.4 kB] |
| Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbrotli1 amd64 1.0.9-2build6 [315 kB] |
| Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 librtmp1 amd64 2.4+20151223.gitfa8646d.1-2build4 [58.2 kB] |
| Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssh-4 amd64 0.9.6-2ubuntu0.22.04.7 [187 kB] |
| Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libcurl4 amd64 7.81.0-1ubuntu1.23 [290 kB] |
| Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 curl amd64 7.81.0-1ubuntu1.23 [194 kB] |
| Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libcurl3-gnutls amd64 7.81.0-1ubuntu1.23 [284 kB] |
| Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 liberror-perl all 0.17029-1 [26.5 kB] |
| Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 git-man all 1:2.34.1-1ubuntu1.17 [954 kB] |
| Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 git amd64 1:2.34.1-1ubuntu1.17 [3174 kB] |
| [91mdebconf: delaying package configuration, since apt-utils is not installed |
| [0mFetched 5711 kB in 1s (8249 kB/s) |
| Selecting previously unselected package libexpat1:amd64.
|
| (Reading database ...
(Reading database ... 5%
(Reading database ... 10%
(Reading database ... 15%
(Reading database ... 20%
(Reading database ... 25%
(Reading database ... 30%
(Reading database ... 35%
(Reading database ... 40%
(Reading database ... 45%
(Reading database ... 50%
(Reading database ... 55%
(Reading database ... 60%
(Reading database ... 65%
(Reading database ... 70%
(Reading database ... 75%
(Reading database ... 80%
(Reading database ... 85%
(Reading database ... 90%
(Reading database ... 95%
(Reading database ... 100%
(Reading database ... 14910 files and directories currently installed.)
|
| Preparing to unpack .../00-libexpat1_2.4.7-1ubuntu0.7_amd64.deb ...
|
| Unpacking libexpat1:amd64 (2.4.7-1ubuntu0.7) ...
|
| Selecting previously unselected package libnghttp2-14:amd64.
|
| Preparing to unpack .../01-libnghttp2-14_1.43.0-1ubuntu0.2_amd64.deb ...
|
| Unpacking libnghttp2-14:amd64 (1.43.0-1ubuntu0.2) ...
|
| Selecting previously unselected package libpsl5:amd64.
|
| Preparing to unpack .../02-libpsl5_0.21.0-1.2build2_amd64.deb ...
|
| Unpacking libpsl5:amd64 (0.21.0-1.2build2) ...
|
| Selecting previously unselected package libbrotli1:amd64.
|
| Preparing to unpack .../03-libbrotli1_1.0.9-2build6_amd64.deb ...
|
| Unpacking libbrotli1:amd64 (1.0.9-2build6) ...
|
| Selecting previously unselected package librtmp1:amd64.
|
| Preparing to unpack .../04-librtmp1_2.4+20151223.gitfa8646d.1-2build4_amd64.deb ...
|
| Unpacking librtmp1:amd64 (2.4+20151223.gitfa8646d.1-2build4) ...
|
| Selecting previously unselected package libssh-4:amd64.
|
| Preparing to unpack .../05-libssh-4_0.9.6-2ubuntu0.22.04.7_amd64.deb ...
|
| Unpacking libssh-4:amd64 (0.9.6-2ubuntu0.22.04.7) ...
|
| Selecting previously unselected package libcurl4:amd64.
|
| Preparing to unpack .../06-libcurl4_7.81.0-1ubuntu1.23_amd64.deb ...
|
| Unpacking libcurl4:amd64 (7.81.0-1ubuntu1.23) ...
|
| Selecting previously unselected package curl.
|
| Preparing to unpack .../07-curl_7.81.0-1ubuntu1.23_amd64.deb ...
|
| Unpacking curl (7.81.0-1ubuntu1.23) ...
|
| Selecting previously unselected package libcurl3-gnutls:amd64.
|
| Preparing to unpack .../08-libcurl3-gnutls_7.81.0-1ubuntu1.23_amd64.deb ...
|
| Unpacking libcurl3-gnutls:amd64 (7.81.0-1ubuntu1.23) ...
|
| Selecting previously unselected package liberror-perl.
|
| Preparing to unpack .../09-liberror-perl_0.17029-1_all.deb ...
|
| Unpacking liberror-perl (0.17029-1) ...
|
| Selecting previously unselected package git-man.
|
| Preparing to unpack .../10-git-man_1%3a2.34.1-1ubuntu1.17_all.deb ...
|
| Unpacking git-man (1:2.34.1-1ubuntu1.17) ...
|
| Selecting previously unselected package git.
|
| Preparing to unpack .../11-git_1%3a2.34.1-1ubuntu1.17_amd64.deb ...
|
| Unpacking git (1:2.34.1-1ubuntu1.17) ...
|
| Setting up libexpat1:amd64 (2.4.7-1ubuntu0.7) ...
|
| Setting up libpsl5:amd64 (0.21.0-1.2build2) ...
|
| Setting up libbrotli1:amd64 (1.0.9-2build6) ...
|
| Setting up libnghttp2-14:amd64 (1.43.0-1ubuntu0.2) ...
|
| Setting up liberror-perl (0.17029-1) ...
|
| Setting up librtmp1:amd64 (2.4+20151223.gitfa8646d.1-2build4) ...
|
| Setting up libssh-4:amd64 (0.9.6-2ubuntu0.22.04.7) ...
|
| Setting up libcurl4:amd64 (7.81.0-1ubuntu1.23) ...
|
| Setting up git-man (1:2.34.1-1ubuntu1.17) ...
|
| Setting up curl (7.81.0-1ubuntu1.23) ...
|
| Setting up libcurl3-gnutls:amd64 (7.81.0-1ubuntu1.23) ...
|
| Setting up git (1:2.34.1-1ubuntu1.17) ...
|
| Processing triggers for libc-bin (2.35-0ubuntu3.6) ...
|
| ---> Removed intermediate container a18056f16af6 |
| ---> b77b6d7f78bb |
| Step 7/9 : RUN python -m pip install --no-cache-dir accelerate datasets bitsandbytes peft safetensors sentencepiece transformers |
| ---> Running in 658e2eee1bdf |
| Collecting accelerate |
| Downloading accelerate-1.13.0-py3-none-any.whl.metadata (19 kB) |
| Collecting datasets |
| Downloading datasets-4.8.4-py3-none-any.whl.metadata (19 kB) |
| Collecting bitsandbytes |
| Downloading bitsandbytes-0.49.2-py3-none-manylinux_2_24_x86_64.whl.metadata (10 kB) |
| Collecting peft |
| Downloading peft-0.18.1-py3-none-any.whl.metadata (14 kB) |
| Collecting safetensors |
| Downloading safetensors-0.7.0-cp38-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.1 kB) |
| Collecting sentencepiece |
| Downloading sentencepiece-0.2.1-cp311-cp311-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl.metadata (10 kB) |
| Collecting transformers |
| Downloading transformers-5.5.0-py3-none-any.whl.metadata (32 kB) |
| Requirement already satisfied: numpy>=1.17 in /opt/conda/lib/python3.11/site-packages (from accelerate) (2.2.2) |
| Requirement already satisfied: packaging>=20.0 in /opt/conda/lib/python3.11/site-packages (from accelerate) (24.2) |
| Requirement already satisfied: psutil in /opt/conda/lib/python3.11/site-packages (from accelerate) (6.1.1) |
| Requirement already satisfied: pyyaml in /opt/conda/lib/python3.11/site-packages (from accelerate) (6.0.2) |
| Requirement already satisfied: torch>=2.0.0 in /opt/conda/lib/python3.11/site-packages (from accelerate) (2.6.0+cu124) |
| Collecting huggingface_hub>=0.21.0 (from accelerate) |
| Downloading huggingface_hub-1.9.0-py3-none-any.whl.metadata (14 kB) |
| Requirement already satisfied: filelock in /opt/conda/lib/python3.11/site-packages (from datasets) (3.17.0) |
| Collecting pyarrow>=21.0.0 (from datasets) |
| Downloading pyarrow-23.0.1-cp311-cp311-manylinux_2_28_x86_64.whl.metadata (3.1 kB) |
| Collecting dill<0.4.2,>=0.3.0 (from datasets) |
| Downloading dill-0.4.1-py3-none-any.whl.metadata (10 kB) |
| Collecting pandas (from datasets) |
| Downloading pandas-3.0.2-cp311-cp311-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl.metadata (79 kB) |
| Requirement already satisfied: requests>=2.32.2 in /opt/conda/lib/python3.11/site-packages (from datasets) (2.32.3) |
| Collecting httpx<1.0.0 (from datasets) |
| Downloading httpx-0.28.1-py3-none-any.whl.metadata (7.1 kB) |
| Requirement already satisfied: tqdm>=4.66.3 in /opt/conda/lib/python3.11/site-packages (from datasets) (4.67.1) |
| Collecting xxhash (from datasets) |
| Downloading xxhash-3.6.0-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (13 kB) |
| Collecting multiprocess<0.70.20 (from datasets) |
| Downloading multiprocess-0.70.19-py311-none-any.whl.metadata (7.5 kB) |
| Requirement already satisfied: fsspec<=2026.2.0,>=2023.1.0 in /opt/conda/lib/python3.11/site-packages (from fsspec[http]<=2026.2.0,>=2023.1.0->datasets) (2024.12.0) |
| Collecting regex>=2025.10.22 (from transformers) |
| Downloading regex-2026.4.4-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (40 kB) |
| Collecting tokenizers<=0.23.0,>=0.22.0 (from transformers) |
| Downloading tokenizers-0.22.2-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (7.3 kB) |
| Collecting typer (from transformers) |
| Downloading typer-0.24.1-py3-none-any.whl.metadata (16 kB) |
| Collecting aiohttp!=4.0.0a0,!=4.0.0a1 (from fsspec[http]<=2026.2.0,>=2023.1.0->datasets) |
| Downloading aiohttp-3.13.5-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (8.1 kB) |
| Collecting anyio (from httpx<1.0.0->datasets) |
| Downloading anyio-4.13.0-py3-none-any.whl.metadata (4.5 kB) |
| Requirement already satisfied: certifi in /opt/conda/lib/python3.11/site-packages (from httpx<1.0.0->datasets) (2024.12.14) |
| Collecting httpcore==1.* (from httpx<1.0.0->datasets) |
| Downloading httpcore-1.0.9-py3-none-any.whl.metadata (21 kB) |
| Requirement already satisfied: idna in /opt/conda/lib/python3.11/site-packages (from httpx<1.0.0->datasets) (3.10) |
| Collecting h11>=0.16 (from httpcore==1.*->httpx<1.0.0->datasets) |
| Downloading h11-0.16.0-py3-none-any.whl.metadata (8.3 kB) |
| Collecting hf-xet<2.0.0,>=1.4.3 (from huggingface_hub>=0.21.0->accelerate) |
| Downloading hf_xet-1.4.3-cp37-abi3-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (4.9 kB) |
| Requirement already satisfied: typing-extensions>=4.1.0 in /opt/conda/lib/python3.11/site-packages (from huggingface_hub>=0.21.0->accelerate) (4.12.2) |
| Requirement already satisfied: charset_normalizer<4,>=2 in /opt/conda/lib/python3.11/site-packages (from requests>=2.32.2->datasets) (3.4.1) |
| Requirement already satisfied: urllib3<3,>=1.21.1 in /opt/conda/lib/python3.11/site-packages (from requests>=2.32.2->datasets) (2.3.0) |
| Requirement already satisfied: networkx in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate) (3.4.2) |
| Requirement already satisfied: jinja2 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate) (3.1.5) |
| Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.4.127 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate) (12.4.127) |
| Requirement already satisfied: nvidia-cuda-runtime-cu12==12.4.127 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate) (12.4.127) |
| Requirement already satisfied: nvidia-cuda-cupti-cu12==12.4.127 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate) (12.4.127) |
| Requirement already satisfied: nvidia-cudnn-cu12==9.1.0.70 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate) (9.1.0.70) |
| Requirement already satisfied: nvidia-cublas-cu12==12.4.5.8 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate) (12.4.5.8) |
| Requirement already satisfied: nvidia-cufft-cu12==11.2.1.3 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate) (11.2.1.3) |
| Requirement already satisfied: nvidia-curand-cu12==10.3.5.147 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate) (10.3.5.147) |
| Requirement already satisfied: nvidia-cusolver-cu12==11.6.1.9 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate) (11.6.1.9) |
| Requirement already satisfied: nvidia-cusparse-cu12==12.3.1.170 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate) (12.3.1.170) |
| Requirement already satisfied: nvidia-cusparselt-cu12==0.6.2 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate) (0.6.2) |
| Requirement already satisfied: nvidia-nccl-cu12==2.21.5 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate) (2.21.5) |
| Requirement already satisfied: nvidia-nvtx-cu12==12.4.127 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate) (12.4.127) |
| Requirement already satisfied: nvidia-nvjitlink-cu12==12.4.127 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate) (12.4.127) |
| Requirement already satisfied: triton==3.2.0 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate) (3.2.0) |
| Requirement already satisfied: sympy==1.13.1 in /opt/conda/lib/python3.11/site-packages (from torch>=2.0.0->accelerate) (1.13.1) |
| Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/lib/python3.11/site-packages (from sympy==1.13.1->torch>=2.0.0->accelerate) (1.3.0) |
| Collecting python-dateutil>=2.8.2 (from pandas->datasets) |
| Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) |
| Collecting click>=8.2.1 (from typer->transformers) |
| Downloading click-8.3.2-py3-none-any.whl.metadata (2.6 kB) |
| Collecting shellingham>=1.3.0 (from typer->transformers) |
| Downloading shellingham-1.5.4-py2.py3-none-any.whl.metadata (3.5 kB) |
| Collecting rich>=12.3.0 (from typer->transformers) |
| Downloading rich-14.3.3-py3-none-any.whl.metadata (18 kB) |
| Collecting annotated-doc>=0.0.2 (from typer->transformers) |
| Downloading annotated_doc-0.0.4-py3-none-any.whl.metadata (6.6 kB) |
| Collecting aiohappyeyeballs>=2.5.0 (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<=2026.2.0,>=2023.1.0->datasets) |
| Downloading aiohappyeyeballs-2.6.1-py3-none-any.whl.metadata (5.9 kB) |
| Collecting aiosignal>=1.4.0 (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<=2026.2.0,>=2023.1.0->datasets) |
| Downloading aiosignal-1.4.0-py3-none-any.whl.metadata (3.7 kB) |
| Requirement already satisfied: attrs>=17.3.0 in /opt/conda/lib/python3.11/site-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<=2026.2.0,>=2023.1.0->datasets) (25.1.0) |
| Collecting frozenlist>=1.1.1 (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<=2026.2.0,>=2023.1.0->datasets) |
| Downloading frozenlist-1.8.0-cp311-cp311-manylinux1_x86_64.manylinux_2_28_x86_64.manylinux_2_5_x86_64.whl.metadata (20 kB) |
| Collecting multidict<7.0,>=4.5 (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<=2026.2.0,>=2023.1.0->datasets) |
| Downloading multidict-6.7.1-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (5.3 kB) |
| Collecting propcache>=0.2.0 (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<=2026.2.0,>=2023.1.0->datasets) |
| Downloading propcache-0.4.1-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (13 kB) |
| Collecting yarl<2.0,>=1.17.0 (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<=2026.2.0,>=2023.1.0->datasets) |
| Downloading yarl-1.23.0-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (79 kB) |
| Requirement already satisfied: six>=1.5 in /opt/conda/lib/python3.11/site-packages (from python-dateutil>=2.8.2->pandas->datasets) (1.17.0) |
| Collecting markdown-it-py>=2.2.0 (from rich>=12.3.0->typer->transformers) |
| Downloading markdown_it_py-4.0.0-py3-none-any.whl.metadata (7.3 kB) |
| Requirement already satisfied: pygments<3.0.0,>=2.13.0 in /opt/conda/lib/python3.11/site-packages (from rich>=12.3.0->typer->transformers) (2.19.1) |
| Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/lib/python3.11/site-packages (from jinja2->torch>=2.0.0->accelerate) (3.0.2) |
| Collecting mdurl~=0.1 (from markdown-it-py>=2.2.0->rich>=12.3.0->typer->transformers) |
| Downloading mdurl-0.1.2-py3-none-any.whl.metadata (1.6 kB) |
| Downloading accelerate-1.13.0-py3-none-any.whl (383 kB) |
| Downloading datasets-4.8.4-py3-none-any.whl (526 kB) |
| ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 527.0/527.0 kB 146.9 MB/s eta 0:00:00 |
| Downloading bitsandbytes-0.49.2-py3-none-manylinux_2_24_x86_64.whl (60.7 MB) |
| ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 60.7/60.7 MB 18.6 MB/s eta 0:00:00 |
| Downloading peft-0.18.1-py3-none-any.whl (556 kB) |
| ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 557.0/557.0 kB 34.5 MB/s eta 0:00:00 |
| Downloading safetensors-0.7.0-cp38-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (507 kB) |
| Downloading sentencepiece-0.2.1-cp311-cp311-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (1.4 MB) |
| ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.4/1.4 MB 22.9 MB/s eta 0:00:00 |
| Downloading transformers-5.5.0-py3-none-any.whl (10.2 MB) |
| ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10.2/10.2 MB 19.1 MB/s eta 0:00:00 |
| Downloading dill-0.4.1-py3-none-any.whl (120 kB) |
| Downloading httpx-0.28.1-py3-none-any.whl (73 kB) |
| Downloading httpcore-1.0.9-py3-none-any.whl (78 kB) |
| Downloading huggingface_hub-1.9.0-py3-none-any.whl (637 kB) |
| ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 637.4/637.4 kB 41.2 MB/s eta 0:00:00 |
| Downloading multiprocess-0.70.19-py311-none-any.whl (144 kB) |
| Downloading pyarrow-23.0.1-cp311-cp311-manylinux_2_28_x86_64.whl (47.6 MB) |
| ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 47.6/47.6 MB 18.9 MB/s eta 0:00:00 |
| Downloading regex-2026.4.4-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (799 kB) |
| ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 799.8/799.8 kB 41.5 MB/s eta 0:00:00 |
| Downloading tokenizers-0.22.2-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.3 MB) |
| ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.3/3.3 MB 21.2 MB/s eta 0:00:00 |
| Downloading pandas-3.0.2-cp311-cp311-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl (11.3 MB) |
| ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11.3/11.3 MB 18.0 MB/s eta 0:00:00 |
| Downloading typer-0.24.1-py3-none-any.whl (56 kB) |
| Downloading xxhash-3.6.0-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (193 kB) |
| Downloading aiohttp-3.13.5-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (1.8 MB) |
| ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.8/1.8 MB 27.4 MB/s eta 0:00:00 |
| Downloading annotated_doc-0.0.4-py3-none-any.whl (5.3 kB) |
| Downloading click-8.3.2-py3-none-any.whl (108 kB) |
| Downloading hf_xet-1.4.3-cp37-abi3-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (4.2 MB) |
| ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.2/4.2 MB 21.6 MB/s eta 0:00:00 |
| Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) |
| Downloading rich-14.3.3-py3-none-any.whl (310 kB) |
| Downloading shellingham-1.5.4-py2.py3-none-any.whl (9.8 kB) |
| Downloading anyio-4.13.0-py3-none-any.whl (114 kB) |
| Downloading aiohappyeyeballs-2.6.1-py3-none-any.whl (15 kB) |
| Downloading aiosignal-1.4.0-py3-none-any.whl (7.5 kB) |
| Downloading frozenlist-1.8.0-cp311-cp311-manylinux1_x86_64.manylinux_2_28_x86_64.manylinux_2_5_x86_64.whl (231 kB) |
| Downloading h11-0.16.0-py3-none-any.whl (37 kB) |
| Downloading markdown_it_py-4.0.0-py3-none-any.whl (87 kB) |
| Downloading multidict-6.7.1-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (246 kB) |
| Downloading propcache-0.4.1-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (210 kB) |
| Downloading yarl-1.23.0-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (102 kB) |
| Downloading mdurl-0.1.2-py3-none-any.whl (10.0 kB) |
| Installing collected packages: xxhash, shellingham, sentencepiece, safetensors, regex, python-dateutil, pyarrow, propcache, multidict, mdurl, hf-xet, h11, frozenlist, dill, click, anyio, annotated-doc, aiohappyeyeballs, yarl, pandas, multiprocess, markdown-it-py, httpcore, aiosignal, rich, httpx, aiohttp, typer, bitsandbytes, huggingface_hub, tokenizers, datasets, accelerate, transformers, peft |
| Attempting uninstall: click |
| Found existing installation: click 8.1.8 |
| Uninstalling click-8.1.8: |
| Successfully uninstalled click-8.1.8 |
| Successfully installed accelerate-1.13.0 aiohappyeyeballs-2.6.1 aiohttp-3.13.5 aiosignal-1.4.0 annotated-doc-0.0.4 anyio-4.13.0 bitsandbytes-0.49.2 click-8.3.2 datasets-4.8.4 dill-0.4.1 frozenlist-1.8.0 h11-0.16.0 hf-xet-1.4.3 httpcore-1.0.9 httpx-0.28.1 huggingface_hub-1.9.0 markdown-it-py-4.0.0 mdurl-0.1.2 multidict-6.7.1 multiprocess-0.70.19 pandas-3.0.2 peft-0.18.1 propcache-0.4.1 pyarrow-23.0.1 python-dateutil-2.9.0.post0 regex-2026.4.4 rich-14.3.3 safetensors-0.7.0 sentencepiece-0.2.1 shellingham-1.5.4 tokenizers-0.22.2 transformers-5.5.0 typer-0.24.1 xxhash-3.6.0 yarl-1.23.0 |
| [91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable.It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning. |
| [0m ---> Removed intermediate container 658e2eee1bdf |
| ---> 2c3ed59677a4 |
| Step 8/9 : WORKDIR /workspace |
| ---> Running in 99dc483a6553 |
| ---> Removed intermediate container 99dc483a6553 |
| ---> a4a590a17bb9 |
| Step 9/9 : CMD ["/bin/bash"] |
| ---> Running in 5bd3a8944bd9 |
| ---> Removed intermediate container 5bd3a8944bd9 |
| ---> f1fa43dd205d |
| Successfully built f1fa43dd205d |
| Successfully tagged automop-distill-student:latest |
|
|
| ========== |
| == CUDA == |
| ========== |
| |
| CUDA Version 12.4.1 |
| |
| Container image Copyright (c) 2016-2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved. |
| |
| This container image and its contents are governed by the NVIDIA Deep Learning Container License. |
| By pulling and using the container, you accept the terms and conditions of this license: |
| https://developer.nvidia.com/ngc/nvidia-deep-learning-container-license |
|
|
| A copy of this license is made available in this container at /NGC-DL-CONTAINER-LICENSE for your convenience. |
| |
|
Fetching 19 files: 0%| | 0/19 [00:00<?, ?it/s]
Fetching 19 files: 100%|██████████| 19/19 [00:00<00:00, 6133.91it/s] |
| The fast path is not available because one of the required library is not installed. Falling back to torch implementation. To install follow https://github.com/fla-org/flash-linear-attention#installation and https://github.com/Dao-AILab/causal-conv1d |
| Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'mrope_interleaved', 'mrope_section'} |
|
Writing model shards: 0%| | 0/6 [00:00<?, ?it/s]
Writing model shards: 17%|█▋ | 1/6 [00:32<02:40, 32.04s/it]
Writing model shards: 33%|███▎ | 2/6 [01:08<02:17, 34.41s/it]
Writing model shards: 50%|█████ | 3/6 [01:42<01:43, 34.42s/it]
Writing model shards: 67%|██████▋ | 4/6 [02:19<01:11, 35.56s/it]
Writing model shards: 83%|████████▎ | 5/6 [02:57<00:36, 36.34s/it]
Writing model shards: 100%|██████████| 6/6 [03:31<00:00, 35.45s/it]
Writing model shards: 100%|██████████| 6/6 [03:32<00:00, 35.40s/it] |
| The tokenizer you are loading from '/workspace/.cache/huggingface/hub/models--Jackrong--Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled/snapshots/9094770e48788ba501437d8e9ecd84a17bf91ce1' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue. |
| Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'mrope_interleaved', 'mrope_section'} |
| { |
| "source_model": "/workspace/.cache/huggingface/hub/models--Jackrong--Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled/snapshots/9094770e48788ba501437d8e9ecd84a17bf91ce1", |
| "output_dir": "/workspace/distill_student_init10", |
| "source_layers": 64, |
| "target_layers": 32, |
| "selected_layers": [ |
| 0, |
| 2, |
| 4, |
| 6, |
| 8, |
| 10, |
| 12, |
| 14, |
| 16, |
| 18, |
| 20, |
| 22, |
| 24, |
| 26, |
| 28, |
| 30, |
| 33, |
| 35, |
| 37, |
| 39, |
| 41, |
| 43, |
| 45, |
| 47, |
| 49, |
| 51, |
| 53, |
| 55, |
| 57, |
| 59, |
| 61, |
| 63 |
| ], |
| "max_shard_size_gb": 5.0 |
| } |
|
|
