[taskcluster 2025-12-01T20:06:06.095Z] Worker Type (translations-1/b-linux-large-gcp-d2g-300gb) settings:
[taskcluster 2025-12-01T20:06:06.095Z]   {
[taskcluster 2025-12-01T20:06:06.095Z]     "config": {
[taskcluster 2025-12-01T20:06:06.095Z]       "deploymentId": ""
[taskcluster 2025-12-01T20:06:06.095Z]     },
[taskcluster 2025-12-01T20:06:06.095Z]     "generic-worker": {
[taskcluster 2025-12-01T20:06:06.095Z]       "config": {
[taskcluster 2025-12-01T20:06:06.095Z]         "headlessTasks": true
[taskcluster 2025-12-01T20:06:06.095Z]       },
[taskcluster 2025-12-01T20:06:06.095Z]       "engine": "multiuser",
[taskcluster 2025-12-01T20:06:06.095Z]       "go-arch": "amd64",
[taskcluster 2025-12-01T20:06:06.095Z]       "go-os": "linux",
[taskcluster 2025-12-01T20:06:06.095Z]       "go-version": "go1.25.4",
[taskcluster 2025-12-01T20:06:06.095Z]       "release": "https://github.com/taskcluster/taskcluster/releases/tag/v93.1.2",
[taskcluster 2025-12-01T20:06:06.095Z]       "revision": "e954a7555fe32f7de69247759908749d1d670889",
[taskcluster 2025-12-01T20:06:06.095Z]       "source": "https://github.com/taskcluster/taskcluster/commits/e954a7555fe32f7de69247759908749d1d670889",
[taskcluster 2025-12-01T20:06:06.095Z]       "version": "93.1.2"
[taskcluster 2025-12-01T20:06:06.095Z]     },
[taskcluster 2025-12-01T20:06:06.095Z]     "image": "projects/taskcluster-imaging/global/images/gw-fxci-gcp-l1-2404-amd64-headless-googlecompute-2025-11-14",
[taskcluster 2025-12-01T20:06:06.095Z]     "instance-id": "1199637793949633516",
[taskcluster 2025-12-01T20:06:06.095Z]     "instance-type": "projects/887720501152/machineTypes/n2-highmem-32",
[taskcluster 2025-12-01T20:06:06.095Z]     "local-ipv4": "10.138.1.128",
[taskcluster 2025-12-01T20:06:06.095Z]     "project-id": "fxci-production-level1-workers",
[taskcluster 2025-12-01T20:06:06.095Z]     "public-hostname": "translations-1-b-linux-large-gcp-d2g-3-s8aryaeqqe2nhm6c4bkqsw.c.fxci-production-level1-workers.internal",
[taskcluster 2025-12-01T20:06:06.095Z]     "public-ipv4": "34.11.221.101",
[taskcluster 2025-12-01T20:06:06.095Z]     "region": "us-west1",
[taskcluster 2025-12-01T20:06:06.095Z]     "zone": "us-west1-b"
[taskcluster 2025-12-01T20:06:06.095Z]   }
[taskcluster 2025-12-01T20:06:06.095Z] Task ID: GrBPBkKHTi-rak0GnBOCjw
[taskcluster 2025-12-01T20:06:06.095Z] === Task Starting ===
[taskcluster 2025-12-01T20:06:06.936Z] [mounts] No existing writable directory cache 'translations-level-1-checkouts-v3-df48af894e217d0aa47d-Gsmh_6qzQ1iOKK1HbrUOIg' - creating /home/generic-worker/caches/LCI4MF9XTTaF6EPAhPIhuA
[taskcluster 2025-12-01T20:06:06.937Z] [mounts] Creating directory /home/task_176461956581946/cache0
[taskcluster 2025-12-01T20:06:06.945Z] [mounts] Updating ownership of files inside directory '/home/task_176461956581946/cache0' from root to task_176461956581946
[taskcluster 2025-12-01T20:06:06.946Z] [mounts] Successfully mounted writable directory cache '/home/task_176461956581946/cache0'
[taskcluster 2025-12-01T20:06:06.946Z] [mounts] Downloading task Gsmh_6qzQ1iOKK1HbrUOIg artifact public/image.tar.zst to /home/generic-worker/downloads/REgQFE4QS9Cdk6AsIfnUBw
[taskcluster 2025-12-01T20:06:08.451Z] [mounts] Downloaded 287588470 bytes with SHA256 4a09d92c86dc14b1cc6daf942658e61da7db8b4b89c68f0c5980fe007613329e from task Gsmh_6qzQ1iOKK1HbrUOIg artifact public/image.tar.zst to /home/generic-worker/downloads/REgQFE4QS9Cdk6AsIfnUBw
[taskcluster:warn 2025-12-01T20:06:08.451Z] [mounts] Download /home/generic-worker/downloads/REgQFE4QS9Cdk6AsIfnUBw of task Gsmh_6qzQ1iOKK1HbrUOIg artifact public/image.tar.zst has SHA256 4a09d92c86dc14b1cc6daf942658e61da7db8b4b89c68f0c5980fe007613329e but task payload does not declare a required value, so content authenticity cannot be verified
[taskcluster 2025-12-01T20:06:08.451Z] [mounts] Creating directory /home/task_176461956581946
[taskcluster 2025-12-01T20:06:08.468Z] [mounts] Copying /home/generic-worker/downloads/REgQFE4QS9Cdk6AsIfnUBw to /home/task_176461956581946/dockerimage
[taskcluster 2025-12-01T20:06:10.852Z] [mounts] Granting task_176461956581946 full control of file '/home/task_176461956581946/dockerimage'
[taskcluster 2025-12-01T20:06:11.649Z] [d2g] Loading docker image
[taskcluster 2025-12-01T20:06:21.976Z] [d2g] Loaded docker image "train:latest"
[taskcluster 2025-12-01T20:06:21.989Z] Executing command 0: docker run -t --name taskcontainer_b5rdf1alSNWm0u2wVdSY1Q --memory-swap -1 --pids-limit -1 '--add-host=localhost.localdomain:127.0.0.1' -v /home/task_176461956581946/cache0:/builds/worker/checkouts -v /home/task_176461956581946/volume0:/builds/worker/artifacts --add-host=taskcluster:host-gateway --env-file 'env.list' 9356188256ab32850d2118720303f5d6370f5dc74baa9d87d91ddfcf38e117bb /usr/local/bin/run-task --firefox_translations_training-checkout=/builds/worker/checkouts/vcs/ -- bash -c 'pip3 install --upgrade pip setuptools && pip3 install -r $VCS_PATH/pipeline/data/requirements/analyze.txt && export PYTHONPATH=$PYTHONPATH:$VCS_PATH && python3 $VCS_PATH/pipeline/data/analyze.py --file_location $MOZ_FETCHES_DIR/news_2007.en.zst --output $TASK_WORKDIR/artifacts --dataset "news-crawl_news.2007" --language en'
[setup 2025-12-01T20:06:33.300+00:00] run-task started in /builds/worker
[setup 2025-12-01T20:06:33.300+00:00] Invoked by command: --firefox_translations_training-checkout=/builds/worker/checkouts/vcs/ -- bash -c pip3 install --upgrade pip setuptools && pip3 install -r $VCS_PATH/pipeline/data/requirements/analyze.txt && export PYTHONPATH=$PYTHONPATH:$VCS_PATH && python3 $VCS_PATH/pipeline/data/analyze.py --file_location $MOZ_FETCHES_DIR/news_2007.en.zst --output $TASK_WORKDIR/artifacts --dataset "news-crawl_news.2007" --language en
[setup 2025-12-01T20:06:33.300+00:00] Python version: 3.10.12
[setup 2025-12-01T20:06:33.300+00:00] Subprocess python version: 
3.10.12
[cache 2025-12-01T20:06:33.322+00:00] cache /builds/worker/checkouts is empty; writing requirements: gid=1000 uid=1000 version=1
[volume 2025-12-01T20:06:33.323+00:00] changing ownership of volume /builds/worker/.task-cache/pip to 1000:1000
[volume 2025-12-01T20:06:33.323+00:00] changing ownership of volume /builds/worker/artifacts to 1000:1000
[volume 2025-12-01T20:06:33.323+00:00] volume /builds/worker/checkouts is a cache
[setup 2025-12-01T20:06:33.323+00:00] running as worker:worker
[vcs 2025-12-01T20:06:33.323+00:00] executing ['git', 'config', '--global', '--add', 'safe.directory', '/builds/worker/checkouts/vcs']
[vcs 2025-12-01T20:06:33.324+00:00] executing ['git', 'clone', 'https://github.com/mozilla/translations', '/builds/worker/checkouts/vcs']
[vcs 2025-12-01T20:06:33.325+00:00] Cloning into '/builds/worker/checkouts/vcs'...
[vcs 2025-12-01T20:06:34.477+00:00] executing ['git', 'fetch', '--tags', '--force', 'https://github.com/mozilla/translations', 'dependabot/pip/pipeline/data/requirements/fonttools-4.61.0']
[vcs 2025-12-01T20:06:34.733+00:00] From https://github.com/mozilla/translations
[vcs 2025-12-01T20:06:34.733+00:00]  * branch              dependabot/pip/pipeline/data/requirements/fonttools-4.61.0 -> FETCH_HEAD
[vcs 2025-12-01T20:06:34.741+00:00] executing ['git', 'fetch', '--no-tags', 'https://github.com/mozilla/translations', 'dependabot/pip/pipeline/data/requirements/fonttools-4.61.0']
[vcs 2025-12-01T20:06:34.965+00:00] From https://github.com/mozilla/translations
[vcs 2025-12-01T20:06:34.965+00:00]  * branch              dependabot/pip/pipeline/data/requirements/fonttools-4.61.0 -> FETCH_HEAD
[vcs 2025-12-01T20:06:34.973+00:00] executing ['git', 'checkout', '-f', '-B', 'dependabot/pip/pipeline/data/requirements/fonttools-4.61.0', '6475dfbcbe751d8c837a16cc396db18c26996088']
[vcs 2025-12-01T20:06:35.134+00:00] Switched to a new branch 'dependabot/pip/pipeline/data/requirements/fonttools-4.61.0'
[vcs 2025-12-01T20:06:35.134+00:00] executing ['git', 'submodule', 'init']
[vcs 2025-12-01T20:06:35.155+00:00] Submodule 'extract-lex' (https://github.com/marian-nmt/extract-lex) registered for path '3rd_party/extract-lex'
[vcs 2025-12-01T20:06:35.155+00:00] Submodule 'fast_align' (https://github.com/clab/fast_align) registered for path '3rd_party/fast_align'
[vcs 2025-12-01T20:06:35.156+00:00] Submodule '3rd_party/kenlm' (https://github.com/kpu/kenlm) registered for path '3rd_party/kenlm'
[vcs 2025-12-01T20:06:35.156+00:00] Submodule '3rd_party/marian-dev' (https://github.com/marian-nmt/marian-dev) registered for path '3rd_party/marian-dev'
[vcs 2025-12-01T20:06:35.156+00:00] Submodule '3rd_party/preprocess' (https://github.com/kpu/preprocess.git) registered for path '3rd_party/preprocess'
[vcs 2025-12-01T20:06:35.157+00:00] Submodule 'inference/3rd_party/emsdk' (https://github.com/emscripten-core/emsdk.git) registered for path 'inference/3rd_party/emsdk'
[vcs 2025-12-01T20:06:35.157+00:00] Submodule 'inference/3rd_party/ssplit-cpp' (https://github.com/browsermt/ssplit-cpp) registered for path 'inference/3rd_party/ssplit-cpp'
[vcs 2025-12-01T20:06:35.158+00:00] Submodule 'inference/marian/src/3rd_party/fbgemm' (https://github.com/marian-nmt/FBGEMM) registered for path 'inference/marian-fork/src/3rd_party/fbgemm'
[vcs 2025-12-01T20:06:35.158+00:00] Submodule 'inference/marian/src/3rd_party/intgemm' (https://github.com/kpu/intgemm) registered for path 'inference/marian-fork/src/3rd_party/intgemm'
[vcs 2025-12-01T20:06:35.159+00:00] Submodule 'inference/marian/src/3rd_party/nccl' (https://github.com/marian-nmt/nccl) registered for path 'inference/marian-fork/src/3rd_party/nccl'
[vcs 2025-12-01T20:06:35.159+00:00] Submodule 'inference/marian/src/3rd_party/onnxjs' (https://github.com/browsermt/onnxjs) registered for path 'inference/marian-fork/src/3rd_party/onnxjs'
[vcs 2025-12-01T20:06:35.159+00:00] Submodule 'inference/marian/src/3rd_party/ruy' (https://github.com/google/ruy) registered for path 'inference/marian-fork/src/3rd_party/ruy'
[vcs 2025-12-01T20:06:35.160+00:00] Submodule 'inference/marian/src/3rd_party/sentencepiece' (https://github.com/browsermt/sentencepiece) registered for path 'inference/marian-fork/src/3rd_party/sentencepiece'
[vcs 2025-12-01T20:06:35.160+00:00] Submodule 'inference/marian/src/3rd_party/simd_utils' (https://github.com/browsermt/simd_utils.git) registered for path 'inference/marian-fork/src/3rd_party/simd_utils'
[vcs 2025-12-01T20:06:35.161+00:00] Submodule 'inference/marian/src/3rd_party/simple-websocket-server' (https://github.com/marian-nmt/Simple-WebSocket-Server) registered for path 'inference/marian-fork/src/3rd_party/simple-websocket-server'
[vcs 2025-12-01T20:06:35.161+00:00] executing ['git', 'submodule', 'update', '--force']
[vcs 2025-12-01T20:06:35.182+00:00] Cloning into '/builds/worker/checkouts/vcs/3rd_party/extract-lex'...
[vcs 2025-12-01T20:06:35.566+00:00] Cloning into '/builds/worker/checkouts/vcs/3rd_party/fast_align'...
[vcs 2025-12-01T20:06:35.934+00:00] Cloning into '/builds/worker/checkouts/vcs/3rd_party/kenlm'...
[vcs 2025-12-01T20:06:36.541+00:00] Cloning into '/builds/worker/checkouts/vcs/3rd_party/marian-dev'...
[vcs 2025-12-01T20:06:38.233+00:00] Cloning into '/builds/worker/checkouts/vcs/3rd_party/preprocess'...
[vcs 2025-12-01T20:06:38.686+00:00] Cloning into '/builds/worker/checkouts/vcs/inference/3rd_party/emsdk'...
[vcs 2025-12-01T20:06:39.305+00:00] Cloning into '/builds/worker/checkouts/vcs/inference/3rd_party/ssplit-cpp'...
[vcs 2025-12-01T20:06:39.705+00:00] Cloning into '/builds/worker/checkouts/vcs/inference/marian-fork/src/3rd_party/fbgemm'...
[vcs 2025-12-01T20:06:40.313+00:00] Cloning into '/builds/worker/checkouts/vcs/inference/marian-fork/src/3rd_party/intgemm'...
[vcs 2025-12-01T20:06:40.757+00:00] Cloning into '/builds/worker/checkouts/vcs/inference/marian-fork/src/3rd_party/nccl'...
[vcs 2025-12-01T20:06:41.171+00:00] Cloning into '/builds/worker/checkouts/vcs/inference/marian-fork/src/3rd_party/onnxjs'...
[vcs 2025-12-01T20:06:41.621+00:00] Cloning into '/builds/worker/checkouts/vcs/inference/marian-fork/src/3rd_party/ruy'...
[vcs 2025-12-01T20:06:42.127+00:00] Cloning into '/builds/worker/checkouts/vcs/inference/marian-fork/src/3rd_party/sentencepiece'...
[vcs 2025-12-01T20:06:43.370+00:00] Cloning into '/builds/worker/checkouts/vcs/inference/marian-fork/src/3rd_party/simd_utils'...
[vcs 2025-12-01T20:06:44.062+00:00] Cloning into '/builds/worker/checkouts/vcs/inference/marian-fork/src/3rd_party/simple-websocket-server'...
[vcs 2025-12-01T20:06:44.484+00:00] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2025-12-01T20:06:44.493+00:00] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2025-12-01T20:06:44.517+00:00] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2025-12-01T20:06:44.617+00:00] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2025-12-01T20:06:44.635+00:00] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2025-12-01T20:06:44.652+00:00] Submodule path 'inference/3rd_party/emsdk': checked out '2346baa7bb44a4a0571cc75f1986ab9aaa35aa03'
[vcs 2025-12-01T20:06:44.665+00:00] Submodule path 'inference/3rd_party/ssplit-cpp': checked out 'a311f9865ade34db1e8e080e6cc146f55dafb067'
[vcs 2025-12-01T20:06:44.683+00:00] Submodule path 'inference/marian-fork/src/3rd_party/fbgemm': checked out '0e33146d3e7f070c7de9494efef49147a9d20558'
[vcs 2025-12-01T20:06:44.699+00:00] Submodule path 'inference/marian-fork/src/3rd_party/intgemm': checked out 'f7401513da71758dacce52fed1c7855549abee59'
[vcs 2025-12-01T20:06:44.712+00:00] Submodule path 'inference/marian-fork/src/3rd_party/nccl': checked out '7d3486128ebc865b9f2cad63a5cfd3a8f6abcb5a'
[vcs 2025-12-01T20:06:44.740+00:00] Submodule path 'inference/marian-fork/src/3rd_party/onnxjs': checked out '924924b08e9596b41aeebada4a172f026be95f5a'
[vcs 2025-12-01T20:06:44.761+00:00] Submodule path 'inference/marian-fork/src/3rd_party/ruy': checked out '2d950b3bfa7ebfbe7a97ecb44b1cc4da5ac1d6f0'
[vcs 2025-12-01T20:06:44.918+00:00] Submodule path 'inference/marian-fork/src/3rd_party/sentencepiece': checked out 'ae41b7740d7006596bb9257e83340b2620db9d00'
[vcs 2025-12-01T20:06:44.941+00:00] Submodule path 'inference/marian-fork/src/3rd_party/simd_utils': checked out 'd0793d86aea9036a5bc77b9ca7791dff024168ca'
[vcs 2025-12-01T20:06:44.952+00:00] Submodule path 'inference/marian-fork/src/3rd_party/simple-websocket-server': checked out '417a2a9e9dbd720b8d2dfa1dafe57cf1b37ca0d7'
[vcs 2025-12-01T20:06:44.953+00:00] cleaning git checkout...
[vcs 2025-12-01T20:06:44.953+00:00] executing ['git', 'clean', '-nxdff']
[vcs 2025-12-01T20:06:44.957+00:00] removing []
[vcs 2025-12-01T20:06:44.957+00:00] successfully cleaned git checkout!
[vcs 2025-12-01T20:06:44.958+00:00] TinderboxPrint:<a href='https://github.com/mozilla/translations/commit/6475dfbcbe751d8c837a16cc396db18c26996088' title='Built from translations commit 6475dfbcbe751d8c837a16cc396db18c26996088'>6475dfbcbe751d8c837a16cc396db18c26996088</a>
[fetches 2025-12-01T20:06:44.958+00:00] fetching artifacts
[fetches 2025-12-01T20:06:44.958+00:00] executing ['/usr/bin/python3', '-u', '/usr/local/bin/fetch-content', 'task-artifacts']
attempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/YZKKVpLVQpidu8q9gsjwAg/artifacts/public/build/news_2007.en.zst to /builds/worker/fetches/news_2007.en.zst
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/YZKKVpLVQpidu8q9gsjwAg/artifacts/public/build/news_2007.en.zst
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/YZKKVpLVQpidu8q9gsjwAg/artifacts/public/build/news_2007.en.zst resolved to 29396 bytes with sha256 f60fc047c2a9cfad56e7c463e4ab3d870ac6bfea9eab45129da8970ad47eabd1 in 0.319s
Verified size of https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/YZKKVpLVQpidu8q9gsjwAg/artifacts/public/build/news_2007.en.zst
PERFHERDER_DATA: {"framework": {"name": "build_metrics"}, "suites": [{"name": "fetch_content", "value": 0.3206219479999959, "lowerIsBetter": true, "shouldAlert": false, "subtests": []}]}
[fetches 2025-12-01T20:06:45.348+00:00] finished fetching artifacts
[task 2025-12-01T20:06:45.348+00:00] executing ['bash', '-c', 'pip3 install --upgrade pip setuptools && pip3 install -r $VCS_PATH/pipeline/data/requirements/analyze.txt && export PYTHONPATH=$PYTHONPATH:$VCS_PATH && python3 $VCS_PATH/pipeline/data/analyze.py --file_location $MOZ_FETCHES_DIR/news_2007.en.zst --output $TASK_WORKDIR/artifacts --dataset "news-crawl_news.2007" --language en']
[task 2025-12-01T20:06:45.621+00:00] Defaulting to user installation because normal site-packages is not writeable
[task 2025-12-01T20:06:45.644+00:00] Requirement already satisfied: pip in /usr/lib/python3/dist-packages (22.0.2)
[task 2025-12-01T20:06:45.789+00:00] Collecting pip
[task 2025-12-01T20:06:45.865+00:00]   Downloading pip-25.3-py3-none-any.whl (1.8 MB)
[task 2025-12-01T20:06:46.033+00:00]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.8/1.8 MB 10.7 MB/s eta 0:00:00
[task 2025-12-01T20:06:46.042+00:00] Requirement already satisfied: setuptools in /usr/lib/python3/dist-packages (59.6.0)
[task 2025-12-01T20:06:46.305+00:00] Collecting setuptools
[task 2025-12-01T20:06:46.316+00:00]   Downloading setuptools-80.9.0-py3-none-any.whl (1.2 MB)
[task 2025-12-01T20:06:46.380+00:00]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 19.0 MB/s eta 0:00:00
[task 2025-12-01T20:06:46.480+00:00] Installing collected packages: setuptools, pip
[task 2025-12-01T20:06:47.585+00:00] Successfully installed pip-25.3 setuptools-80.9.0
[task 2025-12-01T20:06:47.830+00:00] Defaulting to user installation because normal site-packages is not writeable
[task 2025-12-01T20:06:48.000+00:00] Collecting certifi==2024.2.2 (from -r /builds/worker/checkouts/vcs/pipeline/data/requirements/analyze.txt (line 7))
[task 2025-12-01T20:06:48.071+00:00]   Downloading certifi-2024.2.2-py3-none-any.whl.metadata (2.2 kB)
[task 2025-12-01T20:06:48.179+00:00] Collecting charset-normalizer==3.3.2 (from -r /builds/worker/checkouts/vcs/pipeline/data/requirements/analyze.txt (line 9))
[task 2025-12-01T20:06:48.188+00:00]   Downloading charset_normalizer-3.3.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (33 kB)
[task 2025-12-01T20:06:48.278+00:00] Collecting contourpy==1.2.0 (from -r /builds/worker/checkouts/vcs/pipeline/data/requirements/analyze.txt (line 11))
[task 2025-12-01T20:06:48.289+00:00]   Downloading contourpy-1.2.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (5.8 kB)
[task 2025-12-01T20:06:48.309+00:00] Collecting cycler==0.12.1 (from -r /builds/worker/checkouts/vcs/pipeline/data/requirements/analyze.txt (line 13))
[task 2025-12-01T20:06:48.318+00:00]   Downloading cycler-0.12.1-py3-none-any.whl.metadata (3.8 kB)
[task 2025-12-01T20:06:48.475+00:00] Collecting fonttools==4.61.0 (from -r /builds/worker/checkouts/vcs/pipeline/data/requirements/analyze.txt (line 15))
[task 2025-12-01T20:06:48.484+00:00]   Downloading fonttools-4.61.0-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (113 kB)
[task 2025-12-01T20:06:48.531+00:00] Collecting idna==3.6 (from -r /builds/worker/checkouts/vcs/pipeline/data/requirements/analyze.txt (line 17))
[task 2025-12-01T20:06:48.540+00:00]   Downloading idna-3.6-py3-none-any.whl.metadata (9.9 kB)
[task 2025-12-01T20:06:48.612+00:00] Collecting kiwisolver==1.4.5 (from -r /builds/worker/checkouts/vcs/pipeline/data/requirements/analyze.txt (line 19))
[task 2025-12-01T20:06:48.622+00:00]   Downloading kiwisolver-1.4.5-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whl.metadata (6.4 kB)
[task 2025-12-01T20:06:48.776+00:00] Collecting matplotlib==3.8.3 (from -r /builds/worker/checkouts/vcs/pipeline/data/requirements/analyze.txt (line 21))
[task 2025-12-01T20:06:48.786+00:00]   Downloading matplotlib-3.8.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (5.8 kB)
[task 2025-12-01T20:06:48.980+00:00] Collecting numpy==1.26.4 (from -r /builds/worker/checkouts/vcs/pipeline/data/requirements/analyze.txt (line 23))
[task 2025-12-01T20:06:48.992+00:00]   Downloading numpy-1.26.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (61 kB)
[task 2025-12-01T20:06:49.028+00:00] Collecting packaging==24.0 (from -r /builds/worker/checkouts/vcs/pipeline/data/requirements/analyze.txt (line 28))
[task 2025-12-01T20:06:49.037+00:00]   Downloading packaging-24.0-py3-none-any.whl.metadata (3.2 kB)
[task 2025-12-01T20:06:49.240+00:00] Collecting pillow==10.2.0 (from -r /builds/worker/checkouts/vcs/pipeline/data/requirements/analyze.txt (line 30))
[task 2025-12-01T20:06:49.251+00:00]   Downloading pillow-10.2.0-cp310-cp310-manylinux_2_28_x86_64.whl.metadata (9.7 kB)
[task 2025-12-01T20:06:49.286+00:00] Collecting pyparsing==3.1.2 (from -r /builds/worker/checkouts/vcs/pipeline/data/requirements/analyze.txt (line 32))
[task 2025-12-01T20:06:49.296+00:00]   Downloading pyparsing-3.1.2-py3-none-any.whl.metadata (5.1 kB)
[task 2025-12-01T20:06:49.318+00:00] Collecting python-dateutil==2.9.0.post0 (from -r /builds/worker/checkouts/vcs/pipeline/data/requirements/analyze.txt (line 34))
[task 2025-12-01T20:06:49.327+00:00]   Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB)
[task 2025-12-01T20:06:49.359+00:00] Collecting requests==2.31.0 (from -r /builds/worker/checkouts/vcs/pipeline/data/requirements/analyze.txt (line 36))
[task 2025-12-01T20:06:49.368+00:00]   Downloading requests-2.31.0-py3-none-any.whl.metadata (4.6 kB)
[task 2025-12-01T20:06:49.389+00:00] Collecting six==1.16.0 (from -r /builds/worker/checkouts/vcs/pipeline/data/requirements/analyze.txt (line 38))
[task 2025-12-01T20:06:49.398+00:00]   Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB)
[task 2025-12-01T20:06:49.426+00:00] Collecting urllib3==2.2.1 (from -r /builds/worker/checkouts/vcs/pipeline/data/requirements/analyze.txt (line 40))
[task 2025-12-01T20:06:49.436+00:00]   Downloading urllib3-2.2.1-py3-none-any.whl.metadata (6.4 kB)
[task 2025-12-01T20:06:49.512+00:00] Downloading certifi-2024.2.2-py3-none-any.whl (163 kB)
[task 2025-12-01T20:06:49.541+00:00] Downloading charset_normalizer-3.3.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (142 kB)
[task 2025-12-01T20:06:49.567+00:00] Downloading contourpy-1.2.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (310 kB)
[task 2025-12-01T20:06:49.606+00:00] Downloading numpy-1.26.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (18.2 MB)
[task 2025-12-01T20:06:49.998+00:00]    ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 18.2/18.2 MB 48.2 MB/s  0:00:00
[task 2025-12-01T20:06:50.007+00:00] Downloading cycler-0.12.1-py3-none-any.whl (8.3 kB)
[task 2025-12-01T20:06:50.020+00:00] Downloading fonttools-4.61.0-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (4.9 MB)
[task 2025-12-01T20:06:50.066+00:00]    ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.9/4.9 MB 106.2 MB/s  0:00:00
[task 2025-12-01T20:06:50.075+00:00] Downloading idna-3.6-py3-none-any.whl (61 kB)
[task 2025-12-01T20:06:50.091+00:00] Downloading kiwisolver-1.4.5-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (1.6 MB)
[task 2025-12-01T20:06:50.110+00:00]    ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.6/1.6 MB 83.3 MB/s  0:00:00
[task 2025-12-01T20:06:50.124+00:00] Downloading matplotlib-3.8.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.6 MB)
[task 2025-12-01T20:06:50.200+00:00]    ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11.6/11.6 MB 152.9 MB/s  0:00:00
[task 2025-12-01T20:06:50.209+00:00] Downloading packaging-24.0-py3-none-any.whl (53 kB)
[task 2025-12-01T20:06:50.231+00:00] Downloading pillow-10.2.0-cp310-cp310-manylinux_2_28_x86_64.whl (4.5 MB)
[task 2025-12-01T20:06:50.268+00:00]    ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.5/4.5 MB 120.6 MB/s  0:00:00
[task 2025-12-01T20:06:50.277+00:00] Downloading pyparsing-3.1.2-py3-none-any.whl (103 kB)
[task 2025-12-01T20:06:50.291+00:00] Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB)
[task 2025-12-01T20:06:50.305+00:00] Downloading requests-2.31.0-py3-none-any.whl (62 kB)
[task 2025-12-01T20:06:50.318+00:00] Downloading urllib3-2.2.1-py3-none-any.whl (121 kB)
[task 2025-12-01T20:06:50.331+00:00] Downloading six-1.16.0-py2.py3-none-any.whl (11 kB)
[task 2025-12-01T20:06:50.520+00:00] Installing collected packages: urllib3, six, pyparsing, pillow, packaging, numpy, kiwisolver, idna, fonttools, cycler, charset-normalizer, certifi, requests, python-dateutil, contourpy, matplotlib
[task 2025-12-01T20:06:54.220+00:00] 
[task 2025-12-01T20:06:54.223+00:00] Successfully installed certifi-2024.2.2 charset-normalizer-3.3.2 contourpy-1.2.0 cycler-0.12.1 fonttools-4.61.0 idna-3.6 kiwisolver-1.4.5 matplotlib-3.8.3 numpy-1.26.4 packaging-24.0 pillow-10.2.0 pyparsing-3.1.2 python-dateutil-2.9.0.post0 requests-2.31.0 six-1.16.0 urllib3-2.2.1
[task 2025-12-01T20:06:54.993+00:00] [analyze] file_location: /builds/worker/fetches/news_2007.en.zst
[task 2025-12-01T20:06:54.993+00:00] [analyze] output_dir: /builds/worker/artifacts
[task 2025-12-01T20:06:54.993+00:00] [analyze] dataset: news-crawl_news.2007
[task 2025-12-01T20:06:54.993+00:00] [analyze] language: en
[task 2025-12-01T20:06:55.120+00:00] [analyze] Saving plot to: /builds/worker/artifacts/news_2007.en.distribution-words.png
[task 2025-12-01T20:06:55.443+00:00] [analyze] Saving plot to: /builds/worker/artifacts/news_2007.en.distribution-codepoints.png
[fetches 2025-12-01T20:06:55.695+00:00] removing /builds/worker/fetches
[fetches 2025-12-01T20:06:55.695+00:00] finished
[taskcluster 2025-12-01T20:06:58.608Z]                        Exit Code: 0
[taskcluster 2025-12-01T20:06:58.608Z]                        User Time: 9.739ms
[taskcluster 2025-12-01T20:06:58.608Z]                      Kernel Time: 21.914ms
[taskcluster 2025-12-01T20:06:58.608Z]                        Wall Time: 36.619339701s
[taskcluster 2025-12-01T20:06:58.608Z]  Average Available System Memory: 249.08 GiB
[taskcluster 2025-12-01T20:06:58.608Z]       Average System Memory Used: 2.80 GiB
[taskcluster 2025-12-01T20:06:58.608Z]          Peak System Memory Used: 3.05 GiB
[taskcluster 2025-12-01T20:06:58.608Z]              Total System Memory: 251.88 GiB
[taskcluster 2025-12-01T20:06:58.608Z]                           Result: SUCCEEDED
[taskcluster 2025-12-01T20:06:58.609Z] === Task Finished ===
[taskcluster 2025-12-01T20:06:58.609Z] Task Duration: 36.619837411s
[taskcluster 2025-12-01T20:06:59.760Z] [mounts] Preserving cache: Moving "/home/task_176461956581946/cache0" to "/home/generic-worker/caches/LCI4MF9XTTaF6EPAhPIhuA"