Skip to content

Staging - #1060

Merged
iamzoltan merged 11 commits into
mainfrom
staging
Jun 23, 2026
Merged

Staging#1060
iamzoltan merged 11 commits into
mainfrom
staging

Conversation

@iamzoltan

Copy link
Copy Markdown
Contributor

No description provided.

@github-actions

Copy link
Copy Markdown

Notebook Processing Failure Context

tutorials/W2D5_TimeSeriesAndNaturalLanguageProcessing/W2D5_Tutorial1.ipynb

2026-06-23T01:54:20.9408202Z Executing tutorials/W2D5_TimeSeriesAndNaturalLanguageProcessing/W2D5_Tutorial1.ipynb
2026-06-23T01:54:21.9728734Z [IPKernelApp] WARNING | Kernel is running over TCP without encryption. All communication (including code and outputs) is sent in plain text and is susceptible to eavesdropping. Use IPC transport or launch with kernel manager-provisioned CurveZMQ keys to enable transport encryption.
2026-06-23T01:54:29.9254380Z 
2026-06-23T01:54:29.9254872Z Read 0M words
2026-06-23T01:54:29.9255322Z Number of words:  8626
2026-06-23T01:54:29.9255789Z Number of labels: 0
2026-06-23T01:54:39.3005189Z 
2026-06-23T01:54:39.3005968Z Progress: 100.0% words/sec/thread:  296434 lr:  0.000000 avg.loss:  2.406399 ETA:   0h 0m 0s
2026-06-23T01:55:26.2297844Z tutorials/W2D5_TimeSeriesAndNaturalLanguageProcessing/W2D5_Tutorial1.ipynb failed quality control.
2026-06-23T01:55:26.2298807Z ============================== Failure ==============================
2026-06-23T01:55:26.2299905Z An error occurred while executing the following cell:
2026-06-23T01:55:26.2300445Z ------------------
2026-06-23T01:55:26.2300849Z tokenizer = get_tokenizer(fasttext_vocab)
2026-06-23T01:55:26.2301409Z num_class, train_data, valid_data, test_data = load_dataset(
2026-06-23T01:55:26.2302170Z   "fancyzhx/ag_news", tokenizer, device=DEVICE, seed=1, batch_size=32, valid_split=0.7
2026-06-23T01:55:26.2302852Z )
2026-06-23T01:55:26.2303132Z hidden_size = 128
2026-06-23T01:55:26.2303533Z embedding_length = fasttext_vectors.size(1)  # 300
2026-06-23T01:55:26.2304250Z model = NeuralNet(num_class, hidden_size, embedding_length, fasttext_vectors).to(DEVICE)
2026-06-23T01:55:26.2305000Z ------------------
2026-06-23T01:55:26.2305195Z 
2026-06-23T01:55:26.2305202Z 
2026-06-23T01:55:26.2308378Z �[0;31m---------------------------------------------------------------------------�[0m
2026-06-23T01:55:26.2309307Z �[0;31mFileNotFoundError�[0m                         Traceback (most recent call last)
2026-06-23T01:55:26.2310009Z Cell �[0;32mIn[48], line 2�[0m
2026-06-23T01:55:26.2310901Z �[1;32m      1�[0m tokenizer �[38;5;241m=�[39m get_tokenizer(fasttext_vocab)
2026-06-23T01:55:26.2311914Z �[0;32m----> 2�[0m num_class, train_data, valid_data, test_data �[38;5;241m=�[39m �[43mload_dataset�[49m�[43m(�[49m
2026-06-23T01:55:26.2314887Z �[1;32m      3�[0m �[43m  �[49m�[38;5;124;43m"�[39;49m�[38;5;124;43mfancyzhx/ag_news�[39;49m�[38;5;124;43m"�[39;49m�[43m,�[49m�[43m �[49m�[43mtokenizer�[49m�[43m,�[49m�[43m �[49m�[43mdevice�[49m�[38;5;241;43m=�[39;49m�[43mDEVICE�[49m�[43m,�[49m�[43m �[49m�[43mseed�[49m�[38;5;241;43m=�[39;49m�[38;5;241;43m1�[39;49m�[43m,�[49m�[43m �[49m�[43mbatch_size�[49m�[38;5;241;43m=�[39;49m�[38;5;241;43m32�[39;49m�[43m,�[49m�[43m �[49m�[43mvalid_split�[49m�[38;5;241;43m=�[39;49m�[38;5;241;43m0.7�[39;49m
2026-06-23T01:55:26.2317427Z �[1;32m      4�[0m �[43m)�[49m
2026-06-23T01:55:26.2317966Z �[1;32m      5�[0m hidden_size �[38;5;241m=�[39m �[38;5;241m128�[39m
2026-06-23T01:55:26.2319010Z �[1;32m      6�[0m embedding_length �[38;5;241m=�[39m fasttext_vectors�[38;5;241m.�[39msize(�[38;5;241m1�[39m)  �[38;5;66;03m# 300�[39;00m
2026-06-23T01:55:26.2319703Z 
2026-06-23T01:55:26.2320397Z Cell �[0;32mIn[46], line 74�[0m, in �[0;36mload_dataset�[0;34m(dataset_name, tokenizer, device, seed, batch_size, valid_split)�[0m
2026-06-23T01:55:26.2321472Z �[1;32m     71�[0m     text_list �[38;5;241m=�[39m torch�[38;5;241m.�[39mcat(text_list)
2026-06-23T01:55:26.2322774Z �[1;32m     72�[0m     �[38;5;28;01mreturn�[39;00m label_list�[38;5;241m.�[39mto(device), text_list�[38;5;241m.�[39mto(device), offsets�[38;5;241m.�[39mto(device)
2026-06-23T01:55:26.2324426Z �[0;32m---> 74�[0m dataset �[38;5;241m=�[39m �[43mdatasets�[49m�[38;5;241;43m.�[39;49m�[43mload_dataset�[49m�[43m(�[49m�[43mdataset_name�[49m�[43m)�[49m
2026-06-23T01:55:26.2325814Z �[1;32m     75�[0m dataset �[38;5;241m=�[39m dataset�[38;5;241m.�[39mmap(encode, batched�[38;5;241m=�[39m�[38;5;28;01mTrue�[39;00m)
2026-06-23T01:55:26.2327816Z �[1;32m     77�[0m num_class �[38;5;241m=�[39m �[38;5;28mlen�[39m(dataset[�[38;5;124m"�[39m�[38;5;124mtrain�[39m�[38;5;124m"�[39m]�[38;5;241m.�[39mfeatures[�[38;5;124m"�[39m�[38;5;124mlabel�[39m�[38;5;124m"�[39m]�[38;5;241m.�[39mnames)
2026-06-23T01:55:26.2328878Z 
2026-06-23T01:55:26.2331180Z File �[0;32m/opt/hostedtoolcache/Python/3.10.20/x64/lib/python3.10/site-packages/datasets/load.py:2062�[0m, in �[0;36mload_dataset�[0;34m(path, name, data_dir, data_files, split, cache_dir, features, download_config, download_mode, verification_mode, keep_in_memory, save_infos, revision, token, streaming, num_proc, storage_options, trust_remote_code, **config_kwargs)�[0m
2026-06-23T01:55:26.2333559Z �[1;32m   2057�[0m verification_mode �[38;5;241m=�[39m VerificationMode(
2026-06-23T01:55:26.2335218Z �[1;32m   2058�[0m     (verification_mode �[38;5;129;01mor�[39;00m VerificationMode�[38;5;241m.�[39mBASIC_CHECKS) �[38;5;28;01mif�[39;00m �[38;5;129;01mnot�[39;00m save_infos �[38;5;28;01melse�[39;00m VerificationMode�[38;5;241m.�[39mALL_CHECKS
2026-06-23T01:55:26.2336925Z �[1;32m   2059�[0m )
2026-06-23T01:55:26.2337498Z �[1;32m   2061�[0m �[38;5;66;03m# Create a dataset builder�[39;00m
2026-06-23T01:55:26.2338343Z �[0;32m-> 2062�[0m builder_instance �[38;5;241m=�[39m �[43mload_dataset_builder�[49m�[43m(�[49m
2026-06-23T01:55:26.2339326Z �[1;32m   2063�[0m �[43m    �[49m�[43mpath�[49m�[38;5;241;43m=�[39;49m�[43mpath�[49m�[43m,�[49m
2026-06-23T01:55:26.2340238Z �[1;32m   2064�[0m �[43m    �[49m�[43mname�[49m�[38;5;241;43m=�[39;49m�[43mname�[49m�[43m,�[49m
2026-06-23T01:55:26.2341238Z �[1;32m   2065�[0m �[43m    �[49m�[43mdata_dir�[49m�[38;5;241;43m=�[39;49m�[43mdata_dir�[49m�[43m,�[49m
2026-06-23T01:55:26.2342288Z �[1;32m   2066�[0m �[43m    �[49m�[43mdata_files�[49m�[38;5;241;43m=�[39;49m�[43mdata_files�[49m�[43m,�[49m
2026-06-23T01:55:26.2343300Z �[1;32m   2067�[0m �[43m    �[49m�[43mcache_dir�[49m�[38;5;241;43m=�[39;49m�[43mcache_dir�[49m�[43m,�[49m
2026-06-23T01:55:26.2344298Z �[1;32m   2068�[0m �[43m    �[49m�[43mfeatures�[49m�[38;5;241;43m=�[39;49m�[43mfeatures�[49m�[43m,�[49m
2026-06-23T01:55:26.2345398Z �[1;32m   2069�[0m �[43m    �[49m�[43mdownload_config�[49m�[38;5;241;43m=�[39;49m�[43mdownload_config�[49m�[43m,�[49m
2026-06-23T01:55:26.2347125Z �[1;32m   2070�[0m �[43m    �[49m�[43mdownload_mode�[49m�[38;5;241;43m=�[39;49m�[43mdownload_mode�[49m�[43m,�[49m
2026-06-23T01:55:26.2348223Z �[1;32m   2071�[0m �[43m    �[49m�[43mrevision�[49m�[38;5;241;43m=�[39;49m�[43mrevision�[49m�[43m,�[49m
2026-06-23T01:55:26.2349153Z �[1;32m   2072�[0m �[43m    �[49m�[43mtoken�[49m�[38;5;241;43m=�[39;49m�[43mtoken�[49m�[43m,�[49m
2026-06-23T01:55:26.2350177Z �[1;32m   2073�[0m �[43m    �[49m�[43mstorage_options�[49m�[38;5;241;43m=�[39;49m�[43mstorage_options�[49m�[43m,�[49m
2026-06-23T01:55:26.2351307Z �[1;32m   2074�[0m �[43m    �[49m�[43mtrust_remote_code�[49m�[38;5;241;43m=�[39;49m�[43mtrust_remote_code�[49m�[43m,�[49m
2026-06-23T01:55:26.2352871Z �[1;32m   2075�[0m �[43m    �[49m�[43m_require_default_config_name�[49m�[38;5;241;43m=�[39;49m�[43mname�[49m�[43m �[49m�[38;5;129;43;01mis�[39;49;00m�[43m �[49m�[38;5;28;43;01mNone�[39;49;00m�[43m,�[49m
2026-06-23T01:55:26.2357847Z �[1;32m   2076�[0m �[43m    �[49m�[38;5;241;43m*�[39;49m�[38;5;241;43m*�[39;49m�[43mconfig_kwargs�[49m�[43m,�[49m
2026-06-23T01:55:26.2358729Z �[1;32m   2077�[0m �[43m�[49m�[43m)�[49m
2026-06-23T01:55:26.2359455Z �[1;32m   2079�[0m �[38;5;66;03m# Return iterable dataset in case of streaming�[39;00m
2026-06-23T01:55:26.2360221Z �[1;32m   2080�[0m �[38;5;28;01mif�[39;00m streaming:
2026-06-23T01:55:26.2360581Z 
2026-06-23T01:55:26.2362665Z File �[0;32m/opt/hostedtoolcache/Python/3.10.20/x64/lib/python3.10/site-packages/datasets/load.py:1782�[0m, in �[0;36mload_dataset_builder�[0;34m(path, name, data_dir, data_files, cache_dir, features, download_config, download_mode, revision, token, storage_options, trust_remote_code, _require_default_config_name, **config_kwargs)�[0m
2026-06-23T01:55:26.2365472Z �[1;32m   1780�[0m     download_config �[38;5;241m=�[39m download_config�[38;5;241m.�[39mcopy() �[38;5;28;01mif�[39;00m download_config �[38;5;28;01melse�[39;00m DownloadConfig()
2026-06-23T01:55:26.2367082Z �[1;32m   1781�[0m     download_config�[38;5;241m.�[39mstorage_options�[38;5;241m.�[39mupdate(storage_options)
2026-06-23T01:55:26.2368154Z �[0;32m-> 1782�[0m dataset_module �[38;5;241m=�[39m �[43mdataset_module_factory�[49m�[43m(�[49m
2026-06-23T01:55:26.2368935Z �[1;32m   1783�[0m �[43m    �[49m�[43mpath�[49m�[43m,�[49m
2026-06-23T01:55:26.2369728Z �[1;32m   1784�[0m �[43m    �[49m�[43mrevision�[49m�[38;5;241;43m=�[39;49m�[43mrevision�[49m�[43m,�[49m
2026-06-23T01:55:26.2370790Z �[1;32m   1785�[0m �[43m    �[49m�[43mdownload_config�[49m�[38;5;241;43m=�[39;49m�[43mdownload_config�[49m�[43m,�[49m
2026-06-23T01:55:26.2371894Z �[1;32m   1786�[0m �[43m    �[49m�[43mdownload_mode�[49m�[38;5;241;43m=�[39;49m�[43mdownload_mode�[49m�[43m,�[49m
2026-06-23T01:55:26.2372910Z �[1;32m   1787�[0m �[43m    �[49m�[43mdata_dir�[49m�[38;5;241;43m=�[39;49m�[43mdata_dir�[49m�[43m,�[49m
2026-06-23T01:55:26.2374135Z �[1;32m   1788�[0m �[43m    �[49m�[43mdata_files�[49m�[38;5;241;43m=�[39;49m�[43mdata_files�[49m�[43m,�[49m
2026-06-23T01:55:26.2375198Z �[1;32m   1789�[0m �[43m    �[49m�[43mcache_dir�[49m�[38;5;241;43m=�[39;49m�[43mcache_dir�[49m�[43m,�[49m
2026-06-23T01:55:26.2376320Z �[1;32m   1790�[0m �[43m    �[49m�[43mtrust_remote_code�[49m�[38;5;241;43m=�[39;49m�[43mtrust_remote_code�[49m�[43m,�[49m
2026-06-23T01:55:26.2377874Z �[1;32m   1791�[0m �[43m    �[49m�[43m_require_default_config_name�[49m�[38;5;241;43m=�[39;49m�[43m_require_default_config_name�[49m�[43m,�[49m
2026-06-23T01:55:26.2379370Z �[1;32m   1792�[0m �[43m    �[49m�[43m_require_custom_configs�[49m�[38;5;241;43m=�[39;49m�[38;5;28;43mbool�[39;49m�[43m(�[49m�[43mconfig_kwargs�[49m�[43m)�[49m�[43m,�[49m
2026-06-23T01:55:26.2380352Z �[1;32m   1793�[0m �[43m�[49m�[43m)�[49m
2026-06-23T01:55:26.2381082Z �[1;32m   1794�[0m �[38;5;66;03m# Get dataset builder class from the processing script�[39;00m
2026-06-23T01:55:26.2382092Z �[1;32m   1795�[0m builder_kwargs �[38;5;241m=�[39m dataset_module�[38;5;241m.�[39mbuilder_kwargs
2026-06-23T01:55:26.2382821Z 
2026-06-23T01:55:26.2384971Z File �[0;32m/opt/hostedtoolcache/Python/3.10.20/x64/lib/python3.10/site-packages/datasets/load.py:1660�[0m, in �[0;36mdataset_module_factory�[0;34m(path, revision, download_config, download_mode, dynamic_modules_path, data_dir, data_files, cache_dir, trust_remote_code, _require_default_config_name, _require_custom_configs, **download_kwargs)�[0m
2026-06-23T01:55:26.2387522Z �[1;32m   1655�[0m                     �[38;5;28;01mraise�[39;00m �[38;5;167;01mFileNotFoundError�[39;00m(
2026-06-23T01:55:26.2389573Z �[1;32m   1656�[0m                         �[38;5;124mf�[39m�[38;5;124m"�[39m�[38;5;124mCouldn�[39m�[38;5;124m'�[39m�[38;5;124mt find a dataset script at �[39m�[38;5;132;01m{�[39;00mrelative_to_absolute_path(combined_path)�[38;5;132;01m}�[39;00m�[38;5;124m or any data file in the same directory. �[39m�[38;5;124m"�[39m
2026-06-23T01:55:26.2393133Z �[1;32m   1657�[0m                         �[38;5;124mf�[39m�[38;5;124m"�[39m�[38;5;124mCouldn�[39m�[38;5;124m'�[39m�[38;5;124mt find �[39m�[38;5;124m'�[39m�[38;5;132;01m{�[39;00mpath�[38;5;132;01m}�[39;00m�[38;5;124m'�[39m�[38;5;124m on the Hugging Face Hub either: �[39m�[38;5;132;01m{�[39;00m�[38;5;28mtype�[39m(e1)�[38;5;241m.�[39m�[38;5;18m__name__�[39m�[38;5;132;01m}�[39;00m�[38;5;124m: �[39m�[38;5;132;01m{�[39;00me1�[38;5;132;01m}�[39;00m�[38;5;124m"�[39m
2026-06-23T01:55:26.2395479Z �[1;32m   1658�[0m                     ) �[38;5;28;01mfrom�[39;00m�[38;5;250m �[39m�[38;5;28;01mNone�[39;00m
2026-06-23T01:55:26.2396243Z �[1;32m   1659�[0m                 �[38;5;28;01melse�[39;00m:
2026-06-23T01:55:26.2397312Z �[0;32m-> 1660�[0m                     �[38;5;28;01mraise�[39;00m �[38;5;167;01mFileNotFoundError�[39;00m(
2026-06-23T01:55:26.2399205Z �[1;32m   1661�[0m                         �[38;5;124mf�[39m�[38;5;124m"�[39m�[38;5;124mCouldn�[39m�[38;5;124m'�[39m�[38;5;124mt find any data file at �[39m�[38;5;132;01m{�[39;00mrelative_to_absolute_path(path)�[38;5;132;01m}�[39;00m�[38;5;124m. �[39m�[38;5;124m"�[39m
2026-06-23T01:55:26.2402617Z �[1;32m   1662�[0m                         �[38;5;124mf�[39m�[38;5;124m"�[39m�[38;5;124mCouldn�[39m�[38;5;124m'�[39m�[38;5;124mt find �[39m�[38;5;124m'�[39m�[38;5;132;01m{�[39;00mpath�[38;5;132;01m}�[39;00m�[38;5;124m'�[39m�[38;5;124m on the Hugging Face Hub either: �[39m�[38;5;132;01m{�[39;00m�[38;5;28mtype�[39m(e1)�[38;5;241m.�[39m�[38;5;18m__name__�[39m�[38;5;132;01m}�[39;00m�[38;5;124m: �[39m�[38;5;132;01m{�[39;00me1�[38;5;132;01m}�[39;00m�[38;5;124m"�[39m
2026-06-23T01:55:26.2405094Z �[1;32m   1663�[0m                     ) �[38;5;28;01mfrom�[39;00m�[38;5;250m �[39m�[38;5;28;01mNone�[39;00m
2026-06-23T01:55:26.2406170Z �[1;32m   1664�[0m             �[38;5;28;01mraise�[39;00m e1 �[38;5;28;01mfrom�[39;00m�[38;5;250m �[39m�[38;5;28;01mNone�[39;00m
2026-06-23T01:55:26.2407281Z �[1;32m   1665�[0m �[38;5;28;01melif�[39;00m trust_remote_code:
2026-06-23T01:55:26.2407648Z 
2026-06-23T01:55:26.2410549Z �[0;31mFileNotFoundError�[0m: Couldn't find any data file at /home/runner/work/course-content-dl/course-content-dl/fancyzhx/ag_news. Couldn't find 'fancyzhx/ag_news' on the Hugging Face Hub either: LocalEntryNotFoundError: An error happened while trying to locate the file on the Hub and we cannot find the requested files in the local cache. Please check your connection and try again or make sure your Internet connection is on.
2026-06-23T01:55:26.2412973Z 
2026-06-23T01:55:26.5299153Z ##[error]Process completed with exit code 1.

tutorials/W3D1_AttentionAndTransformers/W3D1_Tutorial1.ipynb

2026-06-23T01:55:26.2471394Z �[1;32m    780�[0m         data �[38;5;241m=�[39m _utils�[38;5;241m.�[39mpin_memory�[38;5;241m.�[39mpin_memory(data, �[38;5;28mself�[39m�[38;5;241m.�[39m_pin_memory_device)
2026-06-23T01:55:26.2471919Z 
2026-06-23T01:55:26.2472645Z File �[0;32m/opt/hostedtoolcache/Python/3.10.20/x64/lib/python3.10/site-packages/torch/utils/data/_utils/fetch.py:52�[0m, in �[0;36m_MapDatasetFetcher.fetch�[0;34m(self, possibly_batched_index)�[0m
2026-06-23T01:55:26.2473613Z �[1;32m     50�[0m �[38;5;28;01mif�[39;00m �[38;5;28mself�[39m�[38;5;241m.�[39mauto_collation:
2026-06-23T01:55:26.2475041Z �[1;32m     51�[0m     �[38;5;28;01mif�[39;00m �[38;5;28mhasattr�[39m(�[38;5;28mself�[39m�[38;5;241m.�[39mdataset, �[38;5;124m"�[39m�[38;5;124m__getitems__�[39m�[38;5;124m"�[39m) �[38;5;129;01mand�[39;00m �[38;5;28mself�[39m�[38;5;241m.�[39mdataset�[38;5;241m.�[39m__getitems__:
2026-06-23T01:55:26.2476519Z �[0;32m---> 52�[0m         data �[38;5;241m=�[39m �[38;5;28;43mself�[39;49m�[38;5;241;43m.�[39;49m�[43mdataset�[49m�[38;5;241;43m.�[39;49m�[43m__getitems__�[49m�[43m(�[49m�[43mpossibly_batched_index�[49m�[43m)�[49m
2026-06-23T01:55:26.2477279Z �[1;32m     53�[0m     �[38;5;28;01melse�[39;00m:
2026-06-23T01:55:26.2478022Z �[1;32m     54�[0m         data �[38;5;241m=�[39m [�[38;5;28mself�[39m�[38;5;241m.�[39mdataset[idx] �[38;5;28;01mfor�[39;00m idx �[38;5;129;01min�[39;00m possibly_batched_index]
2026-06-23T01:55:26.2478529Z 
2026-06-23T01:55:26.2479163Z File �[0;32m/opt/hostedtoolcache/Python/3.10.20/x64/lib/python3.10/site-packages/datasets/arrow_dataset.py:2781�[0m, in �[0;36mDataset.__getitems__�[0;34m(self, keys)�[0m
2026-06-23T01:55:26.2480353Z �[1;32m   2779�[0m �[38;5;28;01mdef�[39;00m�[38;5;250m �[39m�[38;5;21m__getitems__�[39m(�[38;5;28mself�[39m, keys: �[38;5;28mlist�[39m) �[38;5;241m-�[39m�[38;5;241m>�[39m �[38;5;28mlist�[39m:
2026-06-23T01:55:26.2481280Z �[1;32m   2780�[0m �[38;5;250m    �[39m�[38;5;124;03m"""Can be used to get a batch using a list of integers indices."""�[39;00m
2026-06-23T01:55:26.2482156Z �[0;32m-> 2781�[0m     batch �[38;5;241m=�[39m �[38;5;28;43mself�[39;49m�[38;5;241;43m.�[39;49m�[38;5;21;43m__getitem__�[39;49m�[43m(�[49m�[43mkeys�[49m�[43m)�[49m
2026-06-23T01:55:26.2483007Z �[1;32m   2782�[0m     n_examples �[38;5;241m=�[39m �[38;5;28mlen�[39m(batch[�[38;5;28mnext�[39m(�[38;5;28miter�[39m(batch))])
2026-06-23T01:55:26.2484143Z �[1;32m   2783�[0m     �[38;5;28;01mreturn�[39;00m [{col: array[i] �[38;5;28;01mfor�[39;00m col, array �[38;5;129;01min�[39;00m batch�[38;5;241m.�[39mitems()} �[38;5;28;01mfor�[39;00m i �[38;5;129;01min�[39;00m �[38;5;28mrange�[39m(n_examples)]
2026-06-23T01:55:26.2485071Z 
2026-06-23T01:55:26.2485715Z File �[0;32m/opt/hostedtoolcache/Python/3.10.20/x64/lib/python3.10/site-packages/datasets/arrow_dataset.py:2777�[0m, in �[0;36mDataset.__getitem__�[0;34m(self, key)�[0m
2026-06-23T01:55:26.2486757Z �[1;32m   2775�[0m �[38;5;28;01mdef�[39;00m�[38;5;250m �[39m�[38;5;21m__getitem__�[39m(�[38;5;28mself�[39m, key):  �[38;5;66;03m# noqa: F811�[39;00m
2026-06-23T01:55:26.2487751Z �[1;32m   2776�[0m �[38;5;250m    �[39m�[38;5;124;03m"""Can be used to index columns (by string names) or rows (by integer index or iterable of indices or bools)."""�[39;00m
2026-06-23T01:55:26.2488889Z �[0;32m-> 2777�[0m     �[38;5;28;01mreturn�[39;00m �[38;5;28;43mself�[39;49m�[38;5;241;43m.�[39;49m�[43m_getitem�[49m�[43m(�[49m�[43mkey�[49m�[43m)�[49m
2026-06-23T01:55:26.2489348Z 
2026-06-23T01:55:26.2489990Z File �[0;32m/opt/hostedtoolcache/Python/3.10.20/x64/lib/python3.10/site-packages/datasets/arrow_dataset.py:2762�[0m, in �[0;36mDataset._getitem�[0;34m(self, key, **kwargs)�[0m
2026-06-23T01:55:26.2491318Z �[1;32m   2760�[0m formatter �[38;5;241m=�[39m get_formatter(format_type, features�[38;5;241m=�[39m�[38;5;28mself�[39m�[38;5;241m.�[39m_info�[38;5;241m.�[39mfeatures, �[38;5;241m*�[39m�[38;5;241m*�[39mformat_kwargs)
2026-06-23T01:55:26.2492670Z �[1;32m   2761�[0m pa_subtable �[38;5;241m=�[39m query_table(�[38;5;28mself�[39m�[38;5;241m.�[39m_data, key, indices�[38;5;241m=�[39m�[38;5;28mself�[39m�[38;5;241m.�[39m_indices)
2026-06-23T01:55:26.2493486Z �[0;32m-> 2762�[0m formatted_output �[38;5;241m=�[39m �[43mformat_table�[49m�[43m(�[49m
2026-06-23T01:55:26.2495307Z �[1;32m   2763�[0m �[43m    �[49m�[43mpa_subtable�[49m�[43m,�[49m�[43m �[49m�[43mkey�[49m�[43m,�[49m�[43m �[49m�[43mformatter�[49m�[38;5;241;43m=�[39;49m�[43mformatter�[49m�[43m,�[49m�[43m �[49m�[43mformat_columns�[49m�[38;5;241;43m=�[39;49m�[43mformat_columns�[49m�[43m,�[49m�[43m �[49m�[43moutput_all_columns�[49m�[38;5;241;43m=�[39;49m�[43moutput_all_columns�[49m
2026-06-23T01:55:26.2496508Z �[1;32m   2764�[0m �[43m�[49m�[43m)�[49m
2026-06-23T01:55:26.2496887Z �[1;32m   2765�[0m �[38;5;28;01mreturn�[39;00m formatted_output
2026-06-23T01:55:26.2497136Z 
2026-06-23T01:55:26.2497949Z File �[0;32m/opt/hostedtoolcache/Python/3.10.20/x64/lib/python3.10/site-packages/datasets/formatting/formatting.py:661�[0m, in �[0;36mformat_table�[0;34m(table, key, formatter, format_columns, output_all_columns)�[0m
2026-06-23T01:55:26.2498847Z �[1;32m    659�[0m �[38;5;28;01melse�[39;00m:
2026-06-23T01:55:26.2499943Z �[1;32m    660�[0m     pa_table_to_format �[38;5;241m=�[39m pa_table�[38;5;241m.�[39mdrop(col �[38;5;28;01mfor�[39;00m col �[38;5;129;01min�[39;00m pa_table�[38;5;241m.�[39mcolumn_names �[38;5;28;01mif�[39;00m col �[38;5;129;01mnot�[39;00m �[38;5;129;01min�[39;00m format_columns)
2026-06-23T01:55:26.2501455Z �[0;32m--> 661�[0m     formatted_output �[38;5;241m=�[39m �[43mformatter�[49m�[43m(�[49m�[43mpa_table_to_format�[49m�[43m,�[49m�[43m �[49m�[43mquery_type�[49m�[38;5;241;43m=�[39;49m�[43mquery_type�[49m�[43m)�[49m
2026-06-23T01:55:26.2502304Z �[1;32m    662�[0m     �[38;5;28;01mif�[39;00m output_all_columns:
2026-06-23T01:55:26.2502879Z �[1;32m    663�[0m         �[38;5;28;01mif�[39;00m �[38;5;28misinstance�[39m(formatted_output, MutableMapping):
2026-06-23T01:55:26.2503236Z 
2026-06-23T01:55:26.2503955Z File �[0;32m/opt/hostedtoolcache/Python/3.10.20/x64/lib/python3.10/site-packages/datasets/formatting/formatting.py:410�[0m, in �[0;36mFormatter.__call__�[0;34m(self, pa_table, query_type)�[0m
2026-06-23T01:55:26.2505286Z �[1;32m    408�[0m     �[38;5;28;01mreturn�[39;00m �[38;5;28mself�[39m�[38;5;241m.�[39mformat_column(pa_table)
2026-06-23T01:55:26.2506044Z �[1;32m    409�[0m �[38;5;28;01melif�[39;00m query_type �[38;5;241m==�[39m �[38;5;124m"�[39m�[38;5;124mbatch�[39m�[38;5;124m"�[39m:
2026-06-23T01:55:26.2506930Z �[0;32m--> 410�[0m     �[38;5;28;01mreturn�[39;00m �[38;5;28;43mself�[39;49m�[38;5;241;43m.�[39;49m�[43mformat_batch�[49m�[43m(�[49m�[43mpa_table�[49m�[43m)�[49m
2026-06-23T01:55:26.2507409Z 
2026-06-23T01:55:26.2508137Z File �[0;32m/opt/hostedtoolcache/Python/3.10.20/x64/lib/python3.10/site-packages/datasets/formatting/torch_formatter.py:119�[0m, in �[0;36mTorchFormatter.format_batch�[0;34m(self, pa_table)�[0m
2026-06-23T01:55:26.2509283Z �[1;32m    117�[0m batch �[38;5;241m=�[39m �[38;5;28mself�[39m�[38;5;241m.�[39mnumpy_arrow_extractor()�[38;5;241m.�[39mextract_batch(pa_table)
2026-06-23T01:55:26.2510167Z �[1;32m    118�[0m batch �[38;5;241m=�[39m �[38;5;28mself�[39m�[38;5;241m.�[39mpython_features_decoder�[38;5;241m.�[39mdecode_batch(batch)
2026-06-23T01:55:26.2511261Z �[0;32m--> 119�[0m batch �[38;5;241m=�[39m �[38;5;28;43mself�[39;49m�[38;5;241;43m.�[39;49m�[43mrecursive_tensorize�[49m�[43m(�[49m�[43mbatch�[49m�[43m)�[49m
2026-06-23T01:55:26.2512028Z �[1;32m    120�[0m �[38;5;28;01mfor�[39;00m column_name �[38;5;129;01min�[39;00m batch:
2026-06-23T01:55:26.2512714Z �[1;32m    121�[0m     batch[column_name] �[38;5;241m=�[39m �[38;5;28mself�[39m�[38;5;241m.�[39m_consolidate(batch[column_name])
2026-06-23T01:55:26.2513143Z 
2026-06-23T01:55:26.2513915Z File �[0;32m/opt/hostedtoolcache/Python/3.10.20/x64/lib/python3.10/site-packages/datasets/formatting/torch_formatter.py:102�[0m, in �[0;36mTorchFormatter.recursive_tensorize�[0;34m(self, data_struct)�[0m
2026-06-23T01:55:26.2515693Z �[1;32m    101�[0m �[38;5;28;01mdef�[39;00m�[38;5;250m �[39m�[38;5;21mrecursive_tensorize�[39m(�[38;5;28mself�[39m, data_struct: �[38;5;28mdict�[39m):
2026-06-23T01:55:26.2517141Z �[0;32m--> 102�[0m     �[38;5;28;01mreturn�[39;00m �[43mmap_nested�[49m�[43m(�[49m�[38;5;28;43mself�[39;49m�[38;5;241;43m.�[39;49m�[43m_recursive_tensorize�[49m�[43m,�[49m�[43m �[49m�[43mdata_struct�[49m�[43m,�[49m�[43m �[49m�[43mmap_list�[49m�[38;5;241;43m=�[39;49m�[38;5;28;43;01mFalse�[39;49;00m�[43m)�[49m
2026-06-23T01:55:26.2518021Z 
2026-06-23T01:55:26.2519101Z File �[0;32m/opt/hostedtoolcache/Python/3.10.20/x64/lib/python3.10/site-packages/datasets/utils/py_utils.py:521�[0m, in �[0;36mmap_nested�[0;34m(function, data_struct, dict_only, map_list, map_tuple, map_numpy, num_proc, parallel_min_length, batched, batch_size, types, disable_tqdm, desc)�[0m
2026-06-23T01:55:26.2521020Z �[1;32m    519�[0m         batch_size �[38;5;241m=�[39m �[38;5;28mmax�[39m(�[38;5;28mlen�[39m(iterable) �[38;5;241m/�[39m�[38;5;241m/�[39m num_proc �[38;5;241m+�[39m �[38;5;28mint�[39m(�[38;5;28mlen�[39m(iterable) �[38;5;241m%�[39m num_proc �[38;5;241m>�[39m �[38;5;241m0�[39m), �[38;5;241m1�[39m)
2026-06-23T01:55:26.2522173Z �[1;32m    520�[0m     iterable �[38;5;241m=�[39m �[38;5;28mlist�[39m(iter_batched(iterable, batch_size))
2026-06-23T01:55:26.2522678Z �[0;32m--> 521�[0m mapped �[38;5;241m=�[39m [
2026-06-23T01:55:26.2523423Z �[1;32m    522�[0m     _single_map_nested((function, obj, batched, batch_size, types, �[38;5;28;01mNone�[39;00m, �[38;5;28;01mTrue�[39;00m, �[38;5;28;01mNone�[39;00m))
2026-06-23T01:55:26.2524441Z �[1;32m    523�[0m     �[38;5;28;01mfor�[39;00m obj �[38;5;129;01min�[39;00m hf_tqdm(iterable, disable�[38;5;241m=�[39mdisable_tqdm, desc�[38;5;241m=�[39mdesc)
2026-06-23T01:55:26.2525313Z �[1;32m    524�[0m ]
2026-06-23T01:55:26.2525614Z �[1;32m    525�[0m �[38;5;28;01mif�[39;00m batched:
2026-06-23T01:55:26.2526476Z �[1;32m    526�[0m     mapped �[38;5;241m=�[39m [mapped_item �[38;5;28;01mfor�[39;00m mapped_batch �[38;5;129;01min�[39;00m mapped �[38;5;28;01mfor�[39;00m mapped_item �[38;5;129;01min�[39;00m mapped_batch]
2026-06-23T01:55:26.2527093Z 
2026-06-23T01:55:26.2527674Z File �[0;32m/opt/hostedtoolcache/Python/3.10.20/x64/lib/python3.10/site-packages/datasets/utils/py_utils.py:522�[0m, in �[0;36m<listcomp>�[0;34m(.0)�[0m
2026-06-23T01:55:26.2529153Z �[1;32m    519�[0m         batch_size �[38;5;241m=�[39m �[38;5;28mmax�[39m(�[38;5;28mlen�[39m(iterable) �[38;5;241m/�[39m�[38;5;241m/�[39m num_proc �[38;5;241m+�[39m �[38;5;28mint�[39m(�[38;5;28mlen�[39m(iterable) �[38;5;241m%�[39m num_proc �[38;5;241m>�[39m �[38;5;241m0�[39m), �[38;5;241m1�[39m)
2026-06-23T01:55:26.2530293Z �[1;32m    520�[0m     iterable �[38;5;241m=�[39m �[38;5;28mlist�[39m(iter_batched(iterable, batch_size))
2026-06-23T01:55:26.2530783Z �[1;32m    521�[0m mapped �[38;5;241m=�[39m [
2026-06-23T01:55:26.2532280Z �[0;32m--> 522�[0m     �[43m_single_map_nested�[49m�[43m(�[49m�[43m(�[49m�[43mfunction�[49m�[43m,�[49m�[43m �[49m�[43mobj�[49m�[43m,�[49m�[43m �[49m�[43mbatched�[49m�[43m,�[49m�[43m �[49m�[43mbatch_size�[49m�[43m,�[49m�[43m �[49m�[43mtypes�[49m�[43m,�[49m�[43m �[49m�[38;5;28;43;01mNone�[39;49;00m�[43m,�[49m�[43m �[49m�[38;5;28;43;01mTrue�[39;49;00m�[43m,�[49m�[43m �[49m�[38;5;28;43;01mNone�[39;49;00m�[43m)�[49m�[43m)�[49m
2026-06-23T01:55:26.2534027Z �[1;32m    523�[0m     �[38;5;28;01mfor�[39;00m obj �[38;5;129;01min�[39;00m hf_tqdm(iterable, disable�[38;5;241m=�[39mdisable_tqdm, desc�[38;5;241m=�[39mdesc)
2026-06-23T01:55:26.2534622Z �[1;32m    524�[0m ]
2026-06-23T01:55:26.2535306Z �[1;32m    525�[0m �[38;5;28;01mif�[39;00m batched:
2026-06-23T01:55:26.2536218Z �[1;32m    526�[0m     mapped �[38;5;241m=�[39m [mapped_item �[38;5;28;01mfor�[39;00m mapped_batch �[38;5;129;01min�[39;00m mapped �[38;5;28;01mfor�[39;00m mapped_item �[38;5;129;01min�[39;00m mapped_batch]
2026-06-23T01:55:26.2536991Z 
2026-06-23T01:55:26.2537598Z File �[0;32m/opt/hostedtoolcache/Python/3.10.20/x64/lib/python3.10/site-packages/datasets/utils/py_utils.py:383�[0m, in �[0;36m_single_map_nested�[0;34m(args)�[0m
2026-06-23T01:55:26.2538462Z �[1;32m    381�[0m         �[38;5;28;01mreturn�[39;00m function([data_struct])[�[38;5;241m0�[39m]
2026-06-23T01:55:26.2538919Z �[1;32m    382�[0m     �[38;5;28;01melse�[39;00m:
2026-06-23T01:55:26.2539465Z �[0;32m--> 383�[0m         �[38;5;28;01mreturn�[39;00m �[43mfunction�[49m�[43m(�[49m�[43mdata_struct�[49m�[43m)�[49m
2026-06-23T01:55:26.2539973Z �[1;32m    384�[0m �[38;5;28;01mif�[39;00m (
2026-06-23T01:55:26.2540282Z �[1;32m    385�[0m     batched
2026-06-23T01:55:26.2540849Z �[1;32m    386�[0m     �[38;5;129;01mand�[39;00m �[38;5;129;01mnot�[39;00m �[38;5;28misinstance�[39m(data_struct, �[38;5;28mdict�[39m)
2026-06-23T01:55:26.2541525Z �[1;32m    387�[0m     �[38;5;129;01mand�[39;00m �[38;5;28misinstance�[39m(data_struct, types)
2026-06-23T01:55:26.2542500Z �[1;32m    388�[0m     �[38;5;129;01mand�[39;00m �[38;5;28mall�[39m(�[38;5;129;01mnot�[39;00m �[38;5;28misinstance�[39m(v, (�[38;5;28mdict�[39m, types)) �[38;5;28;01mfor�[39;00m v �[38;5;129;01min�[39;00m data_struct)
2026-06-23T01:55:26.2543224Z �[1;32m    389�[0m ):
2026-06-23T01:55:26.2544108Z �[1;32m    390�[0m     �[38;5;28;01mreturn�[39;00m [mapped_item �[38;5;28;01mfor�[39;00m batch �[38;5;129;01min�[39;00m iter_batched(data_struct, batch_size) �[38;5;28;01mfor�[39;00m mapped_item �[38;5;129;01min�[39;00m function(batch)]
2026-06-23T01:55:26.2545092Z 
2026-06-23T01:55:26.2545893Z File �[0;32m/opt/hostedtoolcache/Python/3.10.20/x64/lib/python3.10/site-packages/datasets/formatting/torch_formatter.py:99�[0m, in �[0;36mTorchFormatter._recursive_tensorize�[0;34m(self, data_struct)�[0m
2026-06-23T01:55:26.2547022Z �[1;32m     97�[0m �[38;5;28;01melif�[39;00m �[38;5;28misinstance�[39m(data_struct, (�[38;5;28mlist�[39m, �[38;5;28mtuple�[39m)):
2026-06-23T01:55:26.2548197Z �[1;32m     98�[0m     �[38;5;28;01mreturn�[39;00m �[38;5;28mself�[39m�[38;5;241m.�[39m_consolidate([�[38;5;28mself�[39m�[38;5;241m.�[39mrecursive_tensorize(substruct) �[38;5;28;01mfor�[39;00m substruct �[38;5;129;01min�[39;00m data_struct])
2026-06-23T01:55:26.2549386Z �[0;32m---> 99�[0m �[38;5;28;01mreturn�[39;00m �[38;5;28;43mself�[39;49m�[38;5;241;43m.�[39;49m�[43m_tensorize�[49m�[43m(�[49m�[43mdata_struct�[49m�[43m)�[49m
2026-06-23T01:55:26.2549859Z 
2026-06-23T01:55:26.2550557Z File �[0;32m/opt/hostedtoolcache/Python/3.10.20/x64/lib/python3.10/site-packages/datasets/formatting/torch_formatter.py:80�[0m, in �[0;36mTorchFormatter._tensorize�[0;34m(self, value)�[0m
2026-06-23T01:55:26.2551636Z �[1;32m     78�[0m         value �[38;5;241m=�[39m value�[38;5;241m.�[39mtranspose((�[38;5;241m2�[39m, �[38;5;241m0�[39m, �[38;5;241m1�[39m))
2026-06-23T01:55:26.2552774Z �[1;32m     79�[0m �[38;5;28;01mif�[39;00m config�[38;5;241m.�[39mTORCHVISION_AVAILABLE �[38;5;129;01mand�[39;00m �[38;5;124m"�[39m�[38;5;124mtorchvision�[39m�[38;5;124m"�[39m �[38;5;129;01min�[39;00m sys�[38;5;241m.�[39mmodules:
2026-06-23T01:55:26.2554016Z �[0;32m---> 80�[0m     �[38;5;28;01mfrom�[39;00m�[38;5;250m �[39m�[38;5;21;01mtorchvision�[39;00m�[38;5;21;01m.�[39;00m�[38;5;21;01mio�[39;00m�[38;5;250m �[39m�[38;5;28;01mimport�[39;00m VideoReader
2026-06-23T01:55:26.2555040Z �[1;32m     82�[0m     �[38;5;28;01mif�[39;00m �[38;5;28misinstance�[39m(value, VideoReader):
2026-06-23T01:55:26.2555725Z �[1;32m     83�[0m         �[38;5;28;01mreturn�[39;00m value  �[38;5;66;03m# TODO(QL): set output to torch tensors ?�[39;00m
2026-06-23T01:55:26.2556244Z 
2026-06-23T01:55:26.2556907Z �[0;31mImportError�[0m: cannot import name 'VideoReader' from 'torchvision.io' (/opt/hostedtoolcache/Python/3.10.20/x64/lib/python3.10/site-packages/torchvision/io/__init__.py)
2026-06-23T01:55:26.2557542Z 
2026-06-23T01:55:26.2557693Z ============================== Failure ==============================
2026-06-23T01:55:26.4262373Z ##[error]Process completed with exit code 1.

@github-actions

Copy link
Copy Markdown

Follow-up PR Created

A follow-up PR has been created for the notebooks that failed to process:

Follow-up PR: #1061
Branch: reprocess-pr1060-20260623024352

The failed notebooks have been reverted to their main branch versions in this PR.
Once this PR is merged, the follow-up PR can be used to reprocess the failed notebooks independently.

@iamzoltan iamzoltan left a comment

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@iamzoltan
iamzoltan merged commit 6fcc732 into main Jun 23, 2026
iamzoltan added a commit that referenced this pull request Jun 23, 2026
…0623024352

Reprocess: Failed notebooks from PR #1060
Dammy-Joe pushed a commit to Dammy-Joe/course-content-dl that referenced this pull request Jul 2, 2026
These notebooks failed to process in the original PR and need reprocessing:
- tutorials/W2D5_TimeSeriesAndNaturalLanguageProcessing/W2D5_Tutorial1.ipynb
- tutorials/W3D1_AttentionAndTransformers/W3D1_Tutorial1.ipynb
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants