Cannot load htm_llama3_refined.json

[lambert-x]

Hi, thanks for the great work.

I download the howto meta file from huggingface and try to load it on a server. However, it always hang and never ends the loading operation. Could you please download the file from your side and load it? I think the metafile migh be corrupted. The SHA256 code is the same as the huggingface.

Here is the script

import json

# Path to the JSON file
file_path = '/dev/shm/HowTo100M_llama3_refined_caption/htm_llama3_refined.json'

# Function to read the first four items from the JSON file
def read_first_four_items(file_path):
    with open(file_path, 'r') as file:
        data = json.load(file)
    
    # Extract the first four items
    first_four_items = data[:4]
    return first_four_items

# Reading the first four items from the JSON file
first_four_items = read_first_four_items(file_path)

# Display the first four items
for i, item in enumerate(first_four_items, start=1):
    print(f'Item {i}: {item}')

[Jazzcharles]

Sorry for the late reply. I have downloaded the file and successfully loaded it with the following code.

import json
metafile = json.load(open('htm_llama3_refined.json'))

The json file is large, so the loading might take a while (several minutes).