Skip to content

RuntimeError: CUDA out of memory. #9

@IGR1chard

Description

@IGR1chard

hi, i got a problem when running the example code, it comes out the error:
RuntimeError: CUDA out of memory :Tried to allocate 183.75 GiB (GPU 0; 12.00 GiB total capacity; 4.98 GiB already allocated; 0 bytes free; 23.62 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF
CODE HERE:
file_path = 'E:/seismic/'
file_name = "Eureka-DT1087-2m-P5kHz-fs250Hz_2022-06-18T112221Z.h5"

normalize = lambda x: (x - np.mean(x, axis=-1, keepdims=True)) / np.std(x, axis=-1, keepdims=True)
with h5py.File(file_path+file_name, "r") as fp:

dx = fp["Acquisition"].attrs["SpatialSamplingInterval"]
fs = fp['Acquisition/Raw[0]'].attrs["OutputDataRate"]
dt = 1.0 / fs
data = fp["Acquisition/Raw[0]/RawData"][...]
data = np.gradient(data, axis=-1) / dt

nx, nt = data.shape
x = np.arange(nx) * dx
t = np.arange(nt) * dt

ngpu = torch.cuda.device_count()
format=h5 --batch_size 1 --workers 0"
base_cmd = (
"EQNet/predict.py "
"--model phasenet_das "
"--data_list=D:/AnacondaProject/3d/files.txt " #
"--data_path=E:/seismic " #
"--result_path=E:/seismic " #
"--format=h5 "
"--batch_size=1 "
"--workers=0"
)
if ngpu == 0:
cmd = f"python {base_cmd} --device cpu --system optasense"
elif ngpu == 1:
cmd = f"python {base_cmd} --system optasense"
else:
cmd = f"torchrun --nproc_per_node {ngpu} {base_cmd} --system optasense"

print(cmd)
os.system(cmd)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions