Skip to content

Hint: If you want to see a list of allocated tensors when OOM happens, add report_tensor_allocations_upon_oom to RunOptions for current allocation info. This isn't available when running in Eager mode. 0 successful operations. 0 derived errors ignored. #221

Open
@How-to-say

Description

@How-to-say

Traceback (most recent call last):
File "C:\Users\WYJ\Desktop\SpleeterGUI_2.9.5\SpleeterGUI\python\tensorflow\python\client\session.py", line 1377, in _do_call
return fn(*args)
File "C:\Users\WYJ\Desktop\SpleeterGUI_2.9.5\SpleeterGUI\python\tensorflow\python\client\session.py", line 1360, in _run_fn
return self._call_tf_sessionrun(options, feed_dict, fetch_list,
File "C:\Users\WYJ\Desktop\SpleeterGUI_2.9.5\SpleeterGUI\python\tensorflow\python\client\session.py", line 1453, in _call_tf_sessionrun
return tf_session.TF_SessionRun_wrapper(self._session, options, feed_dict,
tensorflow.python.framework.errors_impl.ResourceExhaustedError: 2 root error(s) found.
(0) RESOURCE_EXHAUSTED: OOM when allocating tensor with shape[25,16,256,512] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc
[[{{function_node batch_normalization_12_cond_false_1982}}{{node FusedBatchNormV3}}]]
Hint: If you want to see a list of allocated tensors when OOM happens, add report_tensor_allocations_upon_oom to RunOptions for current allocation info. This isn't available when running in Eager mode.
[[strided_slice_15/_905]]
Hint: If you want to see a list of allocated tensors when OOM happens, add report_tensor_allocations_upon_oom to RunOptions for current allocation info. This isn't available when running in Eager mode.
(1) RESOURCE_EXHAUSTED: OOM when allocating tensor with shape[25,16,256,512] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc
[[{{function_node batch_normalization_12_cond_false_1982}}{{node FusedBatchNormV3}}]]
Hint: If you want to see a list of allocated tensors when OOM happens, add report_tensor_allocations_upon_oom to RunOptions for current allocation info. This isn't available when running in Eager mode.
0 successful operations.
0 derived errors ignored.
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "runpy.py", line 196, in run_module_as_main
File "runpy.py", line 86, in run_code
File "C:\Users\WYJ\Desktop\SpleeterGUI_2.9.5\SpleeterGUI\python\spleeter_main
.py", line 273, in
entrypoint()
File "C:\Users\WYJ\Desktop\SpleeterGUI_2.9.5\SpleeterGUI\python\spleeter_main
.py", line 267, in entrypoint
spleeter()
File "C:\Users\WYJ\Desktop\SpleeterGUI_2.9.5\SpleeterGUI\python\typer\main.py", line 214, in call
return get_command(self)(*args, **kwargs)
File "C:\Users\WYJ\Desktop\SpleeterGUI_2.9.5\SpleeterGUI\python\click\core.py", line 829, in call
return self.main(*args, **kwargs)
File "C:\Users\WYJ\Desktop\SpleeterGUI_2.9.5\SpleeterGUI\python\click\core.py", line 782, in main
rv = self.invoke(ctx)
File "C:\Users\WYJ\Desktop\SpleeterGUI_2.9.5\SpleeterGUI\python\click\core.py", line 1259, in invoke
return process_result(sub_ctx.command.invoke(sub_ctx))
File "C:\Users\WYJ\Desktop\SpleeterGUI_2.9.5\SpleeterGUI\python\click\core.py", line 1066, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "C:\Users\WYJ\Desktop\SpleeterGUI_2.9.5\SpleeterGUI\python\click\core.py", line 610, in invoke
return callback(*args, **kwargs)
File "C:\Users\WYJ\Desktop\SpleeterGUI_2.9.5\SpleeterGUI\python\typer\main.py", line 497, in wrapper
return callback(**use_params) # type: ignore
File "C:\Users\WYJ\Desktop\SpleeterGUI_2.9.5\SpleeterGUI\python\spleeter_main
.py", line 141, in separate
separator.separate_to_file(
File "C:\Users\WYJ\Desktop\SpleeterGUI_2.9.5\SpleeterGUI\python\spleeter\separator.py", line 297, in separate_to_file
sources = self.separate(waveform, audio_descriptor)
File "C:\Users\WYJ\Desktop\SpleeterGUI_2.9.5\SpleeterGUI\python\spleeter\separator.py", line 241, in separate
return self._separate_tensorflow(waveform, audio_descriptor)
File "C:\Users\WYJ\Desktop\SpleeterGUI_2.9.5\SpleeterGUI\python\spleeter\separator.py", line 221, in _separate_tensorflow
prediction = next(prediction_generator)
File "C:\Users\WYJ\Desktop\SpleeterGUI_2.9.5\SpleeterGUI\python\tensorflow_estimator\python\estimator\estimator.py", line 642, in predict
preds_evaluated = mon_sess.run(predictions)
File "C:\Users\WYJ\Desktop\SpleeterGUI_2.9.5\SpleeterGUI\python\tensorflow\python\training\monitored_session.py", line 782, in run
return self._sess.run(
File "C:\Users\WYJ\Desktop\SpleeterGUI_2.9.5\SpleeterGUI\python\tensorflow\python\training\monitored_session.py", line 1311, in run
return self._sess.run(
File "C:\Users\WYJ\Desktop\SpleeterGUI_2.9.5\SpleeterGUI\python\tensorflow\python\training\monitored_session.py", line 1416, in run
raise six.reraise(*original_exc_info)
File "C:\Users\WYJ\Desktop\SpleeterGUI_2.9.5\SpleeterGUI\python\six.py", line 719, in reraise
raise value
File "C:\Users\WYJ\Desktop\SpleeterGUI_2.9.5\SpleeterGUI\python\tensorflow\python\training\monitored_session.py", line 1401, in run
return self._sess.run(*args, **kwargs)
File "C:\Users\WYJ\Desktop\SpleeterGUI_2.9.5\SpleeterGUI\python\tensorflow\python\training\monitored_session.py", line 1469, in run
outputs = _WrappedSession.run(
File "C:\Users\WYJ\Desktop\SpleeterGUI_2.9.5\SpleeterGUI\python\tensorflow\python\training\monitored_session.py", line 1232, in run
return self._sess.run(*args, **kwargs)
File "C:\Users\WYJ\Desktop\SpleeterGUI_2.9.5\SpleeterGUI\python\tensorflow\python\client\session.py", line 967, in run
result = self._run(None, fetches, feed_dict, options_ptr,
File "C:\Users\WYJ\Desktop\SpleeterGUI_2.9.5\SpleeterGUI\python\tensorflow\python\client\session.py", line 1190, in _run
results = self._do_run(handle, final_targets, final_fetches,
File "C:\Users\WYJ\Desktop\SpleeterGUI_2.9.5\SpleeterGUI\python\tensorflow\python\client\session.py", line 1370, in _do_run
return self._do_call(_run_fn, feeds, fetches, targets, options,
File "C:\Users\WYJ\Desktop\SpleeterGUI_2.9.5\SpleeterGUI\python\tensorflow\python\client\session.py", line 1396, in _do_call
raise type(e)(node_def, op, message) # pylint: disable=no-value-for-parameter
tensorflow.python.framework.errors_impl.ResourceExhaustedError: Graph execution error:
2 root error(s) found.
(0) RESOURCE_EXHAUSTED: OOM when allocating tensor with shape[25,16,256,512] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc
[[{{node FusedBatchNormV3}}]]
Hint: If you want to see a list of allocated tensors when OOM happens, add report_tensor_allocations_upon_oom to RunOptions for current allocation info. This isn't available when running in Eager mode.
[[strided_slice_15/_905]]
Hint: If you want to see a list of allocated tensors when OOM happens, add report_tensor_allocations_upon_oom to RunOptions for current allocation info. This isn't available when running in Eager mode.
(1) RESOURCE_EXHAUSTED: OOM when allocating tensor with shape[25,16,256,512] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc
[[{{node FusedBatchNormV3}}]]
Hint: If you want to see a list of allocated tensors when OOM happens, add report_tensor_allocations_upon_oom to RunOptions for current allocation info. This isn't available when running in Eager mode.
0 successful operations.
0 derived errors ignored.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions