Dask Persistent Task Graph Visualisation

[CMCDragonkai]

The "Graph" or "Task Graph" visualisation on the web UI seems to only show a visualisation when there's a running job on the dask cluster.

Is there a way to make this visualisation persistent? Or to keep a record of the visualisation so we can review the details after the job has finished?

[mrocklin]

There is the `.visualize()` method on Dask collection objects, although that uses a different rendering engine (graphviz) which slows down after a few hundred nodes. Currently there is no way to save the Task Graph plot, it would probably be pretty easy to add a Bokeh tool to safe a static figure though. https://bokeh.pydata.org/en/latest/docs/user_guide/tools.html#savetool

…

On Mon, Mar 11, 2019 at 12:12 AM Roger Qiu ***@***.***> wrote: The "Graph" or "Task Graph" visualisation on the web UI seems to only show a visualisation when there's a running job on the dask cluster. Is there a way to make this visualisation persistent? Or to keep a record of the visualisation so we can review the details after the job has finished? — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <https://github.com/dask/dask/issues/4577>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AASszI9lhJ9YwVmcxtoEgaZ3CuPLYwqDks5vVgHygaJpZM4bn8Ap> .

[mrocklin]

I've moved this to the dask/distributed repository

[mathdugre]

The "Graph" tab seems to already have the option (see photo below); please correct me if this is not what you meant.

However, I agree with @CMCDragonkai that it could be useful on the "Task Graph" as well; and maybe on the "Profile" tab so that all plot (except the system ones) can be saved.

@mrocklin What do you think?

[mrocklin]

There are a couple of functions, for those plots

• http://docs.dask.org/en/latest/futures.html#distributed.Client.profile
• http://docs.dask.org/en/latest/futures.html#distributed.Client.get_task_stream

However they are not well advertised and not as easy to use as a simple button :)

I think that improving the user's ability here to record telemetry and present it after exerution would be very valuable.