There is qpeek command that allows you to stream what is going on with a job. I think it is a very partial solution for monitoring larger batch of long-running jobs like we encounter in DL. I think it would nice to port/extend qpeek to smartdispatch.
What I envision is having
smart-dispatch peek <batch_id> --err --out
or
smart-dispatch peek all --err --out
that would just print out combined err/out of selected jobs (could use qselect conventions for that).
There are also nice improvements for supporting viewing really many jobs, for instance what if
smart-dispatch peek all --err --out
opened tmux-like window, that would allow to switch quickly between all the jobs running with some shortcut.
There is
qpeekcommand that allows you to stream what is going on with a job. I think it is a very partial solution for monitoring larger batch of long-running jobs like we encounter in DL. I think it would nice to port/extendqpeekto smartdispatch.What I envision is having
smart-dispatch peek <batch_id> --err --outor
smart-dispatch peek all --err --outthat would just print out combined err/out of selected jobs (could use
qselectconventions for that).There are also nice improvements for supporting viewing really many jobs, for instance what if
smart-dispatch peek all --err --outopened tmux-like window, that would allow to switch quickly between all the jobs running with some shortcut.