Guild uses jupyter-nbconvert
to execute a notebook in-place. This
command does not render output as it executes. Guild reads output
after the command is executed. This makes it impossible to record
output scalars before the notebook executes fully.
Requirements:
- guild<=0.7.3rc1
- See requirements.txt
Execute guild run test.ipynb
and in a separate terminal run guild tensorboard
to view progress. Scalars are not displayed until after
the notebook completes.
Write scalars as they are generated to a TF event file using one of the various supported methods. Since scalars are logged explicitly, you can disable output scalars for the operation. See guild.yml for a sample configuration.
To test the workaround provided here, run guild run test
and run
guild tensorboard
in a separate terminal. Refresh the view as the
notebook runs - TensorBoard should show the latest loss recorded by
the notebook as the notebook runs.
None planned at this time. See Workarounds above for information on logging scalars as the notebook runs.