WIP Initial commit to get some things logged to mlflow. #170
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
If testing locally be sure to
pip install mlflow
, and optionallypynvml
if you want to collect gpu metrics.You should be able to log model parameters and metrics immediately without any initial setup. To view the results you'll need to start the mlflow server using the following at the command line:
mlflow ui --backend-store-uri file://<.../results/mlflow>
Pass in the full path to the directory
/<where your results are>/results/mlflow
with a leading/
.Then go to `http://127.0.0.1:5000 and you should be presented with the MLFlow UI.
The default experiment is
notebook
. You can change the experiment name in your config using:In this example, I used port 8080 by starting mlflow server like so:
mlflow ui --backend-store-uri ... --port 8080
Example showing the parameter logging - by default, it will log all the keys under
[model]
and the criterion and optimizer specific parameters in the configuration used for the run. Other parameters can be added. The screenshot below shows only the model parameter.