有没有一种方法可以使用mlfow从AWS Glue Job记录统计信息/工件？

Question

您能否让我知道在mlflow的当前版本中是否有这样的功能？

Answer 1

I think the general answer here is that you can log arbitrary data and artifacts from your experiment to your MLflow tracking server using mlflow_log_artifact() or mlflow_set_tag() , depending on how you want to do it. If there's an API to get data from Glue and you can fetch it during your MLflow run, then you can log it. Write a csv, save a .png to disk and log that, or declare a variable and access it when you are setting the tag.

This applies for Glue or any other API that you are getting a response from. One of the key benefits of MLflow is that it is such a general framework, so you can track what matters to that particular experiment.

Hope this helps!