Skip to main content

​
create_metric_configs

def create_metric_configs(project_id: str,
                          run_id: str,
                          metrics: builtins.list[Union[GalileoScorers, Metric, LocalMetricConfig, str]]) -> tuple[builtins.list[ScorerConfig], builtins.list[LocalMetricConfig]]
Process metrics and create scorer configurations for experiments or log streams. This unified function categorizes metrics into server-side and client-side types, validates they exist, and registers server-side metrics with Galileo. Arguments
  • project_id (str): The ID of the project
  • run_id (str): The ID of the run (can be experiment ID or log stream ID)
  • metrics (builtins.list[Union[GalileoScorers, Metric, LocalMetricConfig, str]]): List of metrics to configure
Raises
  • ValueError: If any specified metrics are unknown or don’t exist in Galileo
Returns
  • tuple[builtins.list[ScorerConfig], builtins.list[LocalMetricConfig]]: A tuple containing:
  • List of ScorerConfig objects for server-side metrics configured in Galileo
  • List of LocalMetricConfig objects for client-side metrics to process locally