Skip to main content

Prerequisites

  • Python 3.12
If you plan to fine-tune on GPU, you’ll also need a compatible CUDA environment (for example, 1x H100-class GPU). Install the SDK with the extras you need:

LLM provider extras (optional)

Pick the provider(s) you use for generation/labeling:
Available LLM providers include llm-openai, llm-azure-openai, llm-gemini, llm-groq.

Deployment extras (optional)

Pick the deployment extra for the cloud environment you use:
Available deployment extras include deploy-kubernetes, deploy-vertex-ai, deploy-azureml, deploy-sagemaker.

Verify install