Configuration

Alumnium needs access to an AI model to work. The following models are supported:

Provider	Model
Anthropic	Claude 3 Haiku
Google	Gemini 2.0 Flash
OpenAI (default)	GPT-4o Mini
Meta	Llama 3.2 90B

These models were chosen because they provide the best balance between intelligence, performance, and cost. They all behave roughly the same in Alumnium tests.

Trying out?

Google provides free-of-charge plan in many regions, which is convenient for experimenting. Alumnium automatically retries the requests when hitting rate limits on the free plans.

Anthropic

To use Anthropic as an AI provider in Alumnium:

1. Get the API key.
2. Export the following environment variables before running tests:

export ALUMNIUM_MODEL="anthropic"
export ANTHROPIC_API_KEY="sk-ant-..."

Google

To use Google AI Studio as an AI provider in Alumnium:

1. Get the API key.
2. Export the following environment variables before running tests:

export ALUMNIUM_MODEL="google"
export GOOGLE_API_KEY="..."

OpenAI

To use OpenAI as an AI provider in Alumnium:

1. Get the API key.
2. Export the following environment variables before running tests:

export ALUMNIUM_MODEL="openai"
export OPENAI_API_KEY="sk-proj-..."

Meta

Caution

Llama support is experimental and doesn’t work with vision checks. Its performance also highly depends on how you run it. The current implementation works via Amazon Bedrock, but we’re looking forward to extending it with Ollama, llama.cpp, etc.

To use Meta Llama as an AI provider in Alumnium:

1. Set up an Amazon Bedrock account.
2. Enable access to Llama 3.2 models.
3. Get the access key and secret.
4. Export the following environment variables before running tests:

export ALUMNIUM_MODEL="aws_meta"
export AWS_ACCESS_KEY="..."
export AWS_SECRET_KEY="..."

Read next to learn how to write tests!