Configuration

Alumnium needs access to an AI model to work. The following models are supported:

Provider	Model
Anthropic	Claude 4.5 Haiku
GitHub	GPT-4o Mini
Google	Gemini 3 Flash
OpenAI (default)	GPT-5 Nano
DeepSeek	DeepSeek R1
Meta	Llama 4 Maverick 17B
MistralAI	Mistral Medium 3
Ollama	Mistral Small 3.1 24B
xAI	Grok 4.1 Fast Reasoning

These models were chosen because they provide the best balance between intelligence, performance, and cost. Most models now support reasoning capabilities for improved accuracy and decision-making in test automation.

Trying out?

Google and GitHub provide free-of-charge plans in many regions, which are convenient for experimenting. Alumnium automatically retries the requests when hitting rate limits on the free plans.

Anthropic

To use Anthropic as an AI provider in Alumnium:

1. Get the API key.
2. Export the following environment variables before running tests:

export ALUMNIUM_MODEL="anthropic"
export ANTHROPIC_API_KEY="sk-ant-..."

GitHub

To use GitHub Models AI provider with OpenAI in Alumnium:

1. Get the personal access token.
2. Export the following environment variables before running tests:

export ALUMNIUM_MODEL="github"
export OPENAI_API_KEY="github_pat_..."

Google

To use Google AI Studio as an AI provider in Alumnium:

1. Get the API key.
2. Export the following environment variables before running tests:

export ALUMNIUM_MODEL="google"
export GOOGLE_API_KEY="..."

OpenAI

To use OpenAI as an AI provider in Alumnium:

1. Get the API key.
2. Export the following environment variables before running tests:

export ALUMNIUM_MODEL="openai"
export OPENAI_API_KEY="sk-proj-..."

DeepSeek

Caution

DeepSeek support is experimental and doesn’t work with vision checks. The current implementation works via the DeepSeek Platform, but we’re looking forward to extending it with Ollama, llama.cpp, etc.

To use DeepSeek as an AI provider in Alumnium:

1. Set up a DeepSeek Platform account.
2. Get the API key.
3. Export the following environment variable before running tests:

export ALUMNIUM_MODEL="deepseek"
export DEEPSEEK_API_KEY="sk-..."

Meta

Caution

Llama support is experimental. Its performance also highly depends on how you run it. The current implementation works via Amazon Bedrock, but we’re looking forward to extending it with Ollama, llama.cpp, etc.

To use Meta Llama as an AI provider in Alumnium:

1. Set up an Amazon Bedrock account.
2. Enable access to Llama 4 Maverick models.
3. Get the access key and secret.
4. Export the following environment variables before running tests:

export ALUMNIUM_MODEL="aws_meta"
export AWS_ACCESS_KEY="..."
export AWS_SECRET_KEY="..."

MistralAI

To use MistralAI as an AI provider in Alumnium:

1. Get the API key.
2. Export the following environemnt variables before running testes:

export ALUMNIUM_MODEL="mistralai"
export MISTRAL_API_KEY="..."

Ollama

Caution

Ollama support is experimental and performance depends on your hardware.

To use Ollama for a fully local model inference:

1. Download and install Ollama.
2. Download Mistrall Small 3.1 24B model:

ollama pull mistral-small3.1:24b

3. Export the following environment variable before running tests:

export ALUMNIUM_MODEL="ollama"
export ALUMNIUM_OLLAMA_URL="..."  # if you host Ollama on a server

xAI

To use xAI as an AI provider in Alumnium:

1. Get the API key.
2. Export the following environemnt variables before running testes:

export ALUMNIUM_MODEL="xai"
export XAI_API_KEY="xai-..."

Read next to learn how to write tests!