Installation
Gaussia uses a modular dependency system, allowing you to install only the components you need.Requirements
- Python 3.11 or higher
- uv (recommended) or pip
Basic Installation
Optional Dependencies
Gaussia provides optional dependency groups for each metric and feature:Metrics
| Extra | Description | Dependencies |
|---|---|---|
toxicity | Toxicity metric with clustering | sentence-transformers, hdbscan, umap-learn, nltk, numpy, pandas |
bias | Bias metric with guardian models | torch |
vision | Vision similarity and hallucination | numpy, sentence-transformers, torch |
humanity | Humanity metric with NRC lexicon | numpy, pandas |
regulatory | Regulatory compliance metric | torch, accelerate |
Features
| Extra | Description | Dependencies |
|---|---|---|
generators | Synthetic dataset generation | langchain-core |
explainability | Token attribution analysis | interpreto, torch, transformers |
prompt-optimizer | Prompt optimization | optuna |
Combined Extras
| Extra | Description |
|---|---|
metrics | All metric extras combined |
all | All metrics and features |
Installation Examples
LLM Provider Dependencies
Several metrics require LangChain-compatible chat models. Install your preferred provider:Verifying Installation
Troubleshooting
ImportError: No module named 'sentence_transformers'
ImportError: No module named 'sentence_transformers'
Install the toxicity extras:
ImportError: No module named 'langchain_openai'
ImportError: No module named 'langchain_openai'
Install your preferred LLM provider:
CUDA/GPU issues with sentence-transformers
CUDA/GPU issues with sentence-transformers
For CPU-only installation:
Python version incompatibility
Python version incompatibility
Ensure you’re using Python 3.11+:
Next Steps
Quickstart
Run your first evaluation
Core Concepts
Understand the architecture