Quickstart Guide

​

Get Access to DeepRails

To get started, you’ll need access to the DeepRails Krino Console and API.

• If your organization already uses DeepRails, ask your admin to invite you.
• If not, create your account or contact our team to get setup with a new account.

​

Get Your API Key

1

Visit the Krino Console

Go to your organization’s Krino Console and select API Keys.

2

Select Create API Key

3

Give your key a distinct name and click Create Key

​

Install the DeepRails Client

from deeprails import DeepRails

# Initialize the client (replace "YOUR_TOKEN" with a valid token)
client = DeepRails(token="DEEPRAILS_API_KEY")

from deeprails import DeepRails

# Initialize the client (replace "YOUR_TOKEN" with a valid token)
client = DeepRails(token="DEEPRAILS_API_KEY")

​

Log Your First Evaluation Run

After installation, run the following code in your Python environment. Replace the placeholders with your actual data.

prompt = "Write a poem about winter"
output = "A frosty greeting on a snowy morn..."

eval_response = client.evaluate.create({
    "model_input": {"user_prompt": prompt},
    "model_output": output,
    "type": "text",
    "guardrail_metrics": ["correctness", "completeness"],
    "score_format": "continuous",
})

print("Evaluation created:", eval_response)

​

Explore Results in Krino Console

Once your evaluations are logged:

1. Open your Krino Console
2. Browse historical runs, filter by project or model
3. Compare prompts and completions side-by-side
4. Debug issues with detailed feedback per metric

​

Next Steps