Getting started with DeepRails Monitor takes only a few minutes. It involves 3 simple steps:

​

Get started with DeepRails Monitor

​

Get Access to DeepRails

To get started, you’ll need access to the DeepRails Krino Console and API.

• If your organization already uses DeepRails, ask your admin to invite you.
• If not, create your account or contact our team to get setup with a new account.

​

Get Your API Key

1

Visit the Krino Console

Go to your organization’s Krino Console and select API Keys.

2

Select Create API Key

3

Give your key a distinct name and click Create Key

​

Install the DeepRails Client

from deeprails import DeepRails

# Initialize the client (replace "YOUR_TOKEN" with a valid token)
client = DeepRails(token="DEEPRAILS_API_KEY")

from deeprails import DeepRails

# Initialize the client (replace "YOUR_TOKEN" with a valid token)
client = DeepRails(token="DEEPRAILS_API_KEY")

​

Create Your Monitor

Go to your Krino Console and create a new Monitor for your workflow. Define its purpose and select the Guardrail metrics you want to track.

Alternatively, you can create a Monitor programmatically using the Python SDK:

name = "History Tutor"
description = "v2, World War II Unit"

monitor_data = {
    "name": name,
    "description": description,
    "metrics": ["correctness", "safety"]
}

monitor_resp = client.monitor.create(monitor_data)
monitor_id = monitor_resp["monitor_id"]

Make sure to save the monitor_id. You’ll need it when logging events associated with this Monitor.

​

Log Your First Event

After setting up the Monitor, run the following code in your Python environment. Replace the placeholders with your actual data.

prompt = "Why did World War 2 start?"
output = "World War II began because some countries wanted more power and land. Germany and Japan invaded other countries, which caused a big conflict."

event_data = {
    "model_input": {"user_prompt": prompt},
    "model_output": output,
    "temperature": 0.7,
    "top_p": 1.0,
    "model": "gpt-3.5-turbo"
}

event_resp = client.monitor.log(monitor_id, event_data)
print("Monitor event logged:", event_resp)

​

Explore Results in Krino Console

Once your evaluations are logged:

1. Open your Krino Console
2. Navigate to the Monitor you created
3. View incoming events and track trends across prompt, model, and metric performance
4. Investigate anomalies, regressions, or drops in quality with detailed Guardrail feedback.

​

Next Steps