Retrieve an Event's Details
Use this endpoint to retrieve a specific event of a guardrail workflow
status, whether the output needed to be filtered out, the improved_model_output if it needed remediation, and more.The
filtered field is set to true when the event fails one or more metrics on the most recent evaluation and is set to false if all metric evaluations were above their thresholds. If filtered is true, then an improvement attempt will begin immediately after the initial evaluation concludes.The
evaluation_history field is an array of the details for each evaluation performed for the event. It can be used to track the progress of the event and see how DeepRails improved your model output over time.The
analysis_of_failures and key_improvements fields summarize the failings of the model output and the relevant changes of the improvement attempt at each step. These fields are returned for each evaluation, except the final one, and summaries of all of failures and improvements are returned in the analysis_of_failures and key_improvements fields of the event response.Authorizations
Bearer authentication header of the form Bearer <token>, where <token> is your auth token.
Path Parameters
The ID of the workflow associated with the event.
The ID of the requested workflow event.
Response
Workflow event details retrieved successfully
Workflow ID associated with the event.
"wkfl_xxxxxxxxxxxx"
A unique workflow event ID.
"evt_xxxxxxxxxxxx"
Status of the event.
In Progress, Completed "Completed"
Type of improvement action used to improve the event.
regen, fixit, do_nothing "fixit"
Type of thresholds used to evaluate the event.
custom, automatic "custom"
Whether the event was filtered and requires improvement.
false
Status of the improvement tool used to improve the event. improvement_required indicates that the evaluation is complete and the improvement action is needed but is not taking place. improved and improvement_failed indicate when the improvement action concludes, successfully and unsuccessfully, respectively. no_improvement_required means that the first evaluation passed all its metrics!
improved, improvement_failed, no_improvement_required, improvement_required "improved"
Improved model output after improvement tool was applied and each metric passed evaluation.
"Mitosis creates haploid gametes for reproduction, while meiosis produces identical diploid cells for growth."
Evaluation result consisting of average scores and rationales for each of the evaluated guardrail metrics.
{
"completeness": {
"score": 0.89,
"rationale": "The sentence is concise, relevant, and well-structured, and it covers the main differences (cell number, genetic similarity, ploidy, and biological role) appropriate to a one-sentence answer. However, it overgeneralizes and makes unqualified universal claims: stating mitosis produces 'diploid' cells and meiosis produces 'four ... gametes' can be inaccurate in some biological contexts (e.g., mitosis in haploid cells or organisms, and oogenesis producing one functional ovum plus polar bodies). To make the sentence both accurate and still compact, add brief qualifiers—for example: 'In diploid organisms, mitosis produces two genetically similar diploid daughter cells for growth and repair, whereas meiosis involves two divisions that typically yield four genetically varied haploid cells (gametes), although in female animals often only one functional gamete results.' This preserves brevity while removing the main factual overgeneralizations.",
"threshold": 0.8
},
"instruction_adherence": {
"score": 1,
"rationale": "The response exemplary meets the explicit instructions by delivering a single, well-formed sentence that clearly contrasts mitosis and meiosis using key distinguishing features (cell number, genetic identity/variation, ploidy, and biological purpose), showing concise and accurate adherence to the prompt.",
"threshold": 0.8
}
}History of evaluations for the event.
[
{
"attempt": "Initial Evaluation",
"evaluation_status": "completed",
"improvement_tool_status": "improvement_required",
"analysis_of_failures": "The response is concise, and well-structured, but it does not cover the main differences (cell number, genetic similarity, ploidy, and biological role) appropriate to a one-sentence answer.",
"key_improvements": [
"Added a brief qualifier to the sentence to make it more accurate.",
"Added a more detailed explanation of the differences between mitosis and meiosis."
],
"guardrail_metrics": ["completeness", "instruction_adherence"],
"run_mode": "precision",
"model_input": {
"user_prompt": "Explain the difference between mitosis and meiosis in one sentence.",
"context": [
{
"role": "user",
"content": "I have an AP Bio exam tomorrow, can you help me study?"
},
{
"role": "tutor",
"content": "Sure, I'll help you study."
}
]
},
"model_output": "Mitosis creates haploid gametes for reproduction, while meiosis produces identical diploid cells for growth.",
"nametag": "Test",
"progress": 100,
"error_message": null,
"evaluation_result": {
"completeness": {
"score": 0.6,
"rationale": "The response is concise, and well-structured, but it does not cover the main differences (cell number, genetic similarity, ploidy, and biological role) appropriate to a one-sentence answer.",
"threshold": 0.8
},
"instruction_adherence": {
"score": 0.25,
"rationale": "The response does not highlight the key differences between mitosis and meiosis.",
"threshold": 0.8
}
},
"evaluation_total_cost": 0.01,
"created_at": "2025-11-10T01:32:44.591Z"
},
{
"attempt": "Improvement Attempt 1",
"evaluation_status": "completed",
"improvement_tool_status": "improved",
"analysis_of_failures": null,
"key_improvements": null,
"guardrail_metrics": ["completeness", "instruction_adherence"],
"run_mode": "precision",
"model_input": {
"user_prompt": "Explain the difference between mitosis and meiosis in one sentence.",
"context": [
{
"role": "user",
"content": "I have an AP Bio exam tomorrow, can you help me study?"
},
{
"role": "tutor",
"content": "Sure, I'll help you study."
}
]
},
"model_output": "Mitosis produces two genetically identical diploid cells for growth and tissue repair, whereas meiosis generates four genetically varied haploid gametes for sexual reproduction.",
"nametag": "Test",
"progress": 100,
"error_message": null,
"evaluation_result": {
"completeness": {
"score": 0.89,
"rationale": "The sentence is concise, relevant, and well-structured, and it covers the main differences (cell number, genetic similarity, ploidy, and biological role) appropriate to a one-sentence answer. However, it overgeneralizes and makes unqualified universal claims: stating mitosis produces 'diploid' cells and meiosis produces 'four ... gametes' can be inaccurate in some biological contexts (e.g., mitosis in haploid cells or organisms, and oogenesis producing one functional ovum plus polar bodies). To make the sentence both accurate and still compact, add brief qualifiers—for example: 'In diploid organisms, mitosis produces two genetically similar diploid daughter cells for growth and repair, whereas meiosis involves two divisions that typically yield four genetically varied haploid cells (gametes), although in female animals often only one functional gamete results.' This preserves brevity while removing the main factual overgeneralizations.",
"threshold": 0.8
},
"instruction_adherence": {
"score": 1,
"rationale": "The response exemplary meets the explicit instructions by delivering a single, well-formed sentence that clearly contrasts mitosis and meiosis using key distinguishing features (cell number, genetic identity/variation, ploidy, and biological purpose), showing concise and accurate adherence to the prompt.",
"threshold": 0.8
}
},
"evaluation_total_cost": 0.01,
"created_at": "2025-11-10T01:32:44.591Z"
}
][
{
"0": [
"Added a brief qualifier to the sentence to make it more accurate.",
"Added a more detailed explanation of the differences between mitosis and meiosis."
]
}
]The maximum number of improvement attempts to be applied to one event before it is considered failed.
10
Mapping of guardrail metric names to tolerance values. Values are strings (low, medium, high) representing automatic tolerance levels.
null
Mapping of guardrail metric names to threshold values. Values are floating point numbers (0.0-1.0) representing custom thresholds.
{
"completeness": 0.8,
"instruction_adherence": 0.8
}Extended AI capabilities available to the event, if any. Can be web_search, file_search, and/or context_awareness.
[
{ "capability": "web_search" },
{ "capability": "file_search" },
{ "capability": "context_awareness" }
]List of files available to the event, if any. Will only be present if file_search is enabled.