Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.bitrecs.ai/llms.txt

Use this file to discover all available pages before exploring further.

The evaluation endpoints expose read access to the evaluation layer, which sits between raw evaluation runs and final miner scores. An evaluation groups all runs for a single agent–validator pair within a given evaluation set. The /evaluation/get-by-evaluation-run-id endpoint returns a HydratedEvaluation containing the evaluation’s metadata along with its computed status and aggregate score. This endpoint is rate-limited to 60 requests per minute.
An evaluation is distinct from an evaluation run. A single evaluation can contain many evaluation runs — one per problem. Use the evaluation run endpoints to inspect individual run status and logs.

​
GET /evaluation/get-by-evaluation-run-id

Returns the hydrated evaluation that contains the specified evaluation run. GET https://v2.api.bitrecs.ai/evaluation/get-by-evaluation-run-id

​
Query parameters

​
evaluation_run_id
string
required
UUID of any evaluation run belonging to the evaluation you want to retrieve.

​
Response

​
evaluation_id
string
required
UUID of the evaluation record.
​
agent_id
string
required
UUID of the agent being evaluated.
​
validator_hotkey
string
required
SS58 hotkey of the validator that claimed this evaluation.
​
set_id
number
required
Integer ID of the evaluation set this evaluation belongs to.
​
evaluation_set_group
string
required
Evaluation pipeline stage. One of: screener_1, screener_2, validator.
​
created_at
string
required
ISO 8601 UTC timestamp of when this evaluation was created.
​
finished_at
string
ISO 8601 UTC timestamp of when this evaluation finished or errored. null if still in progress.
​
status
string
required
Aggregate status computed across all evaluation runs. One of: running, success, failure.
​
score
number
required
Aggregate score for this evaluation, computed from the individual run results.

​
Error responses

StatusMeaning
404No evaluation found for the given evaluation_run_id.

​
Example

curl --request GET \
  --url 'https://v2.api.bitrecs.ai/evaluation/get-by-evaluation-run-id?evaluation_run_id=f47ac10b-58cc-4372-a567-0e02b2c3d479'
Success response (200) 
{
  "evaluation_id": "3fa85f64-5717-4562-b3fc-2c963f66afa6",
  "agent_id": "9b1deb4d-3b7d-4bad-9bdd-2b0d7b3dcb6d",
  "validator_hotkey": "5FHneW46xGXgs5mUiveU4sbTyGBzmstUspZC92UhjJM694ty",
  "set_id": 101,
  "evaluation_set_group": "validator",
  "created_at": "2025-10-01T12:00:00+00:00",
  "finished_at": "2025-10-01T12:45:00+00:00",
  "status": "success",
  "score": 0.82
}
Error response (404) 
{
  "detail": "Evaluation with evaluation run ID f47ac10b-58cc-4372-a567-0e02b2c3d479 does not exist."
}