Evaluation Suites / OpenGray Fast Evaluation Engine
OpenGray Fast Evaluation Engine
OpenGray Workspace · og-fast-eval
High Throughput
Overview
Low-latency execution profile designed for automated prompt test suites, CI pipelines, and structured schema extraction.
Optimised for rapid iteration inside the OpenGray Playground and automated SDK test runners, featuring strict JSON schema validation and real-time cost tracking.
Capabilities
Run this evaluation suite
curl https://open-gray.com/api/v1/evaluations/run \
-H "Authorization: Bearer sk-og-v1-..." \
-H "Content-Type: application/json" \
-d '{
"engine": "og-fast-eval",
"suite": "q3-revenue-summary",
"input": "Summarise our Q3 revenue drivers."
}'
import requests
response = requests.post(
"https://open-gray.com/api/v1/evaluations/run",
headers={"Authorization": "Bearer sk-og-v1-..."},
json={
"engine": "og-fast-eval",
"suite": "q3-revenue-summary",
"input": "Summarise our Q3 revenue drivers.",
},
)
print(response.json()["output"])
const response = await fetch("https://open-gray.com/api/v1/evaluations/run", {
method: "POST",
headers: {
"Authorization": "Bearer sk-og-v1-...",
"Content-Type": "application/json",
},
body: JSON.stringify({
engine: "og-fast-eval",
suite: "q3-revenue-summary",
input: "Summarise our Q3 revenue drivers.",
}),
});
const result = await response.json();
console.log(result.output);
<?php
$payload = [
'engine' => 'og-fast-eval',
'suite' => 'q3-revenue-summary',
'input' => 'Summarise our Q3 revenue drivers.',
];
$ch = curl_init('https://open-gray.com/api/v1/evaluations/run');
curl_setopt_array($ch, [
CURLOPT_POST => true,
CURLOPT_RETURNTRANSFER => true,
CURLOPT_HTTPHEADER => [
'Authorization: Bearer sk-og-v1-...',
'Content-Type: application/json',
],
CURLOPT_POSTFIELDS => json_encode($payload),
]);
$body = json_decode(curl_exec($ch), true);
echo $body['output'];
Pass "stream": true for real-time telemetry events.