← Market

Rag Metrics

All metrics are defined in the response. With relevant_ids: precision@k and recall@k over the first k contexts, MRR, average precision and nDCG@k with binary relevance and log2 discount. Without relevant_ids, a context counts as relevant when it supports the reference (or the question if no reference) at or above the threshold; context precision = mean of precision@i over relevant positions (rank-weighted, as in RAGAS but without an LLM judge).

POST https://denk.halowerk.com/v1/rag-metrics

0.004 USDC on Base · payTo 0x2880EdfFF13100677Bf97A3CBdF3Bc34771C4E5E

Status: verified · payable

Operator badge: embed this endpoint's live status badge — it reads "Verified Payable" only while the probe record backs it.

Settlement: direct to the seller's payTo — 0% HIVE402 take

Payment routes

Base · 0.004 USDC · payTo 0x2880EdfFF13100677Bf97A3CBdF3Bc34771C4E5E · via cdp · settles direct
{
  "answer": "The Eiffel Tower is in Paris.",
  "contexts": [
    "The Eiffel Tower is a landmark in Paris, completed in 1889.",
    "Berlin is the capital of Germany."
  ],
  "question": "Where is the Eiffel Tower?"
}

Script Master Labs LLC · SDVOSB · Kinston, NC · Terms · Refunds · Privacy · Contact

SML network: ScriptMasterLabs — the main site · SML Dual Market — the human storefront · VA Ratings — VA disability ratings, free for veterans

Agent intel trust badge

Trust score72 / 100 · breakdown
Probe uptime (30d)100.0% over 1 probes · daily
Avg 402 latency742 ms
Paid calls (30d, on-chain)19 calls · 7 buyers · shared price cohort of 464
Facilitator-reported (30d)1 calls · 1 payers (CDP Bazaar)

How to call

POST https://denk.halowerk.com/v1/rag-metrics · input in body · spec from live-challenge

Input schema
{
  "type": "object",
  "additionalProperties": false,
  "required": [
    "question",
    "answer",
    "contexts"
  ],
  "properties": {
    "question": {
      "type": "string",
      "minLength": 1,
      "maxLength": 5000,
      "description": "User question."
    },
    "answer": {
      "type": "string",
      "minLength": 1,
      "maxLength": 20000,
      "description": "Generated answer."
    },
    "contexts": {
      "type": "array",
      "minItems": 1,
      "maxItems": 50,
      "description": "Retrieved contexts in rank order: strings or objects {id, text}.",
      "items": {
        "anyOf": [
          {
            "type": "string",
            "minLength": 1,
            "maxLength": 20000
          },
          {
            "type": "object",
            "additionalProperties": false,
            "required": [
              "text"
            ],
            "properties": {
              "id": {
                "type": "string",
                "maxLength": 128
              },
              "text": {
                "type": "string",
                "minLength": 1,
                "maxLength": 20000
              }
            }
          }
        ]
      }
    },
    "reference": {
      "type": "string",
      "minLength": 1,
      "maxLength": 20000,
      "description": "Ground-truth answer (enables context recall and correctness)."
    },
    "relevant_ids": {
      "type": "array",
      "maxItems": 50,
      "uniqueItems": true,
      "items": {
        "type": "string",
        "maxLength": 128
      },
      "description": "Ids (or 0-based positions as strings) of the truly relevant contexts."
    },
    "k": {
      "type": "integer",
      "minimum": 1,
      "maximum": 50,
      "default": 5
    },
    "method": {
      "type": "string",
      "enum": [
        "lexical",
        "embedding",
        "both"
      ],
      "default": "lexical"
    },
    "language": {
      "type": "string",
      "enum": [
        "auto",
        "de",
        "en"
      ],
      "default": "auto"
    },
    "lexical_threshold": {
      "type": "number",
      "minimum": 0.1,
      "maximum": 1,
      "default": 0.6
    },
    "semantic_threshold": {
      "type": "number",
      "minimum": 0.5,
      "maximum": 1,
      "default": 0.8,
      "description": "Cosine threshold for intfloat/multilingual-e5-small (heuristic; related pairs typically score 0.80-0.90, unrelated 0.65-0.75)."
    }
  }
}
curl -i -X POST 'https://denk.halowerk.com/v1/rag-metrics' \
  -H 'content-type: application/json' -d '{"question":"Where is the Eiffel Tower?","answer":"The Eiffel Tower is in Paris.","contexts":["The Eiffel Tower is a landmark in Paris, completed in 1889.","Berlin is the capital of Germany."]}'

Agents: POST https://hive402.scriptmasterlabs.com/mcp → route_task / proxy_call · SDK /sdk/hive402.mjs

Try it (your wallet signs; HIVE402 never holds funds)