Interface: SemanticProbe
Defined in: packages/core/src/introspection/SemanticProbe.ts:79
A semantic probe definition — a structured test case for LLM-based behavioral evaluation.
Properties
actionKey
readonly actionKey: string;Defined in: packages/core/src/introspection/SemanticProbe.ts:85
Action key being probed
actualOutput
readonly actualOutput: unknown;Defined in: packages/core/src/introspection/SemanticProbe.ts:93
Actual output from the current handler
contractContext
readonly contractContext: ProbeContractContext;Defined in: packages/core/src/introspection/SemanticProbe.ts:95
Behavioral contract context for the judge
description
readonly description: string;Defined in: packages/core/src/introspection/SemanticProbe.ts:87
Description of what this probe tests
expectedOutput
readonly expectedOutput: unknown;Defined in: packages/core/src/introspection/SemanticProbe.ts:91
Expected output (known-good baseline)
id
readonly id: string;Defined in: packages/core/src/introspection/SemanticProbe.ts:81
Unique identifier for this probe
input
readonly input: Record<string, unknown>;Defined in: packages/core/src/introspection/SemanticProbe.ts:89
Input arguments to the tool
toolName
readonly toolName: string;Defined in: packages/core/src/introspection/SemanticProbe.ts:83
Tool name being probed