FEDERAL.AIAPPLIED RESEARCH
Applied AI Flight Tests / v0.1

Before an agent acts,
inspect the evidence.

Local models. Explicit contracts. Measurable trade-offs. Explore the engineering evidence behind AI systems that have to work beyond the demo.

RECORDED EVIDENCE  /  No live inference

A model response is not yet an operational finding.

Inspect every input, output, and decision in a fixed local-model evaluation.

PUBLIC SYNTHETIC DEV SET
Development cases
20
15 configuration · 5 runtime
Model contract pass
0 / 20
Qwen3-0.6B · strict bare JSON
Rule baseline exact
20 / 20
Consistency check, not generalization
Recorded CPU inference
395.11 s
4 threads · greedy · non-thinking
Why publish a failed run? All 20 model responses included Markdown fences despite a bare-JSON contract. A downstream system must know whether it can consume the answer. These original responses remain unmodified; failure here does not mean every statement in them is wrong.

Loading evidence…

Expected static findings
Runtime conclusion
Published model grade

The decision

This configuration has not earned downstream execution.

A useful evaluation separates supported configuration facts from claims about actual runtime incidents. The next study should predeclare its revised interface and use independently authored cases.

Read the full evaluation →

Inspect the method

Public cases. Fixed prompt. Exact artifacts.

The baseline implements the same rules used to construct these labels. No result here establishes production performance, broad NiFi compatibility, or the ability of frontier models.

Model configuration & source hashes
View the exact system prompt