01Safety
30.0 / 30
What changed in the harness
Selection accuracy 100%, destructive-action safety rate 100% (baseline only -- no rewrite pass applied).
Category breakdown
Where the score comes from.
Earned points across the four signals Gradable measures. Safety and Legibility are scored out of 30; Economics and Discoverability are scored out of 20.
02Legibility
28.4 / 30
03Economics
20.0 / 20
04Discoverability
19.7 / 20
Highest-impact fix
Estimated gain +2 pointsDisambiguate overlapping tool choices
Give confusable tools explicit decision boundaries and examples of when to choose one instead of the other.
Description evidence
Defects and rewrites.
0 defects found across the exposed tool descriptions. Suggested rewrites make purpose, inputs, boundaries, and returns easier for an agent to understand.
| Tool | Defect types | Suggested rewrite |
|---|---|---|
| No description defects were flagged in this assessment. | ||
Selection evidence
Confusable tool pairs.
7 pairs where similar names or overlapping descriptions may send an agent toward the wrong tool.
| Tool A | Tool B | Confidence | Why they collide |
|---|---|---|---|
get_top_vr_games |
get_top_vr_apps |
medium | Both return a 'current ranked list of top VR X' with identical no-arg schemas; a vague request like 'what are the top VR titles/experiences right now' doesn't clearly signal games vs. apps/utilities. |
get_vr_trending |
get_vr_events |
medium | A task like 'what's happening in VR right now' could plausibly map to either currently trending topics or upcoming calendar events, since both convey 'what's current in VR'. |
list_vr_originals |
list_vr_sources |
medium | Phrasing like 'list VR.org's articles/content' is ambiguous between the editorial article list (originals) and the aggregated news-source list (sources), especially since sources also implies articles via per-source counts. |
search_vr_news |
list_vr_originals |
medium | Both surface VR.org article-like content; 'show me VR.org's recent articles' could be read as the aggregated news search (which includes VR-native sources) or the editorial originals list. |
compare_vr_headsets |
vr_explain |
medium | vr_explain's own example topic is 'best headset', overlapping with compare_vr_headsets' side-by-side comparisons; a query like 'which headset is best, Quest 3 or PSVR2' could trigger either the canonical explainer or a direct comparison. |
get_vr_trending |
get_top_vr_games |
low | A request like 'what VR games are trending' could be routed to either the general trending-topics tool or the dedicated top-games ranking, though the tools' outputs (topics vs. game list) are distinct enough to usually disambiguate. |
get_vr_deals |
get_top_vr_apps |
low | Both are 'current' curated/ranked VR.org lists; a query like 'best VR apps to get' could momentarily suggest deals (product picks with prices) instead of the software ranking, though deals skews hardware/accessories. |
Compare the field