01Safety
30.0 / 30
What changed in the harness
Selection accuracy 96→96, token cost up 6%, unconfirmed writes 100%→100%.
Category breakdown
Where the score comes from.
Earned points across the four signals Gradable measures. Safety and Legibility are scored out of 30; Economics and Discoverability are scored out of 20.
02Legibility
28.4 / 30
03Economics
19.8 / 20
04Discoverability
17.7 / 20
Highest-impact fix
Estimated gain +2 pointsMake target tools discoverable on the first call
Clarify tool names, decision boundaries, and required argument schemas so an agent can choose and construct the target call without exploratory steps.
Description evidence
Defects and rewrites.
3 defects found across the exposed tool descriptions. Suggested rewrites make purpose, inputs, boundaries, and returns easier for an agent to understand.
| Tool | Defect types | Suggested rewrite |
|---|---|---|
browse_subreddit |
params_unexplained |
Fetch posts from a subreddit sorted by your choice. Returns a post list with content, metadata, and a data_source field. With Reddit credentials (data_source "api") posts include score, num_comments, and upvote_ratio; without credentials, results come from Reddit's public RSS feed (data_source "rss") and those fields plus nsfw are null — see the response note and do not infer popularity from them. sort selects the ordering of results (hot/new/top/rising/controversial, default hot). time filters results to posts from the given period (hour/day/week/month/year/all). include_nsfw controls whether NSFW content is included (default false). |
search_reddit |
params_unexplained |
Search for posts across Reddit or specific subreddits. Returns matching posts with content and metadata. sort selects the ordering of results (relevance/hot/top/new/comments, default relevance). time restricts results to posts from the given period (hour/day/week/month/year/all, default all). author limits results to posts by the specified Reddit username. flair filters results to posts carrying the given flair text. |
get_post_details |
params_unexplained |
Fetch a Reddit post with its comments. Requires EITHER url OR post_id. IMPORTANT: When using post_id alone, an extra API call is made to fetch the subreddit first (2 calls total). For better efficiency, always provide the subreddit parameter when known (1 call total). comment_sort selects the ordering of the returned comments (best/top/new/controversial/qa, default best). extract_links controls whether links found within the post and comments are extracted and returned (default false). |
Selection evidence
Confusable tool pairs.
1 pair where similar names or overlapping descriptions may send an agent toward the wrong tool.
| Tool A | Tool B | Confidence | Why they collide |
|---|---|---|---|
search_reddit |
reddit_explain |
low | Descriptions are fairly distinct (searching posts vs. explaining terms/slang), so typical phrasing like 'what does karma mean?' clearly maps to reddit_explain. Some weak ambiguity exists in phrasing that mixes search and explanation, e.g. 'search for what AMA means on Reddit,' where an agent could call search_reddit instead of reddit_explain, but the schemas and examples usually disambiguate, so confusion is only mildly plausible. |
Compare the field