01Safety
0.0 / 30
What changed in the harness
Selection accuracy 100→98, token cost up 1%, unconfirmed writes 0%→0%.
Category breakdown
Where the score comes from.
Earned points across the four signals Gradable measures. Safety and Legibility are scored out of 30; Economics and Discoverability are scored out of 20.
02Legibility
28.4 / 30
03Economics
18.5 / 20
04Discoverability
11.3 / 20
Highest-impact fix
Estimated gain +30 pointsAdd explicit identity and permission preflight tools
Expose machine-readable principal/tenant confirmation and a non-mutating permission check so agents can verify both before destructive actions.
Description evidence
Defects and rewrites.
3 defects found across the exposed tool descriptions. Suggested rewrites make purpose, inputs, boundaries, and returns easier for an agent to understand.
| Tool | Defect types | Suggested rewrite |
|---|---|---|
search_hotels |
params_unexplained |
Search hotels, lodging, accommodations, resorts, and places to stay for a trip. Filter by city, country, check-in/check-out dates, room type (standard, deluxe, suite, penthouse, or accessible), nightly price, star rating, and amenities (pool, gym, wifi, etc.). Returns matching properties with rates, photos, and availability across 2M+ properties (LiteAPI). Use this when the user wants to book a hotel, find a place to stay, compare lodging options, or pick a resort. |
search_dining |
no_return_description |
Search restaurants, dining options, and reservation availability by city, date, time, cuisine, party size, neighborhood, and price range. Returns matching restaurants with their reservation availability for the requested party size, date, and time; full reservation flow arrives in the next release. Use this when the user wants to find a restaurant, book dinner, plan a meal, get reservations, or pick a place to eat on a trip. |
search_events |
no_return_description |
Search live events, concerts, sports games, theater, comedy, and shows in a city from the Ticketmaster + SeatGeek catalog. Filter by city, date range, category (music / sports / arts / theater / family / comedy), and keyword (artist name, team name, show title). Returns matching events with their dates, venues, and ticket availability so the user can pick one to buy tickets for. Use this when the user wants tickets to a concert, a sports game, a Broadway show, or any live event during their trip. |
Selection evidence
Confusable tool pairs.
3 pairs where similar names or overlapping descriptions may send an agent toward the wrong tool.
| Tool A | Tool B | Confidence | Why they collide |
|---|---|---|---|
search_activities |
search_events |
medium | Both take city plus date range and describe 'things to do'; a request like 'what's happening this weekend' or 'book something for Saturday night' could resolve to a tour/attraction (activities) or a concert/show (events), especially since activities includes a 'nightlife' category and events covers live shows. |
search_dining |
search_activities |
medium | search_activities explicitly lists 'food tours' and cooking classes as categories, while search_dining covers restaurants and reservations; a request like 'book a food tour' or 'wine tasting' could misroute to search_dining because of its food/reservation semantics. |
search_flights |
search_transport |
medium | Both are transportation tools; a request like 'arrange my transportation for the trip' or 'get us from Miami to Key West' could map to flights (between cities) or ground transport (rental car/rideshare), and neither tool name clearly signals the air vs ground split. |
Compare the field