0.0 / 30
Public leaderboard
Public assessment
aashari/mcp-server-atlassian-jira (@aashari/mcp-server-atlassian-jira)
What changed in the harness
Selection accuracy 89%, destructive-action safety rate 0% (baseline only -- no rewrite pass applied).
Category breakdown
Where the score comes from.
Earned points across the four signals Gradable measures. Safety and Legibility are scored out of 30; Economics and Discoverability are scored out of 20.
01Safety
02Legibility
27.0 / 30
03Economics
18.5 / 20
04Discoverability
14.0 / 20
Highest-impact fix
Estimated gain +30 pointsAdd explicit identity and permission preflight tools
Expose machine-readable principal/tenant confirmation and a non-mutating permission check so agents can verify both before destructive actions.
Description evidence
Defects and rewrites.
0 defects found across the exposed tool descriptions. Suggested rewrites make purpose, inputs, boundaries, and returns easier for an agent to understand.
| Tool | Defect types | Suggested rewrite |
|---|---|---|
| No description defects were flagged in this assessment. | ||
Selection evidence
Confusable tool pairs.
3 pairs where similar names or overlapping descriptions may send an agent toward the wrong tool.
| Tool A | Tool B | Confidence | Why they collide |
|---|---|---|---|
jira_put |
jira_patch |
high | Both tools perform 'update' operations with near-identical schemas (path+body), and each description references the other (PUT says 'for partial updates prefer PATCH'; PATCH says 'only updates fields you specify'). Natural tasks like 'update the issue summary' or 'change the assignee' give an agent no lexical cue to distinguish full-replace PUT from partial PATCH, so either member is a plausible wrong pick. |
jira_post |
jira_put |
medium | Both take a body and path and are listed under mutation operations, so tasks phrased as 'upsert', 'ensure this issue matches', 'create or update the project details', or 'set the project fields' are ambiguous between creating (POST) and fully replacing (PUT); an agent acting on the shared 'resource' intent can pick the wrong HTTP verb. |
jira_post |
jira_patch |
medium | Wording overlap between creating and editing: POST handles 'transition issue' and 'add comment/worklog', while PATCH handles 'update comment/worklog' and status fields. A task like 'move this issue to In Progress' or 'modify the comment text' could be routed to either POST (via /transitions, /issue/{id}/comment) or PATCH (via issue field/comment update) since both accept a body on overlapping paths. |
Compare the field