Public leaderboard

Public assessment

gpu-bridge/mcp-server (@gpu-bridge/mcp-server)

gpu-bridge-mcp-server · v2.0.0 · scanned

What changed in the harness

Selection accuracy 100→98, token cost up 4%, unconfirmed writes 100%→100%.

Category breakdown

Where the score comes from.

Earned points across the four signals Gradable measures. Safety and Legibility are scored out of 30; Economics and Discoverability are scored out of 20.

01Safety

30.0 / 30

30.0 out of 30
02Legibility

28.1 / 30

28.1 out of 30
03Economics

20.0 / 20

20.0 out of 20
04Discoverability

14.0 / 20

14.0 out of 20

Highest-impact fix

Estimated gain +6 points

Make target tools discoverable on the first call

Clarify tool names, decision boundaries, and required argument schemas so an agent can choose and construct the target call without exploratory steps.

Description evidence

Defects and rewrites.

4 defects found across the exposed tool descriptions. Suggested rewrites make purpose, inputs, boundaries, and returns easier for an agent to understand.

Tool Defect types Suggested rewrite
gpu_run
no_return_description
Submit a GPU-Bridge AI service job. 30 services available: LLM inference (sub-second), image generation (FLUX, SD3.5), video generation, video enhancement (up to 4K), speech-to-text (Whisper, <1s), TTS (40+ voices), music generation, voice cloning, embeddings, document reranking (Jina), OCR, PDF/document parsing, NSFW detection, image captioning, visual Q&A, background removal, face restoration, upscaling, stickers, and more. Use gpu_catalog to see all available services. Returns a job ID for the submitted job; poll it with gpu_status to retrieve the final result.
gpu_catalog
no_return_description
Returns a catalog of all available GPU-Bridge services, each with its pricing and model information. No authentication required.
gpu_balance
no_return_description
Returns the GPU-Bridge account's current credit balance, daily spend, volume discount tier, and recent job history.
gpu_estimate
no_return_description
Returns the estimated cost of running a given GPU-Bridge service before submitting it, based on the requested service and optional runtime in seconds. No authentication required.

Selection evidence

Confusable tool pairs.

4 pairs where similar names or overlapping descriptions may send an agent toward the wrong tool.

Tool A Tool B Confidence Why they collide
gpu_balance gpu_estimate medium Both concern money; a task like 'do I have enough credits to run image generation?' conflates current account balance with per-run cost, so the agent could call either tool.
gpu_catalog gpu_estimate medium Both surface pricing; 'what does it cost to use llm-4090?' could send the agent to the catalog's pricing list instead of a per-service estimate, or vice versa.
gpu_run gpu_estimate medium Both take a service key; 'run image generation and tell me what it costs' splits between executing the job and estimating cost, and 'how much to generate an image' could wrongly trigger gpu_run because it mentions generation.
gpu_status gpu_balance low gpu_balance's description includes job history, so 'show me my past jobs/results' could loosely match gpu_status, though status is the dedicated results-retrieval tool.

Compare the field

One score is useful.
The evidence makes it actionable.

Back to the leaderboard