Skip to content
saymock
Product Agents Developers FAQ Pricing
EN, English
  • Français
  • English
  • Deutsch
  • Español
  • Português
  • Italiano
  • Nederlands
  • 日本語
  • 한국어
  • 简体中文
Theme
Sign in Try it

Benchmark · November 12, 2026

Saymock vs Figma (MCP): the same agent on three screens

Claude Opus 5.5 reproduced three Wikipedia screens as editable designs, once with Saymock and once with Figma’s official MCP server. Same prompt, same assets, same budget, three runs per screen and per tool, scored blind. Here are the protocol and every number, including the ones that don’t flatter us.

Results

Median of each screen’s three runs, then the mean of the three screens. Tokens and dollars are what Claude Code measures for the agent doing the design, at API prices; export and scoring are excluded.

Per screenSaymockFigma (MCP)Difference
Tokens processed1.88M2.74M−31%
of which output tokens30k61k−50%
Cost$1.70$2.69−37%
Time5.4 min9.8 min1.8× faster
Agent turns34.738.7−10%
Tool errors1.04.04× fewer
Score /10079.082.2+3.2 for Figma: a tie
Visual fidelity /6047.049.7+2.7 for Figma
Editability /4031.332.8+1.5 for Figma
Successful runs9/99/9

Takeaways

  • Quality: a tie. Figma leads by 3.2 points on average, under the 5-point threshold our protocol sets. It is ahead on each of the three screens, by 1.5 (iPhone) to 6 points (Android).
  • Cost: Saymock uses less. 31% fewer tokens, half the output tokens, 37% fewer dollars per screen.
  • Time: 1.8× faster. 5.4 minutes per screen against 9.8.
  • Not on every screen. On the iPhone, Saymock’s median run processed more tokens than Figma’s (3.07M against 1.91M), while still costing less. On Android and the web, Saymock processes 2.3 to 2.6 times fewer.

Why the dollar gap is wider than the token gap: a token’s price depends on whether it is re-read from the cache ($0.20 per million), read for the first time ($4 to $8) or written by the model ($20). With Saymock, the model writes half as many tokens, the most expensive ones.

By screen

Median of each tool’s three runs.

Screen Score /100 Tokens Cost Time
SaymockFigmaSaymockFigmaSaymockFigmaSaymockFigma
iPhone78.580.03.07M1.91M$2.29$2.586.9 min9.7 min
Android78.084.01.20M3.14M$1.44$2.884.6 min10.5 min
Web80.582.51.38M3.18M$1.38$2.624.8 min9.2 min

Protocol

The screens

Three Wikipedia screens of different kinds, captured from the real apps. Each agent gets the screenshot and the app’s real files: photos, icons, logo, and the fonts used for each text role.

ScreenContentSize
iPhoneiOS app home: feed of cards, photos, segmented control, translucent tab bar430×932, @3x
AndroidAndroid app home: banner, image card, Material 3 navigation411×923, @2.625x
WebWikipedia’s Main Page: columns, colored boxes, photos, side panel1440×900, @2x

The same conditions for both tools

  • Same agent: Claude Code in non-interactive mode, model Claude Opus 5.5. Each run starts from an empty folder, with no context or previous session.
  • Same prompt: “reproduce this screen as an editable design”. Each tool only adds how to create its file.
  • One tool loaded: Saymock’s MCP server (the production version) or Figma’s official MCP server, never both, and no other connectors.
  • Same budget: $15 and 45 minutes per run, one run at a time.
  • Hands off: nobody fixes, nudges or resumes an agent. A failed run would count as one; all 18 succeeded.

Scoring

  • Each result is scored out of 100: visual fidelity out of 60 (layout, typography, colors, icons and imagery, content, pixel metrics) and editability out of 40 (layer hierarchy and names, flowing layout, reuse, cleanliness).
  • Double blind: two independent judges (Claude Opus 5.5, a fresh session per result) score each result without knowing which tool made it. They were never more than 5 points apart.
  • For each screen and tool we keep the median of the three runs, then average the three screens. Each criterion is its own median, so visual plus editability does not add up exactly to the score.
  • A gap under 5 points is a tie, and is reported as one.

All 18 runs

The raw numbers of every run. Saymock’s first iPhone run (85 turns, 6.83M tokens) is the one that processed the most tokens; the median leaves it out, this table shows it.

ScreenToolRunScoreVisualEdit.TokensOutputCostTimeTurnsErrors
iPhoneSaymock180.046.533.56.83M50k$3.5917.1 min852
iPhoneSaymock278.545.533.03.07M36k$2.296.9 min491
iPhoneSaymock378.545.533.01.63M23k$1.544.2 min280
iPhoneFigma181.548.033.55.99M101k$4.5216.7 min664
iPhoneFigma274.545.029.51.68M45k$1.957.6 min293
iPhoneFigma380.046.533.51.91M65k$2.589.7 min294
AndroidSaymock178.046.032.01.15M28k$1.404.6 min251
AndroidSaymock279.046.033.01.20M27k$1.444.3 min211
AndroidSaymock377.045.531.51.30M30k$1.564.9 min321
AndroidFigma185.553.032.52.56M52k$2.309.4 min333
AndroidFigma284.050.034.03.50M65k$2.9210.8 min463
AndroidFigma382.552.530.03.14M61k$2.8810.5 min412
WebSaymock178.049.528.51.28M26k$1.384.8 min302
WebSaymock280.549.531.01.38M24k$1.384.3 min281
WebSaymock380.551.529.01.74M32k$1.765.8 min351
WebFigma183.551.032.53.18M55k$2.629.2 min465
WebFigma282.048.533.51.72M46k$2.038.1 min313
WebFigma382.550.032.53.61M67k$3.0610.5 min506

Where each tool loses points

Mean points lost per criterion (maximum in parentheses). Higher means weaker.

CriterionSaymockFigma
Layout (15)2.52.2
Typography (12)2.82.2
Colors and surfaces (8)1.51.3
Icons and imagery (10)2.01.2
Content (10)0.70.3
Pixel metrics (5)3.33.3
Hierarchy and naming (10)1.31.0
Flowing layout (12)2.21.8
Reuse (10)3.73.2
Cleanliness (8)1.01.0
  • Saymock loses most on text (letter spacing of a substitute font, which shifts the line breaks), on a few icon glyphs, and on values repeated by hand instead of shared tokens.
  • Figma loses most on fonts (Inter instead of SF Pro on the iPhone), on corner radii that are too large, and on the lack of text and color styles.

Limits

  • Three screens from a single app: a solid trend, not a general law.
  • One model (Claude Opus 5.5). Another model or agent may change the gaps.
  • The judges are models, not human designers.
  • Costs are API costs. On a Claude subscription you pay in quota, not dollars; tokens remain the comparable measure.
  • We build Saymock: this benchmark is not independent. That is why we publish the protocol and every run.
saymock
Product Agents Developers FAQ Pricing Benchmark Contact Sign in

© 2026 saymock

Legal notice Terms of use Terms of sale Privacy