SpacetimeDB vs PostgreSQL — AI App Generation Benchmark

Sequential upgrade · L1–L11 · 13 feature groups · Claude Sonnet 4.6 · Chat app

Load data:
Runs found
📊

No run loaded

Click 📁 Open folder… to select the llm-sequential-upgrade/ directory — the viewer will find all METRICS_DATA*.json files inside and list them for selection.

Or click 📄 Open file… to load a single file directly.

Total Cost
—
SpacetimeDB
—
PostgreSQL
Total Bugs
—
SpacetimeDB
—
PostgreSQL
Fix Sessions
—
SpacetimeDB
—
PostgreSQL
Final LOC (hand-written)
—
SpacetimeDB
—
PostgreSQL
Total Time
—
SpacetimeDB
—
PostgreSQL
Fix Success (1st attempt)
—
SpacetimeDB
—
PostgreSQL
SpacetimeDB
PostgreSQL

Upgrade Cost per Level ($)

Fix Cost per Level ($)

Fix costs attributed to the level where the bug was introduced.

Total Cost per Level — Upgrade + Fix ($)

Cumulative Cost over Levels ($)

Bugs Found per Level

Cumulative Bugs over Levels

Lines of Code over Levels (hand-written, excl. generated bindings)

Backend LOC over Levels

Frontend LOC over Levels

Upgrade Duration per Level (seconds)

Output Tokens per Upgrade