kayg/calternal
Watch
1
0
Fork
You've already forked calternal
 0
Code Issues 190 Pull requests 61 Projects Releases Packages Wiki Activity Actions 20

Perf harness: fixture Homes, server scenarios, budgets (superseded) #95

Closed
kayg wants to merge 6 commits from issue/44-perf-harness-4 into dev
pull from: issue/44-perf-harness-4
merge into: kayg:dev
Conversation 2 Commits 6 Files changed 28 +2856
kayg commented 2026-10-13 23:12:26 +00:00
Owner
Copy link

Part of #44: the perf harness. Superseded by #96 (this PR stopped picking up pushes on the forge). Its title and body were wrongly copied from another PR when it was opened; fixed here.

🤖 Generated with Claude Code

Part of #44: the perf harness. Superseded by #96 (this PR stopped picking up pushes on the forge). Its title and body were wrongly copied from another PR when it was opened; fixed here. 🤖 Generated with [Claude Code](https://claude.com/claude-code)
`calternal-fixtures` makes realistic Homes (1k/10k/100k notes) in the real
on-disk format, byte-identical for a seed: daily notes with log entries,
regular notes with frontmatter (+05:30 times), links `[t](<path.md>)`,
tags, tasks, attachment refs, 1 in 2,000 notes at 50,000 words, some in a
subfolder, some without a `calternal-id`.

`calternal-perf` runs the real server binary on them: first-start indexing
(cold), then fresh servers on the indexed Home measuring startup to
/healthz, notes.list, journal catch-up, opening notes (room join and
notes.get), sync round trip and save ack, and an edit storm (4 clients,
10k keystrokes with save checks, plus an outside app rewriting the file)
that checks nothing was lost or doubled. RSS and disk bytes written come
from /proc. Median of runs per p50/p95 with a noise figure; budgets in
perf/budgets.json, --gate exits 1 on a breach.

perf/run-vm.sh runs it on the perf machine; perf/browser.sh wraps the
existing @perf keystroke-to-paint browser test.

Part of #44

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_018Yyy8fQGxPLkLa8v8NXz7T
The storm kept typing before the first "\nOutside line", but a keystroke
right after that newline glued onto the outside line, moved the boundary
past it, and later keystrokes edited it. The check then reported the line
missing, though the server had kept every line exactly once (verified in
the saved files). Typing now stops before the newline ahead of the first
outside line. run-vm.sh copies with tar (no rsync needed) and keeps the
build outside the copied tree.

Part of #44

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_018Yyy8fQGxPLkLa8v8NXz7T
docs/perf/budgets.md says what each metric measures, how (perf VM, no host
cache, page cache dropped, median of 5 runs, noise), the gated budget and
the target for each, the first baseline at 1k/10k/100k notes, and the
problems it shows: a fake outside change journaled per unopened note on
every start, slow first-start indexing, one fsync per keystroke per room,
and heavy whole-Home lists at 100k. perf/budgets.json holds the same
limits for the harness; targets the code doesn't meet yet don't gate.

Part of #44

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_018Yyy8fQGxPLkLa8v8NXz7T
dev now pages `notes.list` and filters by tag, so the harness measures
what the app asks for: a page of 50 newest first, A to Z, by tag, and 20
pages on through a cursor. A cold run is done when a one-note page counts
every note and the Home says its scan finished (`incomplete: false`).

Part of #44

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_018Yyy8fQGxPLkLa8v8NXz7T
The request that opens the Home is now the first page of the note list
(`home.first_page`, gated). The old whole-Home list stays measured
(`home.first_list`, `home.list`) but only as a target: it is deprecated
and costs seconds at 100k notes.

Part of #44

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_018Yyy8fQGxPLkLa8v8NXz7T
Perf budgets: baseline on today's dev, budgets from it
All checks were successful
CI / rust (pull_request) Successful in 1m13s
Details
CI / web (pull_request) Successful in 2m45s
Details
8566e5332e 
dev gained the batched startup scan, paged lists and fan-out before the
disk while this was measured, which fixed four of the problems the first
baseline found. The page now holds the baseline at e2f4928 (5 warm and 3
cold runs at 1k, 10k and 100k notes), budgets set just above it, and the
problems still open: memory at 100k, the first request waiting for the
Home at 100k, a flat 51 ms first open, keystroke throughput.

Part of #44

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_018Yyy8fQGxPLkLa8v8NXz7T
kayg commented 2026-10-13 23:16:06 +00:00
Author
Owner
Copy link

Reviewed by Claude: deterministic fixture Homes (1k/10k/100k), perf runner against the real binary incl. edit storm with outside writes (no loss/duplication), median-of-runs with noise, budgets.json gate. Baseline posted on #44. CI green. Merging. Problems found are filed as issues.

Reviewed by Claude: deterministic fixture Homes (1k/10k/100k), perf runner against the real binary incl. edit storm with outside writes (no loss/duplication), median-of-runs with noise, budgets.json gate. Baseline posted on #44. CI green. Merging. Problems found are filed as issues.
kayg changed title from Settings saved on the server, live on every device to Perf harness: fixture Homes, server scenarios, budgets (superseded) 2026-10-13 23:19:57 +00:00
kayg commented 2026-10-13 23:19:58 +00:00
Author
Owner
Copy link

Superseded by #96 (rebased onto current dev).

Superseded by #96 (rebased onto current dev).
kayg closed this pull request 2026-10-13 23:19:58 +00:00
All checks were successful
CI / rust (pull_request) Successful in 1m13s
Details
CI / web (pull_request) Successful in 2m45s
Details

Pull request closed

This pull request cannot be reopened because the branch was deleted.
Sign in to join this conversation.
Reviewers
No reviewers
Labels
Clear labels   
backend
Rust server

  
design
Mockups, UI and TASTE

  
docs
ADRs, CONTEXT, TASTE

  
idea
Parked idea, never worked until promoted

  
infra
Deploy, CI, VMs

  
perf
Performance and budgets

  
reliability
Data integrity, corruption traps

  
web
Web client

No labels
backend
design
docs
idea
infra
perf
reliability
web
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
kayg/calternal!95
No description provided.