[WIP] Borrow task checkbox fields; ARM64 performance acceptance still blocked

kayg commented

2026-10-28 02:19:26 +00:00

Owner

Task indexing copied plain checkbox text and block IDs into temporary owned strings, serialized them to JSON, then discarded those copies. The shared parser now lends those fields directly to serialization. Public parsing, stored JSON, schema and parser rules are unchanged. The branch retains the idle and index-write improvements from #710.

Related to #686; supersedes draft #710. Blocked on performance acceptance. After commands failing: tasks-after-1-10k (exit 1), tasks-after-1-100k (exit 1), tasks-after-2-10k (exit 1), tasks-after-2-100k (exit 1), tasks-after-3-10k (exit 1), tasks-after-3-100k (exit 1).

100k metric	Before, runs 1 / 2 / 3	After, runs 1 / 2 / 3	Limit
Warm update p95 ms	48.776 / 36.930 / 30.993	43.918 / 29.091 / 42.332	40 ms
Cold growth percent	19.151 / 19.052 / 19.180	15.317 / 18.767 / 15.936	10 percent

Workspace tests: 1188 passed, 0 failed, 20 ignored. Crash/recovery matrices, formatting, clippy with warnings denied, editor and web typechecks, and 5,000 parser cases passed.

No limit or durability barrier was changed. Atomic note replacement still waits for file sync, required directory sync and durable FULL history. All scheduling, journal, cache, page-size, compression and checkpoint experiments were rejected and remain outside the product diff.

The remaining warm cost is USB SSD flush latency and contention. Extending existing history batching with bounded cross-save coordination while preserving every acknowledgment barrier remains possible future work; it is not implemented or proven here. Complete before/after tables, rejected experiments with numbers and verbatim gate output are on #686. Raw evidence archive, SHA256 5d61debc7998e04e11a3c3edc94657cf33108c1e0aeb6e1a3c73c5c8b27f1d55.

Head: e837280e03fa2763121639222efee8c575494d17. Before: 21180d0b2a82b8003cb1f1ee117a0a300ba5edaa.

Task indexing copied plain checkbox text and block IDs into temporary owned strings, serialized them to JSON, then discarded those copies. The shared parser now lends those fields directly to serialization. Public parsing, stored JSON, schema and parser rules are unchanged. The branch retains the idle and index-write improvements from #710. Related to #686; supersedes draft #710. Blocked on performance acceptance. After commands failing: tasks-after-1-10k (exit 1), tasks-after-1-100k (exit 1), tasks-after-2-10k (exit 1), tasks-after-2-100k (exit 1), tasks-after-3-10k (exit 1), tasks-after-3-100k (exit 1). | 100k metric | Before, runs 1 / 2 / 3 | After, runs 1 / 2 / 3 | Limit | | --- | --- | --- | --- | | Warm update p95 ms | 48.776 / 36.930 / 30.993 | 43.918 / 29.091 / 42.332 | 40 ms | | Cold growth percent | 19.151 / 19.052 / 19.180 | 15.317 / 18.767 / 15.936 | 10 percent | Workspace tests: 1188 passed, 0 failed, 20 ignored. Crash/recovery matrices, formatting, clippy with warnings denied, editor and web typechecks, and 5,000 parser cases passed. No limit or durability barrier was changed. Atomic note replacement still waits for file sync, required directory sync and durable FULL history. All scheduling, journal, cache, page-size, compression and checkpoint experiments were rejected and remain outside the product diff. The remaining warm cost is USB SSD flush latency and contention. Extending existing history batching with bounded cross-save coordination while preserving every acknowledgment barrier remains possible future work; it is not implemented or proven here. Complete before/after tables, rejected experiments with numbers and verbatim gate output are on #686. [Raw evidence archive](https://git.kayg.org/attachments/b134be11-fabf-4550-8f15-44d4d6b60d4b), SHA256 `5d61debc7998e04e11a3c3edc94657cf33108c1e0aeb6e1a3c73c5c8b27f1d55`. Head: `e837280e03fa2763121639222efee8c575494d17`. Before: `21180d0b2a82b8003cb1f1ee117a0a300ba5edaa`.

kayg added 22 commits

2026-10-28 02:19:26 +00:00

Reduce quota recount work and task write overhead b499f9a258

Reduce task index write amplification during cold fills a28185bfc9

Stream quota recounts and retain the bulk fill page cache d5aa104306

Avoid duplicate parsing and group later cold-fill writes bfc879f0e5

Commit a disk seed with its first property edit 1340a68106

Skip discarded checkbox fields during task index discovery b55bf2ad04

Reuse quota snapshot paths across drift recounts 473b6282b7

Read simple display properties without rebuilding a YAML tree bc354f92d6

Avoid unused property copies during task description aaf442509a

Keep closed task tags out of live indexes 3ac76b9e15