kayg/calternal
Watch
1
0
Fork
You've already forked calternal
 0
Code Issues 190 Pull requests 61 Projects Releases Packages Wiki Activity Actions 26

Train BM12 #884

Closed
kayg wants to merge 110 commits from train/2026-11-03-bm12 into dev
pull from: train/2026-11-03-bm12
merge into: kayg:dev
Conversation 11 Commits 110 Files changed 189 +8916 -70015
kayg commented 2026-11-02 23:29:02 +00:00
Owner
Copy link

Train BM12 on current origin/dev 55f35fcde3bc91ca3781055577b93e93819f6cd4, assembled with --no-ff in the requested order from the recorded current heads. Replaces closed #883.

RED. Never merge as part of this task. All non-browser gates passed. Browser total: 2,670 passed, 4 failed, 1,573 explicit skips, 0 unattempted; zero retries. One failure is known pre-existing and reproduced on origin/dev; three unlisted failures remain unresolved after one passing origin/dev comparison each.

Tested head 1e776f9e810c46c91bc752a117ed4f43ebd3938f. Final report, source heads, exact gates, first errors and attribution. Owned VM jobs finished and worktrees/builds/temp Homes cleaned.

Train BM12 on current origin/dev `55f35fcde3bc91ca3781055577b93e93819f6cd4`, assembled with --no-ff in the requested order from the recorded current heads. Replaces closed #883. **RED. Never merge as part of this task.** All non-browser gates passed. Browser total: 2,670 passed, 4 failed, 1,573 explicit skips, 0 unattempted; zero retries. One failure is known pre-existing and reproduced on origin/dev; three unlisted failures remain unresolved after one passing origin/dev comparison each. Tested head `1e776f9e810c46c91bc752a117ed4f43ebd3938f`. [Final report, source heads, exact gates, first errors and attribution](https://git.kayg.org/kayg/calternal/pulls/884#issuecomment-76167). Owned VM jobs finished and worktrees/builds/temp Homes cleaned.
kayg added 177 commits 2026-11-02 23:29:02 +00:00
test: write authority fixtures atomically
Some checks failed
CI / server (pull_request) Has been cancelled
Details
CI / rust (pull_request) Has been cancelled
Details
CI / web (pull_request) Has been cancelled
Details
b130c95f60
test(notes): cover cache reuse and first page during rebuild
Some checks failed
CI / server (pull_request) Has been cancelled
Details
CI / rust (pull_request) Has been cancelled
Details
CI / web (pull_request) Has been cancelled
Details
e0e78626ed
docs(perf): record attachment index flush baseline
Some checks failed
CI / server (pull_request) Has been cancelled
Details
CI / rust (pull_request) Has been cancelled
Details
CI / web (pull_request) Has been cancelled
Details
Markdown extraction contract / markdown-native-contract (pull_request) Has been cancelled
Details
Markdown extraction contract / markdown-editor-contract (pull_request) Has been cancelled
Details
8f57b68941
fix(tasks): match Upcoming date selection and group order to mockup
Some checks failed
CI / web (pull_request) Has been cancelled
Details
Markdown extraction contract / markdown-native-contract (pull_request) Has been cancelled
Details
Markdown extraction contract / markdown-editor-contract (pull_request) Has been cancelled
Details
CI / server (pull_request) Has been cancelled
Details
CI / rust (pull_request) Has been cancelled
Details
3f62ac8fd6
Replace svelte-sonner with our own small toast stack
Some checks failed
CI / web (pull_request) Has been cancelled
Details
Markdown extraction contract / markdown-native-contract (pull_request) Has been cancelled
Details
CI / server (pull_request) Has been cancelled
Details
CI / rust (pull_request) Has been cancelled
Details
Markdown extraction contract / markdown-editor-contract (pull_request) Has been cancelled
Details
c98b6ee9e6 
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
test(notes): run crash rounds until confirmed append coverage
Some checks failed
CI / server (pull_request) Has been cancelled
Details
CI / rust (pull_request) Has been cancelled
Details
CI / web (pull_request) Has been cancelled
Details
Markdown extraction contract / markdown-editor-contract (pull_request) Has been cancelled
Details
Markdown extraction contract / markdown-native-contract (pull_request) Has been cancelled
Details
50cce9dcce
test(notes): reproduce capture racing a daily placeholder reader
Some checks failed
CI / server (pull_request) Has been cancelled
Details
CI / rust (pull_request) Has been cancelled
Details
CI / web (pull_request) Has been cancelled
Details
Markdown extraction contract / markdown-native-contract (pull_request) Has been cancelled
Details
Markdown extraction contract / markdown-editor-contract (pull_request) Has been cancelled
Details
68cecd2ba8
test(web): hold Undo toast during composer server assertions
Some checks failed
CI / server (pull_request) Has been cancelled
Details
CI / rust (pull_request) Has been cancelled
Details
CI / web (pull_request) Has been cancelled
Details
Markdown extraction contract / markdown-native-contract (pull_request) Has been cancelled
Details
Markdown extraction contract / markdown-editor-contract (pull_request) Has been cancelled
Details
24fdae745d
test(auth): observe idle upload completion before checking workers
Some checks failed
CI / server (pull_request) Has been cancelled
Details
CI / rust (pull_request) Has been cancelled
Details
CI / web (pull_request) Has been cancelled
Details
Markdown extraction contract / markdown-native-contract (pull_request) Has been cancelled
Details
Markdown extraction contract / markdown-editor-contract (pull_request) Has been cancelled
Details
144e717145
docs: link historical CI allocation observations
Some checks failed
CI / server (pull_request) Has been cancelled
Details
CI / rust (pull_request) Has been cancelled
Details
CI / web (pull_request) Has been cancelled
Details
Markdown extraction contract / markdown-native-contract (pull_request) Has been cancelled
Details
Markdown extraction contract / markdown-editor-contract (pull_request) Has been cancelled
Details
9c05d871a1
perf: gate named app chunks with explicit brotli budgets
Some checks failed
CI / server (pull_request) Has been cancelled
Details
CI / rust (pull_request) Has been cancelled
Details
CI / web (pull_request) Has been cancelled
Details
Markdown extraction contract / markdown-native-contract (pull_request) Has been cancelled
Details
Markdown extraction contract / markdown-editor-contract (pull_request) Has been cancelled
Details
da1071ed09 
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
# Conflicts:
#	Cargo.lock
# Conflicts:
#	crates/engine/src/execute.rs
Train BM12: merge #857
Some checks failed
CI / server (pull_request) Has been cancelled
Details
CI / rust (pull_request) Has been cancelled
Details
CI / web (pull_request) Has been cancelled
Details
Markdown extraction contract / markdown-native-contract (pull_request) Has been cancelled
Details
Markdown extraction contract / markdown-editor-contract (pull_request) Has been cancelled
Details
22dd36f1a5
kayg commented 2026-11-02 23:29:21 +00:00
Author
Owner
Copy link

BM12 assembled at 1e776f9e810c46c91bc752a117ed4f43ebd3938f on current origin/dev 55f35fcde3bc91ca3781055577b93e93819f6cd4. All requested current heads merged --no-ff in order.

PR Source head
#779 7b97e4d14231be07f6a80cb9ca172d02442c487e
#858 626388da9052eaecb159d735f0cadc5e59e88312
#866 ba1f47dc94797d4a8a937298464b5e4828e301c2
#824 f1c1aa961e169ef99e132063a97ccbd9a89a5def
#827 76f11dc4ba06468a2a0ed4d4592cea6038206696
#828 5d7b9b36cd008de78851809724c90a85d92b40a7
#833 ccaece3dfecbe2048634fc792d7d4a2c6e31f324
#836 5f7d1a59776411e7f3353d0023817b43affae51e
#831 316b43e9578c3e4d2944df8df43caebc611356f7
#844 50cce9dcceb87f23a9f346300b3336e315ff6c0c
#847 40448327a15730271d56226b898e48bcc87b2a4d
#855 c38c3083d51f4adcf5cd76a70f1f6960b427413e
#857 144e717145e35f70356f593b7c04a527e00f7b17
#856 26548949efef7e6e4109ccc8e158f21a12f2b026
#840 5de79c18bce498fd85e3adb4be4fa8a84be85085

Reused identical BM10/BM11 resolutions: #824 Cargo.lock union; #828 credential check followed by runtime timer; #840 retained #856 desktop corpus guards while preserving new server timing additions. Inherited #831 artifacts removed, preserved in #880 (comment).

Known pre-existing cases from brief: vim.spec.ts:341 and :380; sidebar-edge.spec.ts:8; webkit-1440 editor.spec.ts:173 convergence (unattributed after 37 train/22 dev passes, #883 comment 76036). These are listed separately from new failures. No retries. Every failing case gets one origin/dev comparison.

Preparation: disk checks dev-01 295 GiB free, dev-02 325 GiB free. Frozen root Bun install will precede cargo test. TMPDIR=$HOME/bm12-tmp on disk. CI=1, Nix, heavy jobs through ~/bin/slot, cargo -j4, Playwright --workers=1 --retries=0. Never merge.

BM12 assembled at `1e776f9e810c46c91bc752a117ed4f43ebd3938f` on current origin/dev `55f35fcde3bc91ca3781055577b93e93819f6cd4`. All requested current heads merged --no-ff in order. | PR | Source head | |---|---| | #779 | `7b97e4d14231be07f6a80cb9ca172d02442c487e` | | #858 | `626388da9052eaecb159d735f0cadc5e59e88312` | | #866 | `ba1f47dc94797d4a8a937298464b5e4828e301c2` | | #824 | `f1c1aa961e169ef99e132063a97ccbd9a89a5def` | | #827 | `76f11dc4ba06468a2a0ed4d4592cea6038206696` | | #828 | `5d7b9b36cd008de78851809724c90a85d92b40a7` | | #833 | `ccaece3dfecbe2048634fc792d7d4a2c6e31f324` | | #836 | `5f7d1a59776411e7f3353d0023817b43affae51e` | | #831 | `316b43e9578c3e4d2944df8df43caebc611356f7` | | #844 | `50cce9dcceb87f23a9f346300b3336e315ff6c0c` | | #847 | `40448327a15730271d56226b898e48bcc87b2a4d` | | #855 | `c38c3083d51f4adcf5cd76a70f1f6960b427413e` | | #857 | `144e717145e35f70356f593b7c04a527e00f7b17` | | #856 | `26548949efef7e6e4109ccc8e158f21a12f2b026` | | #840 | `5de79c18bce498fd85e3adb4be4fa8a84be85085` | Reused identical BM10/BM11 resolutions: #824 Cargo.lock union; #828 credential check followed by runtime timer; #840 retained #856 desktop corpus guards while preserving new server timing additions. Inherited #831 artifacts removed, preserved in https://git.kayg.org/kayg/calternal/pulls/880#issuecomment-75592. Known pre-existing cases from brief: vim.spec.ts:341 and :380; sidebar-edge.spec.ts:8; webkit-1440 editor.spec.ts:173 convergence (unattributed after 37 train/22 dev passes, #883 comment 76036). These are listed separately from new failures. No retries. Every failing case gets one origin/dev comparison. Preparation: disk checks dev-01 295 GiB free, dev-02 325 GiB free. Frozen root Bun install will precede cargo test. TMPDIR=$HOME/bm12-tmp on disk. CI=1, Nix, heavy jobs through ~/bin/slot, cargo -j4, Playwright --workers=1 --retries=0. Never merge.
kayg commented 2026-11-02 23:32:54 +00:00
Author
Owner
Copy link

Preparation checkpoint: frozen root Bun install PASS on both VMs before cargo test; fmt PASS; clippy --workspace --all-targets --locked -j4 -- -D warnings PASS. dev-02 cargo build -j4 and web build PASS. Rust workspace test is compiling on dev-01. Both browser halves will start together after gates. Separate origin/dev products are being prepared for one comparison per failing case, using the same train test definitions.

Temporary split config is outside the repository, imports the native config, retains admin-setup on each half with its dependents, and removes only dependencies outside that half. WebKit listing selects 2,113 cases. The first listing failed before any test execution because the external directory lacked type=module; the corrected listing passes. No browser test retry occurred. All raw logs and temporary artifacts stay outside the repository.

Preparation checkpoint: frozen root Bun install PASS on both VMs before cargo test; fmt PASS; clippy --workspace --all-targets --locked -j4 -- -D warnings PASS. dev-02 cargo build -j4 and web build PASS. Rust workspace test is compiling on dev-01. Both browser halves will start together after gates. Separate origin/dev products are being prepared for one comparison per failing case, using the same train test definitions. Temporary split config is outside the repository, imports the native config, retains admin-setup on each half with its dependents, and removes only dependencies outside that half. WebKit listing selects 2,113 cases. The first listing failed before any test execution because the external directory lacked type=module; the corrected listing passes. No browser test retry occurred. All raw logs and temporary artifacts stay outside the repository.
kayg commented 2026-11-02 23:59:57 +00:00
Author
Owner
Copy link

BM12 first-run non-browser gates: all PASS at 1e776f9e810c46c91bc752a117ed4f43ebd3938f. No gate retry.

Gate / exact command dev-01 dev-02
Root bun install --frozen-lockfile before Rust tests PASS PASS
cargo fmt --all --check PASS not assigned
cargo clippy --workspace --all-targets --locked -j4 -- -D warnings PASS not assigned
cargo test --workspace -j4 PASS not assigned
cargo build -j4 PASS PASS
(cd apps/web && bun run build) PASS PASS
PERF_DIST="$PWD/apps/web/dist" PERF_OUT="$HOME/bm12-train/bundle" PERF_WORK="$HOME/bm12-train/bundle-work" bash perf/web.sh --bundle-only --gate PASS not assigned
node ci/check-case-paths.mjs PASS not assigned
node ci/check-no-evidence.mjs PASS not assigned

All commands CI=1 under Nix; every heavy command through ~/bin/slot. Consistent CARGO_PROFILE_DEV_DEBUG=0 CARGO_PROFILE_TEST_DEBUG=0 CARGO_INCREMENTAL=0. TMPDIR=$HOME/bm12-tmp on the root disk for tests and Playwright temp Homes. Disk checked before heavy work and browser launch: above 50 GiB free on both. Unchanged bundle budgets pass; bundle-only produces sizes, with no frame-performance claim.

Full browser halves launched together: dev-01 Chromium 2,134 cases at 03 Nov 05:29:16 IST, dev-02 WebKit 2,113 cases at 05:29:14 IST. Admin setup retained on each half with its dependents; native same-half scheduling dependencies retained. Workers=1, retries=0. Exact command from apps/web:

CI=1 TMPDIR="$HOME/bm12-tmp" BM12_HALF=<chromium|webkit> \
CALTERNAL_BIN="$PWD/../../target/debug/calternal" E2E_DIST="$PWD/dist" \
bunx playwright test --config="$HOME/bm12-train/playwright.config.ts" \
  --output="$HOME/bm12-train/test-results" --workers=1 --retries=0 --reporter=line,json

Listing-only preparation errors are preserved: the external config initially needed type=module on dev-02; an early dev-01 listing lacked the not-yet-built dist. Both ran zero test cases. The actual first full launches are executing normally. No attempted case has been rerun.

BM12 first-run non-browser gates: **all PASS** at `1e776f9e810c46c91bc752a117ed4f43ebd3938f`. No gate retry. | Gate / exact command | dev-01 | dev-02 | |---|---|---| | Root `bun install --frozen-lockfile` before Rust tests | PASS | PASS | | `cargo fmt --all --check` | PASS | not assigned | | `cargo clippy --workspace --all-targets --locked -j4 -- -D warnings` | PASS | not assigned | | `cargo test --workspace -j4` | PASS | not assigned | | `cargo build -j4` | PASS | PASS | | `(cd apps/web && bun run build)` | PASS | PASS | | `PERF_DIST="$PWD/apps/web/dist" PERF_OUT="$HOME/bm12-train/bundle" PERF_WORK="$HOME/bm12-train/bundle-work" bash perf/web.sh --bundle-only --gate` | PASS | not assigned | | `node ci/check-case-paths.mjs` | PASS | not assigned | | `node ci/check-no-evidence.mjs` | PASS | not assigned | All commands CI=1 under Nix; every heavy command through ~/bin/slot. Consistent CARGO_PROFILE_DEV_DEBUG=0 CARGO_PROFILE_TEST_DEBUG=0 CARGO_INCREMENTAL=0. TMPDIR=$HOME/bm12-tmp on the root disk for tests and Playwright temp Homes. Disk checked before heavy work and browser launch: above 50 GiB free on both. Unchanged bundle budgets pass; bundle-only produces sizes, with no frame-performance claim. Full browser halves launched together: dev-01 Chromium 2,134 cases at 03 Nov 05:29:16 IST, dev-02 WebKit 2,113 cases at 05:29:14 IST. Admin setup retained on each half with its dependents; native same-half scheduling dependencies retained. Workers=1, retries=0. Exact command from apps/web: ```sh CI=1 TMPDIR="$HOME/bm12-tmp" BM12_HALF=<chromium|webkit> \ CALTERNAL_BIN="$PWD/../../target/debug/calternal" E2E_DIST="$PWD/dist" \ bunx playwright test --config="$HOME/bm12-train/playwright.config.ts" \ --output="$HOME/bm12-train/test-results" --workers=1 --retries=0 --reporter=line,json ``` Listing-only preparation errors are preserved: the external config initially needed type=module on dev-02; an early dev-01 listing lacked the not-yet-built dist. Both ran zero test cases. The actual first full launches are executing normally. No attempted case has been rerun.
kayg commented 2026-11-02 23:59:58 +00:00
Author
Owner
Copy link

BM12 Rust first-run target accounting. 78 executable targets and 22 doctest targets PASS, no failed target, no remainder run, no retry. Root frozen Bun install preceded cargo test; both independent_652_real_syncclient bridge cases passed.

Target First result
unittests src/main.rs ok. 35 passed; 0 failed; 1 ignored; 0 measured; 0 filtered out; finished in 73.97s
tests/attachments_crash.rs ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 3.20s
tests/contacts_live.rs ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 2.76s
tests/fix_tz_live.rs ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.76s
tests/notes_crash.rs ok. 3 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 7.14s
tests/notes_crash_typing.rs ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 3.55s
tests/notes_live.rs ok. 3 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 1.18s
tests/prefs_live.rs ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.20s
tests/search_live.rs ok. 2 passed; 0 failed; 1 ignored; 0 measured; 0 filtered out; finished in 1.41s
tests/startup.rs ok. 5 passed; 0 failed; 1 ignored; 0 measured; 0 filtered out; finished in 0.16s
tests/storage_startup.rs ok. 10 passed; 0 failed; 1 ignored; 0 measured; 0 filtered out; finished in 10.24s
unittests src/lib.rs ok. 22 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 4.30s
unittests src/lib.rs ok. 53 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 3.92s
tests/abuse.rs ok. 12 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 1.29s
tests/app_passwords.rs ok. 29 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 2.09s
tests/create.rs ok. 6 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.25s
tests/groups.rs ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.25s
tests/host_cookies.rs ok. 3 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.29s
tests/invites.rs ok. 8 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.81s
tests/isolation.rs ok. 3 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.27s
tests/login.rs ok. 11 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.71s
tests/migration.rs ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.59s
tests/passkeys.rs ok. 10 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.64s
tests/people.rs ok. 4 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.27s
tests/quota_counter.rs ok. 2 passed; 0 failed; 1 ignored; 0 measured; 0 filtered out; finished in 3.60s
tests/reliability_review.rs ok. 19 passed; 0 failed; 3 ignored; 0 measured; 0 filtered out; finished in 4.47s
tests/reliability_round3.rs ok. 10 passed; 0 failed; 2 ignored; 0 measured; 0 filtered out; finished in 124.33s
tests/security_regressions.rs ok. 14 passed; 0 failed; 1 ignored; 0 measured; 0 filtered out; finished in 2.80s
tests/setup.rs ok. 8 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.37s
unittests src/lib.rs ok. 24 passed; 0 failed; 1 ignored; 0 measured; 0 filtered out; finished in 0.83s
unittests src/lib.rs ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
tests/apple.rs ok. 4 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
tests/break_codec.rs ok. 11 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
tests/break_generated.rs ok. 9 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 2.87s
tests/break_inventory.rs ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s
tests/break_labels.rs ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
tests/break_layout.rs ok. 27 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s
tests/break_links.rs ok. 4 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
tests/break_merge.rs ok. 16 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s
tests/format3.rs ok. 21 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s
tests/hostile.rs ok. 10 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 5.12s
tests/layout.rs ok. 13 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
tests/roundtrip.rs ok. 10 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.04s
unittests src/lib.rs ok. 131 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 82.63s
unittests src/lib.rs ok. 16 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
unittests src/lib.rs ok. 23 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 1.62s
unittests src/lib.rs ok. 20 passed; 0 failed; 1 ignored; 0 measured; 0 filtered out; finished in 0.92s
unittests src/lib.rs ok. 5 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.97s
unittests src/main.rs ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
unittests src/lib.rs ok. 52 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 1.83s
unittests src/lib.rs ok. 13 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 146.37s
unittests src/lib.rs ok. 3 passed; 0 failed; 1 ignored; 0 measured; 0 filtered out; finished in 0.00s
unittests src/bin/markdown-worker.rs ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
tests/contract.rs ok. 5 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s
tests/depth.rs ok. 5 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s
tests/limits.rs ok. 8 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.38s
tests/memory.rs ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 2.16s
tests/tags.rs ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
unittests src/lib.rs ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
unittests src/lib.rs ok. 37 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.52s
unittests src/lib.rs ok. 547 passed; 0 failed; 6 ignored; 0 measured; 0 filtered out; finished in 559.11s
unittests src/main.rs ok. 7 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
unittests src/bin/storage-bench.rs ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
unittests src/bin/tasks-bench.rs ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
unittests src/bin/tasks-create-bench.rs ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
unittests src/lib.rs ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
unittests src/lib.rs ok. 27 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 258.03s
unittests src/lib.rs ok. 16 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.14s
tests/note_generation.rs ok. 1 passed; 0 failed; 1 ignored; 0 measured; 0 filtered out; finished in 1.49s
tests/search.rs ok. 12 passed; 0 failed; 1 ignored; 0 measured; 0 filtered out; finished in 1.87s
unittests src/lib.rs ok. 15 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.32s
tests/access.rs ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.03s
tests/live.rs ok. 6 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.10s
tests/signout.rs ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.07s
tests/web.rs ok. 3 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s
unittests src/lib.rs ok. 9 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.43s
unittests src/lib.rs ok. 67 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 84.11s
unittests src/lib.rs ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
Doc-tests calternal_attachments ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
Doc-tests calternal_auth ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
Doc-tests calternal_backdrops ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
Doc-tests calternal_contacts ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
Doc-tests calternal_contacts_actions ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
Doc-tests calternal_core ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
Doc-tests calternal_daily ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
Doc-tests calternal_engine ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
Doc-tests calternal_fixtures ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
Doc-tests calternal_fsio ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
Doc-tests calternal_imap_uid ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
Doc-tests calternal_markdown_view ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
Doc-tests calternal_memory ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
Doc-tests calternal_migrate_v0 ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
Doc-tests calternal_notes ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
Doc-tests calternal_plugin_hello ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
Doc-tests calternal_prefs ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
Doc-tests calternal_search ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
Doc-tests calternal_server ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
Doc-tests calternal_store ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
Doc-tests calternal_tasks ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
Doc-tests calternal_testkit ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s

Aggregate: 1471 passed, 0 failed, 22 explicitly ignored. Command: CI=1 TMPDIR="$HOME/bm12-tmp" ~/bin/slot cargo test --workspace -j4 under Nix with the profile variables in the gate comment. No first errors to report and no failing Rust case requiring an origin/dev comparison.

BM12 Rust first-run target accounting. **78 executable targets and 22 doctest targets PASS**, no failed target, no remainder run, no retry. Root frozen Bun install preceded cargo test; both independent_652_real_syncclient bridge cases passed. | Target | First result | |---|---| | `unittests src/main.rs` | ok. 35 passed; 0 failed; 1 ignored; 0 measured; 0 filtered out; finished in 73.97s | | `tests/attachments_crash.rs` | ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 3.20s | | `tests/contacts_live.rs` | ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 2.76s | | `tests/fix_tz_live.rs` | ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.76s | | `tests/notes_crash.rs` | ok. 3 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 7.14s | | `tests/notes_crash_typing.rs` | ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 3.55s | | `tests/notes_live.rs` | ok. 3 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 1.18s | | `tests/prefs_live.rs` | ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.20s | | `tests/search_live.rs` | ok. 2 passed; 0 failed; 1 ignored; 0 measured; 0 filtered out; finished in 1.41s | | `tests/startup.rs` | ok. 5 passed; 0 failed; 1 ignored; 0 measured; 0 filtered out; finished in 0.16s | | `tests/storage_startup.rs` | ok. 10 passed; 0 failed; 1 ignored; 0 measured; 0 filtered out; finished in 10.24s | | `unittests src/lib.rs` | ok. 22 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 4.30s | | `unittests src/lib.rs` | ok. 53 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 3.92s | | `tests/abuse.rs` | ok. 12 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 1.29s | | `tests/app_passwords.rs` | ok. 29 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 2.09s | | `tests/create.rs` | ok. 6 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.25s | | `tests/groups.rs` | ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.25s | | `tests/host_cookies.rs` | ok. 3 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.29s | | `tests/invites.rs` | ok. 8 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.81s | | `tests/isolation.rs` | ok. 3 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.27s | | `tests/login.rs` | ok. 11 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.71s | | `tests/migration.rs` | ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.59s | | `tests/passkeys.rs` | ok. 10 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.64s | | `tests/people.rs` | ok. 4 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.27s | | `tests/quota_counter.rs` | ok. 2 passed; 0 failed; 1 ignored; 0 measured; 0 filtered out; finished in 3.60s | | `tests/reliability_review.rs` | ok. 19 passed; 0 failed; 3 ignored; 0 measured; 0 filtered out; finished in 4.47s | | `tests/reliability_round3.rs` | ok. 10 passed; 0 failed; 2 ignored; 0 measured; 0 filtered out; finished in 124.33s | | `tests/security_regressions.rs` | ok. 14 passed; 0 failed; 1 ignored; 0 measured; 0 filtered out; finished in 2.80s | | `tests/setup.rs` | ok. 8 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.37s | | `unittests src/lib.rs` | ok. 24 passed; 0 failed; 1 ignored; 0 measured; 0 filtered out; finished in 0.83s | | `unittests src/lib.rs` | ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `tests/apple.rs` | ok. 4 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `tests/break_codec.rs` | ok. 11 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `tests/break_generated.rs` | ok. 9 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 2.87s | | `tests/break_inventory.rs` | ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s | | `tests/break_labels.rs` | ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `tests/break_layout.rs` | ok. 27 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s | | `tests/break_links.rs` | ok. 4 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `tests/break_merge.rs` | ok. 16 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s | | `tests/format3.rs` | ok. 21 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s | | `tests/hostile.rs` | ok. 10 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 5.12s | | `tests/layout.rs` | ok. 13 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `tests/roundtrip.rs` | ok. 10 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.04s | | `unittests src/lib.rs` | ok. 131 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 82.63s | | `unittests src/lib.rs` | ok. 16 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `unittests src/lib.rs` | ok. 23 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 1.62s | | `unittests src/lib.rs` | ok. 20 passed; 0 failed; 1 ignored; 0 measured; 0 filtered out; finished in 0.92s | | `unittests src/lib.rs` | ok. 5 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.97s | | `unittests src/main.rs` | ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `unittests src/lib.rs` | ok. 52 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 1.83s | | `unittests src/lib.rs` | ok. 13 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 146.37s | | `unittests src/lib.rs` | ok. 3 passed; 0 failed; 1 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `unittests src/bin/markdown-worker.rs` | ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `tests/contract.rs` | ok. 5 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s | | `tests/depth.rs` | ok. 5 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s | | `tests/limits.rs` | ok. 8 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.38s | | `tests/memory.rs` | ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 2.16s | | `tests/tags.rs` | ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `unittests src/lib.rs` | ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `unittests src/lib.rs` | ok. 37 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.52s | | `unittests src/lib.rs` | ok. 547 passed; 0 failed; 6 ignored; 0 measured; 0 filtered out; finished in 559.11s | | `unittests src/main.rs` | ok. 7 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `unittests src/bin/storage-bench.rs` | ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `unittests src/bin/tasks-bench.rs` | ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `unittests src/bin/tasks-create-bench.rs` | ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `unittests src/lib.rs` | ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `unittests src/lib.rs` | ok. 27 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 258.03s | | `unittests src/lib.rs` | ok. 16 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.14s | | `tests/note_generation.rs` | ok. 1 passed; 0 failed; 1 ignored; 0 measured; 0 filtered out; finished in 1.49s | | `tests/search.rs` | ok. 12 passed; 0 failed; 1 ignored; 0 measured; 0 filtered out; finished in 1.87s | | `unittests src/lib.rs` | ok. 15 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.32s | | `tests/access.rs` | ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.03s | | `tests/live.rs` | ok. 6 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.10s | | `tests/signout.rs` | ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.07s | | `tests/web.rs` | ok. 3 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.01s | | `unittests src/lib.rs` | ok. 9 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.43s | | `unittests src/lib.rs` | ok. 67 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 84.11s | | `unittests src/lib.rs` | ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `Doc-tests calternal_attachments` | ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `Doc-tests calternal_auth` | ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `Doc-tests calternal_backdrops` | ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `Doc-tests calternal_contacts` | ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `Doc-tests calternal_contacts_actions` | ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `Doc-tests calternal_core` | ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `Doc-tests calternal_daily` | ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `Doc-tests calternal_engine` | ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `Doc-tests calternal_fixtures` | ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `Doc-tests calternal_fsio` | ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `Doc-tests calternal_imap_uid` | ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `Doc-tests calternal_markdown_view` | ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `Doc-tests calternal_memory` | ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `Doc-tests calternal_migrate_v0` | ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `Doc-tests calternal_notes` | ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `Doc-tests calternal_plugin_hello` | ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `Doc-tests calternal_prefs` | ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `Doc-tests calternal_search` | ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `Doc-tests calternal_server` | ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `Doc-tests calternal_store` | ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `Doc-tests calternal_tasks` | ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | | `Doc-tests calternal_testkit` | ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s | Aggregate: 1471 passed, 0 failed, 22 explicitly ignored. Command: `CI=1 TMPDIR="$HOME/bm12-tmp" ~/bin/slot cargo test --workspace -j4` under Nix with the profile variables in the gate comment. No first errors to report and no failing Rust case requiring an origin/dev comparison.
kayg commented 2026-11-03 00:11:56 +00:00
Author
Owner
Copy link

First browser failure, original attempt, no retry: chromium-1440 list-fit.spec.ts:67, a list scrolls the moment it is opened. This is outside the brief’s known pre-existing list, so it is unresolved pending its single origin/dev comparison. The original full run continues; no assertion or timeout changed.

  1) [chromium-1440] › e2e/list-fit.spec.ts:67:1 › a list scrolls the moment it is opened ──────────

    Error: scrolling started within a moment

    expect(received).toBeLessThan(expected)

    Expected: < 1500
    Received:   1654

      90 |   } else await page.mouse.wheel(0, 500)
      91 |   await expect.poll(at, { timeout: moment }).toBeGreaterThan(100)
    > 92 |   expect(Date.now() - t0, 'scrolling started within a moment').toBeLessThan(moment)
         |                                                                ^
      93 |   // And no frame is frozen while it goes: no gap of half a second between frames.
      94 |   const gaps = await page.evaluate(async () => {
      95 |     const out: number[] = []
        at /home/claude/Developer/Worktrees/bm12/apps/web/e2e/list-fit.spec.ts:92:64

The assertion is an existing functional wall-clock check. This Linux result is recorded as a test failure; it is not GPU frame-performance qualification. The exact same train test definition will run once against the prepared origin/dev product.

First browser failure, original attempt, no retry: **chromium-1440 list-fit.spec.ts:67**, a list scrolls the moment it is opened. This is outside the brief’s known pre-existing list, so it is unresolved pending its single origin/dev comparison. The original full run continues; no assertion or timeout changed. ```text 1) [chromium-1440] › e2e/list-fit.spec.ts:67:1 › a list scrolls the moment it is opened ────────── Error: scrolling started within a moment expect(received).toBeLessThan(expected) Expected: < 1500 Received: 1654 90 | } else await page.mouse.wheel(0, 500) 91 | await expect.poll(at, { timeout: moment }).toBeGreaterThan(100) > 92 | expect(Date.now() - t0, 'scrolling started within a moment').toBeLessThan(moment) | ^ 93 | // And no frame is frozen while it goes: no gap of half a second between frames. 94 | const gaps = await page.evaluate(async () => { 95 | const out: number[] = [] at /home/claude/Developer/Worktrees/bm12/apps/web/e2e/list-fit.spec.ts:92:64 ``` The assertion is an existing functional wall-clock check. This Linux result is recorded as a test failure; it is not GPU frame-performance qualification. The exact same train test definition will run once against the prepared origin/dev product.
kayg commented 2026-11-03 00:17:36 +00:00
Author
Owner
Copy link

Second original Chromium failure outside the known list: chromium-1440 refusal-performance.spec.ts:29. No retry. Unresolved pending its one origin/dev comparison after the full run. The first error is a destroyed execution context during page.evaluate, before the timing assertion. No performance qualification is inferred.

  2) [chromium-1440] › e2e/refusal-performance.spec.ts:29:1 › typing and collaborator packets next to a refused 65 MiB paste stay under 16 ms 

    Error: page.evaluate: Execution context was destroyed, most likely because of a navigation.

      21 | const run = (name: 'refusedPaste' | 'offlineBacklog') => async ({ page }: { page: import('@playwright/test').Page }) => {
      22 |   await page.goto(`${origin}/integration/performance.html`)
    > 23 |   return page.evaluate(async (name) => {
         |               ^
      24 |     const path = '/integration/refusal-performance.ts'
      25 |     return (await import(/* @vite-ignore */ path))[name]()
      26 |   }, name)
        at /home/claude/Developer/Worktrees/bm12/apps/web/e2e/refusal-performance.spec.ts:23:15
        at /home/claude/Developer/Worktrees/bm12/apps/web/e2e/refusal-performance.spec.ts:31:18
Second original Chromium failure outside the known list: **chromium-1440 refusal-performance.spec.ts:29**. No retry. Unresolved pending its one origin/dev comparison after the full run. The first error is a destroyed execution context during page.evaluate, before the timing assertion. No performance qualification is inferred. ```text 2) [chromium-1440] › e2e/refusal-performance.spec.ts:29:1 › typing and collaborator packets next to a refused 65 MiB paste stay under 16 ms Error: page.evaluate: Execution context was destroyed, most likely because of a navigation. 21 | const run = (name: 'refusedPaste' | 'offlineBacklog') => async ({ page }: { page: import('@playwright/test').Page }) => { 22 | await page.goto(`${origin}/integration/performance.html`) > 23 | return page.evaluate(async (name) => { | ^ 24 | const path = '/integration/refusal-performance.ts' 25 | return (await import(/* @vite-ignore */ path))[name]() 26 | }, name) at /home/claude/Developer/Worktrees/bm12/apps/web/e2e/refusal-performance.spec.ts:23:15 at /home/claude/Developer/Worktrees/bm12/apps/web/e2e/refusal-performance.spec.ts:31:18 ```
kayg commented 2026-11-03 00:42:36 +00:00
Author
Owner
Copy link

First original WebKit failure outside the known list: webkit-390 missing-links.spec.ts:245, renamed in the app: the link is repointed and still opens the note. No retry. Unresolved pending its single origin/dev comparison.

  1) [webkit-390] › e2e/missing-links.spec.ts:245:1 › renamed in the app: the link is repointed and still opens the note 

    Error: expect(page).toHaveURL(expected) failed

    Expected pattern: /t-wr9vkn/
    Received string:  "http://127.0.0.1:46227/?test=1#/note/l-rv8h11"
    Timeout: 5000ms

    Call log:
      - Expect "toHaveURL" with timeout 5000ms
        13 × locator resolved to <html class="" lang="en" data-card="1" data-sky="night" data-app="ready" data-edge="glass" data-ready="true" data-scheme="dark" data-docscroll="1" data-listed="true" data-synced="true" data-backdrop="sky" data-input="pointer" data-accent="marigold" data-last-input="pointer">…</html>
           - unexpected value "http://127.0.0.1:46227/?test=1#/note/l-rv8h11"


      255 |   await expect(editor.locator('.cm-link')).not.toHaveClass(/cm-link-(new|trash|gone)/)
      256 |   await editor.locator('.cm-link').click()
    > 257 |   await expect(page).toHaveURL(new RegExp(t))
          |                      ^
      258 | })
      259 |
      260 | test('nothing about links sits above the title', async ({ page }) => {
        at /home/cua/Developer/Worktrees/bm12/apps/web/e2e/missing-links.spec.ts:257:22
First original WebKit failure outside the known list: **webkit-390 missing-links.spec.ts:245**, renamed in the app: the link is repointed and still opens the note. No retry. Unresolved pending its single origin/dev comparison. ```text 1) [webkit-390] › e2e/missing-links.spec.ts:245:1 › renamed in the app: the link is repointed and still opens the note Error: expect(page).toHaveURL(expected) failed Expected pattern: /t-wr9vkn/ Received string: "http://127.0.0.1:46227/?test=1#/note/l-rv8h11" Timeout: 5000ms Call log: - Expect "toHaveURL" with timeout 5000ms 13 × locator resolved to <html class="" lang="en" data-card="1" data-sky="night" data-app="ready" data-edge="glass" data-ready="true" data-scheme="dark" data-docscroll="1" data-listed="true" data-synced="true" data-backdrop="sky" data-input="pointer" data-accent="marigold" data-last-input="pointer">…</html> - unexpected value "http://127.0.0.1:46227/?test=1#/note/l-rv8h11" 255 | await expect(editor.locator('.cm-link')).not.toHaveClass(/cm-link-(new|trash|gone)/) 256 | await editor.locator('.cm-link').click() > 257 | await expect(page).toHaveURL(new RegExp(t)) | ^ 258 | }) 259 | 260 | test('nothing about links sits above the title', async ({ page }) => { at /home/cua/Developer/Worktrees/bm12/apps/web/e2e/missing-links.spec.ts:257:22 ```
kayg commented 2026-11-03 01:09:27 +00:00
Author
Owner
Copy link

BM12 WebKit first-run matrix, dev02, tested head 1e776f9e810c46c91bc752a117ed4f43ebd3938f. Original full command exit 1. Workers=1, retries=0; every attempted train case ran once.

Project Passed Failed Explicit skips Unattempted
webkit-1440 423 0 605 0
webkit-390 864 1 163 0
admin-webkit-1440 9 0 9 0
admin-webkit-390 9 0 9 0
admin-setup 1 0 0 0
prefs-webkit 3 0 4 0
look-webkit-1440 4 0 1 0
look-webkit-390 4 0 1 0
sidebar-band-webkit 3 0 0 0
Total 1320 1 792 0

Every failed case below received exactly one actual origin/dev comparison. Product base 55f35fcde3bc91ca3781055577b93e93819f6cd4: separate binary and production dist, baseline source for directly served editor integrations, current train e2e definitions overlaid only in the owned detached baseline worktree. Native Playwright config is identical on base and train; the external wrapper selects the target project and retains admin-setup when needed. No product source overlay beyond #779 Nix tooling.

Failed case Origin/dev once Attribution
webkit-390 missing-links.spec.ts:245 PASS unresolved; origin/dev PASS, outside the known pre-existing list

webkit-390 missing-links.spec.ts:245 renamed in the app: the link is repointed and still opens the note

Train first error, retry=0:

Error: expect(page).toHaveURL(expected) failed

Expected pattern: /t-wr9vkn/
Received string:  "http://127.0.0.1:46227/?test=1#/note/l-rv8h11"
Timeout: 5000ms

Call log:
  - Expect "toHaveURL" with timeout 5000ms
    13 × locator resolved to <html class="" lang="en" data-card="1" data-sky="night" data-app="ready" data-edge="glass" data-ready="true" data-scheme="dark" data-docscroll="1" data-listed="true" data-synced="true" data-backdrop="sky" data-input="pointer" data-accent="marigold" data-last-input="pointer">…</html>
       - unexpected value "http://127.0.0.1:46227/?test=1#/note/l-rv8h11"


  255 |   await expect(editor.locator('.cm-link')).not.toHaveClass(/cm-link-(new|trash|gone)/)
  256 |   await editor.locator('.cm-link').click()
> 257 |   await expect(page).toHaveURL(new RegExp(t))
      |                      ^
  258 | })
  259 |
  260 | test('nothing about links sits above the title', async ({ page }) => {
    at /home/cua/Developer/Worktrees/bm12/apps/web/e2e/missing-links.spec.ts:257:22

Exact one-case baseline command under Nix:

cd /home/cua/Developer/Worktrees/bm12-base/apps/web
CI=1 TMPDIR=/home/cua/bm12-tmp BM12_BASELINE_PROJECT=webkit-390 \
CALTERNAL_BIN=/home/cua/Developer/Worktrees/bm12-base/target/debug/calternal \
E2E_DIST=/home/cua/Developer/Worktrees/bm12-base/apps/web/dist \
/home/cua/bin/slot bunx playwright test missing-links.spec.ts:245 --config=/home/cua/bm12-train/playwright.baseline.config.ts --project=webkit-390 '--grep=renamed\ in\ the\ app:\ the\ link\ is\ repointed\ and\ still\ opens\ the\ note' --workers=1 --retries=0 --reporter=line,json --output=/home/cua/bm12-baseline/browser-cases/e350707d5667-results

Baseline PASS, exactly one case attempted.

Known pre-existing list retained from the brief: vim.spec.ts:341 and :380; sidebar-edge.spec.ts:8; webkit-1440 editor.spec.ts:173 convergence (historically unattributed after 37 train / 22 dev passes, #883 comment 76036). Known failures are not counted as new. Any unlisted failure whose baseline passes remains unresolved. Linux motion/frame checks are functional diagnostics only; no GPU performance qualification. No assertion, timeout or budget was changed. Artifacts are PR comments only.

BM12 WebKit first-run matrix, dev02, tested head `1e776f9e810c46c91bc752a117ed4f43ebd3938f`. Original full command exit 1. Workers=1, retries=0; every attempted train case ran once. | Project | Passed | Failed | Explicit skips | Unattempted | |---|---:|---:|---:|---:| | webkit-1440 | 423 | 0 | 605 | 0 | | webkit-390 | 864 | 1 | 163 | 0 | | admin-webkit-1440 | 9 | 0 | 9 | 0 | | admin-webkit-390 | 9 | 0 | 9 | 0 | | admin-setup | 1 | 0 | 0 | 0 | | prefs-webkit | 3 | 0 | 4 | 0 | | look-webkit-1440 | 4 | 0 | 1 | 0 | | look-webkit-390 | 4 | 0 | 1 | 0 | | sidebar-band-webkit | 3 | 0 | 0 | 0 | | **Total** | 1320 | 1 | 792 | 0 | Every failed case below received exactly one actual origin/dev comparison. Product base `55f35fcde3bc91ca3781055577b93e93819f6cd4`: separate binary and production dist, baseline source for directly served editor integrations, current train e2e definitions overlaid only in the owned detached baseline worktree. Native Playwright config is identical on base and train; the external wrapper selects the target project and retains admin-setup when needed. No product source overlay beyond #779 Nix tooling. | Failed case | Origin/dev once | Attribution | |---|---|---| | webkit-390 missing-links.spec.ts:245 | PASS | unresolved; origin/dev PASS, outside the known pre-existing list | webkit-390 missing-links.spec.ts:245 `renamed in the app: the link is repointed and still opens the note` Train first error, retry=0: ```text Error: expect(page).toHaveURL(expected) failed Expected pattern: /t-wr9vkn/ Received string: "http://127.0.0.1:46227/?test=1#/note/l-rv8h11" Timeout: 5000ms Call log: - Expect "toHaveURL" with timeout 5000ms 13 × locator resolved to <html class="" lang="en" data-card="1" data-sky="night" data-app="ready" data-edge="glass" data-ready="true" data-scheme="dark" data-docscroll="1" data-listed="true" data-synced="true" data-backdrop="sky" data-input="pointer" data-accent="marigold" data-last-input="pointer">…</html> - unexpected value "http://127.0.0.1:46227/?test=1#/note/l-rv8h11" 255 | await expect(editor.locator('.cm-link')).not.toHaveClass(/cm-link-(new|trash|gone)/) 256 | await editor.locator('.cm-link').click() > 257 | await expect(page).toHaveURL(new RegExp(t)) | ^ 258 | }) 259 | 260 | test('nothing about links sits above the title', async ({ page }) => { at /home/cua/Developer/Worktrees/bm12/apps/web/e2e/missing-links.spec.ts:257:22 ``` Exact one-case baseline command under Nix: ```sh cd /home/cua/Developer/Worktrees/bm12-base/apps/web CI=1 TMPDIR=/home/cua/bm12-tmp BM12_BASELINE_PROJECT=webkit-390 \ CALTERNAL_BIN=/home/cua/Developer/Worktrees/bm12-base/target/debug/calternal \ E2E_DIST=/home/cua/Developer/Worktrees/bm12-base/apps/web/dist \ /home/cua/bin/slot bunx playwright test missing-links.spec.ts:245 --config=/home/cua/bm12-train/playwright.baseline.config.ts --project=webkit-390 '--grep=renamed\ in\ the\ app:\ the\ link\ is\ repointed\ and\ still\ opens\ the\ note' --workers=1 --retries=0 --reporter=line,json --output=/home/cua/bm12-baseline/browser-cases/e350707d5667-results ``` Baseline PASS, exactly one case attempted. Known pre-existing list retained from the brief: vim.spec.ts:341 and :380; sidebar-edge.spec.ts:8; webkit-1440 editor.spec.ts:173 convergence (historically unattributed after 37 train / 22 dev passes, #883 comment 76036). Known failures are not counted as new. Any unlisted failure whose baseline passes remains unresolved. Linux motion/frame checks are functional diagnostics only; no GPU performance qualification. No assertion, timeout or budget was changed. Artifacts are PR comments only.
kayg commented 2026-11-03 01:16:47 +00:00
Author
Owner
Copy link

BM12 Chromium first-run matrix, dev01, tested head 1e776f9e810c46c91bc752a117ed4f43ebd3938f. Original full command exit 1. Workers=1, retries=0; every attempted train case ran once.

Project Passed Failed Explicit skips Unattempted
chromium-1440 423 3 602 0
chromium-390 867 0 161 0
throttled-1440 2 0 0 0
throttled-390 2 0 0 0
admin-chromium-1440 12 0 9 0
admin-chromium-390 12 0 9 0
flow 1 0 0 0
passkeys 1 0 0 0
admin-setup 1 0 0 0
prefs-chromium 7 0 0 0
look-chromium-1440 5 0 0 0
look-chromium-390 5 0 0 0
contrast 9 0 0 0
sidebar-band-chromium 3 0 0 0
Total 1350 3 781 0

Dependency-blocked cases received only their first attempts through an explicit --test-list and --no-deps, with scheduling dependencies removed for those unattempted entries only. No attempted case was rerun. The original full-command failure remains recorded.

Unattempted-only command from apps/web:

/home/claude/bin/slot bunx playwright test --config=/home/claude/bm12-train/playwright.unrun.config.ts --test-list=/home/claude/bm12-train/unrun/tests.txt --no-deps --workers=1 --retries=0 --reporter=line,json --output=/home/claude/bm12-train/unrun/test-results

Every failed case below received exactly one actual origin/dev comparison. Product base 55f35fcde3bc91ca3781055577b93e93819f6cd4: separate binary and production dist, baseline source for directly served editor integrations, current train e2e definitions overlaid only in the owned detached baseline worktree. Native Playwright config is identical on base and train; the external wrapper selects the target project and retains admin-setup when needed. No product source overlay beyond #779 Nix tooling.

Failed case Origin/dev once Attribution
chromium-1440 list-fit.spec.ts:67 PASS unresolved; origin/dev PASS, outside the known pre-existing list
chromium-1440 refusal-performance.spec.ts:29 PASS unresolved; origin/dev PASS, outside the known pre-existing list
chromium-1440 vim.spec.ts:380 FAIL known pre-existing from brief; reproduced the same Saved assertion on origin/dev

chromium-1440 list-fit.spec.ts:67 a list scrolls the moment it is opened

Train first error, retry=0:

Error: scrolling started within a moment

expect(received).toBeLessThan(expected)

Expected: < 1500
Received:   1654

  90 |   } else await page.mouse.wheel(0, 500)
  91 |   await expect.poll(at, { timeout: moment }).toBeGreaterThan(100)
> 92 |   expect(Date.now() - t0, 'scrolling started within a moment').toBeLessThan(moment)
     |                                                                ^
  93 |   // And no frame is frozen while it goes: no gap of half a second between frames.
  94 |   const gaps = await page.evaluate(async () => {
  95 |     const out: number[] = []
    at /home/claude/Developer/Worktrees/bm12/apps/web/e2e/list-fit.spec.ts:92:64

Exact one-case baseline command under Nix:

cd /home/claude/Developer/Worktrees/bm12-base/apps/web
CI=1 TMPDIR=/home/claude/bm12-tmp BM12_BASELINE_PROJECT=chromium-1440 \
CALTERNAL_BIN=/home/claude/Developer/Worktrees/bm12-base/target/debug/calternal \
E2E_DIST=/home/claude/Developer/Worktrees/bm12-base/apps/web/dist \
/home/claude/bin/slot bunx playwright test list-fit.spec.ts:67 --config=/home/claude/bm12-train/playwright.baseline.config.ts --project=chromium-1440 '--grep=a\ list\ scrolls\ the\ moment\ it\ is\ opened' --workers=1 --retries=0 --reporter=line,json --output=/home/claude/bm12-baseline/browser-cases/4c82cece0561-results

Baseline PASS, exactly one case attempted.

chromium-1440 refusal-performance.spec.ts:29 typing and collaborator packets next to a refused 65 MiB paste stay under 16 ms

Train first error, retry=0:

Error: page.evaluate: Execution context was destroyed, most likely because of a navigation.

  21 | const run = (name: 'refusedPaste' | 'offlineBacklog') => async ({ page }: { page: import('@playwright/test').Page }) => {
  22 |   await page.goto(`${origin}/integration/performance.html`)
> 23 |   return page.evaluate(async (name) => {
     |               ^
  24 |     const path = '/integration/refusal-performance.ts'
  25 |     return (await import(/* @vite-ignore */ path))[name]()
  26 |   }, name)
    at /home/claude/Developer/Worktrees/bm12/apps/web/e2e/refusal-performance.spec.ts:23:15
    at /home/claude/Developer/Worktrees/bm12/apps/web/e2e/refusal-performance.spec.ts:31:18

Exact one-case baseline command under Nix:

cd /home/claude/Developer/Worktrees/bm12-base/apps/web
CI=1 TMPDIR=/home/claude/bm12-tmp BM12_BASELINE_PROJECT=chromium-1440 \
CALTERNAL_BIN=/home/claude/Developer/Worktrees/bm12-base/target/debug/calternal \
E2E_DIST=/home/claude/Developer/Worktrees/bm12-base/apps/web/dist \
/home/claude/bin/slot bunx playwright test refusal-performance.spec.ts:29 --config=/home/claude/bm12-train/playwright.baseline.config.ts --project=chromium-1440 '--grep=typing\ and\ collaborator\ packets\ next\ to\ a\ refused\ 65\ MiB\ paste\ stay\ under\ 16\ ms' --workers=1 --retries=0 --reporter=line,json --output=/home/claude/bm12-baseline/browser-cases/ea348b6b1d7d-results

Baseline PASS, exactly one case attempted.

chromium-1440 vim.spec.ts:380 : commands in the bar: :n, :s, :%s, :w, :q

Train first error, retry=0:

Error: expect(locator).toBeVisible() failed

Locator: locator('.bar-wrap').getByText('Saved').first()
Expected: visible
Timeout: 5000ms
Error: element(s) not found

Call log:
  - Expect "toBeVisible" locator('.bar-wrap').getByText('Saved').first() with timeout 5000ms
  - waiting for locator('.bar-wrap').getByText('Saved').first()


  403 |     // :w says it's saved.
  404 |     await keys(page, ':', 'w', 'Enter')
> 405 |     await expect(bar(page).getByText('Saved').first()).toBeVisible()
      |                                                        ^
  406 |     // An unknown command says so, and nothing changes.
  407 |     const text = await editorText(page)
  408 |     await keys(page, ':')
    at /home/claude/Developer/Worktrees/bm12/apps/web/e2e/vim.spec.ts:405:56

Exact one-case baseline command under Nix:

cd /home/claude/Developer/Worktrees/bm12-base/apps/web
CI=1 TMPDIR=/home/claude/bm12-tmp BM12_BASELINE_PROJECT=chromium-1440 \
CALTERNAL_BIN=/home/claude/Developer/Worktrees/bm12-base/target/debug/calternal \
E2E_DIST=/home/claude/Developer/Worktrees/bm12-base/apps/web/dist \
/home/claude/bin/slot bunx playwright test vim.spec.ts:380 --config=/home/claude/bm12-train/playwright.baseline.config.ts --project=chromium-1440 '--grep=:\ commands\ in\ the\ bar:\ :n,\ :s,\ :%s,\ :w,\ :q' --workers=1 --retries=0 --reporter=line,json --output=/home/claude/bm12-baseline/browser-cases/bfb8f8db82f4-results

Baseline first error:

Error: expect(locator).toBeVisible() failed

Locator: locator('.bar-wrap').getByText('Saved').first()
Expected: visible
Timeout: 5000ms
Error: element(s) not found

Call log:
  - Expect "toBeVisible" locator('.bar-wrap').getByText('Saved').first() with timeout 5000ms
  - waiting for locator('.bar-wrap').getByText('Saved').first()


  403 |     // :w says it's saved.
  404 |     await keys(page, ':', 'w', 'Enter')
> 405 |     await expect(bar(page).getByText('Saved').first()).toBeVisible()
      |                                                        ^
  406 |     // An unknown command says so, and nothing changes.
  407 |     const text = await editorText(page)
  408 |     await keys(page, ':')
    at /home/claude/Developer/Worktrees/bm12-base/apps/web/e2e/vim.spec.ts:405:56

Known pre-existing list retained from the brief: vim.spec.ts:341 and :380; sidebar-edge.spec.ts:8; webkit-1440 editor.spec.ts:173 convergence (historically unattributed after 37 train / 22 dev passes, #883 comment 76036). Known failures are not counted as new. Any unlisted failure whose baseline passes remains unresolved. Linux motion/frame checks are functional diagnostics only; no GPU performance qualification. No assertion, timeout or budget was changed. Artifacts are PR comments only.

BM12 Chromium first-run matrix, dev01, tested head `1e776f9e810c46c91bc752a117ed4f43ebd3938f`. Original full command exit 1. Workers=1, retries=0; every attempted train case ran once. | Project | Passed | Failed | Explicit skips | Unattempted | |---|---:|---:|---:|---:| | chromium-1440 | 423 | 3 | 602 | 0 | | chromium-390 | 867 | 0 | 161 | 0 | | throttled-1440 | 2 | 0 | 0 | 0 | | throttled-390 | 2 | 0 | 0 | 0 | | admin-chromium-1440 | 12 | 0 | 9 | 0 | | admin-chromium-390 | 12 | 0 | 9 | 0 | | flow | 1 | 0 | 0 | 0 | | passkeys | 1 | 0 | 0 | 0 | | admin-setup | 1 | 0 | 0 | 0 | | prefs-chromium | 7 | 0 | 0 | 0 | | look-chromium-1440 | 5 | 0 | 0 | 0 | | look-chromium-390 | 5 | 0 | 0 | 0 | | contrast | 9 | 0 | 0 | 0 | | sidebar-band-chromium | 3 | 0 | 0 | 0 | | **Total** | 1350 | 3 | 781 | 0 | Dependency-blocked cases received only their first attempts through an explicit --test-list and --no-deps, with scheduling dependencies removed for those unattempted entries only. No attempted case was rerun. The original full-command failure remains recorded. Unattempted-only command from apps/web: ```sh /home/claude/bin/slot bunx playwright test --config=/home/claude/bm12-train/playwright.unrun.config.ts --test-list=/home/claude/bm12-train/unrun/tests.txt --no-deps --workers=1 --retries=0 --reporter=line,json --output=/home/claude/bm12-train/unrun/test-results ``` Every failed case below received exactly one actual origin/dev comparison. Product base `55f35fcde3bc91ca3781055577b93e93819f6cd4`: separate binary and production dist, baseline source for directly served editor integrations, current train e2e definitions overlaid only in the owned detached baseline worktree. Native Playwright config is identical on base and train; the external wrapper selects the target project and retains admin-setup when needed. No product source overlay beyond #779 Nix tooling. | Failed case | Origin/dev once | Attribution | |---|---|---| | chromium-1440 list-fit.spec.ts:67 | PASS | unresolved; origin/dev PASS, outside the known pre-existing list | | chromium-1440 refusal-performance.spec.ts:29 | PASS | unresolved; origin/dev PASS, outside the known pre-existing list | | chromium-1440 vim.spec.ts:380 | FAIL | known pre-existing from brief; reproduced the same Saved assertion on origin/dev | chromium-1440 list-fit.spec.ts:67 `a list scrolls the moment it is opened` Train first error, retry=0: ```text Error: scrolling started within a moment expect(received).toBeLessThan(expected) Expected: < 1500 Received: 1654 90 | } else await page.mouse.wheel(0, 500) 91 | await expect.poll(at, { timeout: moment }).toBeGreaterThan(100) > 92 | expect(Date.now() - t0, 'scrolling started within a moment').toBeLessThan(moment) | ^ 93 | // And no frame is frozen while it goes: no gap of half a second between frames. 94 | const gaps = await page.evaluate(async () => { 95 | const out: number[] = [] at /home/claude/Developer/Worktrees/bm12/apps/web/e2e/list-fit.spec.ts:92:64 ``` Exact one-case baseline command under Nix: ```sh cd /home/claude/Developer/Worktrees/bm12-base/apps/web CI=1 TMPDIR=/home/claude/bm12-tmp BM12_BASELINE_PROJECT=chromium-1440 \ CALTERNAL_BIN=/home/claude/Developer/Worktrees/bm12-base/target/debug/calternal \ E2E_DIST=/home/claude/Developer/Worktrees/bm12-base/apps/web/dist \ /home/claude/bin/slot bunx playwright test list-fit.spec.ts:67 --config=/home/claude/bm12-train/playwright.baseline.config.ts --project=chromium-1440 '--grep=a\ list\ scrolls\ the\ moment\ it\ is\ opened' --workers=1 --retries=0 --reporter=line,json --output=/home/claude/bm12-baseline/browser-cases/4c82cece0561-results ``` Baseline PASS, exactly one case attempted. chromium-1440 refusal-performance.spec.ts:29 `typing and collaborator packets next to a refused 65 MiB paste stay under 16 ms` Train first error, retry=0: ```text Error: page.evaluate: Execution context was destroyed, most likely because of a navigation. 21 | const run = (name: 'refusedPaste' | 'offlineBacklog') => async ({ page }: { page: import('@playwright/test').Page }) => { 22 | await page.goto(`${origin}/integration/performance.html`) > 23 | return page.evaluate(async (name) => { | ^ 24 | const path = '/integration/refusal-performance.ts' 25 | return (await import(/* @vite-ignore */ path))[name]() 26 | }, name) at /home/claude/Developer/Worktrees/bm12/apps/web/e2e/refusal-performance.spec.ts:23:15 at /home/claude/Developer/Worktrees/bm12/apps/web/e2e/refusal-performance.spec.ts:31:18 ``` Exact one-case baseline command under Nix: ```sh cd /home/claude/Developer/Worktrees/bm12-base/apps/web CI=1 TMPDIR=/home/claude/bm12-tmp BM12_BASELINE_PROJECT=chromium-1440 \ CALTERNAL_BIN=/home/claude/Developer/Worktrees/bm12-base/target/debug/calternal \ E2E_DIST=/home/claude/Developer/Worktrees/bm12-base/apps/web/dist \ /home/claude/bin/slot bunx playwright test refusal-performance.spec.ts:29 --config=/home/claude/bm12-train/playwright.baseline.config.ts --project=chromium-1440 '--grep=typing\ and\ collaborator\ packets\ next\ to\ a\ refused\ 65\ MiB\ paste\ stay\ under\ 16\ ms' --workers=1 --retries=0 --reporter=line,json --output=/home/claude/bm12-baseline/browser-cases/ea348b6b1d7d-results ``` Baseline PASS, exactly one case attempted. chromium-1440 vim.spec.ts:380 `: commands in the bar: :n, :s, :%s, :w, :q` Train first error, retry=0: ```text Error: expect(locator).toBeVisible() failed Locator: locator('.bar-wrap').getByText('Saved').first() Expected: visible Timeout: 5000ms Error: element(s) not found Call log: - Expect "toBeVisible" locator('.bar-wrap').getByText('Saved').first() with timeout 5000ms - waiting for locator('.bar-wrap').getByText('Saved').first() 403 | // :w says it's saved. 404 | await keys(page, ':', 'w', 'Enter') > 405 | await expect(bar(page).getByText('Saved').first()).toBeVisible() | ^ 406 | // An unknown command says so, and nothing changes. 407 | const text = await editorText(page) 408 | await keys(page, ':') at /home/claude/Developer/Worktrees/bm12/apps/web/e2e/vim.spec.ts:405:56 ``` Exact one-case baseline command under Nix: ```sh cd /home/claude/Developer/Worktrees/bm12-base/apps/web CI=1 TMPDIR=/home/claude/bm12-tmp BM12_BASELINE_PROJECT=chromium-1440 \ CALTERNAL_BIN=/home/claude/Developer/Worktrees/bm12-base/target/debug/calternal \ E2E_DIST=/home/claude/Developer/Worktrees/bm12-base/apps/web/dist \ /home/claude/bin/slot bunx playwright test vim.spec.ts:380 --config=/home/claude/bm12-train/playwright.baseline.config.ts --project=chromium-1440 '--grep=:\ commands\ in\ the\ bar:\ :n,\ :s,\ :%s,\ :w,\ :q' --workers=1 --retries=0 --reporter=line,json --output=/home/claude/bm12-baseline/browser-cases/bfb8f8db82f4-results ``` Baseline first error: ```text Error: expect(locator).toBeVisible() failed Locator: locator('.bar-wrap').getByText('Saved').first() Expected: visible Timeout: 5000ms Error: element(s) not found Call log: - Expect "toBeVisible" locator('.bar-wrap').getByText('Saved').first() with timeout 5000ms - waiting for locator('.bar-wrap').getByText('Saved').first() 403 | // :w says it's saved. 404 | await keys(page, ':', 'w', 'Enter') > 405 | await expect(bar(page).getByText('Saved').first()).toBeVisible() | ^ 406 | // An unknown command says so, and nothing changes. 407 | const text = await editorText(page) 408 | await keys(page, ':') at /home/claude/Developer/Worktrees/bm12-base/apps/web/e2e/vim.spec.ts:405:56 ``` Known pre-existing list retained from the brief: vim.spec.ts:341 and :380; sidebar-edge.spec.ts:8; webkit-1440 editor.spec.ts:173 convergence (historically unattributed after 37 train / 22 dev passes, #883 comment 76036). Known failures are not counted as new. Any unlisted failure whose baseline passes remains unresolved. Linux motion/frame checks are functional diagnostics only; no GPU performance qualification. No assertion, timeout or budget was changed. Artifacts are PR comments only.
kayg commented 2026-11-03 01:19:08 +00:00
Author
Owner
Copy link

Final BM12 test report: RED. Never merge as part of this task.

PR #884, branch train/2026-11-03-bm12, tested and current head 1e776f9e810c46c91bc752a117ed4f43ebd3938f. Assembly base and origin/dev comparison product 55f35fcde3bc91ca3781055577b93e93819f6cd4. BM11 #883 is closed with the replacement link. BM12 remains open and unmerged.

Current source heads were captured from the PR API immediately before each --no-ff merge, in this order:

PR Recorded source head
#779 7b97e4d14231be07f6a80cb9ca172d02442c487e
#858 626388da9052eaecb159d735f0cadc5e59e88312
#866 ba1f47dc94797d4a8a937298464b5e4828e301c2
#824 f1c1aa961e169ef99e132063a97ccbd9a89a5def
#827 76f11dc4ba06468a2a0ed4d4592cea6038206696
#828 5d7b9b36cd008de78851809724c90a85d92b40a7
#833 ccaece3dfecbe2048634fc792d7d4a2c6e31f324
#836 5f7d1a59776411e7f3353d0023817b43affae51e
#831 316b43e9578c3e4d2944df8df43caebc611356f7
#844 50cce9dcceb87f23a9f346300b3336e315ff6c0c
#847 40448327a15730271d56226b898e48bcc87b2a4d
#855 c38c3083d51f4adcf5cd76a70f1f6960b427413e
#857 144e717145e35f70356f593b7c04a527e00f7b17
#856 26548949efef7e6e4109ccc8e158f21a12f2b026
#840 5de79c18bce498fd85e3adb4be4fa8a84be85085

Identical BM10/BM11 resolutions reused: #824 Cargo.lock union; #828 credential check followed by runtime timer; #840 retains #856 desktop corpus guards. The assembled source differs from BM11 only in the repaired sign-out fixture and WebKit NotePreview fix. Inherited #831 measurement files were removed, preserved in #880 comment 75592. No source changes after the tested head. No assertion, timeout or budget changed.

First-run gate / exact command Result
Root bun install --frozen-lockfile, before cargo test PASS, both VMs
cargo fmt --all --check PASS
cargo clippy --workspace --all-targets --locked -j4 -- -D warnings PASS
cargo test --workspace -j4 PASS: 1,471 passed, 22 explicitly ignored; 78 executable and 22 doctest targets
cargo build -j4 PASS, both VMs
(cd apps/web && bun run build) PASS, both VMs
PERF_DIST="$PWD/apps/web/dist" PERF_OUT="$HOME/bm12-train/bundle" PERF_WORK="$HOME/bm12-train/bundle-work" bash perf/web.sh --bundle-only --gate PASS, unchanged budgets
node ci/check-case-paths.mjs PASS
node ci/check-no-evidence.mjs PASS
Full Chromium half, dev-01 1,350 passed, 3 failed, 781 explicit skips, 0 unattempted
Full WebKit half, dev-02 1,320 passed, 1 failed, 792 explicit skips, 0 unattempted

All commands CI=1 under Nix, heavy commands through ~/bin/slot, cargo -j4 and Playwright --workers=1 --retries=0. CARGO_PROFILE_DEV_DEBUG=0 CARGO_PROFILE_TEST_DEBUG=0 CARGO_INCREMENTAL=0. TMPDIR=$HOME/bm12-tmp on the root disk for Rust and Playwright temp Homes. Root frozen Bun install preceded cargo test, and both independent_652_real_syncclient bridge cases passed. df -h checks preceded heavy preparation and browser launch, above 50 GiB free throughout.

Browser halves launched together at 03 Nov 05:29 IST. Admin-setup retained on each half with its dependents; only cross-half scheduling dependencies removed. Original full commands both exited 1. The Chromium original result was 1,346 passed / 3 failed / 781 skipped / 4 dependency-blocked; those four received only their first attempts via an explicit --test-list and --no-deps and all passed. No attempted case was rerun. Completed-report audit confirms maximum one train attempt per case, zero nonzero retries, zero runner errors and zero unattempted cases.

Browser total: 2,670 passed / 4 failed / 1,573 explicit skips / 0 unattempted. Every failed case received exactly one actual origin/dev comparison, using separate origin/dev binary, production dist and source for direct editor integration servers, with the train e2e definitions overlaid only in the owned detached baseline worktree. Native config is identical on base and train. Only Nix tooling was overlaid beyond those test definitions.

Failed case Origin/dev once Attribution
chromium-1440 list-fit.spec.ts:67 PASS unresolved, outside known list; 1,654 ms against existing 1,500 ms scroll-start assertion
chromium-1440 refusal-performance.spec.ts:29 PASS unresolved, outside known list; execution context destroyed by navigation during page.evaluate, before timing assertion
chromium-1440 vim.spec.ts:380 FAIL, same Saved assertion at line 405 known pre-existing, reproduced
webkit-390 missing-links.spec.ts:245 PASS unresolved, outside known list; renamed-link click remained on source note at line 257

A baseline PASS does not prove a product regression; it leaves the original train failure unresolved. Three failures are outside the known pre-existing list, so the requested condition for a green verdict is not met.

Known pre-existing cases are retained explicitly: vim.spec.ts:341 PASS in chromium-1440; vim.spec.ts:380 FAIL as above; sidebar-edge.spec.ts:8 PASS in chromium-1440 and explicitly SKIP in WebKit; webkit-1440 editor.spec.ts:173 convergence PASS this first run, with the historical failure still unattributed after 37 train / 22 dev passes in #883 comment 76036. These are not counted as new. Both repaired webkit-390 sign-out selectors, review4-signout.spec.ts:120 uplink=false / BroadcastChannel=true and :427 cancellation, PASS on their first attempts.

Per-project tables, all first errors and exact baseline commands: Chromium, WebKit. Gate commands/setup, Rust target table. Linux motion/frame assertions are functional diagnostics only; no GPU performance qualification is claimed.

Cleanup verified on both VMs: all four owned bm12 units inactive before removal; owned bm12/bm12-base worktrees, targets, node_modules, builds, seeded browser Homes, disk-backed TMPDIR, traces, raw logs and temporary reports removed. Root free space afterward: dev-01 295 GiB, dev-02 325 GiB. No other worktree or job touched. The control train worktree is retained, tracked tree clean. Artifacts are PR comments only, none committed. No Forgejo commit statuses or reviews were published when checked; this report records the executed gates. No merge performed.

Final BM12 test report: **RED. Never merge as part of this task.** PR https://git.kayg.org/kayg/calternal/pulls/884, branch `train/2026-11-03-bm12`, tested and current head `1e776f9e810c46c91bc752a117ed4f43ebd3938f`. Assembly base and origin/dev comparison product `55f35fcde3bc91ca3781055577b93e93819f6cd4`. BM11 #883 is closed with the replacement link. BM12 remains open and unmerged. Current source heads were captured from the PR API immediately before each --no-ff merge, in this order: | PR | Recorded source head | |---|---| | #779 | `7b97e4d14231be07f6a80cb9ca172d02442c487e` | | #858 | `626388da9052eaecb159d735f0cadc5e59e88312` | | #866 | `ba1f47dc94797d4a8a937298464b5e4828e301c2` | | #824 | `f1c1aa961e169ef99e132063a97ccbd9a89a5def` | | #827 | `76f11dc4ba06468a2a0ed4d4592cea6038206696` | | #828 | `5d7b9b36cd008de78851809724c90a85d92b40a7` | | #833 | `ccaece3dfecbe2048634fc792d7d4a2c6e31f324` | | #836 | `5f7d1a59776411e7f3353d0023817b43affae51e` | | #831 | `316b43e9578c3e4d2944df8df43caebc611356f7` | | #844 | `50cce9dcceb87f23a9f346300b3336e315ff6c0c` | | #847 | `40448327a15730271d56226b898e48bcc87b2a4d` | | #855 | `c38c3083d51f4adcf5cd76a70f1f6960b427413e` | | #857 | `144e717145e35f70356f593b7c04a527e00f7b17` | | #856 | `26548949efef7e6e4109ccc8e158f21a12f2b026` | | #840 | `5de79c18bce498fd85e3adb4be4fa8a84be85085` | Identical BM10/BM11 resolutions reused: #824 Cargo.lock union; #828 credential check followed by runtime timer; #840 retains #856 desktop corpus guards. The assembled source differs from BM11 only in the repaired sign-out fixture and WebKit NotePreview fix. Inherited #831 measurement files were removed, preserved in [#880 comment 75592](https://git.kayg.org/kayg/calternal/pulls/880#issuecomment-75592). No source changes after the tested head. No assertion, timeout or budget changed. | First-run gate / exact command | Result | |---|---| | Root `bun install --frozen-lockfile`, before cargo test | PASS, both VMs | | `cargo fmt --all --check` | PASS | | `cargo clippy --workspace --all-targets --locked -j4 -- -D warnings` | PASS | | `cargo test --workspace -j4` | PASS: 1,471 passed, 22 explicitly ignored; 78 executable and 22 doctest targets | | `cargo build -j4` | PASS, both VMs | | `(cd apps/web && bun run build)` | PASS, both VMs | | `PERF_DIST="$PWD/apps/web/dist" PERF_OUT="$HOME/bm12-train/bundle" PERF_WORK="$HOME/bm12-train/bundle-work" bash perf/web.sh --bundle-only --gate` | PASS, unchanged budgets | | `node ci/check-case-paths.mjs` | PASS | | `node ci/check-no-evidence.mjs` | PASS | | Full Chromium half, dev-01 | 1,350 passed, 3 failed, 781 explicit skips, 0 unattempted | | Full WebKit half, dev-02 | 1,320 passed, 1 failed, 792 explicit skips, 0 unattempted | All commands CI=1 under Nix, heavy commands through ~/bin/slot, cargo -j4 and Playwright --workers=1 --retries=0. CARGO_PROFILE_DEV_DEBUG=0 CARGO_PROFILE_TEST_DEBUG=0 CARGO_INCREMENTAL=0. TMPDIR=$HOME/bm12-tmp on the root disk for Rust and Playwright temp Homes. Root frozen Bun install preceded cargo test, and both independent_652_real_syncclient bridge cases passed. df -h checks preceded heavy preparation and browser launch, above 50 GiB free throughout. Browser halves launched together at 03 Nov 05:29 IST. Admin-setup retained on each half with its dependents; only cross-half scheduling dependencies removed. Original full commands both exited 1. The Chromium original result was 1,346 passed / 3 failed / 781 skipped / 4 dependency-blocked; those four received only their first attempts via an explicit --test-list and --no-deps and all passed. No attempted case was rerun. Completed-report audit confirms maximum one train attempt per case, zero nonzero retries, zero runner errors and zero unattempted cases. **Browser total: 2,670 passed / 4 failed / 1,573 explicit skips / 0 unattempted.** Every failed case received exactly one actual origin/dev comparison, using separate origin/dev binary, production dist and source for direct editor integration servers, with the train e2e definitions overlaid only in the owned detached baseline worktree. Native config is identical on base and train. Only Nix tooling was overlaid beyond those test definitions. | Failed case | Origin/dev once | Attribution | |---|---|---| | chromium-1440 list-fit.spec.ts:67 | PASS | unresolved, outside known list; 1,654 ms against existing 1,500 ms scroll-start assertion | | chromium-1440 refusal-performance.spec.ts:29 | PASS | unresolved, outside known list; execution context destroyed by navigation during page.evaluate, before timing assertion | | chromium-1440 vim.spec.ts:380 | FAIL, same Saved assertion at line 405 | known pre-existing, reproduced | | webkit-390 missing-links.spec.ts:245 | PASS | unresolved, outside known list; renamed-link click remained on source note at line 257 | A baseline PASS does not prove a product regression; it leaves the original train failure unresolved. Three failures are outside the known pre-existing list, so the requested condition for a green verdict is not met. Known pre-existing cases are retained explicitly: vim.spec.ts:341 PASS in chromium-1440; vim.spec.ts:380 FAIL as above; sidebar-edge.spec.ts:8 PASS in chromium-1440 and explicitly SKIP in WebKit; webkit-1440 editor.spec.ts:173 convergence PASS this first run, with the historical failure still unattributed after 37 train / 22 dev passes in [#883 comment 76036](https://git.kayg.org/kayg/calternal/pulls/883#issuecomment-76036). These are not counted as new. Both repaired webkit-390 sign-out selectors, review4-signout.spec.ts:120 uplink=false / BroadcastChannel=true and :427 cancellation, PASS on their first attempts. Per-project tables, all first errors and exact baseline commands: [Chromium](https://git.kayg.org/kayg/calternal/pulls/884#issuecomment-76162), [WebKit](https://git.kayg.org/kayg/calternal/pulls/884#issuecomment-76157). [Gate commands/setup](https://git.kayg.org/kayg/calternal/pulls/884#issuecomment-76087), [Rust target table](https://git.kayg.org/kayg/calternal/pulls/884#issuecomment-76088). Linux motion/frame assertions are functional diagnostics only; no GPU performance qualification is claimed. Cleanup verified on both VMs: all four owned bm12 units inactive before removal; owned bm12/bm12-base worktrees, targets, node_modules, builds, seeded browser Homes, disk-backed TMPDIR, traces, raw logs and temporary reports removed. Root free space afterward: dev-01 295 GiB, dev-02 325 GiB. No other worktree or job touched. The control train worktree is retained, tracked tree clean. Artifacts are PR comments only, none committed. No Forgejo commit statuses or reviews were published when checked; this report records the executed gates. No merge performed.
kayg commented 2026-11-03 02:09:36 +00:00
Author
Owner
Copy link

Replaced by Train BM13: #885 . BM12 results remain preserved here.

Replaced by Train BM13: https://git.kayg.org/kayg/calternal/pulls/885 . BM12 results remain preserved here.
kayg closed this pull request 2026-11-03 02:09:37 +00:00
Some checks failed
CI / server (pull_request) Has been cancelled
Details
CI / rust (pull_request) Has been cancelled
Details
CI / web (pull_request) Has been cancelled
Details
Markdown extraction contract / markdown-native-contract (pull_request) Has been cancelled
Details
Markdown extraction contract / markdown-editor-contract (pull_request) Has been cancelled
Details

Pull request closed

Please reopen this pull request to perform a merge.
Sign in to join this conversation.
Reviewers
No reviewers
Labels
Clear labels   
backend
Rust server

  
design
Mockups, UI and TASTE

  
docs
ADRs, CONTEXT, TASTE

  
idea
Parked idea, never worked until promoted

  
infra
Deploy, CI, VMs

  
perf
Performance and budgets

  
reliability
Data integrity, corruption traps

  
web
Web client

No labels
backend
design
docs
idea
infra
perf
reliability
web
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
kayg/calternal!884
No description provided.