Tests: high latency by default + input-to-photon gate (D130) #55
Closed
opened 2026-10-07 07:35:56 +00:00 by kayg
·
17 comments
No Branch/Tag specified
main
j470b-server-mesh-rejoin
mesh-compat-382
j444b-d381-key-wins-flood
j461b-macos-utun-reader-thread
j475b-remove-host-motion
fix-reconnect-new-link
j481-d380
dev
j479-mesh-soak
fix/j476-host-facts
j475-motion-pill-split
j470-mac-node-join
root-upgrade-d376
j474-review-merge
latency-targets-120hz
nightly-suite-shards
gotatun-pin-j469
macos-utun-reader-thread
fix-flood-echo-stall
wip/j416
motion-fast-ease-out
mesh-addhost-j259
takeover-close-terminals-d368
kbd-instant-followups
fix-trust-key-double-click
nightly-suite-partial-report
appwin-icons-j207
rusqlite-slice1
swipe-content-first-d374
mesh-mtu-381
addhost-instant-open
glass-contrast-d365-mock
glass-contrast-d365
signout-followups-442
fix-startup-toast-red
research-gotatun-matrix-j317
themes-sync-j304
fix-load-flakes
fix-nix-zig-patch
fix-compute01-browser-baseline
ratchet-size-baseline-419
predict-auto-d130
revoke-coverage-d367
nightly-suite-queue-timeout
nightly-browser-suite
fix-rustsec-2026-0459
fonts-ioskeley-obel
log-retention-d375
fix-kbd-no-anim-427
fix-dev-red-specs-2
takeover-proof-305-j205
wip/j410-server-pump
ui-consistency-d372
fix-osc52-clipboard
libghostty-vt-1.0
forget-retired-host-d369
j404-merge-426
fix-setup-lock-race
fix-touch-select-426
revoke-access-report-ui
fix-predictive-echo-specs
fix-selinux-agent-exec
wip/j395-checkpoint2
wip/j395
j391-review-scratch
ui-consistency-j195-deferred-rebased
fix-rustc-paths-421
decisions-wording-341
fix-install-suite-red
fix-dev-rtt-specs
fix-pending-removal-align
fix-privileged-skip
fix-install-suite-404
review-j368
mesh-dns-j254
revoke-access-report-d356b
revoke-privilege-round5
fix-removal-confirm
review-j360
gotatun-rotation-367
deps-refresh-340
review-j354
review-J351
review-j350
addhost-takeover-d359
revoke-report-items-347
revoke-end-sessions-d362
review-j348
size-mesh-ssh-346
size-trim-337
revoke-access-diff-d356
j259-pre-rebase-b06c5a6
j305-ended-at-start-spec
addhost-sudo-consent
fix-layout-real-specs-411
fix-shell-open-411
fix-console-hosts-373
fix-shell-exit
fuzz-host-name-353
fix-host-details-410
macos-filter-j197
research-gotatun-tricks
revoke-p3-j216l
stale-state-pill
revoke-followups-j216k
revoke-progress-j216e
backup/macos01-20261106/lume/j197
backup/macos01-20261106/lume/appwin-icons-j207-stash0
backup/macos01-20261106/claude/stash-0
backup/macos01-20261106/claude/stash-1
backup/macos01-20261106/claude/J80-macos-s1
backup/macos01-20261106/claude/J80
backup/macos01-20261106/claude/J80-slice1-20261102
backup/macos01-20261106/claude/J16b-appwin-on-dev
backup/macos01-20261106/claude/appwin-launch-idle-146
backup/macos01-20261106/claude/J80-s1-run
wip/j259
trust-285-p3c
runtime-lock-j216f
mesh-ssh-p3-j175
tun-proof-p3b
trust-285-p3
terminal-polish-j271
tun-proof-p3
ssh-install-flakes-j216i
fuzz-fixes-j264
trust-285-a
trust-285-b
restart-oversized-fixture-j198
backup/macos01-20261106/lume/appwin-icons-j207
restart-bound-j216h
up-preflight-p3-j198
backup/macos01-20261106/lume/j251
up-preflight-j198
wip/up-preflight-j198-j245-p2
wip/up-preflight-j198-j245-p1
agent-fsync-offloop-j196
wip/up-preflight-j198-j245
settings-offscreen-j231
wip/up-preflight-j198-j226-inspection
wip/j103f
themes-j206
wip/up-preflight-j198-j226
flakes-j216c
backup/macos01-20261106/claude/j197
flakes-j216b
backup/macos01-20261106/claude/j197-red
wip/up-preflight-j198-review
flakes-j216
backup/macos01-20261106/claude/appwin-icons-j207
engineering-j208b
appwin-mock-j209
toast-stack-j165
engineering-j208
decisions-d351
decisions-d350
decisions-d349
appearance-presets-mock-j129
decisions-d348
docs-audit-spec
doc-coverage-baseline-raise
decisions-d347
decisions-d346b
decisions-d346
j88h-profile
ui-consistency-j195-deferred
ui-consistency-j195
engineering-practices-j194
preferred-login-ui-j166
signin-pools-263-j174
macos-node-265-s1
decisions-d345
decisions-d344
proxy-cgroup-j164
verify-quick-fuzz-329
proxy-start-io-j168
timing-flakes-j163
up-263-s1
mcp-events-j147
verify-quick-fuzz-j158
proxy-p3-j159
agent-resource-j157-detect
wip/j103d-final
remote-cancel-hang-j155
proxy-traefik-281-j62d
j149-verify-quick
proxy-traefik-281-j62b
j150-drop-unnamed
wip/j79d-red-r4
wip/j103d-d332
rootless-toast-j142
wip/j103d-head
wip/j103d
j125c-mcp
macos-build-j136
backup/macos01-20261106/claude/j136
wip/j79d-red-cli
wip/j79d-red-server
j121-link-liveness
j118c-tracer-failures
wip/j79c-head
release-desktop-j131
j124c-signed-macos
wip/j79c-red-p3
wip/j79c-red-p23
wip/j79c-red-p22
merge-j128-check
perf-deferred-j128
sidebar-toggle-260
j127-shortcut-changed-dot
j125-mcp
j118-tracer-failures
j126-account-summary
settings-sections-mock-j92
j120-pinch-lock
sidebar-292
backup/macos01-20261106/claude/j120
taste-2026-11-03
row-actions-242-215
backup/macos01-20261106/claude/stash-0-untracked
backup/macos01-20261106/claude/J80-265-s1-run
backup/macos01-20261106/claude/J80-macos-s1-20261102
j112-canvas-commands
ui-no-overshoot-scroll
fix-recovery-restart
backup/macos01-20261106/claude/stash-1-untracked
taste-2026-11-02
size-baseline-ratchet
machine-cards-structure-j108
j109-boot-copy-mockups
fix-dev-red
wip/up-263-s1
j95b-settings-rows
proxy-traefik-281
j95-option-rows
docs-human-j91
docs-keys-palette
fix-flood-1013-270-j38d
mesh-ssh-s1
mesh-ssh-s0
addhost-d291-tunnel
test-stability-load
mesh-relay-220
repro-296
shim-thp-off-24
mesh-pins-258-v2
mesh-dns
signin-d311-merged
docs-pages
ui-size-283
fix-ui-batch-specs
wip/j12b-edge-update
gate-on-arm
fix-rename-sync-293
trust-285-j60b
fix-focus-ring-clip
integ-ui-1101
edge-update-v2
signin-d311
taste-2026-11-01
layout-per-tab-250
ui-approved-splitopt-224
ui-approved-splitopt-224-on-dev
icon-text-centre-282
ui-approved-189-212-216
research-reverse-proxy
transfer-budget-320
review-mesh-pins-258-r2
sidebar-pill-259
review-mesh-relay-220
wip/j12-edge-update-v2
nix-package
status-crash-loop-237
fix-dev-test-failures
fix-fixture-socket-path
wip/mesh-relay-220-pre-dev-advance-rebase
fix-canvas-side-clip
research-head-to-head
frosted-real-256
review-mesh-pins-258
wip/mesh-relay-220-pre-final-rebase
review-layout-per-tab-250-r2
broad-suite-triage
nix-devshell
review-status-crash-loop-237-r3
wip/nix-devshell-pre-p3
taste-frosted-real
wip/code-serve-demo-2026-10-30
wip/code-serve-glass-2026-10-30
wip/code-serve-clusters-2026-10-30
wip/code-merge-release94-dev-2026-10-30
wip/rproxy-delta-scratch-2026-10-30
wip/stale-note-257-staged-2026-10-30
wip/d241-size-staged-2026-10-30
review-broad-suite-207
wip/mesh-pins-258-pre-split
wip/mesh-relay-220-pre-rebase
mesh-measure-220
plan-211-update
review-edge-autoupdate-r3
perf24-reconnect
review-stale-note-r2
release-prod-live
d241-shell-marker
review-mesh-pins-server-258
review-revocation-r3
review-setup-token-r2
review-sync-journal-r3
wip/review-mesh-pins-258-prune-review-1995fee46
frosted-scroll-256
sync-journal-r3
revocation-per-account-wip
review-tokio-asyncfd-0386
review-sync-p3s
wip/stash-8by64-stash0-2026-10-30
mesh-drag-r2
setup-token-data-wip
release-9-4
auth-busy-1013
mesh-view-overlap
sync-p3s
review-auth-busy-wake
review-readd-r8-wip
mesh-drag-bounds
audit-auth-93
app-windows-stream-start
review-authority-cap-r3
app-windows-r7-measure
readd-minimal-r6
readd-minimal-r5
app-windows-r7-soak
readd-minimal-r4
app-windows-r7
app-windows-r6
readd-minimal-r3
readd-minimal-r2
readd-minimal
merge-release8-dev
review-busy-page-liveness-r2
review-busy-page-liveness
mesh-view-trim
review-authority-read-retry-r2
review-remove-uninstall-r2
release-retry-reattach
release-retry
review-remove-uninstall
review-authority-read-retry
app-windows-ship
mesh-autoswitch-p2
mesh-ssh
mesh-relay
mesh-macos-node
screen-and-control
session-labels
review-real-logins-r5
review-real-logins-r4
review-real-logins-r3
shim-memory-r2
review-real-logins-r2
shim-memory
shadow-addhost-instant
shadow-real-logins
shadow-same-session-flood
shadow-prod-perf-fix
hosts-from-server
app-windows-real
app-windows-transport
release-prod-6w
mesh-policy-verify
quiet-close-toast
dev-merge-r4
review-mesh-agent-transport
review-app-windows-transport
settings-roundtrip
review-release-pipeline-r4
mesh-agent-transport
ended-strip-fix
review-audit-ca-update-d244
settings-rows
phone-width
signout-clear
fix-restart-tests
dev-merge-rp
signer-hardening
review-audit-ca-update
terminal-fidelity
review-audit-ca-update-wip
mesh-integrate
review-mesh-agent-transport-515d3712
review-mesh-dataplane-feec1988
mesh-dataplane
signout
research-canvas-node
wip/review-renderer-cost
wip/review-terminal-fidelity
padlock-glyph
review-release-pipeline-2e95b689
phone-polish
sidebar-polish
inbox-generic
review-mesh-dataplane-378d4055
prod-batch
ui-inbox
ui-ca-unlock
ui-machine-sections
review-mesh-dataplane-a5f744fb
tls-session-prod
session-bounds-prod
fix-dead-session
session-bounds
tls-session
palette-polish
shortcuts-d222
research-appmeta
phone-gutter
ui-centre-button
wip/ui-centre-button
wip/tls-session
review-addhost-breakit
ui-platform
renderer-cost
remote-agents
mesh-api
ssh-bootstrap
prod-hotfix2
prod-fixes
review-remote-agents
review-mesh-dataplane
session-life
research-browser
review-mesh-api
research-capture
review-mesh-api-round3
review-mesh-api-round1
gate-stability
review-gate-stability
review-relay-direct
review-mesh-api-findings
proto-sessions
font-picker
proto-addhost
proto-windows
mesh-core
latency-gate
research-bsd
research-discovery
keytray-mods
mock-core
ui-tweaks
fix-motion-sel
fix-motion
integrate2
fix-robust
t-web
t-server
vt-ghostty
fix-snap-echo
t-web-auth
review-vt2
t-agent
lane-protocol
lane-shim
lane-auth
s1-base
s1-contracts
s1-workspace
No results found.
No labels
launch-qa
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".
No due date set.
Dependencies
No dependencies set
Reference
kayg/infraternal#55
Loading…
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
D130: the default test environment runs with high latency (a 300 ms+ round trip via netem or CDP emulation) for the browser suite and the native end-to-end checks, so every run exposes slow protocol and app paths. Add an input-to-photon gate (typed character visible within 1 frame with prediction; echo within RTT + 1 frame; a flood must not delay echo). Regressions block merges.
Starting on branch latency-gate from dev base
cecc7ecd7b. Issue #55 has no comments; parent S1 issue #5 has one comment recording round 1 and DECISIONS 48–53.Correction to my start note: the related parent is #52 (11 comments, all read), not #5. Its prior measurement found CDP did not shape established WebSocket traffic (100 ms configured, 2–10 ms Hello/Welcome and Attach/Output); the follow-up used a test-only bidirectional WebSocket bridge and measured ~206–245 ms at 100 ms each way. I will use a stream proxy for the browser leg.
Finding: reconnect-to-resumed is 1038.70 ms at configured RTT 300 ms (jitter ±30), exceeding the 900 ms RTT×2+300 budget. Production tracer test output: METRIC name=reconnect_resumed source=tracer-production-build n=1 p50_ms=1038.70 p99_ms=1038.70 budget_ms=900 result=FAIL. Filed as #61; product changes are out of scope for this lane.
Finding: at 300 ms RTT, cold setup-screen render p99 was 1664.10 ms and first-contentful-paint p99 was 1582.30 ms on infraternal-dev (8 cores, load 6.29/7.97/7.09), exceeding the existing 1000 ms local gate. Filed separately as #62; the run was desktop Chromium, not a mid-range phone.
Finding: production tracer keystroke→echo confirmation measured p50 323.90 ms / p99 338.00 ms (n=20) against 334 ms (300 RTT + 2×17 ms). Glyph visible measured p50 330.80 / p99 357.20 ms and is report-only until #50 lands. The host was loaded at 10.19/10.22/8.16 on 8 cores. Filed as #63.
Second corrected-proxy run confirmed reconnect→resumed at 1041.40 ms and echo-confirmed p99 at 338.00 ms (budget 334). The first run over-estimated WebSocket frame delay because jitter was resampled per TCP recv chunk; the relay now samples once per TCP flow, then preserves that delay across stream chunks.
The relay now samples jitter once per direction per 200 ms quiet-to-active burst, reusing it across arbitrary TCP chunks in one WebSocket frame. Its 31-sample self-test at RTT 300/jitter 30 measured p50 308.80 ms, p99 324.03 ms. With that model, the latest production run measured reconnect 996.70 ms (budget 900), echo confirmation p99 359.90 ms (budget 334), and glyph visible p99 369.90 ms (report-only); host load was 7.00/7.52/7.43 on 8 cores.
Final relay access-screen measurement: setup render p50 1442.90 / p99 1955.50 ms; first-contentful-paint p50 1221.40 / p99 1733.80 ms (n=30), against the existing 1000 ms render gate. Host load 19.18/11.15/8.71 on 8 cores. The test timeout is increased so the sign-in group can finish too.
Harness finding: the first native latency stage failed before measurement because the scratch state path produced a 114-byte AF_UNIX session socket path, beyond sun_path; the agent returned terminal-open-refused. Reproduction with a short per-run state root produced a 100-byte socket path and opened 3/3 real PTY sessions at INFRATERNAL_TEST_RTT=0. I’m routing native fixture state under the short per-job scratch root and will rerun the native profile.
Full
scripts/verify latencyrun on infraternal-dev (x86_64, 8 cores; profile loads: setup 3.39 6.72 10.07, native 4.57 6.87 10.08, auth-browser 14.80 9.22 10.58, tracer-browser 17.73 10.48 10.96; TRACER_TEST_PORT=4621). Proxy self-test n=31: RTT p50=305.20 ms, p99=331.02 ms, PASS; auth-browser passed 4 Chromium scenarios. Native n=100 baseline PTY echo p99=329.47 ms, other-session flood p99=302.45 ms (growth −27.02 ms, PASS); same-session flood p99=449.58 ms (growth +120.11 ms, FAIL; new finding #73). Production browser: sign-in usable p99=4987.10 ms (PASS); reconnect p99=1012.70 ms/900 ms (FAIL); confirmed echo p99=371.40 ms/334 ms (FAIL); glyph p99=381.00 ms (report); setup/sign-in render p99=1509.70/1839.10 ms (FAIL). Full Playwright suite: 29 passed, 3 failed in 9.2 min; failures were the motion audit (two 62–63 ms main-thread long tasks), reconnect/echo budget assertions, and access-render budget assertion. The earlier setup-token socket hang-up did not reproduce. Full log:$HOME/.cache/codex-scratch/latency-gate/latency-final.log.Completed the scratch-target support step at
70fa661. The default native fixture root exposed a test-path bug:.sockwas 105 bytes but AckBarrier’s.upstreamsibling was 109 bytes, beyond Linuxsun_path; the real binary then emittedterminal shim disconnected.fixture_statenow accounts for both names and uses a shorter default root. Reproduction after the fix: all 24 abrupt-stop positions pass at RTT=300. Fast gate passes; relay smoke n=3 p50=296.82 ms, p99=302.52 ms, and Rust workspace tests plus TypeScript protocol tests are green.Full latency profile finished on infraternal-dev (x86_64, 8 cores), 300 ms RTT ±30 ms, TRACER_TEST_PORT=4621. Native phase load was 14.01/9.92/7.08; tracer-browser load was 8.84/9.29/7.19. Full log during this run: $HOME/.cache/codex-scratch/latency-gate/latency-final.log. Current code head before the docs-only commit:
a8bd3f2.METRIC name=network_rtt_selftest configured_rtt_ms=300 jitter_ms=30 loss=unsupported transport=tcp-stream n=31 p50_ms=308.19 p99_ms=329.64 result=PASS
METRIC name=keystroke_echo_confirmed_baseline source=real-agent-pty n=100 p50_ms=300.54 p99_ms=329.01 budget_ms=334.00 result=PASS
METRIC name=keystroke_pty_echo_baseline source=real-agent-pty n=100 p50_ms=300.58 p99_ms=329.06 budget_ms=334.00 result=PASS
METRIC name=keystroke_echo_confirmed_flood_other_session source=real-agent-pty n=100 p50_ms=317.67 p99_ms=323.25 budget_ms=334.00 result=PASS
METRIC name=keystroke_pty_echo_flood_other_session source=real-agent-pty n=100 p50_ms=318.03 p99_ms=326.25 budget_ms=334.00 result=PASS
METRIC name=flood_isolation_other_session source=real-agent-pty n=100 baseline_p99_ms=329.06 flood_p99_ms=326.25 growth_ms=-2.81 budget_ms=16.67 result=PASS
METRIC name=keystroke_echo_confirmed_flood_same_session source=real-agent-pty n=100 p50_ms=319.19 p99_ms=333.73 budget_ms=334.00 result=PASS
METRIC name=keystroke_pty_echo_flood_same_session source=real-agent-pty n=100 p50_ms=339.07 p99_ms=382.24 budget_ms=334.00 result=FAIL
METRIC name=flood_isolation_same_session source=real-agent-pty n=100 baseline_p99_ms=329.06 flood_p99_ms=382.24 growth_ms=53.18 budget_ms=16.67 result=FAIL
METRIC name=returning_signin_terminal_usable source=tracer-production-build n=10 p50_ms=3956.40 p99_ms=5024.70 budget_ms=5000 result=FAIL
METRIC name=reconnect_resumed source=tracer-production-build n=20 p50_ms=808.00 p99_ms=1009.00 budget_ms=900 result=FAIL
METRIC name=keystroke_echo_confirmed source=tracer-production-build n=20 p50_ms=337.60 p99_ms=364.70 budget_ms=334 result=FAIL
METRIC name=keystroke_glyph_visible source=tracer-production-build n=20 p50_ms=352.10 p99_ms=372.40 budget_ms=17 result=REPORT
METRIC name=access_screen_render_upper_bound_setup source=tracer-production-build n=30 configured_rtt_ms=300 p50_ms=1341.60 p99_ms=1861.70 budget_ms=1000 result=FAIL
METRIC name=access_screen_first_contentful_paint_setup source=tracer-production-build n=30 configured_rtt_ms=300 p50_ms=1172.20 p99_ms=1614.20 budget_ms=1000 result=REPORT
METRIC name=access_screen_render_upper_bound_signin source=tracer-production-build n=30 configured_rtt_ms=300 p50_ms=1621.60 p99_ms=2054.40 budget_ms=1000 result=FAIL
METRIC name=access_screen_first_contentful_paint_signin source=tracer-production-build n=30 configured_rtt_ms=300 p50_ms=1454.40 p99_ms=1964.30 budget_ms=1000 result=REPORT
Browser suite: 28 passed, 4 failed. Failures: the 4x CPU motion audit sampled pointer checkbox draw offset 0 and missed an intermediate frame; onboarding timed out waiting 5 s for the test double to connect after returning sign-in; the terminal probe assertion included sign-in/echo/reconnect budget failures above; access render exceeded budget. Findings are tracked in #52, #61, #62, #63, #73 and #74. No product changes were made.
Documentation step complete:
6c4edf7updates docs/PROCESS.md and apps/tracer/README.md with the default 300 ms RTT and jitter, rootless relay boundaries, loss limitation, metrics, and fast/full profiles. Fast gate follows on this exact head.Finished on branch
latency-gate, HEAD6c4edf78081f79787bb3ac14408983389f5d3b8a. Final required gate command:nix shell nixpkgs#binutils nixpkgs#file nixpkgs#gnumake nixpkgs#perl nixpkgs#zig_0_15 -c scripts/verify fastFast gate output (verbatim summary from the run):
Fast gate exited 0. Full latency profile findings and associated issues are recorded in the earlier comments; no issue was closed. No push or deploy performed.
Reproducibility note: the exact final invocation was
CARGO_TARGET_DIR="$HOME/.cache/codex-scratch/latency-gate/target" TRACER_TEST_PORT=4621 nix shell nixpkgs#binutils nixpkgs#file nixpkgs#gnumake nixpkgs#perl nixpkgs#zig_0_15 -c scripts/verify fast. The temporary target and log directory were removed after the run as required; all profile metrics are recorded in these issue comments. Final self-review found a clean diff check and no product-code or dependency changes.Merged latency-gate into dev at
ac03b19. Orchestrator ranscripts/verify faston dev after the merge (exit 0):Budget misses from the full profile stay open in #52 #61 #62 #63 #73 #74.
Closed by the orchestrator during the 2026-10-28 handover (#254), on the owner's request to close finished issues. Evidence: Gate merged as
ac03b1913(verified in dev and prod): 300 ms RTT default profile and input-to-photon gate; remaining budget misses were split into #52 #61 #62 #63 #73 #74. Reopen if anything is still missing.kayg referenced this issue2026-10-28 17:53:54 +00:00