kayg/infraternal-v0
Archived
Watch
1
0
Fork
You've already forked infraternal-v0
 0
Code Issues 92 Pull requests Projects Releases Packages Wiki Activity Actions

Reduce log decoder allocation on 10k-line workloads #83

Open
opened 2026-10-04 18:56:19 +00:00 by kayg · 4 comments
kayg commented 2026-10-04 18:56:19 +00:00
Owner
Copy link

Problem and evidence

At 10,000 source lines/s, the loaded browser trial had frame p99 216.7 ms, 14 long tasks and a 163 ms maximum at load1 24.84. A repeat at load1 8.29 had p99 33.4 ms and two long tasks of 75 and 63 ms. All 100,000 records drained in 10.289 s; 10,000 lines / 990,000 bytes remained, with 6,120,808 bytes JS heap and 477 DOM nodes. CPU samples included 219.9 ms in LogRecordDecoder.feed and 500.4 ms of GC. Current feed constructs a DataView for every record and reads each timestamp as BigInt before converting safe values (packages/web/src/lib/log-stream.ts:37-63).

The browser CPU trace is browser-busy-loaded-timeline.json; repeat trace: browser-timeline.json.

Recommendation

Reuse a decoder DataView and avoid per-record BigInt conversion for timestamps exactly representable as JavaScript numbers, retaining a precise fallback for values outside the safe range. Profile render/layout and allocation batches next; decoder savings alone cannot explain every scheduling stall.

Payoff, effort and risk

Expected gain: lower allocation and GC cost, eliminate tasks over 50 ms where possible, and move frame p99 toward one refresh interval.
Quick win vs deeper change: decoder reuse is estimated at ≤½ day; render/layout investigation and batching is a deeper 1–2 day change.
Risk: medium; preserve uint64 precision, split-record handling, UTF-8 boundaries and reactive rendering semantics.

Priority: Now (≤1 day for decoder reuse).

2026-10-04 owner decisions: Matches the 10,000-lines/s terminal/log requirement, phone-first UX and code/tests-as-spec. Keep logs virtualized and bounded at 10,000 lines / 4 MiB. Related: #20 (logs view) and #60 (stream boundary).

Report: perf-audit report
Source: perf-audit 2026-10-04

## Problem and evidence At 10,000 source lines/s, the loaded browser trial had frame p99 216.7 ms, 14 long tasks and a 163 ms maximum at load1 24.84. A repeat at load1 8.29 had p99 33.4 ms and two long tasks of 75 and 63 ms. All 100,000 records drained in 10.289 s; 10,000 lines / 990,000 bytes remained, with 6,120,808 bytes JS heap and 477 DOM nodes. CPU samples included 219.9 ms in LogRecordDecoder.feed and 500.4 ms of GC. Current feed constructs a DataView for every record and reads each timestamp as BigInt before converting safe values (packages/web/src/lib/log-stream.ts:37-63). The browser CPU trace is [browser-busy-loaded-timeline.json](/mnt/hdd/infraternal/jobs/perf-audit/browser-busy-loaded-timeline.json); repeat trace: [browser-timeline.json](/mnt/hdd/infraternal/jobs/perf-audit/browser-timeline.json). ## Recommendation Reuse a decoder DataView and avoid per-record BigInt conversion for timestamps exactly representable as JavaScript numbers, retaining a precise fallback for values outside the safe range. Profile render/layout and allocation batches next; decoder savings alone cannot explain every scheduling stall. ## Payoff, effort and risk **Expected gain:** lower allocation and GC cost, eliminate tasks over 50 ms where possible, and move frame p99 toward one refresh interval. **Quick win vs deeper change:** decoder reuse is estimated at ≤½ day; render/layout investigation and batching is a deeper 1–2 day change. **Risk:** medium; preserve uint64 precision, split-record handling, UTF-8 boundaries and reactive rendering semantics. **Priority:** Now (≤1 day for decoder reuse). **2026-10-04 owner decisions:** Matches the 10,000-lines/s terminal/log requirement, phone-first UX and code/tests-as-spec. Keep logs virtualized and bounded at 10,000 lines / 4 MiB. Related: #20 (logs view) and #60 (stream boundary). **Report:** [perf-audit report](/mnt/hdd/infraternal/jobs/perf-audit/report.md) Source: perf-audit 2026-10-04
kayg commented 2026-10-05 01:35:43 +00:00
Author
Owner
Copy link

Started perf-logs-windows, sole writer in /mnt/hdd/infraternal/wt-lp/perf-logs-windows. Branch perf-logs-windows; base/head 173525d835. Scope: log decoder allocations and measured bounded receive-window policy; preserve #77 batched credit and revocation deadlines. Will run targeted stream/decoder tests, throughput and 32 MiB remote-upload regression, then INFRATERNAL_VERIFY_RUN_ID=perf-logs-windows scripts/verify fast; no merge gate or push. Reading audit scripts and searching for missing perf-test-vm workflow; dev-VM diagnostics will be explicitly distinguished from perf-test-VM certification.

Started perf-logs-windows, sole writer in /mnt/hdd/infraternal/wt-lp/perf-logs-windows. Branch perf-logs-windows; base/head 173525d8358a2576e681576605a7a7c5f1b9ebdd. Scope: log decoder allocations and measured bounded receive-window policy; preserve #77 batched credit and revocation deadlines. Will run targeted stream/decoder tests, throughput and 32 MiB remote-upload regression, then INFRATERNAL_VERIFY_RUN_ID=perf-logs-windows scripts/verify fast; no merge gate or push. Reading audit scripts and searching for missing perf-test-vm workflow; dev-VM diagnostics will be explicitly distinguished from perf-test-VM certification.
kayg commented 2026-10-05 01:40:55 +00:00
Author
Owner
Copy link

Decoder implementation reuses its fixed header DataView and reads uint64 timestamps as two uint32 words. High word <=0x1fffff is exactly the 53-bit safe range; zero and unsafe uint64 values retain null behavior without rounding. Added tests cover safe/unsafe boundaries, every header split, every UTF-8 byte split and reset. Targeted Vitest: 1 file / 8 tests passed.

Chromium CDP HeapProfiler measures JS allocation (native heaptrack/dhat do not attribute V8 objects). Three alternating base/candidate 100,000-record trials at 10,000 source lines/s, 99-byte bodies, 13-byte headers, 100 records/feed; samples include objects collected by both GC generations at 1024-byte interval. Initial base/candidate estimates ~32.7 MB/~24.0 MB; exact final medians will follow. Always 10,000 retained lines / 990,000 bytes. Load1 ~3.5–4.3. This is same-host dev-VM diagnostic A/B, not perf-test-VM certification. Method: https://chromedevtools.github.io/devtools-protocol/tot/HeapProfiler/#method-startSampling ; timestamp semantics: https://tc39.es/ecma262/#sec-number.max_safe_integer and https://tc39.es/ecma262/#sec-dataview.prototype.getuint32 .

Decoder implementation reuses its fixed header DataView and reads uint64 timestamps as two uint32 words. High word <=0x1fffff is exactly the 53-bit safe range; zero and unsafe uint64 values retain null behavior without rounding. Added tests cover safe/unsafe boundaries, every header split, every UTF-8 byte split and reset. Targeted Vitest: 1 file / 8 tests passed. Chromium CDP HeapProfiler measures JS allocation (native heaptrack/dhat do not attribute V8 objects). Three alternating base/candidate 100,000-record trials at 10,000 source lines/s, 99-byte bodies, 13-byte headers, 100 records/feed; samples include objects collected by both GC generations at 1024-byte interval. Initial base/candidate estimates ~32.7 MB/~24.0 MB; exact final medians will follow. Always 10,000 retained lines / 990,000 bytes. Load1 ~3.5–4.3. This is same-host dev-VM diagnostic A/B, not perf-test-VM certification. Method: https://chromedevtools.github.io/devtools-protocol/tot/HeapProfiler/#method-startSampling ; timestamp semantics: https://tc39.es/ecma262/#sec-number.max_safe_integer and https://tc39.es/ecma262/#sec-dataview.prototype.getuint32 .
kayg commented 2026-10-05 01:50:15 +00:00
Author
Owner
Copy link

Perf-test-VM certification is unavailable in this job: .claude/skills/perf-test-vm/SKILL.md is missing, and the skill was not found in the local Codex/Claude skill locations. No remote perf-test VM workflow or connection contract is available. Continuing the authorized implementation, real-service regressions and explicitly labeled Debian dev-VM diagnostics; no absolute performance certification or threshold relaxation is claimed. The integration lead must run the perf-test-VM A/B and independent review before merging.

Perf-test-VM certification is unavailable in this job: .claude/skills/perf-test-vm/SKILL.md is missing, and the skill was not found in the local Codex/Claude skill locations. No remote perf-test VM workflow or connection contract is available. Continuing the authorized implementation, real-service regressions and explicitly labeled Debian dev-VM diagnostics; no absolute performance certification or threshold relaxation is claimed. The integration lead must run the perf-test-VM A/B and independent review before merging.
kayg commented 2026-10-05 02:17:11 +00:00
Author
Owner
Copy link

perf-logs-windows — #83 / #80

Head: 79b211653663437edae7968aaa82a4507d14648a. Branch: perf-logs-windows. Base: 173525d8358a2576e681576605a7a7c5f1b9ebdd. Three logical commits; no push, merge gate, issue closure, other AI agents or systemd units.

Changes

The log decoder reuses its 13-byte header DataView. Two uint32 words replace per-record BigInts; only nonzero exact 53-bit timestamps become numbers, with unsafe uint64 values still null. Split headers/bodies and UTF-8 behavior remain bounded and covered by tests.

TypeScript declares 1 MiB output receive windows for exec/SSH and keeps logs/events/stats at 256 KiB. OPEN always carries the same size reserved locally; Rust omitted-field defaults and native input windows remain 256 KiB. The six-ms connection-wide CREDIT scheduler, #77 native input batching, signing, audit, authorization and Rust stream paths are unchanged. The simultaneous benchmark now uses actual product defaults rather than a hardcoded 4 MiB log window.

Decoder allocation A/B

Chromium sampled decoder allocations: 32,656,644 → 23,933,944 bytes, 26.71% lower, medians of three alternating trials. Each trial: 100,000 records at 10,000 lines/s, 99-byte bodies + 13-byte headers, 100 records/feed, about 10 seconds. All retain exactly 10,000 lines / 990,000 body bytes and zero partial records. Load1 3.56–4.77.

The profiler samples at 1,024 bytes and includes objects collected by both major and minor GC; numbers are estimates, not exact allocation counts. JavaScript objects live inside V8 and cannot be attributed by native dhat/heaptrack. This uses the appropriate Chromium heap profiler instead. No browser rendering/frame-time improvement is claimed.

Reproduce: bun e2e/remote/log-decoder-bench.ts BASE_SOURCE packages/web/src/lib/log-stream.ts; extract BASE_SOURCE with git show 173525d:packages/web/src/lib/log-stream.ts. Raw: decoder-ab.jsonl. Method: Chromium HeapProfiler; timestamp semantics: ECMAScript safe integers and uint32 DataView reads.

PTY capacity A/B

Three trials per path/window, 32 MiB batched native PTY output, six-ms credit return; exact byte counts and exit status checked in all 36 trials. MiB/s below measures first-to-last DATA, excluding OPEN and the source’s final one-second sleep. Server/native Rust is identical to the base. Load1 3.68–5.14. These are protocol capacity diagnostics, not xterm ingestion certification.

Path 256 KiB 512 KiB 1 MiB
embedded docker 39.505 79.169 125.890
remote docker 37.625 74.439 108.586
embedded podman 39.096 79.080 157.626
remote podman 36.652 73.828 145.488

Raw: pty-batched.json, pty.log, pty-batched.ts adapted from the audit with this worktree’s harness, release binary, owned label and 512 KiB comparison. Batched source code is /mnt/hdd/infraternal/jobs/perf-audit/terminal-source.c.

Paced simultaneous workload and policy choice

The source targets 55.490 MiB/s (four 16,001-byte lines per 1,100 us), with no catch-up bursts; every successful trial includes at least 500 browser echo samples. It uses the existing browser workload through the real release server and enrolled mTLS infraternal agent, with the current TypeScript client bundled for the browser. Actual source throughput was also measured. Real rootful Docker and rootless Podman; fixture log-file cap 1 MiB matches the existing paced benchmark.

The controlled window experiment completed nine embedded Docker and three remote Docker trials before a between-trial host_offline refusal. An earlier run stopped on a newly created fixture’s not_found; its higher-load results are excluded from the controlled table. Neither partial run is presented as a complete provider matrix. Inventory-publication/load admission fences were added to the diagnostic; final policy timing trials additionally assert no tunnel-generation replacement.

Controlled embedded Docker 256 KiB 512 KiB 1 MiB
Logs MiB/s 23.476 40.338 53.810
Echo p99 ms 8.900 11.200 18.900

Controlled window load1 2.17–7.66. Larger log windows improve throughput but systematically worsen echo. They are not adopted. Standalone PTY gains justify the 1 MiB terminal window; larger terminal credit does not add source batching or relax admission.

The complete chosen-policy A/B has three alternating trials per setting/path: old explicit 256 KiB for both channels versus product defaults (256 KiB logs / 1 MiB terminals). All 24 timing trials preserve the tunnel generation. Actual source emitted 38.961–55.165 MiB/s; load1 1.84–9.96.

Path Logs MiB/s before → after Echo p99 ms before → after
embedded docker 21.858 → 22.789 10.300 → 9.600
remote docker 19.872 → 19.657 13.900 → 15.800
embedded podman 3.284 → 3.352 14.300 → 15.600
remote podman 3.155 → 3.378 19.400 → 23.600

Peak sampled server RSS (10-ms sampling) was 38.273 MiB. After warming, eight real simultaneous 1 MiB log overrides showed server RSS 38.273 → 38.273 MiB; the ninth OPEN was refused, all CLOSE acknowledgments arrived and a replacement OPEN succeeded. This is a warm RSS observation, not zero allocated bytes or an exact unsampled peak.

Performance certification remains blocked: logs are below 50 MiB/s, multiple echo paths exceed both the 5-ms absolute and 10-ms dev criteria, and final remote echo medians are higher than baseline. Shared-load dev results do not establish an acceptable echo regression or justify relaxing thresholds. The rootless source did not sustain the nominal target in every trial. This job does not certify the simultaneous budget or recommend merging on the fast gate alone. Run the exact candidate/base A/B on the perf-test VM before merge; the required perf-test-vm skill/connection workflow is unavailable locally. Rendering-frame and xterm-ingest budgets were not measured.

Raw controlled experiment: windows-controlled-partial.json; final matrix: final-policy/windows.json; runnable diagnostic: e2e/remote/window-bench.ts. STREAM_WINDOWS=262144,0 reproduces the old/default comparison (0 selects per-kind defaults). The default script setting compares 256 KiB / 512 KiB / 1 MiB explicitly. Set INFRATERNAL_E2E_BINARY to the built release binary and INFRATERNAL_ARTIFACT_DIR to a private artifact directory.

Memory math at 500 hosts / 20,000 containers

  • Maximum per channel: 4 MiB; maximum per connection: 8 MiB in each direction. No increase.
  • Default terminal pair: 1 MiB output + 256 KiB native input. Eight default terminals use 8 MiB output and 2 MiB native-input reservations. Default logs use 256 KiB; 32 fit in one client connection. Mixed channels share the same budget.
  • Existing admission: 64 client connections globally / four per user. Therefore at most 512 default terminal or 2,048 default log attachments globally, and 32 terminals / 128 logs per user. Global permitted payload is at most 64 × 8 MiB = 512 MiB per client direction (32 MiB per user), at most 1 GiB for both directions. This counts credit, not socket buffers, queue metadata, retained strings or replay.
  • Tunnel caps stay 8 MiB per direction shared across clients/providers. They are not new allocations per host or multiplied by container inventory.
  • One default log subscription on each of 500 hosts reserves 125 MiB output; 20,000 subscriptions would require 4,882.8125 MiB and cannot be admitted under the existing limits. Demand-driven inventory rows reserve no stream windows. Do not assume all 20,000 containers are streamed simultaneously.
  • Log retention remains 10,000 lines / 4 MiB, split body ≤64 KiB. Native 8 KiB reads / 32-slot output pumps and replay admission are unchanged.

Correctness and verification

  • Decoder: 1 Vitest file / 8 tests pass; safe/unsafe uint64 boundaries, all header split positions, UTF-8 split at every byte, empty body, reset, retention and high-rate credit flood.
  • Stream: 4 Vitest files / 78 tests pass (76 existing plus policy/wire-reservation tests). Existing flow-control and protocol failure tests remain intact.
  • TypeScript stream check and Svelte check pass (zero web errors/warnings).
  • 36 PTY capacity transfers: all 32 MiB, expected byte count and exit 0.
  • Four SHA-256 32 MiB stdin transfers: embedded/remote Docker and rootless Podman, expected digest and exit 0; original 256 KiB input window and native batched-credit bounds retained, with 1 MiB declared output. All preserve the tunnel generation.
  • Four pending-upload authorization withdrawals: audited forbidden CLOSE received in 3.426 / 93.112 / 86.855 / 46.989 ms, all within C+850 ms. Owned physical tunnel stop: audited host_offline in 2.699 ms. Raw: upload-regression.log; driver is the existing binary-stream regression adapted only for label/output directory, 32 MiB selection and 1 MiB output declaration.
  • All throwaway containers labelled infraternal.test=perf-logs-windows; final Docker/Podman label queries return no IDs. No other fixtures removed.
  • Source graph rebuilt/updated; impact review covered the decoder, client, benchmark consumers and tests. No independent reviewer was launched (job explicitly forbids delegation); orchestrator owns independent review.

The first fast-gate attempt failed the package-import declaration check because the allocation script was placed under packages/web. Moving it to the root-owned e2e directory uses the existing Playwright declaration without adding a dependency. Final fast result follows.

Final gate

PASS (exit 0): INFRATERNAL_VERIFY_RUN_ID=perf-logs-windows scripts/verify fast. Never ran verify merge.

Verbatim gate output:

PASS fast: migrations are append-only (0.167s)
PASS fast: workspace package dependencies (0.249s)
PASS fast: gate target-directory and launch diagnostics tests (0.292s)
PASS fast: JavaScript dependencies (1.769s)
PASS fast: advisory review policy tests (0.184s)
SUPPLY_CHAIN_REVIEWS advisory exceptions are within their review windows
SUPPLY_CHAIN cargo-deny: cargo-deny 0.20.2
SUPPLY_CHAIN_NOTICES match THIRD_PARTY_NOTICES.md from 81 frontend packages
SUPPLY_CHAIN_NOTICES copied source: 47 calternal-derived files
SUPPLY_CHAIN_NOTICES license files: 54 distinct texts; 0 packages need manual license review
advisories ok
SUPPLY_CHAIN_RUST_ADVISORIES passed with refreshed advisory data
licenses ok
SUPPLY_CHAIN_RUST_LICENSES passed
bun audit v1.4.2 (744846f84)

cookie@0.6.0
  workspace:@infraternal/web > @sveltejs/kit > cookie
  low: cookie accepts cookie name, path, and domain with out of bounds characters (<0.7.0) - https://github.com/advisories/GHSA-pxg6-pf52-xh8x

1 vulnerability (1 low)

  bun audit fix           upgrade the vulnerable packages within their ranges
  bun audit fix --latest  also cross major versions
SUPPLY_CHAIN_BUN_AUDIT findings reported; this check is report-only
SUPPLY_CHAIN_PASS Rust advisory/license checks complete; Bun findings are report-only
PASS fast: supply-chain checks (3.642s)
PASS fast: build web app (7.261s)
PASS fast: cargo fmt --check (1.480s)
PASS fast: cargo clippy (150.448s)
PASS fast: cargo test (266.336s)
PASS fast: svelte-check (19.532s)
PASS fast: UI package svelte-check (8.956s)
PASS fast: stream package typecheck (10.648s)
PASS fast: Vitest (9.145s)
PASS fast: UI package Vitest (10.435s)
PASS fast: stream package Vitest (2.760s)
PASS fast: OpenAPI and TypeScript client drift (75.182s)
PASS fast: terminal TypeScript (1.956s)
PASS fast: terminal Vitest (1.135s)
# perf-logs-windows — #83 / #80 Head: `79b211653663437edae7968aaa82a4507d14648a`. Branch: `perf-logs-windows`. Base: `173525d8358a2576e681576605a7a7c5f1b9ebdd`. Three logical commits; no push, merge gate, issue closure, other AI agents or systemd units. ## Changes The log decoder reuses its 13-byte header DataView. Two uint32 words replace per-record BigInts; only nonzero exact 53-bit timestamps become numbers, with unsafe uint64 values still null. Split headers/bodies and UTF-8 behavior remain bounded and covered by tests. TypeScript declares 1 MiB output receive windows for exec/SSH and keeps logs/events/stats at 256 KiB. OPEN always carries the same size reserved locally; Rust omitted-field defaults and native input windows remain 256 KiB. The six-ms connection-wide CREDIT scheduler, #77 native input batching, signing, audit, authorization and Rust stream paths are unchanged. The simultaneous benchmark now uses actual product defaults rather than a hardcoded 4 MiB log window. ## Decoder allocation A/B Chromium sampled decoder allocations: **32,656,644 → 23,933,944 bytes**, **26.71% lower**, medians of three alternating trials. Each trial: 100,000 records at 10,000 lines/s, 99-byte bodies + 13-byte headers, 100 records/feed, about 10 seconds. All retain exactly 10,000 lines / 990,000 body bytes and zero partial records. Load1 3.56–4.77. The profiler samples at 1,024 bytes and includes objects collected by both major and minor GC; numbers are estimates, not exact allocation counts. JavaScript objects live inside V8 and cannot be attributed by native dhat/heaptrack. This uses the appropriate Chromium heap profiler instead. No browser rendering/frame-time improvement is claimed. Reproduce: `bun e2e/remote/log-decoder-bench.ts BASE_SOURCE packages/web/src/lib/log-stream.ts`; extract BASE_SOURCE with `git show 173525d:packages/web/src/lib/log-stream.ts`. Raw: `decoder-ab.jsonl`. Method: [Chromium HeapProfiler](https://chromedevtools.github.io/devtools-protocol/tot/HeapProfiler/#method-startSampling); timestamp semantics: [ECMAScript safe integers](https://tc39.es/ecma262/#sec-number.max_safe_integer) and [uint32 DataView reads](https://tc39.es/ecma262/#sec-dataview.prototype.getuint32). ## PTY capacity A/B Three trials per path/window, 32 MiB batched native PTY output, six-ms credit return; exact byte counts and exit status checked in all 36 trials. MiB/s below measures first-to-last DATA, excluding OPEN and the source’s final one-second sleep. Server/native Rust is identical to the base. Load1 3.68–5.14. These are protocol capacity diagnostics, not xterm ingestion certification. | Path | 256 KiB | 512 KiB | 1 MiB | |---|---:|---:|---:| | embedded docker | 39.505 | 79.169 | 125.890 | | remote docker | 37.625 | 74.439 | 108.586 | | embedded podman | 39.096 | 79.080 | 157.626 | | remote podman | 36.652 | 73.828 | 145.488 | Raw: `pty-batched.json`, `pty.log`, `pty-batched.ts` adapted from the audit with this worktree’s harness, release binary, owned label and 512 KiB comparison. Batched source code is `/mnt/hdd/infraternal/jobs/perf-audit/terminal-source.c`. ## Paced simultaneous workload and policy choice The source targets 55.490 MiB/s (four 16,001-byte lines per 1,100 us), with no catch-up bursts; every successful trial includes at least 500 browser echo samples. It uses the existing browser workload through the real release server and enrolled mTLS infraternal agent, with the current TypeScript client bundled for the browser. Actual source throughput was also measured. Real rootful Docker and rootless Podman; fixture log-file cap 1 MiB matches the existing paced benchmark. The controlled window experiment completed nine embedded Docker and three remote Docker trials before a between-trial `host_offline` refusal. An earlier run stopped on a newly created fixture’s `not_found`; its higher-load results are excluded from the controlled table. Neither partial run is presented as a complete provider matrix. Inventory-publication/load admission fences were added to the diagnostic; final policy timing trials additionally assert no tunnel-generation replacement. | Controlled embedded Docker | 256 KiB | 512 KiB | 1 MiB | |---|---:|---:|---:| | Logs MiB/s | 23.476 | 40.338 | 53.810 | | Echo p99 ms | 8.900 | 11.200 | 18.900 | Controlled window load1 2.17–7.66. Larger log windows improve throughput but systematically worsen echo. They are not adopted. Standalone PTY gains justify the 1 MiB terminal window; larger terminal credit does not add source batching or relax admission. The complete chosen-policy A/B has three alternating trials per setting/path: old explicit 256 KiB for both channels versus product defaults (256 KiB logs / 1 MiB terminals). All 24 timing trials preserve the tunnel generation. Actual source emitted 38.961–55.165 MiB/s; load1 1.84–9.96. | Path | Logs MiB/s before → after | Echo p99 ms before → after | |---|---:|---:| | embedded docker | 21.858 → 22.789 | 10.300 → 9.600 | | remote docker | 19.872 → 19.657 | 13.900 → 15.800 | | embedded podman | 3.284 → 3.352 | 14.300 → 15.600 | | remote podman | 3.155 → 3.378 | 19.400 → 23.600 | Peak sampled server RSS (10-ms sampling) was 38.273 MiB. After warming, eight real simultaneous 1 MiB log overrides showed server RSS 38.273 → 38.273 MiB; the ninth OPEN was refused, all CLOSE acknowledgments arrived and a replacement OPEN succeeded. This is a warm RSS observation, not zero allocated bytes or an exact unsampled peak. **Performance certification remains blocked:** logs are below 50 MiB/s, multiple echo paths exceed both the 5-ms absolute and 10-ms dev criteria, and final remote echo medians are higher than baseline. Shared-load dev results do not establish an acceptable echo regression or justify relaxing thresholds. The rootless source did not sustain the nominal target in every trial. This job does not certify the simultaneous budget or recommend merging on the fast gate alone. Run the exact candidate/base A/B on the perf-test VM before merge; the required `perf-test-vm` skill/connection workflow is unavailable locally. Rendering-frame and xterm-ingest budgets were not measured. Raw controlled experiment: `windows-controlled-partial.json`; final matrix: `final-policy/windows.json`; runnable diagnostic: `e2e/remote/window-bench.ts`. `STREAM_WINDOWS=262144,0` reproduces the old/default comparison (0 selects per-kind defaults). The default script setting compares 256 KiB / 512 KiB / 1 MiB explicitly. Set `INFRATERNAL_E2E_BINARY` to the built release binary and `INFRATERNAL_ARTIFACT_DIR` to a private artifact directory. ## Memory math at 500 hosts / 20,000 containers - Maximum per channel: 4 MiB; maximum per connection: 8 MiB in each direction. No increase. - Default terminal pair: 1 MiB output + 256 KiB native input. Eight default terminals use 8 MiB output and 2 MiB native-input reservations. Default logs use 256 KiB; 32 fit in one client connection. Mixed channels share the same budget. - Existing admission: 64 client connections globally / four per user. Therefore at most 512 default terminal or 2,048 default log attachments globally, and 32 terminals / 128 logs per user. Global permitted payload is at most 64 × 8 MiB = 512 MiB per client direction (32 MiB per user), at most 1 GiB for both directions. This counts credit, not socket buffers, queue metadata, retained strings or replay. - Tunnel caps stay 8 MiB per direction shared across clients/providers. They are not new allocations per host or multiplied by container inventory. - One default log subscription on each of 500 hosts reserves 125 MiB output; 20,000 subscriptions would require 4,882.8125 MiB and cannot be admitted under the existing limits. Demand-driven inventory rows reserve no stream windows. Do not assume all 20,000 containers are streamed simultaneously. - Log retention remains 10,000 lines / 4 MiB, split body ≤64 KiB. Native 8 KiB reads / 32-slot output pumps and replay admission are unchanged. ## Correctness and verification - Decoder: 1 Vitest file / 8 tests pass; safe/unsafe uint64 boundaries, all header split positions, UTF-8 split at every byte, empty body, reset, retention and high-rate credit flood. - Stream: 4 Vitest files / 78 tests pass (76 existing plus policy/wire-reservation tests). Existing flow-control and protocol failure tests remain intact. - TypeScript stream check and Svelte check pass (zero web errors/warnings). - 36 PTY capacity transfers: all 32 MiB, expected byte count and exit 0. - Four SHA-256 32 MiB stdin transfers: embedded/remote Docker and rootless Podman, expected digest and exit 0; original 256 KiB input window and native batched-credit bounds retained, with 1 MiB declared output. All preserve the tunnel generation. - Four pending-upload authorization withdrawals: audited `forbidden` CLOSE received in 3.426 / 93.112 / 86.855 / 46.989 ms, all within C+850 ms. Owned physical tunnel stop: audited `host_offline` in 2.699 ms. Raw: `upload-regression.log`; driver is the existing binary-stream regression adapted only for label/output directory, 32 MiB selection and 1 MiB output declaration. - All throwaway containers labelled `infraternal.test=perf-logs-windows`; final Docker/Podman label queries return no IDs. No other fixtures removed. - Source graph rebuilt/updated; impact review covered the decoder, client, benchmark consumers and tests. No independent reviewer was launched (job explicitly forbids delegation); orchestrator owns independent review. The first fast-gate attempt failed the package-import declaration check because the allocation script was placed under packages/web. Moving it to the root-owned e2e directory uses the existing Playwright declaration without adding a dependency. Final fast result follows. ## Final gate PASS (exit 0): `INFRATERNAL_VERIFY_RUN_ID=perf-logs-windows scripts/verify fast`. Never ran verify merge. Verbatim gate output: ```text PASS fast: migrations are append-only (0.167s) PASS fast: workspace package dependencies (0.249s) PASS fast: gate target-directory and launch diagnostics tests (0.292s) PASS fast: JavaScript dependencies (1.769s) PASS fast: advisory review policy tests (0.184s) SUPPLY_CHAIN_REVIEWS advisory exceptions are within their review windows SUPPLY_CHAIN cargo-deny: cargo-deny 0.20.2 SUPPLY_CHAIN_NOTICES match THIRD_PARTY_NOTICES.md from 81 frontend packages SUPPLY_CHAIN_NOTICES copied source: 47 calternal-derived files SUPPLY_CHAIN_NOTICES license files: 54 distinct texts; 0 packages need manual license review advisories ok SUPPLY_CHAIN_RUST_ADVISORIES passed with refreshed advisory data licenses ok SUPPLY_CHAIN_RUST_LICENSES passed bun audit v1.4.2 (744846f84) cookie@0.6.0 workspace:@infraternal/web > @sveltejs/kit > cookie low: cookie accepts cookie name, path, and domain with out of bounds characters (<0.7.0) - https://github.com/advisories/GHSA-pxg6-pf52-xh8x 1 vulnerability (1 low) bun audit fix upgrade the vulnerable packages within their ranges bun audit fix --latest also cross major versions SUPPLY_CHAIN_BUN_AUDIT findings reported; this check is report-only SUPPLY_CHAIN_PASS Rust advisory/license checks complete; Bun findings are report-only PASS fast: supply-chain checks (3.642s) PASS fast: build web app (7.261s) PASS fast: cargo fmt --check (1.480s) PASS fast: cargo clippy (150.448s) PASS fast: cargo test (266.336s) PASS fast: svelte-check (19.532s) PASS fast: UI package svelte-check (8.956s) PASS fast: stream package typecheck (10.648s) PASS fast: Vitest (9.145s) PASS fast: UI package Vitest (10.435s) PASS fast: stream package Vitest (2.760s) PASS fast: OpenAPI and TypeScript client drift (75.182s) PASS fast: terminal TypeScript (1.956s) PASS fast: terminal Vitest (1.135s) ```
Commenting is not possible because the repository is archived.
No Branch/Tag specified
Branches Tags
main
dev
perf-gates
provider-docker-podman
fix-networkidle
fix-apierror-panics
fix-revoke-panic
wal-race
fix-private-storage
provider-runtime
plugin-design
server-channels
scope-v01
deploy-git-fix
sec-hardening
gates-tiering
sidebar-sync
multi-tab
cli-eof
podman-flake
ssh-reattach
agent-tunnel
process-boundary
shadcn
stream-params
cli-ssh
ssh-product
container-live
flaky-tests
s1-e2e
ssh-test-isolation
cli-stream
research-lxc
container-live-agent
ui-apis
grant-shrink
deploy-o2
ui-redesign
migration-fix
cli
stream
No results found.
Labels
Clear labels
No items
No labels
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
kayg/infraternal-v0#83
No description provided.