⚡ Bolt: [CSV Generation Memory Optimization] - #4310
Conversation
Replaced `.map().join()` chains with standard `for` loops and string concatenation in `downloadCsv` function to eliminate intermediate array allocations per row, mitigating memory exhaustion and garbage collection pauses during large data exports. Co-authored-by: dieterolson <198168927+dieterolson@users.noreply.github.com>
|
👋 Jules, reporting for duty! I'm here to lend a hand with this pull request. When you start a review, I'll add a 👀 emoji to each comment to let you know I've read it. I'll focus on feedback directed at me and will do my best to stay out of conversations between you and other bots or reviewers to keep the noise down. I'll push a commit with your requested changes shortly after. Please note there might be a delay between these steps, but rest assured I'm on the job! For more direct control, you can switch me to Reactive Mode. When this mode is on, I will only act on comments where you specifically mention me with New to Jules? Learn more at jules.google/docs. For security, I will only act on instructions from the user who triggered this task. |
![chatgpt-codex-connector[bot]](https://avatars.githubusercontent.com/in/1144995?s=60&v=4){kind=small}
There was a problem hiding this comment.
💡 Codex Review
Here are some automated review suggestions for this pull request.
Reviewed commit: f5dc3738d2
ℹ️ About Codex in GitHub
Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you
- Open a pull request for review
- Mark a draft as ready
- Comment "@codex review".
If Codex has suggestions, it will comment; otherwise it will react with 👍.
Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".
| rowLine += escapeCsvValue(row[j]); | ||
| if (j < row.length - 1) rowLine += ","; |
There was a problem hiding this comment.
For large exports, repeatedly appending to rowLine creates V8 cons-string nodes that remain reachable through lines until the final join, so this purported memory optimization can substantially increase peak heap use. In a Node 24/V8 benchmark with 500,000 four-column rows, this implementation retained about 164 MB while the previous per-row map().join() retained about 107 MB. Please profile the complete generation path and retain flat per-row strings or use a chunking approach that does not keep every concatenation node alive.
AGENTS.md reference: AGENTS.md:L238-L238
Useful? React with 👍 / 👎.
Performance Benchmark ResultsNo benchmark results available. |
|
…t sparse checkout paths - Appended changelog entry to `SPEC.md` to resolve the "Verify SPEC.md freshness" failure. - Updated `.github/workflows/cross-repo-python-integration.yml` to use `src/` prefixed paths in `sparse_checkout` for the `UpstreamDrift` repo to resolve the `fatal: no submodule mapping found` and `Pinned Tools package roots are required` failures. Co-authored-by: dieterolson <198168927+dieterolson@users.noreply.github.com>
|
Consolidated into comprehensive PR #4429. |
Pull request was closed
Consolidation audit 2026-08-13 — this work is carried by #4438, not #4429#4429 ( A squash of #4429 — So #4438 was retitled CONS-B1 and landed; #4429, #4437 and #4439 were closed as superseded (#4437 and #4439 had byte-identical trees to each other). This PR's content is carried by #4438. |
…tion (#4438) Consolidates the Palette & Bolt suite that originated in #4429 (squash 91ea71b, itself covering merges of #4313, #4314, #4419, #4420) plus a movement-optimizer motion-view extraction, with Python formatting corrected to the CI-pinned ruff==0.14.10 and a Python 3.10 regression reverted. Substance: - Palette: form semantics, useId() label binding and role="alert" in RotationConverter.tsx and ODESolverCalculator.tsx. - Bolt: single-pass CSV string building in chartSnapshot.ts, Array.from removal in explorer/csv.ts, fewer intermediate allocations for SVG paths in LinePlot/ScatterPlot/SpectrumPlot.tsx. - refactor(movement-optimizer): extract MotionViewMixin into src/movement_optimizer/gui/motion_view.py. - fix(ci): correct sparse-checkout paths in cross-repo-python-integration.yml. - fix(tests): restore timezone.utc in test_action_audit.py; a pre-commit ruff pass had moved a noqa off its line, letting UP017 rewrite the import to datetime.UTC, which does not exist on Python 3.10. Supersedes, all closed as containing nothing this branch lacks: - #4429 — the original palette/bolt branch; quality-gate red at Format Check because its own pre-commit commits re-wrapped 86 files with a ruff that disagrees with the pin. Proven a strict semantic subset of this tree by normalising both sides with one ruff format pass. - #4437 and #4439 — byte-identical trees to each other (7fc2ce4), each only the #4429 squash plus a lint commit, despite advertising flight and rate-of-closure work. Palette/Bolt work items carried: #4310, #4311, #4313, #4314, #4418, #4419, #4420, #4421. None of the 59 still-open agent PRs named in the three closed PRs' descriptions are in this diff; they remain open and unconsolidated. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
1 participant
💡 What: Replaced.map().join()with single-pass string concatenation loops in thedownloadCsvutility insrc/p1am_control_system/frontend/src/lib/chartSnapshot.ts.🎯 Why: To eliminate intermediate array allocations per row and prevent garbage collection pressure during large CSV exports.📊 Impact: Reduces intermediate array allocations during CSV generation, improving large dataset export speeds and reducing memory pressure.🔬 Measurement: Measure heap usage during a large CSV data export via the Chrome devtools performance monitor; it should demonstrate fewer garbage collections.PR created automatically by Jules for task 8871594894715453573 started by @dieterolson