[fft] Prototype: out-parameter storage forms + clobber conventions (NTT first) - #81
Draft
devin-ai-integration[bot] wants to merge 3 commits into
Draft
[fft] Prototype: out-parameter storage forms + clobber conventions (NTT first)#81devin-ai-integration[bot] wants to merge 3 commits into
devin-ai-integration[bot] wants to merge 3 commits into
Conversation
Contributor
Author
🤖 Devin AI EngineerI'll be helping with this pull request! Here's what you should know: ✅ I will automatically:
Note: I can only respond to comments from users who have write access to this repository. ⚙️ Control Options:
|
GCC Code Coverage Report📂 Overall coverage
|
Base automatically changed from
devin/1785329305-cached-span-operands
to
devin/1785327766-series-span-cleanup
July 29, 2026 19:58
devin-ai-integration
Bot
force-pushed
the
devin/1785329461-storage-outparams
branch
from
July 29, 2026 19:59
0d0e673 to
699a309
Compare
devin-ai-integration
Bot
force-pushed
the
devin/1785329461-storage-outparams
branch
5 times, most recently
from
July 29, 2026 22:56
eeee217 to
ca2c7b6
Compare
ecnerwala
added a commit
that referenced
this pull request
Jul 31, 2026
…n, zero-pad-tolerant extend_to (#79) ## Summary Removes the recurring rough edges in the `series::` layer (now includes the operator normalization originally split out as #80): 1. **`underlying()` is gone.** The `like` contract is now: direct indexing plus two span borrows — into the engine primitives and into the series layer's own exactness-tagged span: ```cpp concept like = ... requires(const S& s, int i) { { s[i] } -> convertible_to<const value_type&>; { std::span<const value_type>(s) }; // borrows into engine ops requires convertible_to<const S&, span<E, S::exact_v>>; // borrows into the series layer }; ``` Each wrapper provides `operator span<E, exact_v>` (`vec` already had it; `cached`/`cached_span`/`prefix_cached` gain it), and `vec` gains `explicit vec(span<E, exact_>)` so materializing an owned copy of any series-like is just `exact<E> r(c)`. `std::span<const T>` borrows go through std::span's range constructor (deliberately no conversion operator on `series::span` — offering both paths makes every implicit conversion ambiguous under `-Wconversion`). `cached`/`prefix_cached` keep a non-contract `uncached()` unwrapper for the by-reference case (`subproduct_tree::rev_prod`). At the sites: `q.underlying()[0]` → `q[0]`, `span<E, false> a = a_.underlying();` → `span<E, false> a = a_;`. 2. **The `sz(coeffs)` zero-padding footgun.** `extend_to`'s doubling loop clamps each step's read to the coefficients that fit: ```cpp while (t.size() < m) { int s = t.size(); t.v.resize(2 * s); core::extend(t.v, coeffs.first(min(sz(coeffs), 2 * s))); } ``` By the prefix contract, a size-`s` transform can only exist if all nonzero coefficients fit in `2s` — so anything past the clamp is necessarily zero and dropping it is exact (no value inspection, no float-equality trimming). The top-level `sz(coeffs) <= 2 * m` assert is the one conservative check kept. The old *"must `extend_to` before padding"* ordering constraint in `kth_term_of_rational_function` is gone, and a cache seeded from short coeffs can later be grown with a longer zero-padded buffer of the same sequence. 3. **Series operators normalized onto `cached_span`** (folded from #80). `detail::whole_operand` is the whole-span counterpart to `product_operand`: any `like` operand becomes a `cached_span` (borrowed coefficients + the cache serving them): ```cpp template <like S> cached_span<E, S::exact_v> whole_operand(const S& s, fft::transformed<E>& tmp) { return {s, whole_cache_or(s, tmp)}; } ``` `square`/`multiply_add2`/`middle_product` and `kth_term_of_linear_recurrence` run on that form (`auto av = detail::whole_operand(a, ta_);` then `av, av.cache()` straight into the `fft::` entry points); `operator*`'s call sites, `operator+`/`operator-`, `ps_inv`, `ps_log`'s assert, and `cached::operator==` drop their coefficient plumbing. Internals uniformly use `series::span`, not `std::span`, for coefficient views. No algorithmic or semantic changes: cache selection, precisions, and transform sizes are identical throughout. ## Testing - Full audit of all fft code (all engines' `extend_to`/`transform`/`finish`/`downsample`/`negate_arg` against the clamped-prefix contract; series operator cache pairings; `poly.hpp`/`online.hpp` call sites) — one issue found and fixed: the dual span-conversion ambiguity above (it produced `-Wconversion` warnings at every implicit borrow). - Full unit suite green (2822854 assertions, 106 cases, all engines) after the `underlying()` removal. - Full Library Checker verification: every fft-related problem AC under both `g++` and `g++-sanitizer` environments (convolutions incl. crt/split, all FPS ops, composition, multipoint/interpolation, characteristic polynomial, `kth_term_of_linearly_recurrent_sequence` 20/20); kth_term/multipoint/interpolation re-verified after the contract change. - Padded-extend harness: seed a transform from unpadded coeffs, extend with a longer zero-padded buffer, compare `finish(sq(...))` against a fresh transform — exact agreement (err = 0) across ntt/split/real for lengths {1,2,3,5} × seeds {2,4} × targets {8,16} × paddings. - Real-engine length-1 `extend_to` verified bit-identical to fresh transforms across seed/target sizes. Stacked follow-up: #81 (storage-separation prototype). Link to Devin session: https://app.devin.ai/sessions/66a2d877f2354e30b3fdfa0c15061db2 Requested by: @ecnerwala <!-- devin-review-badge-beta-begin --> --- <a href="https://app.beta.devin.ai/review/ecnerwala/cp-book/pull/79" target="_blank"> <picture> <source media="(prefers-color-scheme: dark)" srcset="https://static.devin.ai/assets/gh-open-in-devin-review-beta-dark.svg?v=1"> <img src="https://static.devin.ai/assets/gh-open-in-devin-review-beta-light.svg?v=1" alt="Open in Devin Review (Beta)"> </picture> </a> <!-- devin-review-badge-beta-end --> --------- Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> Co-authored-by: Andrew He <he.andrew.mail@gmail.com>
devin-ai-integration
Bot
force-pushed
the
devin/1785329461-storage-outparams
branch
from
July 31, 2026 04:26
ca2c7b6 to
48dd415
Compare
Engines may provide out-parameter forms of the value-returning primitives (transform/mul/downsample/negate_arg building into a caller-reserved object, reusing its capacity); fft::*_into helpers dispatch to them when present and fall back to move-assignment. NTT implements them; the Bostan-Mori loop hoists its transforms/products out of the loop and runs on the helpers. engine.hpp documents the ownership conventions (const& borrow, sink clobbers, & out-param overwrites). Co-Authored-By: Andrew He <he.andrew.mail@gmail.com>
…gine concept Co-Authored-By: Andrew He <he.andrew.mail@gmail.com>
Co-Authored-By: Andrew He <he.andrew.mail@gmail.com>
devin-ai-integration
Bot
force-pushed
the
devin/1785329461-storage-outparams
branch
from
August 2, 2026 04:48
48dd415 to
ac82edf
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Draft/prototype, stacked on #79. Separates storage from semantics the way we discussed: no opaque byte arena — instead the caller pre-constructs/reserves a
transformed/productand the engine builds into it, and clobber permission is encoded in the parameter form.engine.hppstates the convention:Each
engineconcept requirement now carries a comment giving the expected function signature and its reference-passing semantics, e.g.:Engine-side (NTT only for now, optional per engine):
The value-returning forms become one-line wrappers over these. Generic callers use dispatch helpers that fall back to move-assignment for engines without the forms:
kth_term_of_rational_functionis the consumer proof:tnq/prod/halfare hoisted out of the loop, and since the sizes are stable per iteration (transforms at n, products at n/2), each object allocates at most once for the whole computation on engines with the out-param forms.Findings (allocation audit)
Counting
operator newinside onekth_term_of_rational_functioncall (NTT, warmbuffer_pool):(~5% wall-clock improvement at d=100000; identical results.) The per-iteration allocations were:
negate_arg(n),mul(n),downsample(n/2) ×2 products, plus the realloc whenextend_todoubles the recycled half back to n — all now capacity reuse. Remaining copies:tp = half/tq = half(n/2 each) are inherent whilefinishconsumes its product in place; a non-consumingfinishwould have to copy anyway.Open questions before rolling out further:
engineconcept (making them required) once split/real/crt/algebras implement them, and retire the_intohelpers in favor of callingE::directly;sq/mul2/addout-param forms (not needed by this consumer, so omitted);Testing
core::even_half/odd_half's forward-read structure; the new concept signature comments checked against every engine's actual overloads (ntt/crt/split/real/algebras);finish's keeps-allocation claim confirmed for all engines (each runs the inverse in the product's own buffers). One stale preamble typo fixed (finish(..., span<value_type>& out)→ by-value span)../build/tests "[fft]"→ 26727 assertions, 85 cases, all pass (the_intofallback path covers the engines without out-param forms).g++andg++-sanitizerenvironments, includingkth_term_of_linearly_recurrent_sequence20/20.Link to Devin session: https://app.devin.ai/sessions/66a2d877f2354e30b3fdfa0c15061db2
Requested by: @ecnerwala