Merge pull request #10861 from apple/ahusain/releaseNotes-71.3.3 by mo74m3ed · Pull Request #7 · mo74m3ed/foundationdb

mo74m3ed · 2026-08-13T01:52:00Z

PLEASE DELETE THIS TEMPLATE WHEN YOU POST YOUR PR FOR REVIEW

Please describe:

The problem (for bugs: how/where you encountered it).
The solution.
Testing done, if any.

We encourage AI-assisted review. Save your diff:

git diff upstream/main -- . > /tmp/pr.diff

Then review it with a prompt like:

Review /tmp/pr.diff. What is it trying to do? Is it correct? Are there bugs? Are there omissions? Are there better ways of doing things? Should this CL be LGTMd?

END OF TEMPLATE TO DELETE

…ase-71.3) (apple#10052)

…t in most workloads that create metaclusters

apple#10068) * make status json report desired role count (log, resolver, proxies...) regardless whether user sets it explicitly * make proxies calculation simpler * Add comment for DatabaseConfiguration

…-71.3) (apple#10055)

…(Cherry-pick apple#10041 to snowflake/release-71.3)) (apple#10042) * Fix for correctness failures when issuing duplicate requests Add comments; Disable failure injection in Snap test * Add Snapshot tests which are clean when fault injection is disabled in Snaptest. * Remove snapshot restarting tests in from_7.1.0_until_71.2.0

…owflake/release-71.3) (apple#10064)

…snowflake/release-71.3) (apple#10071)

…ot test failure. (apple#10078) * Downgrade "inaccurate shard estimate" consistency check to warning, not test failure. We know that the hash function used for sampling keys is biased and oversamples. The fix is non-trivial, since we can't straightforwardly change the sampling function for existing FDB databases. Thus, we downgrade this particular test failure to a warning. * Disable test failure entirely, since it will retry and fail again. Change the existing log message to a warning, so we at least have some indiciation in the logs that we hit the biased shard estimate issue.

…#10070 to snowflake/release-71.3) (apple#10084)

…idate it when loading the entry from the cluster. (apple#10085)

…ble rocksdb related tests (apple#10082)

…ple#10089 to snowflake/release-71.3) (apple#10102)

…to snowflake/release-71.3) (apple#10092)

…to snowflake/release-71.3) (apple#10097)

…#10073 to snowflake/release-71.3) (apple#10099) * Write storage_metadata for TSS and add test for it (Cherry-Pick apple#10073 to snowflake/release-71.3) * populate storage metadata for tss * add metadata check to quiesent consistency check * check storage metadata and storage server interface in the same transaction

…herry-Pick apple#10058 to snowflake/release-71.3) (apple#10101)

…we have Python 2 files and a few files written externally. Add external files as exclusions to the precommit checks. (apple#10094)

…tdown improvements found along the way. (Cherry-Pick apple#10109 to snowflake/release-71.3) (apple#10131)

… used during commit protection in Java

to snowflake/release-71.3) (apple#10072)

…… (Cherry-Pick apple#10106 to snowflake/release-71.3) (apple#10113)

(cherry picked from commit cdef452)

…10108) (apple#10115) Description 'Type' is a reserved keywork for TraceEvent, RESTKmsConnector was usng 'Type' to log CipherDetail or BlobMetadata type information. It causes 'fdbserver' binary to crash/restart Patch addresses the usage to ensure TraceEvent compatibility is maintained. Further, it proposes following test improvements: 1. Fix existing unit-test that 'should' have caught this issue. 2. Add more test coverage. 3. Add CODE_PROBE to ensure relevant corner cases are validated. Testing RESTKmsConnectorUnit (cherry picked from commit 7e872c4)

…ecause otherwise we could delete our coordinated state (apple#10136)

…py (Cherry-Pick apple#10076 to snowflake/release-71.3) (apple#10139)

…herry-Pick apple#10157 to snowflake/release-71.3) (apple#10158)

* fix: Non-storage processes were not being checked for locality exclusions fix: Data distribution when not detect a newly added process was locality excluded fix: RemoveServerSafely did not wait for processes to be excluded before killing them when excluding localities * fix: do not allow locality based excludes if they cannot exclude the required addresses * fix: do not allow rebootAndDelete when doing locality based excludes because it changes the processId of a process

* Prevent Status actor from bubbling up timeout error Description Patch addresses occurrences where Status.actor ends up bubbling timeout error up to the ClusterController causing recovery to be triggered when ClusterGetStatus timeout for some reason. Testing devRunCorrectness - 100K * Update fdbserver/Status.actor.cpp Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com> --------- Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>

…ectly deal with re-aligning keys after downsample (apple#10794)

…pple#10811) * Normalize clear costs for quota throttler * Track cost of point clears

Description Release notes - snowflake 71.3.4 Testing

…r a request (apple#10808) * FDBCORE-5950: Ensure exponential backoff while refreshing KMS URLs for a request Description KMS server(s) outage could last for longer times, RESTKmsConnector follow exponential-backoff semantics when retrying request to same KMS server, however, it doesn't follow exponential backoff semantics when attempting to retry request after refreshing KMS URLs by reading on-disk discovery file. Patch addresses the concern by ensuring request follow exponential backoff semantics for above mentioned scenario. Testing devRunCorrectness - 100K 20230824-141642-ahusain-6351198682ff45b7 * Update the initial and max delays as KNOBs Description Testing

…ake/release-71.3) (apple#10830) * Add trace details about over-replicated shard and range count * Fix count refresh

…) (apple#10832) * EaR: Handle KMS timeout in storage server and commit proxy * EaR: reduce KMS request timeout

Description KMS health check monitor is instrumental in determing FDB <-> KMS connectivity issues (no connection or flakiness). Patch lower the check interval to be under FDB commit timeout to get assist diagnosing such issues. The change do translate to increased request to KMS, however, the health-check asks for FDB system keyspace encryption key, it would be hitting cache on KMS server all the time (unless a KMS server got replaced and the first read is a miss) Testing devRunCorrectness - 100K

Co-authored-by: Ata E Husain Bohra <ata.husain@snowflake.com>

…and parallelism (apple#10789)

Description Bump version to 71.3.5 Testing

… compatibility with previous 71.3 patches (apple#10847)

Description Release notes for snowflake/71.3.3 Testing

DatabaseContext currently leaks memory by creating `Counter`s with unique IDs on construction. Each status json call creates a new `DatabaseContext` object, causing a memory leak over time.

Description Bump snowflake/release-71.3 from 71.3.5 -> 71.3.6 Testing

* Release notes for snowflake/release-71.3.5 Description Release notes for snowflake/release-71.3.5a Testing

Description Release notes - snowflake/release-71.3.6 Testing

Release notes 71.3.3

mo74m3ed · 2026-08-13T01:53:04Z

@copilot resolve the merge conflicts on this branch.

mo74m3ed · 2026-08-13T01:53:45Z

@copilot resolve the merge conflicts on this branch.

mo74m3ed · 2026-08-13T01:53:50Z

@copilot resolve the merge conflicts on this branch.

sfc-gh-satherton and others added 30 commits April 26, 2023 10:40

Manual Shard Configuration (Cherry-Pick apple#10009 to snowflake/rele…

a01ea72

…ase-71.3) (apple#10052)

Add a utility function for creating a simulated metacluster and use i…

12b7104

…t in most workloads that create metaclusters

make status json report desired role count (log, resolver, proxies...… (

e6c12b5

apple#10068) * make status json report desired role count (log, resolver, proxies...) regardless whether user sets it explicitly * make proxies calculation simpler * Add comment for DatabaseConfiguration

Add basic PTree metrics (Cherry-Pick apple#10045 to snowflake/release…

f3dd95d

…-71.3) (apple#10055)

Add trace event "TeamEligibilityCount" (Cherry-Pick apple#10028 to sn…

7395b95

…owflake/release-71.3) (apple#10064)

disabling global conncetion pool for now (Cherry-Pick apple#10054 to …

fa743e8

…snowflake/release-71.3) (apple#10071)

Make test progress tracing in runWorkload consistent

cf41b16

Create blob connection per tenant for blob restore (Cherry-Pick apple…

2071326

…#10070 to snowflake/release-71.3) (apple#10084)

Add a metacluster version to the MetaclusterRegistrationEntry and val…

b183a3b

…idate it when loading the entry from the cluster. (apple#10085)

fix Incompatible CheckpointMetaData upgrading from sfc/71.2; And disa…

427ebb1

…ble rocksdb related tests (apple#10082)

Separate failed and excluded servers on fdbcli output (Cherry-Pick ap…

dfbcf99

…ple#10089 to snowflake/release-71.3) (apple#10102)

fixing incorrect uses of ThreadSafeAsyncVar (Cherry-Pick apple#10086 …

dffb29c

…to snowflake/release-71.3) (apple#10092)

Fix commit location accounting in DiskQueue. (Cherry-Pick apple#10075 …

a96321c

…to snowflake/release-71.3) (apple#10097)

fix: do not let too many shards use large teams (apple#10098)

c751c3a

Add configuration option auto_tenant_assignment to data clusters (C…

438eab2

…herry-Pick apple#10058 to snowflake/release-71.3) (apple#10101)

Apply black format to most Python files, excluding a few cases where …

2287854

…we have Python 2 files and a few files written externally. Add external files as exclusions to the precommit checks. (apple#10094)

testing doc build fix (apple#10120)

b5748f2

AsyncFileWriteChecker false-positive bug fix and sim-only Redwood shu…

55792d6

…tdown improvements found along the way. (Cherry-Pick apple#10109 to snowflake/release-71.3) (apple#10131)

Add urllib3<2 to requirements.txt for Sphinx (apple#10141)

a3515de

Add API version protection for the change to use a default option for…

7c4fcdf

… used during commit protection in Java

BM should drop continue assignment if BW is dead (Cherry-Pick apple#9987

6d9d6e4

to snowflake/release-71.3) (apple#10072)

adding logic to disable splitting within a truncated tuple, and valid…

2227155

…… (Cherry-Pick apple#10106 to snowflake/release-71.3) (apple#10113)

Update a few Data Distribution code probes (apple#10110) (apple#10133)

11dc910

(cherry picked from commit cdef452)

Do not allow changing the coordinators to a set that is unreliable, b…

079ebd3

…ecause otherwise we could delete our coordinated state (apple#10136)

Enable MovingData to show overall moved bytes rather than just one co…

096210b

…py (Cherry-Pick apple#10076 to snowflake/release-71.3) (apple#10139)

Bug fix, check is supposed to be for overlap, not lack of overlap. (C…

3c1b8e5

…herry-Pick apple#10157 to snowflake/release-71.3) (apple#10158)

sfc-gh-etschannen and others added 23 commits August 15, 2023 17:24

fixed split downsampling to happen as part of split range and to corr…

5e32238

…ectly deal with re-aligning keys after downsample (apple#10794)

(snowflake/release-71.3) Fix quota throttler clear cost estimation (a…

0a07d82

…pple#10811) * Normalize clear costs for quota throttler * Track cost of point clears

Release notes - snowflake 71.3.4 (apple#10814)

1135817

Description Release notes - snowflake 71.3.4 Testing

Cherry-pick fix for FDBCORE-5124 (apple#10664)

734f743

Wait file deleted in blob manifest cleanup (apple#10792)

41c1524

enabling median assignment limiting (apple#10803)

8fae616

Add trace details about over-replicated shard and range count (snowfl…

a124aeb

…ake/release-71.3) (apple#10830) * Add trace details about over-replicated shard and range count * Fix count refresh

EaR: Handle KMS timeout in storage server and commit proxy (apple#10831…

18e5a6e

…) (apple#10832) * EaR: Handle KMS timeout in storage server and commit proxy * EaR: reduce KMS request timeout

adding timeout (apple#10804)

e88aa3c

Co-authored-by: Ata E Husain Bohra <ata.husain@snowflake.com>

Catch initial flush error and avoid crashing blob manager (apple#10797)

6ef50bb

Additional BM purge stats, and reducing memory overhead, slow tasks, …

23a3257

…and parallelism (apple#10789)

Bump version to 71.3.5 (apple#10841)

4e413a1

Description Bump version to 71.3.5 Testing

Restoring the original names of blob granule API functions for binary…

704032b

… compatibility with previous 71.3 patches (apple#10847)

Release notes 71.3.3

05c2042

Description Release notes for snowflake/71.3.3 Testing

Avoid creating a DatabaseContext on every status json call

2e1d86e

DatabaseContext currently leaks memory by creating `Counter`s with unique IDs on construction. Each status json call creates a new `DatabaseContext` object, causing a memory leak over time.

Bump version to 71.3.6 for snowflake/release-71.3 (apple#10863)

daa5ed0

Description Bump snowflake/release-71.3 from 71.3.5 -> 71.3.6 Testing

Release notes for snowflake/release-71.3.5 (apple#10886)

1c58ccd

* Release notes for snowflake/release-71.3.5 Description Release notes for snowflake/release-71.3.5a Testing

Release notes - snowflake/release-71.3.6 (apple#10920)

0f853fe

Description Release notes - snowflake/release-71.3.6 Testing

Merge pull request apple#10861 from apple/ahusain/releaseNotes-71.3.3

c95c020

Release notes 71.3.3

mo74m3ed force-pushed the main branch from efe315d to be70f3c Compare August 16, 2026 00:12

Navigation Menu

Merge pull request #10861 from apple/ahusain/releaseNotes-71.3.3 - #7

Merge pull request #10861 from apple/ahusain/releaseNotes-71.3.3#7
mo74m3ed wants to merge 521 commits into
mainfrom
snowflake/release-71.3

mo74m3ed commented Aug 13, 2026

Uh oh!

mo74m3ed commented Aug 13, 2026

Uh oh!

mo74m3ed commented Aug 13, 2026

Uh oh!

mo74m3ed commented Aug 13, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

20 participants

Conversation

mo74m3ed commented Aug 13, 2026

PLEASE DELETE THIS TEMPLATE WHEN YOU POST YOUR PR FOR REVIEW

END OF TEMPLATE TO DELETE

Uh oh!

mo74m3ed commented Aug 13, 2026

Uh oh!

mo74m3ed commented Aug 13, 2026

Uh oh!

mo74m3ed commented Aug 13, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

20 participants