Add support to configure replication factor of delete files.#219
Merged
shanthoosh merged 10 commits intoopenhouse-1.5.2from Jan 7, 2026
Merged
Add support to configure replication factor of delete files.#219shanthoosh merged 10 commits intoopenhouse-1.5.2from
shanthoosh merged 10 commits intoopenhouse-1.5.2from
Conversation
shanthoosh
force-pushed
the
configure_replication_during_creation
branch
from
19cada3 to
364e96a
Compare
shanthoosh
force-pushed
the
configure_replication_during_creation
branch
from
07b4998 to
9e078c8
Compare
sumedhsakdeo
reviewed
Dec 3, 2025
sumedhsakdeo
reviewed
Dec 3, 2025
core/src/main/java/org/apache/iceberg/hadoop/HadoopOutputFile.java
Outdated
Show resolved
Hide resolved
sumedhsakdeo
reviewed
Dec 3, 2025
sumedhsakdeo
reviewed
Dec 3, 2025
sumedhsakdeo
reviewed
Dec 3, 2025
sumedhsakdeo
reviewed
Dec 3, 2025
core/src/main/java/org/apache/iceberg/io/OutputFileFactory.java
Outdated
Show resolved
Hide resolved
sumedhsakdeo
reviewed
Dec 3, 2025
spark/v3.3/spark/src/main/java/org/apache/iceberg/spark/source/SparkPositionDeltaWrite.java
Outdated
Show resolved
Hide resolved
sumedhsakdeo
reviewed
Dec 3, 2025
spark/v3.3/spark/src/main/java/org/apache/iceberg/spark/SparkSQLProperties.java
Outdated
Show resolved
Hide resolved
sumedhsakdeo
requested changes
Dec 3, 2025
Contributor
sumedhsakdeo
left a comment
sumedhsakdeo
left a comment
There was a problem hiding this comment.
Left a few comments.
shanthoosh
force-pushed
the
configure_replication_during_creation
branch
2 times, most recently
from
72ffef6 to
350298a
Compare
shanthoosh
force-pushed
the
configure_replication_during_creation
branch
2 times, most recently
from
945cd30 to
f060270
Compare
shanthoosh
force-pushed
the
configure_replication_during_creation
branch
from
f060270 to
3eb8f71
Compare
sumedhsakdeo
reviewed
Jan 5, 2026
core/src/main/java/org/apache/iceberg/hadoop/HadoopOutputFile.java
Outdated
Show resolved
Hide resolved
spark/v3.4/spark/src/main/java/org/apache/iceberg/spark/source/SparkPositionDeletesRewrite.java
Show resolved
Hide resolved
shanthoosh
force-pushed
the
configure_replication_during_creation
branch
from
f5418fb to
d3279a5
Compare
shanthoosh
force-pushed
the
configure_replication_during_creation
branch
from
d3279a5 to
84243fa
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Changes
Adds support to configures the replication factor during the creation of the delete files. Enables the spark jobs to set the HDFS delete replication as part of the writer configuration.
Tests