Skip to content

Catalog Migrator: Add missing BUNDLE-NOTICE and BUNDLE-LICENSE entries #196

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
ajantha-bhat wants to merge 3 commits into
base: main
Choose a base branch
from
Draft

Catalog Migrator: Add missing BUNDLE-NOTICE and BUNDLE-LICENSE entries #196

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
6f9bd15
Catalog Migrator: Add missing BUNDLE-NOTICE and BUNDLE-LICENSE entries
ajantha-bhat Mar 21, 2026
2c090b8
Bump Iceberg and Polaris versions
ajantha-bhat Jul 13, 2026
37224f6
Add Iceberg notice attribution
ajantha-bhat Jul 13, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 7 additions & 0 deletions iceberg-catalog-migrator/cli/BUNDLE-LICENSE
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1239,6 +1239,13 @@ License: BSD 3-Clause

--------------------------------------------------------------------------------

This artifact bundles iq80 LevelDB (Java port of LevelDB).

Project URL: https://github.com/dain/leveldb
License: Apache License, Version 2.0 - http://www.apache.org/licenses/LICENSE-2.0.txt

--------------------------------------------------------------------------------

This artifact bundles Project Nessie.

Project URL: https://github.com/projectnessie/nessie
Expand Down
82 changes: 82 additions & 0 deletions iceberg-catalog-migrator/cli/BUNDLE-NOTICE
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,32 @@ to the ASF by Dremio Corporation. (https://www.dremio.com/) copyright 2022.

-------------------------------------------------------------------------

This artifact bundles Apache Iceberg with the following in its NOTICE:
| Apache Iceberg
| Copyright 2017-2026 The Apache Software Foundation
|
| This product includes software developed at
| The Apache Software Foundation (http://www.apache.org/).
|
| This project includes code from Kite, developed at Cloudera, Inc. with
| the following copyright notice:
|
| Copyright 2013 Cloudera Inc.
|
| Licensed under the Apache License, Version 2.0 (the "License");
| you may not use this file except in compliance with the License.
| You may obtain a copy of the License at
|
| http://www.apache.org/licenses/LICENSE-2.0
|
| Unless required by applicable law or agreed to in writing, software
| distributed under the License is distributed on an "AS IS" BASIS,
| WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
| See the License for the specific language governing permissions and
| limitations under the License.

-------------------------------------------------------------------------

This artifact bundles reload4j with the following in its NOTICE:
| Apache log4j
| Copyright 2007 The Apache Software Foundation
Expand Down Expand Up @@ -165,3 +191,59 @@ This artifact bundles Netty with the following in its NOTICE:
| * HOMEPAGE:
| * https://github.com/JCTools/JCTools

-------------------------------------------------------------------------

This artifact bundles Snappy Java with the following in its NOTICE:
| This product includes software developed by Google Snappy.
| (http://code.google.com/p/snappy)
|
| This product includes software developed by Apache
| PureJavaCrc32C from apache-hadoop-common.
| (http://hadoop.apache.org)

Comment on lines +196 to +203

@dimas-b dimas-b Mar 23, 2026

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cf. https://github.com/xerial/snappy-java/blob/main/NOTICE

(which version do we bundle?)

Why do we not mention the "google" and "PureJavaCrc32C" fragments exactly as in the upstream NOTICE?

Why do not mention "libstdc++"?

Why do not mention Hadoop? The LICENSE file mentions that it is bundled 🤔

Should we also include the "Contributors" section from upstream? I tend to think we should since it's part of Snappy-java's original NOTICE

-------------------------------------------------------------------------

This artifact bundles HawtJNI with the following in its NOTICE:
| This product includes software developed by FuseSource Corp.
| http://fusesource.com
|
| This product includes software developed at
| Progress Software Corporation and/or its subsidiaries or affiliates.
|
| This product includes software developed by IBM Corporation and others.

-------------------------------------------------------------------------

This artifact bundles BoneCP with the following in its NOTICE:
| BoneCP
| Copyright 2010 Wallace Wadge

-------------------------------------------------------------------------

This artifact bundles Eigenbase Properties with the following in its NOTICE:
| eigenbase-properties
| Copyright (C) 2012-2020, Julian Hyde
| This product includes software from the Eigenbase project, licensed from
| DynamoBI Corporation.
| Copyright (C) 2005 Dynamo BI Corporation

-------------------------------------------------------------------------

This artifact bundles Groovy with the following in its NOTICE:
| Apache Groovy
| Copyright 2003-2015 The Apache Software Foundation
|
| This product includes software developed at
| The Apache Software Foundation (http://www.apache.org/).
|
| It includes the following other software:
|
| Antlr 2 (http://www.antlr2.org/)
| ASM (http://asm.ow2.org/)
| GPars (http://www.gpars.org/)
| Hamcrest (https://github.com/hamcrest/JavaHamcrest)
| JCommander (http://jcommander.org/)
| Openbeans (https://code.google.com/p/openbeans/)
| QDox (http://qdox.codehaus.org/)
| TestNG (http://testng.org/)
| XStream (http://xstream.codehaus.org/)
16 changes: 8 additions & 8 deletions iceberg-catalog-migrator/docs/examples.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,7 @@ Below are some examples of registering tables from one catalog to another.
### Registering All Tables from Hadoop Catalog to Polaris Catalog

```shell
java -jar iceberg-catalog-migrator-cli-0.0.1.jar register \
java -jar iceberg-catalog-migrator-cli-1.6.0.jar register \
--source-catalog-type HADOOP \
--source-catalog-properties warehouse=/tmp/warehouse,type=hadoop \
--target-catalog-type REST \
Expand All @@ -46,7 +46,7 @@ java -jar iceberg-catalog-migrator-cli-0.0.1.jar register \
In this example, only tables t1 and t2 in namespace foo will be migrated.

```shell
java -jar iceberg-catalog-migrator-cli-0.0.1.jar migrate \
java -jar iceberg-catalog-migrator-cli-1.6.0.jar migrate \
--source-catalog-type HADOOP \
--source-catalog-properties warehouse=/tmp/warehouse,type=hadoop \
--target-catalog-type REST \
Expand All @@ -56,7 +56,7 @@ java -jar iceberg-catalog-migrator-cli-0.0.1.jar migrate \

### Migrate from GLUE Catalog to Polaris Catalog
```shell
java -jar iceberg-catalog-migrator-cli-0.0.1.jar migrate \
java -jar iceberg-catalog-migrator-cli-1.6.0.jar migrate \
--source-catalog-type GLUE \
--source-catalog-properties warehouse=s3a://some-bucket/wh/,io-impl=org.apache.iceberg.aws.s3.S3FileIO \
--target-catalog-type REST \
Expand All @@ -65,7 +65,7 @@ java -jar iceberg-catalog-migrator-cli-0.0.1.jar migrate \

### Migrate from HIVE Catalog to Polaris Catalog
```shell
java -jar iceberg-catalog-migrator-cli-0.0.1.jar migrate \
java -jar iceberg-catalog-migrator-cli-1.6.0.jar migrate \
--source-catalog-type HIVE \
--source-catalog-properties warehouse=s3a://some-bucket/wh/,io-impl=org.apache.iceberg.aws.s3.S3FileIO,uri=thrift://localhost:9083 \
--target-catalog-type REST \
Expand All @@ -78,7 +78,7 @@ source catalog directory in `storage_configuration_info`.

### Migrate from DYNAMODB Catalog to Polaris Catalog
```shell
java -jar iceberg-catalog-migrator-cli-0.0.1.jar migrate \
java -jar iceberg-catalog-migrator-cli-1.6.0.jar migrate \
--source-catalog-type DYNAMODB \
--source-catalog-properties warehouse=s3a://some-bucket/wh/,io-impl=org.apache.iceberg.aws.s3.S3FileIO \
--target-catalog-type REST \
Expand All @@ -87,7 +87,7 @@ java -jar iceberg-catalog-migrator-cli-0.0.1.jar migrate \

### Migrate from JDBC Catalog to Polaris Catalog
```shell
java -jar iceberg-catalog-migrator-cli-0.0.1.jar migrate \
java -jar iceberg-catalog-migrator-cli-1.6.0.jar migrate \
--source-catalog-type JDBC \
--source-catalog-properties warehouse=/tmp/warehouseJdbc,jdbc.user=root,jdbc.password=pass,uri=jdbc:mysql://localhost:3306/db1,name=catalogName \
--target-catalog-type REST \
Expand All @@ -96,7 +96,7 @@ java -jar iceberg-catalog-migrator-cli-0.0.1.jar migrate \

### Migrate Only Tables Starting with "foo"
```shell
java -jar iceberg-catalog-migrator-cli-0.0.1.jar migrate \
java -jar iceberg-catalog-migrator-cli-1.6.0.jar migrate \
--source-catalog-type HIVE \
--source-catalog-properties warehouse=s3a://some-bucket/wh/,io-impl=org.apache.iceberg.aws.s3.S3FileIO,uri=thrift://localhost:9083 \
--target-catalog-type NESSIE \
Expand All @@ -109,7 +109,7 @@ java -jar iceberg-catalog-migrator-cli-0.0.1.jar migrate \
The file idx.txt contains each table identifier to migrate delimited by a newline.

```shell
java -jar iceberg-catalog-migrator-cli-0.0.1.jar migrate \
java -jar iceberg-catalog-migrator-cli-1.6.0.jar migrate \
--source-catalog-type HIVE \
--source-catalog-properties warehouse=/tmp/warehouse,type=hadoop \
--target-catalog-type NESSIE \
Expand Down
8 changes: 4 additions & 4 deletions iceberg-catalog-migrator/docs/getting-started.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -50,7 +50,7 @@ These commands:
3. Build the tool
4. Create a JAR file in `iceberg-catalog-migrator/cli/build/libs/` directory

The JAR file will be created with name `iceberg-catalog-migrator-cli-<version>.jar` where `<version>` is the version of the tool found in the `iceberg-catalog-migrator/version.txt` file. For the examples below, we will assume the version is `0.0.1-SNAPSHOT`, so the JAR file name will be `iceberg-catalog-migrator-cli-0.0.1-SNAPSHOT.jar`.
The JAR file will be created with name `iceberg-catalog-migrator-cli-<version>.jar` where `<version>` is the version of the tool found in the `iceberg-catalog-migrator/version.txt` file. For the examples below, we will assume the version is `1.6.0`, so the JAR file name will be `iceberg-catalog-migrator-cli-1.6.0.jar`.

### Step 2: Set the Object Storage Environment Variables
The tool will need access to the underlying object storage via environmental variables. For this example, we will use AWS S3 with an access key and id:
Expand Down Expand Up @@ -84,12 +84,12 @@ export TOKEN_TARGET=xxxxxxx
### Step 4: Validate the Migration
Execute the following command to understand how to migrate the tables:
```shell
java -jar ./cli/build/libs/iceberg-catalog-migrator-cli-0.0.1-SNAPSHOT.jar register -h
java -jar ./cli/build/libs/iceberg-catalog-migrator-cli-1.6.0.jar register -h
```

In the example, execute the following command to perform a dry run migration. This will not migrate the tables but will provide information on the operation:
```shell
java -jar ./cli/build/libs/iceberg-catalog-migrator-cli-0.0.1-SNAPSHOT.jar register \
java -jar ./cli/build/libs/iceberg-catalog-migrator-cli-1.6.0.jar register \
--source-catalog-type REST \
--source-catalog-properties uri=http://sourcecatalog:8181/api/catalog,warehouse=test,token=$TOKEN_SOURCE \
--target-catalog-type REST \
Expand All @@ -103,7 +103,7 @@ After validating all inputs, the console will display a list of table identifier

In the example, execute the following command to perform a migration:
```shell
java -jar ./cli/build/libs/iceberg-catalog-migrator-cli-0.0.1-SNAPSHOT.jar migrate \
java -jar ./cli/build/libs/iceberg-catalog-migrator-cli-1.6.0.jar migrate \
--source-catalog-type REST \
--source-catalog-properties uri=http://sourcecatalog:8181/api/catalog,warehouse=test,token=$TOKEN_SOURCE \
--target-catalog-type REST \
Expand Down
2 changes: 1 addition & 1 deletion iceberg-catalog-migrator/gradle/libs.versions.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ googleJavaFormat = "1.25.2"
guava = "33.4.0-jre"
hadoop = "3.4.1" # this is in mapping with iceberg repo.
hive = { strictly = "2.3.10"} # this is in mapping with iceberg repo.
iceberg = "1.10.0"
iceberg = "1.11.0"
immutables = "2.10.1"
jacoco = "0.8.12"
jandex = "3.2.3"
Expand Down
2 changes: 1 addition & 1 deletion iceberg-catalog-migrator/version.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1 +1 @@
0.0.1-SNAPSHOT
1.6.0