51 Pull requests merged by 16 people

• [1.8.x] Core: Remove namespace/table/view HEAD endpoints from defaults (#12351)

  #12368 merged Feb 22, 2025

• API: Move Variant interfaces and serialized implementations to API

  #12374 merged Feb 21, 2025

• [1.7.x] Fix {LICENSE,NOTICE} for Spark Runtime

  #12355 merged Feb 21, 2025

• [1.7.x] Fix {LICENSE,NOTICE} for Azure Bundle

  #12361 merged Feb 21, 2025

• [1.7.x] Fix {LICENSE,NOTICE} for AWS Bundle

  #12360 merged Feb 21, 2025

• [1.7.x] Fix {LICENSE,NOTICE} for GCP Bundle

  #12359 merged Feb 21, 2025

• [1.7.x] Fix {LICENSE,NOTICE} for Flink Runtime

  #12358 merged Feb 21, 2025

• [1.7.x] Fix {LICENSE,NOTICE} for Kafka Connect Runtime

  #12353 merged Feb 21, 2025

• Nit: Remove additional 'Iceberg' in Puffin footer payload

  #12369 merged Feb 21, 2025

• Core: Remove namespace/table/view HEAD endpoints from defaults

  #12351 merged Feb 21, 2025

• [1.7.x] Bump Nessie to 0.120.5 to include updated License/Notice

  #12356 merged Feb 21, 2025

• API: Move variant to API and add extract expression

  #12304 merged Feb 21, 2025

• [1.7.x] Kafka: Pin Kafka-Connect version to fix integration tests

  #12354 merged Feb 20, 2025

• Core, Spark: Remove deprecated code for 1.9.0

  #12336 merged Feb 20, 2025

• Core: Handle partition evolution case in PartitionStatsUtil#computeStats

  #12137 merged Feb 20, 2025

• Core: Remove deprecated Util.blockLocations method and StructCopy class

  #12320 merged Feb 20, 2025

• Spark: Remove Spark 3.3 support

  #12279 merged Feb 20, 2025

• Bump versions in {LICENSE,NOTICE}

  #12337 merged Feb 20, 2025

• Parquet: Remove deprecated VectorizedReader.setRowGroupInfo and ParquetValueReader.setPageSource

  #12321 merged Feb 20, 2025

• [1.8.x] Build: Revert AWS SDK from 2.30.11 to 2.29.52

  #12339 merged Feb 20, 2025

• Spark 3.5: Fix Incorrect Spec Used With AddFiles Procedure

  #12319 merged Feb 19, 2025

• Docs: Add documentation for Rate limiting in Spark Structured Streaming

  #12217 merged Feb 19, 2025

• Docs: Fix link of catalog in terms.md

  #12326 merged Feb 19, 2025

• [1.8.x] Kafka: Pin Kafka-Connect version to fix integration tests

  #12341 merged Feb 19, 2025

• Kafka: Pin Kafka-Connect version to fix integration tests

  #12340 merged Feb 19, 2025

• [1.8.x] Parquet: Fix performance regression in reader init (#12305)

  #12338 merged Feb 19, 2025

• Checkstyle: Apply the same generic type naming rules to interfaces and classes

  #12333 merged Feb 19, 2025

• [1.8.x] Core: Adjust Jackson settings to handle large metadata json (#12224)

  #12330 merged Feb 19, 2025

• [1.8.x] Parquet: Fix performance regression in reader init (#12305)

  #12329 merged Feb 19, 2025

• Revert "Core: Serialize null when there is no current snapshot"

  #12312 merged Feb 19, 2025

• Fix: fix apache amoro ams doc pic ref

  #12332 merged Feb 19, 2025

• [1.8.x] Core: Fallback to GET requests for namespace/table/view exists checks

  #12328 merged Feb 19, 2025

• Core: Fallback to GET requests for namespace/table/view exists checks

  #12314 merged Feb 19, 2025

• [1.8.x] Revert "Core: Serialize null when there is no current snapshot"

  #12313 merged Feb 19, 2025

• Parquet: Fix performance regression in reader init

  #12305 merged Feb 19, 2025

• Docs: add apache amoro(incubating) with iceberg (#11965)

  #11966 merged Feb 19, 2025

• Parquet: Fix errorprone warning

  #12324 merged Feb 19, 2025

• Docs: Add rewrite-table-path in spark procedure

  #12115 merged Feb 19, 2025

• Parquet: Implement Variant readers

  #12139 merged Feb 18, 2025

• Docs: Refactor site navigation bar

  #12289 merged Feb 18, 2025

• Fix CI: Update tests with UnknownType from Required to Optional

  #12316 merged Feb 18, 2025

• Core: add variant type support

  #11831 merged Feb 18, 2025

• API: Fix TestInclusiveMetricsEvaluator notStartsWith tests

  #12303 merged Feb 18, 2025

• API: Reject unknown type for required fields and validate defaults

  #12302 merged Feb 18, 2025

• Core: Fix non-setting row-lineage from table properties on initial table creation

  #12307 merged Feb 18, 2025

• Build: Bump mkdocs-material from 9.6.3 to 9.6.4

  #12284 merged Feb 17, 2025

• OpenAPI: Add overwrite option when registering an iceberg table

  #12239 merged Feb 17, 2025

• Build: Bump software.amazon.awssdk:bom from 2.30.16 to 2.30.21

  #12286 merged Feb 17, 2025

• Build: Bump io.netty:netty-buffer from 4.1.117.Final to 4.1.118.Final

  #12287 merged Feb 17, 2025

• Spark 3.5: Fix job description of RewriteTablePathSparkAction

  #12282 merged Feb 17, 2025

• Build: Bump datamodel-code-generator from 0.27.2 to 0.28.1

  #12290 merged Feb 16, 2025

28 Pull requests opened by 20 people

• Docs: Add warning about `snapshot_ids` arg in `expired_snapshots` procedure

  #12291 opened Feb 16, 2025

• Replace usages of Aws4Signer with AwsV4HttpSigner in REST SigV4

  #12295 opened Feb 17, 2025

• Add properties support for HadoopTables.load() (#12251)

  #12296 opened Feb 17, 2025

• WIP: Interface based DataFile reader and writer API

  #12298 opened Feb 17, 2025

• AWS: Integrate S3 analytics accelerator library

  #12299 opened Feb 17, 2025

• Fix IndexOutOfBounds exception in FileFormat#fromFileName

  #12301 opened Feb 17, 2025

• Core: Interface changes for separating rewrite planner and runner

  #12306 opened Feb 18, 2025

• Path parameters should encode spaces as '%20' instead of '+'

  #12309 opened Feb 18, 2025

• API, Core: Update inclusive metrics evaluator for extract and transforms

  #12311 opened Feb 18, 2025

• Throw on `{write.folder-storage.path,write.object-storage.path}` properties

  #12315 opened Feb 18, 2025

• Wrap variant in PrimitiveHoder so serialization can result same instance

  #12317 opened Feb 18, 2025

• Core: Print un-pretty metadata files without whitespace

  #12318 opened Feb 18, 2025

• Use delimited column names in `CreateChangelogViewProcedure`

  #12322 opened Feb 18, 2025

• Parquet: Implement Variant writers

  #12323 opened Feb 18, 2025

• Spark: Infer partition spec in ADD_FILES procedure for FileTables than taking latest table spec

  #12327 opened Feb 19, 2025

• Spec: Add implementation note on `current-snapshot-id`

  #12334 opened Feb 19, 2025

• Core: Write `null` for `current-snapshot-id` for V3+

  #12335 opened Feb 19, 2025

• Docs: Add Stackable to the Vendors page

  #12344 opened Feb 19, 2025

• API, Core: Add geometry and geography types support

  #12346 opened Feb 20, 2025

• WIP Parquet: Support reading/writing geometry and geography columns

  #12347 opened Feb 20, 2025

• Build: remove Hadoop 2 dependency

  #12348 opened Feb 20, 2025

• Core: REST Catalog OAuth2 Support Refresh Token Flow

  #12362 opened Feb 20, 2025

• Fix versions in LICENSE/NOTICE

  #12364 opened Feb 21, 2025

• [1.8.x] Fix versions in LICENSE/NOTICE

  #12365 opened Feb 21, 2025

• Core: Apply correct metric configs in GenericAppenderFactory

  #12366 opened Feb 21, 2025

• AWS: fix GlueCatalog name validation

  #12367 opened Feb 21, 2025

• Docs: Fix lifecycle and versions in multi-engine-support

  #12370 opened Feb 21, 2025

• Handling no coordinator and data loss in current design in icr mode

  #12372 opened Feb 21, 2025

13 Issues closed by 5 people

• Do not override finalize

  #10901 closed Feb 20, 2025

• Partition spec mismatch when 'compatibility.snapshot-id-inheritance.enabled' is true

  #12273 closed Feb 19, 2025

• Nested column filter expression

  #12331 closed Feb 19, 2025

• Rest catalog: write.metadata.delete-after-commit set true not deleting expired metadata files

  #10894 closed Feb 19, 2025

• Some schema updates do not support dots inside a field name

  #10875 closed Feb 19, 2025

• Apache Flink not committing new snapshots to Iceberg Table

  #9089 closed Feb 18, 2025

• Incorrect Results and SIGSEGV on Read with Iceberg + PySpark + Nessie

  #12178 closed Feb 17, 2025

• Java doc link is not working

  #12166 closed Feb 17, 2025

• Field comments are not written for timestamp field

  #4212 closed Feb 17, 2025

• Define behavior of gc.enabled and location ownership

  #4159 closed Feb 17, 2025

• MERGE INTO TABLE is not supported temporarily.

  #10882 closed Feb 16, 2025

• Athena Iceberg does not delete orphan files

  #10878 closed Feb 16, 2025

• throw exception : InvalidOperationException(message:The following columns have types incompatible with the existing columns in their respective positions : idd1) when add column

  #3747 closed Feb 16, 2025

19 Issues opened by 16 people

• Iceberg 1.8.0 Breaking oauth2 authentication

  #12373 opened Feb 21, 2025

• Upgrading to iceberg 1.8.0 and spark 3.5.4 causes NoClassDefFoundError: org/apache/spark/sql/catalyst/expressions/AnsiCast

  #12371 opened Feb 21, 2025

• Spark Iceberg REST Catalog refresh token

  #12363 opened Feb 21, 2025

• Critical Warnings For Users of Iceberg Kafka Connect Need To Be Documented

  #12357 opened Feb 20, 2025

• Allow Custom Transactional ID in Iceberg Kafka Connect

  #12352 opened Feb 20, 2025

• How can we override auth.session-timeout-ms of catalog or avoid cache at all?

  #12350 opened Feb 20, 2025

• Add spark 4.0.0-preview2 support

  #12349 opened Feb 20, 2025

• does iceberg support spark connect ?

  #12345 opened Feb 20, 2025

• Limit the delete file/records

  #12343 opened Feb 19, 2025

• Add possibility of configuration for Coordinator and Worker prefix

  #12342 opened Feb 19, 2025

• Add option to provide partition spec in spark ADD_FILES procedure

  #12325 opened Feb 19, 2025

• Serialize `null` for `current-snapshot-id` when there is no current snapshot for ≥V3

  #12310 opened Feb 18, 2025

• Spaces in path parameters are encoded as '+' instead of '%20'

  #12308 opened Feb 18, 2025

• IndexOutOfBounds in FileFormat#fromFileName

  #12300 opened Feb 17, 2025

• Support for Identity Columns in Apache Iceberg

  #12297 opened Feb 17, 2025

• API to find out the number of datafiles deleted

  #12288 opened Feb 16, 2025

• REST API responses with Spark return status code 200 instead of 204

  #12283 opened Feb 16, 2025

• Print un-pretty metadata JSON files without whitespace

  #12281 opened Feb 15, 2025

• previous eq deletes handling on new write

  #12280 opened Feb 15, 2025

75 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• Add Variant custom logical type for Avro

  #12238 commented on Feb 22, 2025 • 19 new comments

• support create table like in flink catalog

  #12199 commented on Feb 21, 2025 • 16 new comments

• Data: Add partition stats writer and reader

  #11216 commented on Feb 20, 2025 • 14 new comments

• List data and metadata directories instead of table root

  #12278 commented on Feb 18, 2025 • 9 new comments

• Materialized View Spec

  #11041 commented on Feb 21, 2025 • 8 new comments

• Core,Api: Add overwrite option when register external table to catalog

  #12228 commented on Feb 21, 2025 • 6 new comments

• AWS, AZURE: Move docker-based tests to integration test source

  #12274 commented on Feb 19, 2025 • 4 new comments

• Spark: Detect dangling DVs properly

  #12270 commented on Feb 19, 2025 • 4 new comments

• S3: Disable strong integrity checksums

  #12264 commented on Feb 21, 2025 • 4 new comments

• Core,REST: extend httpClient builder to support tls factory

  #11979 commented on Feb 18, 2025 • 4 new comments

• Retry on NoSuchNamespaceException not found in rename table for rest catalog

  #12159 commented on Feb 18, 2025 • 3 new comments

• Auth Manager API part 6: API enablement

  #12197 commented on Feb 19, 2025 • 3 new comments

• Data: Handle case where partition location is missing for `TableMigrationUtil`

  #12212 commented on Feb 21, 2025 • 2 new comments

• Core: Fix failure when reading files table with branch

  #11719 commented on Feb 18, 2025 • 2 new comments

• Azure: Support vended credentials refresh in ADLSFileIO.

  #11577 commented on Feb 17, 2025 • 2 new comments

• Spec: Allow Equality Deletes with Row Lineage and Define Behavior

  #12230 commented on Feb 21, 2025 • 1 new comment

• Core: Extended header support for RESTClient implementations

  #12194 commented on Feb 19, 2025 • 1 new comment

• Remove deprecated `OBJECT_STORE_PATH ` and `WRITE_FOLDER_STORAGE_LOCATION `

  #12174 commented on Feb 18, 2025 • 1 new comment

• Spec additions for encryption

  #12162 commented on Feb 17, 2025 • 1 new comment

• Spark: Rewrite V2 deletes to V3 DVs

  #12250 commented on Feb 19, 2025 • 1 new comment

• Use Snapshot's statistics file in SparkScan

  #11040 commented on Feb 21, 2025 • 1 new comment

• Core: HadoopFileIO to support bulk delete through the Hadoop Filesystem APIs

  #10233 commented on Feb 17, 2025 • 1 new comment

• Arrow, Parquet, Spark 3.5, Flink 1.20: Avoid deprecated method

  #11874 commented on Feb 20, 2025 • 1 new comment

• Purge RCK test entries in `afterEach` instead of `beforeEach`

  #11699 commented on Feb 18, 2025 • 0 new comments

• Core: Expose `added_rows_count`, `existing_rows_count` and `deleted_rows_count` fields in all_manifests and manifests tables

  #11679 commented on Feb 17, 2025 • 0 new comments

• Spark 3.5: Add query runner in test module

  #11758 commented on Feb 17, 2025 • 0 new comments

• Kafka Connect: Add the configuration option to provide a transactional id prefix to use

  #11780 commented on Feb 19, 2025 • 0 new comments

• Fix comment on `WRITE_OBJECT_STORE_PARTITIONED_PATHS` table property

  #11798 commented on Feb 18, 2025 • 0 new comments

• [Core] Support Truncate(0) for metrics

  #11905 commented on Feb 16, 2025 • 0 new comments

• AWS: Add support for enabling access to S3 Requester Pays bucket

  #11915 commented on Feb 22, 2025 • 0 new comments

• Kafka Connect: Add SMTs for Debezium and AWS DMS

  #11936 commented on Feb 18, 2025 • 0 new comments

• Core: Refactor Table Metadata Tests

  #11947 commented on Feb 21, 2025 • 0 new comments

• Core: Properly detect metadata tables

  #11963 commented on Feb 17, 2025 • 0 new comments

• Spark3.5: Standardizing Error Handling in Iceberg Spark Module - TestViews

  #11993 commented on Feb 22, 2025 • 0 new comments

• Core, Test: Parsing and Writing Tests for V3 Metadata

  #12025 commented on Feb 22, 2025 • 0 new comments

• Spark: Support singular form of years, months, days, and hours functions

  #12117 commented on Feb 18, 2025 • 0 new comments

• Core: Remove duplicate definitions of MAX_FILE_GROUP_SIZE_BYTES

  #12222 commented on Feb 19, 2025 • 0 new comments

• SPARK: Remove dependency on hadoop's filesystem class from remove orphan files

  #12254 commented on Feb 20, 2025 • 0 new comments

• Spark: support rewrite on specified target branch

  #12257 commented on Feb 18, 2025 • 0 new comments

• Spark: Structured Streaming read limit support follow-up

  #12260 commented on Feb 18, 2025 • 0 new comments

• Core: Set missing table-default property in RESTSessionCatalog

  #11646 commented on Feb 17, 2025 • 0 new comments

• Proxy Settings for catalog REST API client

  #12059 commented on Feb 18, 2025 • 0 new comments

• UpdateSchema.add_column doesn't support adding parent and child in the same transaction

  #12223 commented on Feb 18, 2025 • 0 new comments

• Move docker-specific tests to integrationTest configuration

  #12236 commented on Feb 18, 2025 • 0 new comments

• It's not possible to readStream from an Iceberg table as source when its snapshots expire

  #9504 commented on Feb 18, 2025 • 0 new comments

• After WRITE ORDERED BY is set in the Iceberg table, Spark will generate an additional layer of Job tasks and no shuffle is generated. Is this a bug?

  #12268 commented on Feb 17, 2025 • 0 new comments

• Long-running Spark rewrite Files Action may lead to OutOfMemoryError

  #11277 commented on Feb 17, 2025 • 0 new comments

• Spark aggreation by partition could use metadata files

  #11394 commented on Feb 17, 2025 • 0 new comments

• Iceberg parallel writes failing - "An error occurred while calling o213.append"

  #11426 commented on Feb 17, 2025 • 0 new comments

• Does iceberg support "Predicate Pushdown" when spark read data from it?

  #11617 commented on Feb 17, 2025 • 0 new comments

• Questions of using flink to update iceberg table partial columns and delete

  #11720 commented on Feb 17, 2025 • 0 new comments

• Subfolder with no name under /data folder

  #12065 commented on Feb 17, 2025 • 0 new comments

• java.lang.IllegalStateException: Connection pool shut down when close FileAppender.

  #12114 commented on Feb 17, 2025 • 0 new comments

• Flaky test `TestFlinkTableSink > testInsertFromSourceTable`

  #11833 commented on Feb 17, 2025 • 0 new comments

• Add aliyun-bundle jar

  #10970 commented on Feb 17, 2025 • 0 new comments

• Does iceberg has plan to support Json Type?

  #6467 commented on Feb 17, 2025 • 0 new comments

• Problems using rewriteTablePath action on local filesystem tables

  #12277 commented on Feb 16, 2025 • 0 new comments

• Specify in lower/upper bounds in data_file struct are exact

  #10930 commented on Feb 16, 2025 • 0 new comments

• Core, Rest: Enable useSystemProperties on RESTClient

  #11548 commented on Feb 19, 2025 • 0 new comments

• Spark: add property to disable client-side purging in spark

  #11317 commented on Feb 21, 2025 • 0 new comments

• API: Define RepairManifests action interface

  #10784 commented on Feb 22, 2025 • 0 new comments

• Core: Add KLL Datasketch as standard blob types to puffin file

  #8202 commented on Feb 20, 2025 • 0 new comments

• [REST Catalog] OAuth 2 grant type "refresh_token" not implemented

  #12196 commented on Feb 21, 2025 • 0 new comments

• Cherrypick the data rows [deleted or old values] from a past snapshot

  #12271 commented on Feb 21, 2025 • 0 new comments

• Allow to configure the tables' namespace when using dynamic routing with Kafka Connect

  #12269 commented on Feb 21, 2025 • 0 new comments

• Update Table Error: UPDATE TABLE is not supported temporarily.

  #9960 commented on Feb 21, 2025 • 0 new comments

• TestS3FileIO fails locally (on OSX with Docker Desktop) due to missing Content-MD5 header during delete

  #12237 commented on Feb 21, 2025 • 0 new comments

• Support row filter & column masking in REST spec

  #10909 commented on Feb 21, 2025 • 0 new comments

• Extends Iceberg table stats API to allow publish data and stats atomically

  #6442 commented on Feb 21, 2025 • 0 new comments

• RewriteDataFiles maintenance action never converges

  #6669 commented on Feb 20, 2025 • 0 new comments

• MERGE INTO requires sorting in already sorted iceberg tables

  #10891 commented on Feb 19, 2025 • 0 new comments

• JdbcCatalog fails to initialize with MS SQL Server

  #10068 commented on Feb 19, 2025 • 0 new comments

• Support for Shallow Clone / Zero Copy Cloning in Apache Iceberg

  #12263 commented on Feb 19, 2025 • 0 new comments

• Add properties support for HadoopTables.load()

  #12251 commented on Feb 19, 2025 • 0 new comments

• deadlock when spark call delete row postition

  #10987 commented on Feb 19, 2025 • 0 new comments