Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Functionality to Read Table Metadata Path from Iceberg REST Catalog #92

Open
wants to merge 15 commits into
base: main
Choose a base branch
from

Conversation

gianhiltbrunner
Copy link

@gianhiltbrunner gianhiltbrunner commented Jan 3, 2025

This PR introduces the ability to read the Iceberg table metadata path from an Iceberg REST catalog as discussed in #16. One example is the following query.

SELECT count(*) FROM ICEBERG_SCAN('test_table', catalog_type='rest', catalog_uri='127.0.0.1:8181', catalog_namespace='default');

The IcebergSnapshot::GetMetaDataPath method has been updated to fetch the metadata location from the appropriate REST endpoint, as specified in the Iceberg REST Catalog Open API Spec. (GET /v1/{prefix}/namespaces/{namespace}/tables/{table} in https://github.com/apache/iceberg/blob/main/open-api/rest-catalog-open-api.yaml).

These changes are tested using the existing REST catalog setup.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant