Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

iceberg metadata is not refreshed after DROP & CREATE again #54786

Open
jason-heo opened this issue Jan 7, 2025 · 1 comment · May be fixed by #54915
Open

iceberg metadata is not refreshed after DROP & CREATE again #54786

jason-heo opened this issue Jan 7, 2025 · 1 comment · May be fixed by #54915
Labels
type/bug Something isn't working

Comments

@jason-heo
Copy link

Steps to reproduce the behavior (Required)

  • CREATE CATALOG
    CREATE EXTERNAL CATALOG iceberg
    PROPERTIES
    (
        "type" = "iceberg",
        "iceberg.catalog.type" = "hadoop",
        "iceberg.catalog.warehouse" = "hdfs://namenode/path/to/iceberg/"
    );
    
    SET CATALOG iceberg;
    
    CREATE DATABASE db1;
    
    USE db1;
    
  • CREATE -> INSERT -> SELECT: OK
    CREATE TABLE member
    (
      name STRING
    );
    
    INSERT INTO member VALUES ('Kim');
    
    SELECT * FROM member;
    +------+
    | name |
    +------+
    | Kim  |
    +------+
    
  • DROP -> CREATE: ERROR (table has old schema)
    DROP TABLE member;
    
    CREATE TABLE member
    (
      address STRING -- address column added rather than name
    );
    
    DESC member;
    +-------+---------------------+------+-------+---------+-------+---------+
    | Field | Type                | Null | Key   | Default | Extra | Comment |
    +-------+---------------------+------+-------+---------+-------+---------+
    | name  | VARCHAR(1073741824) | Yes  | false | NULL    |       | NULL    |
    +-------+---------------------+------+-------+---------+-------+---------+
    
  • INSERT -> SELECT: ERROR (old data is retrieved)
    INSERT INTO member VALUES ('Earth');
    
    SELECT * FROM member;
    +------+
    | name |
    +------+
    | Kim  | <= invalid data
    +------+
    

Expected behavior (Required)

new schema and new data should be shown

Real behavior (Required)

old schema and old data is printed.

REFRESH EXTERNAL TABLE <tab-name> doesn't solved this problem.

StarRocks version (Required)

mysql> SELECT CURRENT_VERSION();
+-------------------+
| current_version() |
+-------------------+
| 3.3.5-6d81f75     |
+-------------------+
@jason-heo jason-heo added the type/bug Something isn't working label Jan 7, 2025
@DorianZheng
Copy link
Contributor

@jason-heo Thank you for filing this issue. We will try to reproduce this issue and reach out to you ASAP.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type/bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants