Update duckdb-rs to DuckDB v1.0.0 #336
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Closed
phillipleblanc
approved these changes
Jun 11, 2024
|
Is upgrading 1.0.0 necessary for using the delta and iceberg extensions from duckdb-rs? I'm having trouble loading them with the current release. |
Not sure about Iceberg, but Delta requires 0.10.3 or higher. This library currently points to 0.10.2. I originally raised this in #322. Hoping this PR makes it through soon 🙏 |
crates/libduckdb-sys/build.rs
Outdated
| @@ -160,7 +160,8 @@ mod build_bundled { | |||
| .flag_if_supported("-stdlib=libstdc++") | |||
| .flag_if_supported("/bigobj") | |||
| .warnings(false) | |||
| .flag_if_supported("-w"); | |||
| .flag_if_supported("-w") | |||
There was a problem hiding this comment.
@Mytherin would it be better to have the preprocessor definition under win_target alone after line 167 like below instead:
cfg.define("_DISABLE_CONSTEXPR_MUTEX_CONSTRUCTOR", None);
There was a problem hiding this comment.
@Mytherin It looks like we might need to pass the pre-processor definition for bindgen builder as well as it seem to use clang for building it at line 324.
bindgen::builder()
.trust_clang_mangling(false)
.clang_arg("/D_DISABLE_CONSTEXPR_MUTEX_CONSTRUCTOR=1")
.header(header.clone())
.parse_callbacks(Box::new(bindgen::CargoCallbacks::new()))
.generate()
.unwrap_or_else(|_| panic!("could not run bindgen on header {header}"))
.write(Box::new(&mut output))
.expect("could not write output of bindgen");
There was a problem hiding this comment.
@Mytherin It looks like latest version of runner seem to resolve the issue that we observe in Windows runner actions/runner-images#10004 (comment).
We could remove our patch from build.rs and re-try the pipeline.
Closed
Swoorup
reviewed
Jun 16, 2024
| @@ -1,6 +1,6 @@ | |||
| [package] | |||
| name = "duckdb" | |||
| version = "0.10.2" | |||
| version = "1.0.0" | |||
There was a problem hiding this comment.
If duckdb and libduckdb-sys share the same version, this can simply be defined in the root manifest.
Suggested change
| version = "1.0.0" | |
| version.workspace = true |
Swoorup
reviewed
Jun 16, 2024
| @@ -1,6 +1,6 @@ | |||
| [package] | |||
| name = "libduckdb-sys" | |||
| version = "0.10.2" | |||
| version = "1.0.0" | |||
There was a problem hiding this comment.
Same comment, could share the version from the root manifest.
Suggested change
| version = "1.0.0" | |
| version.workspace = true |
There was a problem hiding this comment.
When i tried this previously it didnt work due to the "publish crates" CI job not understanding workspace properties.
There was a problem hiding this comment.
https://github.com/duckdb/duckdb-rs/actions/runs/9369017132/job/25793098113
I ended up updating the action anyway so it might be fixed now idk.
There was a problem hiding this comment.
@Maxxen
Might have been fixed: katyo/publish-crates#669
Co-authored-by: Murali S <[email protected]>
|
Can this PR be merged? |
|
The CI is still broken unfortunately, which needs to be fixed before we can merge this |
|
I've disabled the Windows CI for now in the interest of getting this merged. I've looked at the bindgen errors and cannot make sense of them - I'm not sure that bindgen even supports Windows. |
robert3005
referenced
this pull request
in spiraldb/vortex
Jul 11, 2024
[](https://renovatebot.com) This PR contains the following updates: | Package | Type | Update | Change | |---|---|---|---| | [duckdb](https://togithub.com/wangfenjin/duckdb-rs) | workspace.dependencies | major | `0.10.2` -> `1.0.0` | --- ### Release Notes <details> <summary>wangfenjin/duckdb-rs (duckdb)</summary> ### [`v1.0.0`](https://togithub.com/duckdb/duckdb-rs/releases/tag/v1.0.0) [Compare Source](https://togithub.com/wangfenjin/duckdb-rs/compare/v0.10.2...v1.0.0) This release upgrades the shipped DuckDB to v1.0.0, in addition to a number of bug fixes. **Note**: The `httpfs` module that ships the `httpfs` extension is removed in this release. The `httpfs` extension can instead be used through DuckDB's native extension installation/loading mechanism. #### What's Changed - feat: support "large" arrow data types by [@​Mause](https://togithub.com/Mause) in [https://github.com/duckdb/duckdb-rs/pull/307](https://togithub.com/duckdb/duckdb-rs/pull/307) - Fixes the issue ignoring nulls when copy from arrow array to flat vector by [@​y-f-u](https://togithub.com/y-f-u) in [https://github.com/duckdb/duckdb-rs/pull/316](https://togithub.com/duckdb/duckdb-rs/pull/316) - change SQLite to DuckDB by [@​era127](https://togithub.com/era127) in [https://github.com/duckdb/duckdb-rs/pull/308](https://togithub.com/duckdb/duckdb-rs/pull/308) - Organise workspace crates and consolidate Cargo.toml manifest properties/dependencies by [@​Swoorup](https://togithub.com/Swoorup) in [https://github.com/duckdb/duckdb-rs/pull/285](https://togithub.com/duckdb/duckdb-rs/pull/285) - Update README.md by [@​yoonghm](https://togithub.com/yoonghm) in [https://github.com/duckdb/duckdb-rs/pull/242](https://togithub.com/duckdb/duckdb-rs/pull/242) - Add support for DuckDB arrays when using Arrow's FixedSizeList by [@​Jeadie](https://togithub.com/Jeadie) in [https://github.com/duckdb/duckdb-rs/pull/323](https://togithub.com/duckdb/duckdb-rs/pull/323) - Add support for BinaryArray in arrow-vtab by [@​phillipleblanc](https://togithub.com/phillipleblanc) in [https://github.com/duckdb/duckdb-rs/pull/324](https://togithub.com/duckdb/duckdb-rs/pull/324) - use openssl from runner by [@​Maxxen](https://togithub.com/Maxxen) in [https://github.com/duckdb/duckdb-rs/pull/327](https://togithub.com/duckdb/duckdb-rs/pull/327) - Add ability to pass vendored feature to openssl in libduckdb-sys by [@​muralisoundararajan](https://togithub.com/muralisoundararajan) in [https://github.com/duckdb/duckdb-rs/pull/321](https://togithub.com/duckdb/duckdb-rs/pull/321) - Implement appender for date/time types by [@​rijkvp](https://togithub.com/rijkvp) in [https://github.com/duckdb/duckdb-rs/pull/313](https://togithub.com/duckdb/duckdb-rs/pull/313) - Support decimal128 without casting to double by [@​Maxxen](https://togithub.com/Maxxen) in [https://github.com/duckdb/duckdb-rs/pull/328](https://togithub.com/duckdb/duckdb-rs/pull/328) - feat: experimental support for further nested types by [@​Mause](https://togithub.com/Mause) in [https://github.com/duckdb/duckdb-rs/pull/318](https://togithub.com/duckdb/duckdb-rs/pull/318) - upgrade arrow-rs to 52 by [@​Mause](https://togithub.com/Mause) in [https://github.com/duckdb/duckdb-rs/pull/332](https://togithub.com/duckdb/duckdb-rs/pull/332) - Expose the underlying schema of executed statement by [@​abhiaagarwal](https://togithub.com/abhiaagarwal) in [https://github.com/duckdb/duckdb-rs/pull/333](https://togithub.com/duckdb/duckdb-rs/pull/333) - Remove mut from raw_query by [@​rijkvp](https://togithub.com/rijkvp) in [https://github.com/duckdb/duckdb-rs/pull/339](https://togithub.com/duckdb/duckdb-rs/pull/339) - Support Arrow type `LargeUtf8`. by [@​Jeadie](https://togithub.com/Jeadie) in [https://github.com/duckdb/duckdb-rs/pull/341](https://togithub.com/duckdb/duckdb-rs/pull/341) - Update duckdb-rs to DuckDB v1.0.0 by [@​Mytherin](https://togithub.com/Mytherin) in [https://github.com/duckdb/duckdb-rs/pull/336](https://togithub.com/duckdb/duckdb-rs/pull/336) - fix: don't write files outside of `OUT_DIR` by [@​frectonz](https://togithub.com/frectonz) in [https://github.com/duckdb/duckdb-rs/pull/347](https://togithub.com/duckdb/duckdb-rs/pull/347) - Remove built-in HTTPFS extension and fix Windows CI by [@​Mytherin](https://togithub.com/Mytherin) in [https://github.com/duckdb/duckdb-rs/pull/353](https://togithub.com/duckdb/duckdb-rs/pull/353) - Upgrade duckdb-loadable-macros to 0.1.2 by [@​Mytherin](https://togithub.com/Mytherin) in [https://github.com/duckdb/duckdb-rs/pull/354](https://togithub.com/duckdb/duckdb-rs/pull/354) #### New Contributors - [@​y-f-u](https://togithub.com/y-f-u) made their first contribution in [https://github.com/duckdb/duckdb-rs/pull/316](https://togithub.com/duckdb/duckdb-rs/pull/316) - [@​era127](https://togithub.com/era127) made their first contribution in [https://github.com/duckdb/duckdb-rs/pull/308](https://togithub.com/duckdb/duckdb-rs/pull/308) - [@​muralisoundararajan](https://togithub.com/muralisoundararajan) made their first contribution in [https://github.com/duckdb/duckdb-rs/pull/321](https://togithub.com/duckdb/duckdb-rs/pull/321) - [@​rijkvp](https://togithub.com/rijkvp) made their first contribution in [https://github.com/duckdb/duckdb-rs/pull/313](https://togithub.com/duckdb/duckdb-rs/pull/313) - [@​abhiaagarwal](https://togithub.com/abhiaagarwal) made their first contribution in [https://github.com/duckdb/duckdb-rs/pull/333](https://togithub.com/duckdb/duckdb-rs/pull/333) - [@​frectonz](https://togithub.com/frectonz) made their first contribution in [https://github.com/duckdb/duckdb-rs/pull/347](https://togithub.com/duckdb/duckdb-rs/pull/347) **Full Changelog**: duckdb/duckdb-rs@v0.10.2...v1.0.0 </details> --- ### Configuration 📅 **Schedule**: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined). 🚦 **Automerge**: Disabled by config. Please merge this manually once you are satisfied. ♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox. 🔕 **Ignore**: Close this PR and you won't be reminded about this update again. --- - [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check this box --- This PR has been generated by [Mend Renovate](https://www.mend.io/free-developer-tools/renovate/). View repository job log [here](https://developer.mend.io/github/spiraldb/vortex). <!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzNy40MjUuMSIsInVwZGF0ZWRJblZlciI6IjM3LjQyNS4xIiwidGFyZ2V0QnJhbmNoIjoiZGV2ZWxvcCIsImxhYmVscyI6W119--> --------- Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com> Co-authored-by: Robert Kruszewski <[email protected]>
](https://renovatebot.com){kind=link}
This was referenced Jan 9, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
(Hopefully) includes a work-around for the broken github actions Windows runners (see actions/runner-images#10004)