Releases: linktimecloud/kubernetes-data-platform
Releases · linktimecloud/kubernetes-data-platform
v1.2.2
Changelog
New Features
- d19b65c: [Backporting] Feat: hue reloader when hive-server config change (#177) (@stdnt-xiao)
Other work
- 2ce3372: Chore: bump KDP to v1.2.2 (@jason-ltc)
Full Changelog: v1.2.1...v1.2.2
Contributors
stdnt-xiao and jason-ltc
Assets 11
v1.2.1
Changelog
New Features
- 72fa625: [Backporting] Feat: Hive supports dynamic configuration of authentication modes (#176) (@stdnt-xiao)
Other work
- 71e6db0: Chore: bump KDP to v1.2.1 (@jason-ltc)
Full Changelog: v1.2.0...v1.2.1
Contributors
stdnt-xiao and jason-ltc
Assets 11
v1.3-alpha.0
What's Changed
- Docs: fix milvus readme by @hakeedra in #163
- Docs: fix user tutorials docs by @xingcan-ltc in #164
- Fix: scale ck memory limit to 8192Mi by @qq157755587 in #165
- Chore: (deps): Bump actions/setup-go from 5.0.1 to 5.0.2 by @dependabot in #169
- Feat: add Ollama app by @xingcan-ltc in #149
- Feat: Add jupyterlab app by @hakeedra in #159
- Feat: add elasticsearch app by @xingcan-ltc in #171
- Feat: Add llm rag guide by @qq157755587 in #170
Full Changelog: v1.2.0...v1.3-alpha.0
Contributors
qq157755587, hakeedra, and 2 other contributors
Assets 11
v1.2.0
Highlights
New features
- Integration of JuiceFS S3 gateway to achieve the architecture of compute-storage separation.
- Integration of Iceberg on Hive/Spark/Flink to build data lakehouse on KDP.
- Integration of the high-performance vector database Milvus with Airbyte to build RAG + LLM systems on KDP.
Documentation
What's Changed
- Fix: update mysql innodb_buffer_pool_size to reasonable range by @harlee-x in #85
- Fix: incorrect default DS url of Grafana by @jason-ltc in #86
- Fix: fix clickhouse parameters and dashboard by @qq157755587 in #91
- Chore: update superset airbyte apps image registry by @xingcan-ltc in #90
- Chore: change the folder path of tutorial images by @xingcan-ltc in #95
- Feat: add a startup probe for StreamPark in case it takes a long time… by @xingcan-ltc in #94
- Fix: Control The mysql mode cannot be changed after installation by @harlee-x in #99
- Fix: airflow db initialization (#98) by @hakeedra in #101
- Chore: format airflow cue def by @xingcan-ltc in #104
- Docs: Add tutorials of KDP installation on main stream Kubernetes management platforms by @jason-ltc in #102
- Fix: handling the issue of context lifecycle being inconsistent with … by @harlee-x in #106
- Feat(airflow): use kubernetes_executor as airflow default executor, use git sync dags and add tutorials by @xingcan-ltc in #113
- Fix(ingress): remove ingress trait parameter ingressClassName, use k8s default class by @xingcan-ltc in #111
- Chore: (deps): Bump docker/login-action from 3.1.0 to 3.2.0 by @dependabot in #114
- Chore: use the open-source Airflow Helm chart and update the web server launch arguments to decrease memory usage by @xingcan-ltc in #116
- Fix: delete nil for architecture list by @harlee-x in #119
- Fix: deal with resource ownerReferences (#121) by @harlee-x in #122
- Fix: Remove context setting when uninstalling the httpfs app (#120) by @xingcan-ltc in #123
- Chore: (deps): Bump goreleaser/goreleaser-action from 5.1.0 to 6.0.0 by @dependabot in #127
- Chore: (deps): Bump golang.org/x/crypto from 0.23.0 to 0.24.0 by @dependabot in #128
- Docs: Visualization Analysis of Taobao Maternal and Infant Shopping Data by @xingcan-ltc in #129
- Chore: (deps): Bump docker/build-push-action from 5.3.0 to 5.4.0 by @dependabot in #133
- Chore: (deps): Bump github.com/spf13/cobra from 1.8.0 to 1.8.1 by @dependabot in #132
- Docs: Add real time increment data analysis docs by @hakeedra in #131
- Chore: (deps): Bump docker/build-push-action from 5.4.0 to 6.1.0 by @dependabot in #136
- Feat: add ttlSecondsAfterFinished for hms job by @qq157755587 in #138
- Chore: (deps): Bump docker/build-push-action from 6.1.0 to 6.2.0 by @dependabot in #144
- Feat: add juicefs s3 gateway app by @xingcan-ltc in #140
- Feat(hue): Add a switch to enable/disable HDFS file browsing by @xingcan-ltc in #141
- Feat: Add Iceberg Support by @qq157755587 in #145
- Feat: Add milvus by @hakeedra in #142
- Fix: update cloudtty ingress object works with different ingress cont… by @harlee-x in #147
- Docs: fix juicefs docs by @xingcan-ltc in #148
- Fix: deal with the web terminal entry is restored to the original state (#150) by @harlee-x in #155
- Docs: fix juicefs doc typo by @xingcan-ltc in #157
- Fix: add policies enable parameter by @harlee-x in #156
- Chore: (deps): Bump golang.org/x/crypto from 0.24.0 to 0.25.0 by @dependabot in #154
- Chore: (deps): Bump docker/setup-qemu-action from 3.0.0 to 3.1.0 by @dependabot in #151
- Chore: (deps): Bump docker/setup-buildx-action from 3.3.0 to 3.4.0 by @dependabot in #152
- Chore: (deps): Bump docker/build-push-action from 6.2.0 to 6.3.0 by @dependabot in #153
- Fix: milvus readme and dependences configuration by @hakeedra in #158
- Fix: user-tutorials doc of real-time incremental data analysis by @hakeedra in #160
- Docs: Add KDP offline install docs by @stdnt-xiao in #135
- Fix: fix metadata of iceberg related images by @qq157755587 in #161
- Fix: deal with job container creating by @harlee-x in #166
New Contributors
- @stdnt-xiao made their first contribution in #135
Full Changelog: v1.1.4...v1.2.0
Contributors
qq157755587, stdnt-xiao, and 5 other contributors
Assets 11
v1.1.4
Changelog
Bug fixes
- e415f39: Fix: update cloudtty ingress object works with different ingress controllers (#146) (@harlee-x)
Documentation updates
- 458f843: Docs: fix typo in rancher tutorial zh (@jason-ltc)
Full Changelog: v1.1.3...v1.1.4
Contributors
harlee-x and jason-ltc
Assets 11
v1.1.3
Changelog
Bug fixes
- 0a9666c: Fix: add ttlSecondsAfterFinished for hms job (#137) (@qq157755587)
Documentation updates
- 77a2b75: Docs: add links for new tutorials of data pipelines (@jason-ltc)
- 5d84523: Docs: fixed typo in tutorial TOC (@jason-ltc)
Full Changelog: v1.1.2...v1.1.3
Contributors
qq157755587 and jason-ltc
Assets 11
v1.1.2
Contributors
hakeedra and xingcan-hu
Assets 11
v1.1.1
Changelog
Bug fixes
- 572b93f: Fix: Remove context setting when uninstalling the httpfs app (#120) (@xingcan-ltc)
- 05a9c29: Fix: deal with resource ownerReferences (#121) (@harlee-x)
- 7003e63: Fix: delete nil for mysql architecture list (#118) (@harlee-x)
Other work
- c70cb3b: Chore: Airflow use the open-source chart and update the web server launch arguments to decrease memory usage (#116) (#117) (@xingcan-ltc)
- 1610693: Chore: bump KDP CLI install tag to v1.1.1 (#126) (@harlee-x)
- 6d46bba: Chore: bump kdp image tag to v1.1.1 (#124) (@harlee-x)
Full Changelog: v1.1.0...v1.1.1
Contributors
harlee-x and xingcan-hu
Assets 11
v1.1.0
Release Notes
We are happy to announce v1.1.0 GA now! 🎉🤗🍺
Highlights
New features
- Cloud Shell: cloudtty has been integrated into KDP now. Users may open a web terminal for either a kubectl shell or a container shell. It brings more flexbility and scalability for users to use KDP in Day2 operations, such as applying/watching custom resources like Spark/Flink applications, debugging, and container-level file uploading/downloading etc.
New catalogs
We've integrated new mainstream open-source catalogs in the DataOps field. Users may explore own data and set up own data pipelines with those DataOps tools.
- Airbyte: Airbyte is an open-source data movement infrastructure for building extract and load (EL) data pipelines. It is designed for versatility, scalability, and ease-of-use.
- Apache Airflow: Airflow™ is a platform created by the community to programmatically author, schedule and monitor workflows.
- Apache Superset: Superset is fast, lightweight, intuitive, and loaded with options that make it easy for users of all skill sets to explore and visualize their data, from simple line charts to highly detailed geospatial charts.
- ClickHouse: ClickHouse is a high-performance, column-oriented SQL database management system (DBMS) for online analytical processing (OLAP).
New tutorials:
- Day1(KDP infrastructure installation)
- Day2(Data integration and development)
Changelog
New Features
- 5f0a57a: Feat: Add Airflow App (#80) (@hakeedra)
- 48351d1: Feat: Airflow uses kubernetes_executor as default executor, git sync dags and add tutorials (#109) (@xingcan-ltc)
- 2ec22b9: Feat: add a startup probe for StreamPark in case it takes a long time to launch (#93) (@xingcan-ltc)
- a464f87: Feat: add airbyte app (#71) (@xingcan-ltc)
- 4ff2106: Feat: add catalog clickhouse (#64) (@qq157755587)
- faefbc9: Feat: add ingress for clickhouse (#75) (@qq157755587)
- 5d5d812: Feat: add superset app (#69) (@xingcan-ltc)
- 9a3b9e1: Feat: add web terminal (#44) (@harlee-x)
- 30a8b90: Feat: bumping kdp CLI version to v1.1.0 (@jason-ltc)
- 79dc86d: Feat: bumping kdp image tag to v1.1.0 (@jason-ltc)
- b47eaff: Feat: bumping kdp-core sub-components to v1.1.0 (#81) (@harlee-x)
- 4424181: Feat: integration with mainstream K8s distributions (#70) (@jason-ltc)
- d81cf45: Feat: kdp built-in grafana integration with external prometheus datasource (@jason-ltc)
Bug fixes
- 642e91c: Fix(cherry-pick #99): mysql arch should not be able to change after installation (#105) (@harlee-x)
- c12c46e: Fix: Fixed link text color (#29) (@harlee-x)
- 204bc78: Fix: add missing k8s resources for hue and streampark (#54) (#55) (@xingcan-ltc)
- 2520904: Fix: airflow db initialization (#98) (@hakeedra)
- cda991c: Fix: delete loki grafana operator (#82) (@harlee-x)
- c25e902: Fix: fix clickhouse parameters and dashboard (#88) (@qq157755587)
- c64da64: Fix: handling the issue of context lifecycle being inconsistent with the application (#108) (@harlee-x)
- c177fc9: Fix: improved installation stability on poor disk I/O performance environment (#53) (@jason-ltc)
- 721119a: Fix: incorrect default DS url of Grafana (#86) (@jason-ltc)
- 85ec1e1: Fix: oam-operator controller/apiserver image repository does not match (#43) (@andymaltcx)
- 85fdae5: Fix: oam-operator image.repository name (#40) (@andymaltcx)
- 9d1b18d: Fix: oam-operator registry url incorrect (#38) (@andymaltcx)
- 11343da: Fix: remove hdfs deprecated proxyuser (#48) (#51) (@qq157755587)
- 83a893e: Fix: remove ingress trait parameter ingressClassName, use k8s default class (#110) (@xingcan-ltc)
- e425d09: Fix: remove zk/hive/spark raw type (#47) (#50) (@qq157755587)
- eb84670: Fix: removed kdpVersion param in infra/kdp-core (@jason-ltc)
- f02b53f: Fix: removed problematic parameter when install vela (#59) (@jason-ltc)
- a51860e: Fix: tuning startupProbe failureThreshold on poor I/O env (#63) (@jason-ltc)
- 9948a4d: Fix: update mysql innodb_buffer_pool_size to reasonable range (#85) (#87) (@harlee-x)
- 695d9ec: Fix: update mysql parameters auth.password and fix regex (#79) (@xingcan-ltc)
- 321d085: Refactor: improved hms-admin-cfg string format (#56) (#57) (@qq157755587)
Documentation updates
- c0907ec: Docs: Add tutorials of KDP installation on main stream Kubernetes management platforms (#102) (@jason-ltc)
- b066cc7: Docs: Correct the position of "Flink on Hive" in the document (#34) (@qq157755587)
- a35c603: Docs: Exploring data using airbyte, clickhouse and superset (#76) (@xingcan-ltc)
- 000b3b1: Docs: Fix relative links in tutorials (#45) (@qq157755587)
- 8f502b5: Docs: add community chat group info in README (@jason-ltc)
- 098d00d: Docs: add flag description to spark-distcp tutorial (#83) (@qq157755587)
- 2b553a4: Docs: add hdfs to hdfs tutorial (#74) (@qq157755587)
- e85f1d6: Docs: improved quick start docs (@jason-ltc)
- 0763371: Docs: update domain resolution description in readme (@jason-ltc)
- 3d5c00d: Docs: update flink and streampark docs (#33) (@xingcan-ltc)
Build process updates
- 7757903: CI: add action for closing inactive issues (@jason-ltc)
- d301c44: CI: remove unused function to fix static check (@jason-ltc)
Other work
- 43074ae: Chore: (deps): Bump actions/setup-go from 5.0.0 to 5.0.1 (#62) (@dependabot[bot])
- fb2647d: Chore: (deps): Bump actions/stale from 5 to 9 (#49) (@dependabot[bot])
- 2e2f74d: Chore: (deps): Bump docker/setup-buildx-action from 3.2.0 to 3.3.0 (#27) (@dependabot[bot])
- 2ae5bbe: Chore: (deps): Bump golang.org/x/crypto from 0.21.0 to 0.22.0 (#26) (@dependabot[bot])
- ce6c28a: Chore: (deps): Bump golang.org/x/crypto from 0.22.0 to 0.23.0 (#68) (@dependabot[bot])
- c70fb97: Chore: (deps): Bump golang.org/x/net from 0.22.0 to 0.23.0 (#52) (@dependabot[bot])
- 7a6d49e: Chore: (deps): Bump golangci/golangci-lint-action from 4.0.0 to 5.3.0 (#61) (@dependabot[bot])
- c57b3ce: Chore: (deps): Bump golangci/golangci-lint-action from 5.3.0 to 6.0.1 (#67) (@dependabot[bot])
- c799819: Chore: (deps): Bump goreleaser/goreleaser-action from 5.0.0 to 5.1.0 (#66) (@dependabot[bot])
- c926de4: Chore: change the folder path of tutorial images (#92) (@xingcan-ltc)
- 6e2f8c7: Chore: format airflow cue def (#103) (@xingcan-ltc)
- 843f2a4: Chore: update image registry of airbyte/superset (#89) (@xingcan-ltc)
- 948d954: Dcos: fix flink doc typo (#41) (@xingcan-ltc)
- 3b060a0: Fix kafka integration doc (#73) (@hakeedra)
- c41c255: add missing env parameters for airbyte (#84) (@xingcan-ltc)
Full Changelog: v1.0.0-rc3...v1.1.0
Contributors
qq157755587, harlee-x, and 5 other contributors
Assets 11
v1.0.2
Changelog
Bug fixes
- 5369dcf: Fix: removed problematic parameter when install vela (#59) (@jason-ltc)
- 000ad1f: Refactor: improved hms-admin-cfg string format (#56) (@qq157755587)
Other work
- 20d6da4: Chore: bumping CLI default ref to v1.0.2 (@jason-ltc)
Full Changelog: v1.0.1...v1.0.2
Contributors
qq157755587 and jason-ltc