v0.1.2

[thtmnisamnstr]

V0.1.2 - Current status -- what works and what doesn't

What works? 🚀

rtdl's initial feature set is built and working. You can use the API on port 80 to
configure streams that ingest json from an rtdl endpoint on port 8080, process them into Parquet,
and save the files to a destination configured in your stream. rtdl can write files locally, to
HDFS, to AWS S3, GCP Cloud Storage, and Azure Blob Storage and you can query your data via Dremio's
web UI at http://localhost:9047 (login with Username: rtdl and Password rtdl1234).

What's new? 💥

• Added HDFS support.
• Added AWS Glue support.
• Added Snowflake External Tables support.

What doesn't work/what's next on the roadmap? 🚴🏼

• Community contribution: Stateful Function for PII detection and masking.
• Move stream configurations to JSON files instead of SQL.
• git integration for stream configurations.
• Research and implementation for Apache Hudi, Apache Iceberg, Delta Lake, and Project Nessie.
• Graphical user interface.
• Dremio Cloud support.

---

This discussion was created from the release v0.1.2.