iceberg

PyIceberg

This repository has moved into https://github.com/dbt-labs/dbt-adapters

Example code for running Spark and Hive jobs on EMR Serverless.

Modern serverless lakehouse implementing HOOK methodology, Unified Star Schema (USS), and Analytical Data Storage System (ADSS) principles on Adventure Works. Features programmatic model generation, event-enhanced Puppini bridges, and temporal resolution across DAS/DAB/DAR layers.

🦖 A SQL-on-everything Query Engine you can execute over multiple databases and file formats. Query your data, where it lives.

Billion-scale embedded vector database built entirely on Parquet and Arrow.

100+ data engineering projects from scratch — streaming, CDC, table formats, query engines, consensus, governance. 2,500+ tests, mypy strict.

Feature demos, integration guides & hands-on labs/projects using Kpow, Flex, Kafka, Flink, Iceberg & more

Lakevision is a tool which provides insights into your Apache Iceberg based Data Lakehouse.

End-to-end retail banking Lakehouse for Customer 360, segmentation, churn analytics, and cross-sell campaigns using Spark, Iceberg, MinIO, Trino, Airflow, and Docker Compose.

An end-to-end open-source data stack for crawling and visualizing real estate data, facilitating insights into market trends.

An Iceberg destination for DLT that supports REST catalogs

Execute SQL queries and manage databases seamlessly with Timeplus. Leverage powerful tools to interact with your data, Kafka topics, and Iceberg tables efficiently. Enhance your data workflows with a user-friendly interface and robust backend capabilities.

An end-to-end AWS data lakehouse leveraging batch data processing, big data technologies, and advanced business analytics.

Metadata-driven ETL framework for portable data pipelines across Polars, Spark, Fabric, Databricks, and AWS.

Demo of a semantic lakehouse on AWS using Agentcore and Iceberg

Python toolkit for working with Ducklake

Stream the data changes from Postgres to Iceberg tables

Production-shaped AWS lakehouse monorepo with contract-driven ingestion, EMR Serverless, Iceberg, Athena, dbt, Airflow, and GPU document OCR.