Data Platform Technology Stack

Technologies I use to design modern lakehouse platforms, distributed data systems, streaming pipelines, and AI-ready analytics architectures.

Data Sources

PostgreSQL

APIs

Files / Storage

Streaming & Event Systems

Kafka

Google Pub/Sub

Azure Event Hub

Data Ingestion

Apache Airflow

Azure Data Factory

Databricks Auto Loader

Data Processing

Apache Spark

Databricks

Python

SQL

Lakehouse & Warehousing

Delta Lake

Snowflake

dbt

Microsoft Fabric

Serving & Analytics

Power BI

Machine Learning

Knowledge Graph (Neo4j)

Vector Database

Platform Engineering

Docker

Kubernetes

Azure

Google Cloud