|
|
|
|
|
|
|
|
|
|
🟤 Bronze |
➡️ |
⚪ Silver |
➡️ |
🟡 Gold |
|
Production-grade Databricks Asset Bundle deployment with automated CI/CD pipelines across dev/staging/prod environments.
⭐ Highlights: Multi-environment deployment, automated testing, asset bundle best practices |
End-to-end Infrastructure-as-Code for Azure data platform with private networking, security controls, and automated provisioning.
⭐ Highlights: Private endpoints, RBAC, modular Terraform, state management |
|
Multi-environment (dev/prod) Lakehouse pipeline with automated deployment, Delta Lake transformations, and data quality checks.
⭐ Highlights: Medallion architecture, environment promotion, automated deployment |
Large-scale e-commerce data processing pipeline with Silver/Gold zone transformations and business analytics layer.
⭐ Highlights: Complex transformations, aggregation pipelines, analytics-ready output |
|
Medallion architecture pipeline for retail analytics with automated data quality checks and business KPI generation.
⭐ Highlights: Domain-specific modeling, data quality framework, retail KPIs |
Reusable Terraform modules for cloud infrastructure provisioning across AWS and Azure with best practices.
⭐ Highlights: Modular design, multi-cloud support, production-ready templates |
Data Platform Architecture ████████████████████ Expert
Databricks & Spark ████████████████████ Expert
Delta Lake & Lakehouse ███████████████████░ Advanced
Terraform & IaC ███████████████████░ Advanced
Azure Cloud Services ████████████████████ Expert
CI/CD & DevOps ██████████████████░░ Advanced
Data Modeling (Star/Snow) ██████████████████░░ Advanced
Python & PySpark ████████████████████ Expert
Data Quality Engineering █████████████████░░░ Advanced
Streaming (Kafka/Event Hub) ████████████████░░░░ Proficient
name: Hridoy Khan
role: Senior Data Engineer
location: Bangladesh
focus: Enterprise Lakehouse Platforms & Cloud Data Architecture
experience:
- Building production-grade data pipelines processing millions of records daily
- Designing multi-environment Lakehouse architectures (Bronze → Silver → Gold)
- Automating cloud infrastructure with Terraform & Databricks Asset Bundles
- Implementing DataOps practices with CI/CD, testing, and monitoring
currently_building: "Multi-cloud Lakehouse platforms with Databricks & Delta Lake"
learning: "Apache Iceberg, dbt, Kafka Streams, Data Mesh patterns"
passionate_about: "Data quality engineering, platform reliability, DataOps"I'm open to collaborating on data engineering projects, speaking at conferences, and discussing cloud data architecture.
