Databricks Data Engineer
4–8 yrsonsiteGurugram
The role
Full-time onsite Databricks Data Engineer role in Gurugram for 4-8 years experience, leading implementation of a modern data platform, building scalable ETL/ELT pipelines, Medallion Architecture and Delta Lake practices, and optimising performance.
What you would do
- Lead implementation and adoption of Databricks across the organisation
- Design, develop and maintain scalable ETL/ELT pipelines
- Implement Medallion Architecture and Delta Lake best practices
- Develop ingestion frameworks for structured, semi-structured and unstructured data
- Implement data quality checks, monitoring, logging and alerting
- Build reusable frameworks and engineering standards
- Ensure data security, governance and compliance
- Troubleshoot production issues and optimise data workflows
What they are looking for
- 4-8 years of experience in Data Engineering
- Hands-on experience implementing Databricks in production
- Experience with Delta Lake and Lakehouse Architecture
- Strong SQL skills
- Experience with Python
- Knowledge of workflow orchestration tools such as Databricks Workflows or Airflow
- Understanding of data modeling, partitioning, indexing and optimisation
- Databricks Certification preferred