Lead Databrick Data Engineer

About Alphanext

Alphanext Technology Solutions is a technology-first global talent partner and product engineering company, helping organisations build scalable technology solutions and deploy highly skilled professionals across domains such as AI, Data Engineering, Cloud, Embedded Systems, and Enterprise Platforms.

With headquarters in London and operational presence across India, Alphanext enables global organizations to hire, build, and scale technology teams faster and more efficiently.

Job Summary:
We are looking for a hands-on Lead Databrick Data Engineer with 7+ years of experience in building scalable data platforms and leading engineering teams. The ideal candidate will have strong expertise in Databricks, Spark, and modern data engineering practices while actively contributing to development and technical delivery.

Key Responsibilities:

• Design and build end-to-end data pipelines using Databricks.

• Develop Medallion Architecture pipelines using Delta Lake, DLT, Workflows, and Unity Catalog.

• Build batch and streaming data pipelines using PySpark and Structured Streaming.

• Implement Lakebase, ZeroBus, and Lakebridge frameworks.

• Perform hands-on coding, troubleshooting, performance tuning, and optimization.

• Drive CI/CD, automation, and reusable pipeline frameworks.

• Lead technical delivery, mentor team members, and conduct code reviews.

• Ensure data quality, governance, security, and engineering best practices.

Required Skills:

• 7+ years of experience in Data Engineering.

• Strong expertise in Databricks, PySpark, Delta Lake, DLT, Workflows, and Unity Catalog.

• Experience with Medallion Architecture and real-time data processing.

• Strong knowledge of Spark performance tuning, CI/CD, and data governance.

• Excellent leadership, communication, and problem-solving skills.