Databricks Lead – Delivery & Engineering

Jade Global Software Pvt LTD

Apply to this job
Pune, Maharashtra Hyderabad, Telangana Until 8/21/2026 10+ years exp H-1B sponsor history First posted April 2, 2026 Last posted April 2, 2026
Job description
Databricks Lead – Delivery & Engineering1

Lead hands-on Databricks delivery, ensuring adherence to CoE standards and best practices.

Key Responsibilities

  • Lead Databricks engineering teams

  • Build and optimize Spark & Delta Lake pipelines

  • Implement Databricks Jobs, Workflows, CI/CD

  • Optimize performance and DBU usage

  • Contribute to Databricks accelerators and standards

  • Design and implement end-to-end data platforms using Databricks Lakehouse

  • Lead development of:

    • Data ingestion (batch & streaming)

    • Delta Lake data modeling (Bronze/Silver/Gold)

    • Scalable ETL/ELT pipelines

  • Optimize Spark workloads for performance and cost

  • Ensure reliability, scalability, and observability of data pipelines

Experience

  • 10–12 years in data engineering

  • 3–5 years hands-on Databricks experience

Skills

  • Deep expertise in Databricks, Apache Spark, Delta Lake

  • Strong hands-on experience with PySpark / Spark SQL  (core, SQL, streaming)

  • Experience designing Lakehouse architectures

  • Strong understanding of data modeling, data quality, and lineage

  • Databricks platform features

  • Cloud-native data engineering

  • Performance tuning & troubleshooting

Certifications (Preferred)

  • Databricks Data Engineer Associate and Professional

About this role

Summary

Lead data engineering teams, build data pipelines, optimize performance, and ensure scalable data platforms.

Job title

Databricks Lead – Delivery & Engineering

Experience level

10+ years

Minimum experience

10+ years exp

Industry

software

Location requirements

On-site in Pune or Hyderabad, India, no remote work.

Salary

Not specified

Visa sponsorship

H-1B sponsor history

Management role

No

Skills & keywords

Required skills

databricksapache sparkdelta lakepysparkspark sqldata modelingdata qualitylineagecloud-native data engineeringperformance tuningtroubleshooting

Preferred skills

databricks data engineer certification

Specializations

databrickssparkdelta lakepysparkcloud-native
Locations

Structured locations inferred from the posting.

Pune, Maharashtra, India

On-site City

Hyderabad, Telangana, India

On-site City