SwiftIn-Azure Databricks Lead

Role: Azure Databrick Lead

Exp-10+ years

Location- Pune/Bangalore

We are seeking an experienced Azure Databricks Lead to drive the design, development, and implementation of data solutions using Azure Databricks. The ideal candidate will have a deep understanding of cloud-based data platforms, strong leadership skills, and a proven track record of managing complex data projects.

Key Responsibilities

• Lead the architecture, design, and deployment of scalable data solutions using Azure Databricks.
• Collaborate with stakeholders to gather requirements and translate them into technical specifications.
• Oversee the development of data pipelines, ETL processes, and machine learning workflows.
• Optimize the performance of data solutions, ensuring reliability and efficiency.
• Manage a team of data engineers and analysts, providing technical mentorship and guidance.
• Integrate Databricks with Azure cloud services such as Azure Data Lake, Azure Synapse, and Azure Machine Learning.
• Ensure adherence to best practices, security standards, and governance policies.
• Drive innovation by exploring and adopting emerging technologies in data engineering and analytics.

Required Skills and Qualifications

• 10+ years of experience in data engineering or related fields, with at least 3+ years on Azure Databricks.
• Expertise in designing and implementing large-scale data pipelines and workflows using Databricks and Apache Spark.
• Strong knowledge of Azure cloud services including Azure Data Factory, Azure Data Lake, Azure Synapse, and Azure Functions.
• Proficiency in programming languages such as Python, Scala, or SQL.
• Hands-on experience with data modeling, ETL processes, and data transformation.
• Familiarity with DevOps practices and CI/CD pipelines for data projects.
• Excellent problem-solving skills and the ability to troubleshoot complex data issues.
• Strong communication and leadership skills to manage teams and interact with stakeholders.

About us

Swiftin is a name that spells consistent dependability by providing high quality supplies and services to its customers since 1978. With its highly experienced sourcing and sales expertise, Swiftin has evolved into a robust organisation which is committed to providing its stakeholders the best in class supplies and services using its core strength of high quality systems and processes. Capitalizing on its industry knowledge and leveraging its strong supplier and customer relationships over the last 45 years, Swiftin has established itself as a leader in the Aluminium Profiles & Accessories, Panel Accessories, Toggle Clamps and Machine Accessories market. Because of our dynamic growth agenda & with a view to expand into additional product categories, the Swiftin group now has 5 companies in its ambit namely; Swiftin Corporation LLP, Swiftin Agencies LLP, Swiftin Solutions LLP, Swift Industrial Technologies & Swiza.