Programming.com - Senior Data Engineer

Job Title: Senior Data Engineer Role
Experience: 5+ Years
Shift: Night Shift
Location: PAN India
Work Mode: Office

About Company:

Programming.com is a global digital transformation and software development company specializing in cutting-edge tech like AI, Metaverse, Blockchain, Cloud, IoT, and AR/VR, providing custom solutions and IT consulting for enterprises and startups worldwide.

Job Summary:

We are seeking a highly skilled Senior Data Engineer to design, build, and maintain scalable data pipelines and ensure high data quality across platforms. The role involves hands-on ownership of ETL pipelines, Epicor data extraction, dbt semantic modeling, and acting as the gatekeeper for data reliability and performance.

Key Responsibilities

• Design, develop, and maintain robust ETL pipelines for large-scale data processing.

• Build and optimize data extraction pipelines from Epicor ERP systems.

• Develop and manage dbt models and semantic layers to support analytics and reporting.

• Implement data quality checks, validation rules, and monitoring frameworks.

• Ensure data accuracy, consistency, performance, and reliability across pipelines.

• Troubleshoot pipeline failures and optimize data workflows.

• Collaborate with analytics, product, and business teams to understand data needs.

• Maintain documentation for pipelines, models, and data processes.

• Follow best practices for version control, testing, and deployment.

Required Skills & Qualifications

• 5+ years of experience as a Data Engineer or similar role.

• Strong proficiency in Python.

• Hands-on experience building ETL pipelines.

• Experience working with dbt, including semantic layer modeling.

• Strong understanding of data quality frameworks and validation techniques.

• Experience integrating ERP systems, preferably Epicor.

• Solid understanding of SQL and data warehousing concepts.

• Experience with cloud platforms and modern data stacks (preferred).

• Strong debugging, problem-solving, and optimization skills.

Good to Have

• Experience with orchestration tools (Airflow, Prefect, etc.).

• Knowledge of CI/CD for data pipelines.

• Experience in handling large-scale datasets and performance tuning.

• Familiarity with data governance and security best practices.