Algotale - Data Engineer ( W )

Job Title: Data Engineer

Location: Pune / Nashik
Experience: 6+ Years
Travel Requirement: Must be ready to travel to South Africa for 2–3 months (January)

Job Description

We are looking for an experienced Data Engineer to build and optimize scalable data pipelines, maintain data architecture, and support analytics initiatives. The role requires technical expertise in SQL, ETL tools, data warehousing, and reporting.

Key Responsibilities

• Design, develop, and maintain scalable and efficient data pipelines.

• Build and manage data architecture for structured and unstructured data.

• Develop and optimize ETL workflows using Apache Spark, Kafka, Airflow, or similar tools.

• Collaborate with analysts, data scientists, and business teams to implement data solutions.

• Ensure data quality, integrity, and strong validation across all pipelines.

• Implement data security, governance, and compliance standards.

• Monitor, troubleshoot, and improve pipeline performance.

• Work with relational and NoSQL databases.

• Optimize SQL queries, stored procedures, and database tuning.

• Create and manage reports using SSRS.

• Support data migration and replication including CDC and SSIS.

• Apply dimensional modelling concepts such as star and snowflake schemas.

• Work within Agile teams and support DevOps-based CI/CD workflows.

• Build and optimize Data Cubes (Mandatory).

Required Skills & Expertise

• Strong SQL proficiency with hands-on experience in query optimization and tuning.

• Practical experience with ETL tools and data pipeline frameworks.

• Strong understanding of data warehousing and BI concepts.

• Experience with SSIS, CDC, and replication techniques.

• Familiarity with NoSQL and relational databases.

• Experience using SSRS for reporting.

• Familiarity with Agile & DevOps practices.

• Python knowledge is an added advantage.

Behavioral Competencies

• Strong problem-solving and decision-making ability.

• Proactive, self-driven, and able to work independently.

• Strong communication and collaboration skills.

• High attention to detail.

• Good time management and ability to work under pressure.

• Curious and continuous learning mindset.

• Strong ownership and accountability.