Senior Test Engineer (AI model testing)

The purpose of this role is to develop required software features, achieving timely delivery in compliance with the performance and quality standards of the company.

Job Description:

Location: Mumbai/Pune/Gurugram/Bengaluru

Experience - 4-6 Years

Job Summary:

The purpose of this role is to take responsibility for conducting manual testing and AI output validation to ensure the software created by developers functions properly and meets the business needs as well.

This role is responsible for fully testing the product or system and tracking issues and defects at all levels of their testing. The candidate will have a strong background in developing test cases, implementing test processes, and recording results for an AI based application. Additionally, the candidate should be proficient in test AI Modal, the knowledge sources, regression, integration, and system testing.

Job Responsibilities:

Develops and executes accurate test cases as per requirements, analyses results and raises issues within schedule.

Ensures optimal test coverage comprising of positive, negative and exception scenarios.

Logs defects with right priority, tracking them to closure and understanding the root cause for an issue.

Tests and proves that the software meets major architectural requirements.

Provides feedback on usability and serviceability, traces the result to quality risk and reports it to concerned people.

Validates AI generated images, video outputs, recommendations and end-user workflows across supported scenarios.

Coordinates with product management and Developer/System Engineer to deliver stable enterprise software products.

Validates AI generated images, video outputs, recommendations and end-user workflows across supported scenarios.

Analyses and verifies best test approaches and executes acceptance, integration, installation, and system testing.

Records test results, validates defect fixes and verifies overall quality acceptance criteria.

Engages in both functional and non-functional testing, Participates in Requirement understanding, Scrum meeting, reviews and test strategy sessions.

Creates and maintains QA and project documentation.

Analyses problems reported in production application, identifies root causes and communicates results with appropriate stakeholders towards resolution.

Job Requirements:

Must Have:

• Minimum 4 to 6 years of experience

• Hands on experience in working with Agile Teams

• Ability to implement test plans, follow test process, and record results

• Strong expertise in writing test cases, reviewing AI outputs, and analyzing test results

• Proficiency in functional, regression, integration, exploratory and system testing

• Experience testing AI-powered applications involving image, videos

• Understanding of Generative AI concepts, prompt testing, hallucination detection and output quality assessment

• Experience validating AI recommendations, image updates, video outputs and content transformations

• Hands-on experience in API Testing

• Familiarity with tools such as JIRA and Git

• Strong attention to detail and commitment to quality

• Strong communication skills and ability to solve problems

• Should be able to provide reports to senior stakeholders
 

Good to have:

Knowledge on Testing framework like playwright, codeceptJS

Knowledge of multimodal AI testing (text, image and video)

Knowledge of cloud technologies, preferably Azure

Understanding of Responsible AI, bias testing and content safety validation

Experience with data validation and model output comparison

Experience/knowledge of performance/load/volume testing

Experience with performance tools such as JMeter.

Location:

DGS India - Bengaluru - Manyata N1 Block

Brand:

Merkle

Time Type:

Full time

Contract Type:

Permanent