Testing - DET - Staff

Job Title: AI Test Engineer

Job Summary:

We are looking for a motivated individual to join our AI Testing team. As a staff AI Test Engineer, you will assist in developing and executing test cases for AI models and systems, ensuring they meet quality and performance standards. You will collaborate with experienced engineers and data scientists to gain hands-on experience in AI testing.

Key Responsibilities:

Test case design:

• Good understanding about the various testing touch points in a model development lifecycle
• Participate in discussions with team members to understand testing needs.
• Support the development of test cases based on project requirements.
• Ability to define test cases to validate input data, Model functional performance, Model response etc

Test Execution:

• Execute manual tests for AI models and document results.
• Prior experience in performing AI specific testing methods like Pairwise testing, Metamorphic testing, Back-to-Back testing, Bias Testing, Drift testing etc
• Knowledge on responsible AI testing
• Knowledge on explainability testing tools (e.g., LIME, SHAP etc.)
• Assist in running automated tests and analysing their outcomes.

Model Validation Support:

• Help validate AI models against performance metrics such as accuracy and recall.
• Learn to conduct exploratory testing to identify potential issues.
• Exposure to testing LLM models

Data Quality Checks:

• Collaborate with data teams to ensure the quality of datasets used in testing.
• Participate in data validation activities to maintain data integrity.
• Prior experience in performing various data validation activities like data collection/generation, data augmentation, Exploratory data analysis, data bias and privacy etc

Documentation:

• Document test results and maintain clear records of defects found during testing.
• Prepare summary reports of testing activities for review.

Learning and Development:

• Stay informed about AI testing best practices and tools.
• Seek guidance from senior engineers to improve testing skills and knowledge.

Education: Bachelor’s degree in Computer Science, Engineering, or a related field; Master’s degree preferred.

Experience:

• 1-4 years of experience in software testing / development with exposure to Python
• 1+ years in testing on AI/ML applications.

Technical Skills:

• Basic understanding of AI/ML concepts and algorithms.
• Familiarity with programming languages such as Python or Java is a plus.
• Exposure to software testing principles and practices.
• Strong analytical and problem-solving skills.
• Attention to detail and a commitment to quality.
• Experience with testing tools (e.g., Selenium, PyTest) through coursework or internships.
• Knowledge of version control systems (e.g., Git) is a plus.
• Experience with Agile methodologies is a bonus.