AI Test Engineer

Job Description

Must Have Technical/Functional Skill

Role Summary

Tests AI model outputs and application functionality. Validates data accuracy, business logic and system performance.

Key Responsibilities

• Design and execute test plans covering AI model outputs, data correctness, and application functionality.
• Create automated tests for APIs and UI where appropriate; maintain regression suites.
• Validate business logic, edge cases, and non-functional requirements (performance, reliability).
• Establish evaluation criteria for AI components (accuracy, hallucination checks, guardrail adherence).
• Triage defects, document reproducible steps, and partner with engineers to resolve issues.
• Contribute to release readiness, quality gates, and continuous improvement of testing practices.
  
  

Required Qualifications

• 3+ years in QA/Test Engineering for web/services-based applications.
• Experience with test automation tools (Selenium) and API testing (Postman or similar).
• Strong understanding of test case design, defect lifecycle, and agile QA practices.
• Familiarity with tracking tools (JIRA) and test documentation.
• Ability to reason about data quality and validate outputs against requirements.
  
  

Preferred / Nice To Have

• Experience testing ML/LLM systems: evaluation datasets, prompt regressions, safety checks.
• Performance testing experience (load, stress) and observability basics.
• Knowledge of accessibility testing for UI.
  
  

Core Skills (from POD sheet)

Selenium, Postman, Test Cases, JIRA, Manual Testing

Salary Range $100,000-$120,000Per year

TCS Employee Benefits Summary

Discretionary Annual Incentive.

Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.

Family Support: Maternal & Parental Leaves.

Insurance Options: Auto & Home Insurance, Identity Theft Protection.

Convenience & Professional Growth: Commuter Benefits & Certification & amp; Training Reimbursement.

Time Off: Vacation, Time Off, Sick Leave & Holidays.

Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.

Qualifications: BACHELOR OF COMPUTER SCIENCE