This is a permanent role with one of the valued client of Zyoin Group.

Key Responsibilities & Skills:

• Automation Tester who has tested AI Products

• Product Testing Strategy - someone who has worked upon

• API testing, Automation Framework, BDD, Python + Behave, Git Version Control

• Evaluation reporting and communication, CI/CD Integration

• LLM Evaluation and Testing for Accuracy, relevance, and context of responses or outputs

• Feedback mechanism and continuous validation

• Testing for Bias, Safety and non-subjective response handling / fall back

• Basic performance testing including p50 / p95, response time SLA, and load testing

• Data storage, traceability, and auditability

• Handling edge cases, harmful prompts, etc.

• Any legal framework application for testing before production
  
  Nice to Have:

• Experience working with Generative AI or LLM-based applications in production environments

• Exposure to AI governance, responsible AI, or model risk management practices

• Familiarity with cloud platforms (AWS, GCP, or Azure) and cloud-based CI/CD pipelines

• Experience collaborating closely with data scientists and ML engineers

• Understanding of prompt engineering and prompt versioning concepts

• Prior experience in regulated domains such as fintech, healthcare, or enterprise SaaS