QA Engineer for AI Systems

Job Summary

A company is looking for a QA Engineer - AI Systems & Fine-Tuning.

Key Responsibilities

• Test the accuracy of MCP Tool Servers to ensure correct interpretation of OpenAPI specifications
• Curate and clean datasets in Python for model fine-tuning and tool-calling accuracy
• Develop automated test suites for prompt regression testing and validate security policies

Required Qualifications

• Expert knowledge of REST, OpenAPI, and API testing tools like Postman or Insomnia
• Proficiency in Python and familiarity with C#
• Experience with LLM evaluation frameworks such as DeepEval or LangSmith
• Hands-on experience with Gravitee APIM or similar API management tools
• Understanding of the MCP architecture and its data access protocols