Java QA Engineer

Job Summary

A company is looking for a QA Engineer/Code Evaluator specializing in AI Chatbot Response Evaluations with a focus on Java.

Key Responsibilities

• Conduct thorough quality assurance audits of Java code evaluations provided by annotators
• Verify adherence to evaluation guidelines and identify issues related to functionality, executability, safety, performance, and documentation
• Document and communicate discrepancies or errors found during evaluations, providing constructive feedback

Required Qualifications

• 7+ years of professional experience in Java quality assurance, software testing, or technical evaluations
• Strong expertise in Java programming, debugging, testing methodologies, and performance analysis
• Experience with AI/ML training datasets, chatbot response evaluation, or data annotation verification is preferred
• Familiarity with large language models (LLMs) or reinforcement learning with human feedback (RLHF) is a plus
• English proficiency at B2, C1, C2, or Native levels