AI Response Evaluator

Job Summary

Working remotely on a task-based contract, the AI Response Evaluator for Cyber Security Threat Intelligence will evaluate AI-generated prompts, utilize reinforcement learning to enhance AI performance, and collaborate with cybersecurity experts to improve threat intelligence systems while making their own hours.

Key responsibilities

• Evaluate AI-generated prompt responses for accuracy and relevance in Cyber Security Threat Intelligence
• Use reinforcement learning with human feedback to grade AI responses and guide improvements
• Collaborate with cybersecurity professionals to refine AI models based on real-world threat intelligence data

Required qualifications

• Significant experience in analyzing and responding to cybersecurity incidents, particularly related to recent vulnerabilities
• Experience assessing Cyber Threat Intelligence and conducting threat modeling
• Knowledge of threat actor group tactics, techniques, and procedures (TTPs)
• Preferred certifications such as SANS GCIH or SANS GCTI
• Experience in identifying and remediating vulnerabilities exploited by threat actor groups