Bioinformatics Benchmarking Engineer

Job Summary

To support the development of AI systems, the full-time remote Bioinformatics Benchmarking Engineer will design, implement, and maintain benchmarking systems that evaluate AI outputs against curated genomic datasets while collaborating closely with the AI Bioinformatics Engineering Lead.

Key responsibilities

• Build and run automated evaluation pipelines for AI outputs end-to-end
• Execute large-scale validation runs across curated VCF datasets and track performance over time
• Partner with engineering to integrate validation directly into CI/CD and document failure modes as they emerge

Required qualifications

• Degree in Bioinformatics, Computational Biology, Genetics, or a related field
• Deep, hands-on experience with VCFs and real-world genomic datasets
• Fluency with ClinVar, dbSNP, HGVS standards, and transcript mapping
• Experience building evaluation frameworks or testing pipelines
• Experience evaluating LLM-based systems and implementing automated QA at scale