Applied Scientist

Job Summary

To enhance the accuracy of the AI agent, the full-time remote Applied Scientist will define metrics, design experiments, and improve evaluation systems while collaborating with ML and AI Engineering teams.

Key responsibilities

• Define and evolve accuracy metrics across the shopping experience, including retrieval and recommendations
• Design and run experiments to measure improvements and regressions in AI performance
• Build and maintain evaluation datasets, benchmarks, and scoring frameworks for the AI agent

Required qualifications

• 5+ years in Applied ML, AI Research, or Applied Science, with a PhD or equivalent depth preferred
• Hands-on experience evaluating modern AI/ML systems, particularly LLMs and ranking systems
• Direct experience with LLM-based systems, including prompt engineering and fine-tuning
• Strong foundations in experimentation, including A/B testing and statistical rigor
• Proven ability to operate in ambiguity and define problems effectively