Research Engineer

Job Summary

To support the development of next-generation open models, the full-time Research Engineer will find and evaluate training data, build scalable data processing pipelines, and work closely with researchers to enhance model capabilities, with the option to work remotely or in-person in San Francisco.

Key responsibilities

• Find, evaluate, and collect valuable training data from various sources
• Build scalable pipelines for transforming raw data into training-ready corpora
• Develop and implement data quality checks to improve collection and processing

Required qualifications

• Strong programming skills in Python with experience in data-processing or distributed systems
• Experience managing large datasets and understanding tradeoffs in storage and compute
• Ability to diagnose data-quality issues and translate research goals into measurable experiments
• Comfort with owning technical problems end to end and collaborating with researchers
• Relevant experience in web crawling, document extraction, or large-scale corpus curation