Research Engineer

Job Summary

To support innovative research and engineering initiatives, the full-time Research Engineer will contribute to projects involving efficient architectures, multimodal systems, and data engineering, working remotely while managing the end-to-end process from research to deployment.

Key responsibilities

• Develop and implement efficient architectures for foundation models, focusing on state space models and hybrid attention designs
• Contribute to multimodal vision and audio systems, ensuring performance under tight latency and memory constraints
• Engage in data engineering tasks including pre-training data curation and scaling strategies to enhance model quality

Required qualifications

• M.S. or Ph.D. in Computer Science, Mathematics, Electrical Engineering, or a related field; or equivalent industry experience
• Demonstrated research or engineering contributions in relevant areas
• Experience training or fine-tuning foundation models at scale
• Hands-on experience with distributed training infrastructure such as DeepSpeed or Megatron-LM
• Published research at top-tier venues like NeurIPS or ICML