Principal Software Engineer

Job Summary

A company is looking for a Principal Software Development Engineer specializing in LLM pretraining.

Key Responsibilities

• Lead pretraining efforts for open-source multilingual language models
• Plan and execute efficient language model pretraining while managing architecture risk
• Provide technical leadership and collaborate on model architecture and data pretraining strategies

Required Qualifications

• Experience training large language models, particularly MoE models
• Full stack research experience with familiarity in the model training stack
• Proven record of engineering successes and research activities, including publications or patents
• Commitment to open source excellence and software craftsmanship
• Experience in industrial research labs and software engineering processes