AI Research Engineer

Job Summary

A company is looking for an AI Research Engineer - Pre training.

Key Responsibilities

• Conduct pre-training AI models on large, distributed servers equipped with thousands of NVIDIA GPUs
• Design, prototype, and scale innovative architectures to enhance model intelligence
• Independently and collaboratively execute experiments, analyze results, and refine methodologies for optimal performance

Required Qualifications

• A degree in Computer Science or related field; ideally a PhD in NLP, Machine Learning, or a related field
• Hands-on experience with large-scale LLM training runs on distributed servers with NVIDIA GPUs
• Familiarity with large-scale, distributed training frameworks, libraries, and tools
• Deep knowledge of state-of-the-art transformer and non-transformer modifications
• Strong expertise in PyTorch and Hugging Face libraries with practical experience in model development and deployment