AI Research Engineer

Job Summary

Driving innovation in AI architecture, the full-time remote AI Research Engineer will focus on large-scale pre-training for LLMs and multi-modal models, enhancing model intelligence and efficiency while implementing novel techniques and algorithms.

Key responsibilities

• Conduct foundational pre-training for LLMs and Multi-Modal models on large, distributed servers with thousands of NVIDIA GPUs
• Design and prototype innovative architectures and cross-modal alignment layers to improve model capabilities
• Source and curate large-scale datasets, establishing robust data pipelines for efficient pre-training

Required qualifications

• A degree in Computer Science or a related field; ideally a PhD in NLP, Machine Learning, or a related area
• Hands-on experience with large-scale LLM or Multi-Modal pre-training on distributed servers
• Familiarity with large-scale distributed training frameworks, libraries, and tools
• Deep knowledge of transformer and non-transformer modifications for enhancing model performance
• Strong expertise in PyTorch and Hugging Face libraries with practical experience in model development and deployment