Engineering Member

Job Summary

A company is looking for a Member of Engineering (Pre-training).

Key Responsibilities

• Follow the latest research on LLMs and source code generation, proposing and evaluating innovations
• Perform LLM-Ops by analyzing experiments and iterating on results
• Write high-quality code in Python, Cython, C/C++, Triton, and CUDA

Required Qualifications

• Experience with Large Language Models (LLM) and deep knowledge of Transformers
• Knowledge/Experience with distributed training and cutting-edge training techniques
• Proficiency in programming with Python, PyTorch or Jax, C/C++, CUDA, and Triton
• Strong machine learning and engineering background
• Research experience in applied deep learning or related fields is a plus