Job Description

xAI is seeking a highly motivated engineer to join the RL infra team and develop low-precision solutions for efficient and stable reinforcement learning training and inference of flagship models. The role involves analyzing numerical properties, co-designing models and systems, and contributing to a challenging and fast-paced environment.

Responsibilities

• Develop low-precision solutions for RL training and inference
• Analyze numerical properties of models and training dynamics
• Develop tools to enhance and monitor numerical stability
• Co-design models, systems, and recipes for optimal training and inference
• Contribute directly to the company’s mission

Requirements

• Strong knowledge in quantization and numerics in LLM inference and training
• Experience in building testing/tools to analyze numerics
• Broad understanding of training/inference frameworks and reinforcement learning
• Strong communication skills
• Proficiency in Python, Rust, C++, CUDA
• PhD in AI or other scientific domains (exceptional candidates)

Benefits

• No benefits