Member of Technical Staff, Pre-Training Scaling

xAI
Full-time
Palo Alto, CA
$180,000 - $440,000
Posted on a month ago

Job Description

xAI is seeking a highly motivated engineer to focus on training trillion parameter neural networks at scale, implementing state-of-the-art deep learning methods, and innovating new scaling paradigms. The company values engineering excellence, curiosity, and a hands-on approach.

Responsibilities

  • Train trillion parameter neural networks
  • Implement latest deep learning methods
  • Innovate new scaling paradigms
  • Contribute directly to the company’s mission
  • Communicate knowledge concisely and accurately

Requirements

  • Strong engineering skills with model-hardware co-design passion
  • Expertise in ML and large model scaling
  • Familiarity with scaling laws
  • Experience with distributed training and multi-GPU neural networks
  • Experience optimizing ML training efficiency
  • Located near the Bay Area or open to relocation

Benefits

  • No benefits