Job Description

xAI is seeking a highly motivated engineer to assess and evaluate AI models, identify weaknesses, and collaborate with modeling and data teams to improve model quality. The ideal candidate will have experience in model evaluation, data synthesis, and building evaluation infrastructure.

Responsibilities

• Assess models
• Identify model weaknesses
• Communicate with modeling and data teams
• Develop evaluation plans
• Collect and synthesize data
• Build evaluation infrastructure

Requirements

• Model assessment and evaluation experience
• Data collection and synthesis skills
• Familiarity with inference frameworks (SGlang, vLLM)
• Strong communication skills
• Python, JAX, XLA, Rust/C++, Spark knowledge

Benefits

• No benefits