Job Description

xAI is seeking a Software Engineer to join their Data Acquisition team, focusing on building systems to collect and process large datasets for AI model training. The role involves architecting and operating large-scale distributed systems, collaborating with other teams to meet data needs, and tackling complex data engineering challenges to support the development of advanced AI systems.

Responsibilities

• Building petabyte-scale data processing systems
• Designing and operating large-scale distributed systems and pipelines
• Managing workloads across cloud compute clusters
• Pre-processing datasets for AI training
• Building and operating large-scale crawlers

Requirements

• Strong engineering skills
• Proficiency in Rust, Go, C++, or Java
• Experience with data processing libraries
• Experience with distributed systems
• Knowledge of AI training data preparation techniques
• Deep knowledge of the internet and crawler architectures
• Strong debugging skills

Benefits

• No benefits