Senior Site Reliability Engineer - Fleet Reliability

What You’ll Do

• Define Fleet Health metrics and indicators to objectively measure and improve system availability

• Collaborate with the observability team on comprehensive monitoring and alerting systems to proactively predict, detect and respond to issues or anomalies

• Create runbooks and automated remediations for common failure scenarios

• Build in automation and auditing to ensure compliance and improve efficiency and productivity

• Participate in on-call rotations and provide support for incident response and resolution

• Implement and integrate logging and metrics across platforms such as Datadog, Prometheus, OpenTelemetry, Grafana, SumoLogic, etc

You

• 7+ years of experience in Site Reliability Engineering, DevOps, or a similar role

• Strong understanding of modern AI infrastructure, from GPU architectures to hardware performance optimization

• Strong understanding of Linux-based systems in a distributed environment

• Solid understanding of Python and Go, with experience working with SWE teams to improve internal tooling.

• Experience with monitoring and alerting tools (e.g., Prometheus, Grafana, SumoLogic)

• Proficiency in automation and configuration management tools (e.g., Ansible, Terraform)

• Familiarity with cloud platforms (e.g., OCI, AWS, GCP, Azure)

• Excellent problem-solving and troubleshooting skills

• Strong communication and collaboration skills

• Passion for continuous improvement and innovation

Nice to Have

• Experience in the machine learning or computer hardware industry

• Knowledge of containerization and orchestration technologies (e.g., Docker, Kubernetes)

• Experience building and/or operating HPC resources.

• Background in chaos engineering or similar reliability testing methodologies

• Understanding of compliance frameworks (SOC 2, ISO 27001, etc.)

Salary Range Information 

Based on market data and other factors, the annual salary range for this position is $155,000-$224,000.