Site Reliability Engineer - Data Platform
IMC TradingAbout the Role
IMC is looking for an experienced SRE with a strong background in managing distributed data systems on both bare metal Linux and Kubernetes. You will join the Data Platform team, which builds and runs the systems used by traders, quant researchers and engineering teams for all their data needs, and is responsible for the foundational platform that data frameworks and tooling are built on top of, including observability, scalability and standardized deployments.
- Design, implement and operate the data platforms.
- Improve observability so issues are caught before users notice them.
- Build automation to reduce toil and allow systems to scale.
- Support and own reliability of critical services (e.g. HDFS, Kafka and Dremio).
- Drive long-term architectural improvements, preventing issues rather than just fixing them.
Requirements
- Strong experience managing distributed data platforms (e.g. Kafka, Hadoop, Spark, Dremio); including full installation, debugging and performance tuning
- Hands on experience deploying, configuring and orchestrating software on Linux and Kubernetes, with proven ability to troubleshoot issues in both environments
- Strong experience with infrastructure as code (Ansible preferred) and best practices
- Proficient programming experience in Python
- Ability to read, write and tune SQL queries
- Comfortable reading Java source code, tuning and debugging running JVMs
- Familiarity with data lakehouse technologies (e.g. Iceberg or Delta Lake) as well as query engine technologies (e.g. Dremio, Presto or Trino)
- Exposure to workflow orchestration tools like Airflow or Dagster
- A proactive mindset: you're not just fixing issues but preventing them
- Comfortable working across teams, with minimal oversight
- Experienced SRE with strong background in managing distributed data systems on both bare metal Linux and Kubernetes