Site Reliability Engineer - Data Engineering
IMC TradingAbout the Role
Join a dynamic Data Engineering team responsible for large-scale data collection, storage, access, and query platforms. This critical role focuses on safe and reliable operation of the platform, as well as projects to evolve and expand its capabilities. You will manage and monitor distributed systems, drive systems automation and CI/CD initiatives, and collaborate with systems engineers, network engineers, traders, and developers to support and troubleshoot queries. As part of a growing team of four in Sydney within the larger APAC Data Team, you will work with counterparts in Chicago, Mumbai, and Amsterdam.
Requirements
- 2+ years of experience in managing large-scale multi-petabyte data infrastructure in a similar role
- Knowledge of Linux system administration and internals, with proven ability to troubleshoot issues in Linux environments
- Experience in at least one of the following technologies: Kafka, HDFS, Kubernetes
- Working knowledge of Docker, Kubernetes, and Helm
- Experience with data access technologies such as Dremio and Presto
- Familiarity with workflow orchestration tools like Airflow and Prefect
- Exposure to cloud platforms such as AWS, GCP, or Azure