Data Engineer - Infrastructure
IMC TradingAbout the Role
Join our Data Engineering Infrastructure team to build and scale the storage and data platforms that power our HFT business. This hands-on role involves working close to bare metal systems, operating large-scale open-source and enterprise storage, tuning Linux systems for performance, and automating infrastructure. As our data footprint grows, you will play a key part in keeping our infrastructure fast, reliable, and ready to scale.
- Design, deploy, and operate large-scale data storage infrastructure, including Hadoop, enterprise storage and S3-compatible platforms
- Tune Linux systems for I/O throughput and overall performance
- Automate configuration and deployment using Ansible, Puppet or other automation platforms
- Build observability into the platform with Prometheus and related tooling
- Partner with engineering teams to deliver reliable, well-architected data solutions with a focus on Storage and Kafka
Requirements
- 5+ years of experience in systems engineering with a strong focus on data storage
- Strong Linux fundamentals, debugging skills, including performance tuning for I/O throughput
- Hands-on experience with Ansible and Puppet for configuration management and automation
- Familiarity with open-source, S3 API compliant, and enterprise storage technologies
- Working knowledge of the Hadoop ecosystem, including YARN
- Experience in Java and Python
- Comfort working with AI-assisted development tools such as Claude in an enterprise setting
- Experience with Prometheus-based monitoring and alerting
What You'll Get
- $175k–$225k base salary
- Discretionary bonus
- Paid leave
- Insurance