HPC Specialist
DRWAbout the Role
Join DRW's AI and Multi Asset Systematic Strategies team as an HPC Specialist, building and operating GPU infrastructure that powers AI and ML workloads. You'll work on the infrastructure stack from bare metal to model serving, combining systems engineering, performance optimization, and infrastructure automation to solve complex problems at the intersection of hardware, networking, and distributed systems.
- Deploy, maintain, and optimize GPU infrastructure for large-scale LLM inference workloads
- Architect and implement distributed serving solutions for multi-node, multi-GPU model deployments
- Manage GPU-enabled Kubernetes clusters and configure network infrastructure for GPU clusters
- Troubleshoot performance bottlenecks and drive reliability improvements through monitoring and incident response
- Collaborate with ML engineers to profile model performance and implement inference acceleration techniques
Requirements
- Bachelor's or Master's degree in Computer Science, Systems Engineering, or related field
- 5+ years in DevOps, SRE, or infrastructure engineering roles
- Strong experience with GPU infrastructure, model serving frameworks (vLLM, SGLang), and GPU driver management
- Hands-on experience optimizing deep learning workloads (inference or training) on GPU clusters
- Deep Linux systems knowledge including network configuration, storage optimization, and Kubernetes orchestration
- Experience with infrastructure as code tools (Ansible, Terraform, or similar)
- Strong understanding of distributed systems, networking protocols (TCP/IP, HTTP/2), and load balancing
- Proficiency in Python and Bash scripting for automation
- Experience with monitoring and observability tools (Prometheus, Grafana, or similar)