Member of Technical Staff, Cloud Orchestration (Remote)
Apply on company site View on the company's hiring page (jobs.ashbyhq.com)
Posted by Inferact on the hiring system it uses for its careers page; applications go straight to the company.
Can I apply?
- Full-time
- Remote from anywhere
- Visa sponsorship available
- $200k–$400k USD/yr
Fully remote, worldwide role building cluster management, deployment automation and monitoring for vLLM inference infrastructure.
Requires strong Kubernetes experience, Python/Rust/Go, infrastructure-as-code, and GPU cluster management.
Expects regular overlap with Pacific Time for critical syncs.
Visa sponsorship offered case-by-case; no citizenship or work permit requirement is stated.
From the posting
- workplace
ATS workplace type: remote
- locations
ATS location: Remote
- salary
ATS pay range: 200000–400000 USD per year
- employment types
full_time
- remote eligible countries
Fully remote, worldwide
- remote timezone requirement
expect regular overlap with Pacific Time for critical syncs
- work auth required
We sponsor visas on a case-by-case basis.
- job function
Member of Technical Staff, Cloud Orchestration (Remote)
- role family
build the operational backbone that keeps vLLM running reliably at massive scale
- skills
Strong experience with Kubernetes and container orchestration at scale.
- education required
Bachelor's degree or equivalent experience in computer science, engineering, or similar.
- actionable
We're looking for an cloud orchestration engineer to build the operational backbone
Job description
Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware—a position that took years to build.
ABOUT THE ROLE
We're looking for an cloud orchestration engineer to build the operational backbone that keeps vLLM running reliably at massive scale. You'll design the systems for cluster management, deployment automation, and production monitoring that enable teams worldwide to serve AI models without friction. You'll ensure that vLLM deployments are observable, debuggable, and recoverable, turning operational complexity into infrastructure that just works.
SKILLS AND QUALIFICATIONS
Minimum qualifications:
- Bachelor's degree or equivalent experience in computer science, engineering, or similar.
- Strong experience with Kubernetes and container orchestration at scale.
- Experience designing and implementing custom Kubernetes operators.
- Proficiency in Python/Rust/Go and infrastructure-as-code tools (Terraform, Helm, etc).
- Experience managing GPU clusters and debugging hardware issues.
- Ability to work across cloud platforms (AWS, GCP, Azure) and on-premise infrastructure.
Preferred qualifications:
- Experience with ML-specific orchestration tools (Ray, Slurm).
- Knowledge of GPU scheduling, multi-tenancy, and resource optimization.
- Familiarity with vLLM deployment patterns and configuration.
- Track record of improving operational reliability for ML systems.
Bonus points if you have:
- Experience deploying inference systems on large-scale GPU (1,000+) clusters.
LOGISTICS
- Location: Fully remote, worldwide. We're timezone-flexible but expect regular overlap with Pacific Time for critical syncs.
- Compensation: We offer competitive compensations (salary + equity) compared to the local market conditions.
- Visa sponsorship: We sponsor visas on a case-by-case basis.
- Benefits: Inferact offers competitive benefits appropriate to your location, including health coverage where applicable.
Seen on
- ashby — jobs.ashbyhq.com