Member of Technical Staff, Performance and Scale
Apply on company site View on the company's hiring page (jobs.ashbyhq.com)
Posted by Inferact on the hiring system it uses for its careers page; applications go straight to the company.
Can I apply?
- Full-time
- On-site
- Visa sponsorship available
- $200k–$400k SGD/yr
Onsite infrastructure engineering role in Singapore building distributed inference systems for vLLM.
Requires systems programming in Rust, Go, or C++ and experience with high-performance distributed systems.
Annual salary S$200,000 to S$400,000 plus equity; the company sponsors visas case-by-case.
Bachelor's degree or equivalent experience in a related field is required.
From the posting
- workplace
ATS workplace type: onsite
- locations
ATS location: Singapore
- salary
ATS pay range: 200000–400000 SGD per year
- employment types
full_time
- work auth required
We sponsor visas on a case-by-case basis.
- job function
We're looking for an infrastructure engineer
- role family
We're looking for an infrastructure engineer to build the distributed systems
- skills
Strong systems programming skills in Rust, Go, or C++.
- education required
Bachelor's degree or equivalent experience in computer science, engineering, or similar.
- actionable
ABOUT THE ROLE
Job description
Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware—a position that took years to build.
ABOUT THE ROLE
We're looking for an infrastructure engineer to build the distributed systems that power inference at global scale. You'll design and implement the foundational layers that enable vLLM to serve models across thousands of accelerators with minimal latency and maximum reliability. Tomorrow, deploying a frontier model at scale should be as straightforward as spinning up a serverless database. The complexity doesn't disappear as it gets absorbed into the infrastructure you're building.
SKILLS AND QUALIFICATIONS
Minimum qualifications:
- Bachelor's degree or equivalent experience in computer science, engineering, or similar.
- Strong systems programming skills in Rust, Go, or C++.
- Experience designing and building high-performance distributed systems at scale.
- Understanding of network protocols and high-performance I/O.
- Ability to debug complex distributed systems issues.
Preferred qualifications:
- Experience with ML serving infrastructure and disaggregated inference architecture.
- Familiarity with GPU programming models and memory hierarchies.
- Knowledge of GPU interconnects (NVLink, InfiniBand, RoCE) and their performance characteristics.
- Track record of improving system reliability and performance at scale.
Bonus points if you have:
- Prior experience in supporting large‑scale model training or inference environments.
LOGISTICS
- Location: This role is based in Singapore.
- Compensation: Depending on background, skills, and experience, the expected annual salary range for this position is S$200,000 to S$400,000 annually + equity.
- Visa sponsorship: We sponsor visas on a case-by-case basis.
- Benefits: Inferact offers a generous benefits package, including medical, dental, and vision coverage.
Seen on
- ashby — jobs.ashbyhq.com