Staff AI Inference Gateway Engineer Remote, Unlimited PTO

Salad Co

Remote job

Salad Technologies is seeking a Staff Software Engineer to own the AI Inference Gateway, a Rust-based, high-throughput gateway serving real-time and batch inferences for SaladCloud across geodistributed GPUs. You will design routing, scaling, and billing integration with telemetry. You’ll impact capacity planning, model evaluation, and production readiness, working with a small, highly technical team led by the CTO. Fully remote role with strong distributed-systems focus. #J-18808-Ljbffr Salad Co

Apply

Vacancy posted 12 hours ago

Similar jobs that could be interesting for youBased on the Staff AI Inference Gateway Engineer Remote, Unlimited PTO in New York, NY vacancy

Remote Inference Runtime Engineer for LLM & Multimodal AI
Inferact is seeking an inference runtime engineer to advance LLM and diffusion model serving. You will optimize how models execute across... ..., shaping the core of vLLM and enabling faster AI inference. This remote role embraces flexible timezones with Pacific overlap...
Remote job
Flexible hours
Inferact
New York, NY
3 days ago
Data Center Operations Engineer
...density, liquid-cooled AI colocation data... ...the deployment of AI inference, SuperPod, and AI factory... ...-on, detail-oriented Engineer, Data Center Operations... ...Customer Support & Remote Hands Services... ...dental, and vision) ~ Unlimited Paid Time Off (PTO) to support flexibility...
Remote work
Rotating shift
Colovore
Chicago, IL
2 days ago
Site Reliability Engineer, Inference Infrastructure
$190k - $260k
...leading security-first enterprise AI company. We build cutting-edge... ...is a team of researchers, engineers, designers, and more, who are... ...influence latency and throughput of inference.Strong understanding or... ...traveling to other offices if you are remote, plus an annual company...
Remote work
Full time
Work experience placement
Work at office
Local area
Home office
Cohere
New York, NY
22 hours ago
Staff Data Analyst (Remote US) New Remote - U.S.
$160.27k - $200.34k
...and an expanding AI stack. With a rent... ...embraces a culture of remote work. You’ll see... ...? JOB TITLE: Staff Data Analyst LOCATION... ...leadership and specific engineering teams. TEAM... ...understanding of Bayesian Inference Experience... .... Time Off: Unlimited PTO to recharge and thrive...
Remote job
Work at office
Local area
Immediate start
Worldwide
Flexible hours
Splice
Brooklyn, NY
4 days ago
Senior Engineer
$131k - $147k
...Caylent is an AI-first cloud services... ...We are a fully remote global company with... ...As a Senior CXE Engineer, you are a hands-on... ...analysis Optimize inference cost and latency hands... ...EventBridge, API Gateway, DynamoDB, Step... ...contribution) ~ Unlimited Vacations ~...
Remote work
Work at office
Worldwide
Caylent
Oregon State
2 days ago
Founding Engineer - Applied AI
...Engineering Agent Workflows Design and implement core workflows and... ...engineering team to deliver AI-powered workflows that are reliable... ...Francisco, or an exceptional remote candidate Nice-to-Have... ...Benefits & Perks Unlimited PTO Full health insurance Free...
Remote work
H1b
Relocation
Visa sponsorship
Ersilia
San Francisco, CA
3 days ago
Developer Relations Engineer
$120k - $160k
...Developer Relations Engineer Growth Remote Full-time or Part-time $120k-$160k + equity (negotiable... ...someone who can explain multimodal AI pipelines on TikTok without sounding... ...Health, dental, and vision insurance Unlimited PTO Conference and event budget...
Remote work
Full time
Part time
Mixpeek
United States
4 days ago
Staff/Senior Machine Learning Research Engineer, Intelligent Systems
$250k - $350k
...mission is to develop reliable AI systems for the world’s... ...like.About the RoleAs a Staff Machine Learning Research Engineer, you will operate across the... ...— training/fine-tuning, inference, memory and retrieval, evaluation... ...stipend, and generous PTO. Additionally, this role...
Full time
Scale AI
New York, NY
22 hours ago
Staff Computer Vision AI/ML Engineer
$114.6k - $252.1k
Job Title: Staff Computer Vision AI/ML EngineerJob Category: ScienceTime Type: Full timeMinimum Clearance... ...is for a Staff Computer Vision AI/ML Engineer. As a CV AI/ML Engineer, you will... ...Computer Vision algorithms to problems in remote sensing, including Automatic Target...
Remote work
Contract work
Work experience placement
Flexible hours
CACI International
Aurora, CO
2 days ago
Staff FinOps AI Governance Lead
$176.1k - $308.2k
...all started when engineer Fred Luddy wrote code... ...ServiceNow is the AI control tower for... ...are looking for a Staff FinOps AI... ...management, batch inference, and caching. Familiarity... ...Experience with GenAI gateway or LLM proxy... ...personas (flexible, remote, or required in office...
Remote work
Work at office
Immediate start
Flexible hours
ServiceNow
Santa Clara, CA
4 days ago
Mechanical Engineer - AI Rack Scale Systems
$160k - $275k
...building next-generation AI compute infrastructure... ...-scale LLM training and inference. We are looking for a hands-on Mechanical Engineer to design, develop, and... ...OfferTime off: 4 weeks PTO (accrued) + 12 company Holidays + up to 3 weeks remote workHealth: Company-subsidized...
Remote work
Daily paid
Full time
Work experience placement
Work at office
Local area
Monday to Friday
Flexible hours
MatX
Mountain View, CA
3 days ago
Developer Relations Engineer
$125k - $180k
...Developer Relations Engineer Runpod is the AI Developer Cloud. More than one million... ...more than 20 billion inference requests. We're at an inflection... ...on. We're a small, remote-first team. We take ownership... ...for dependents. ~ Flexible PTO- take the time you need to...
Remote work
Home office
Visa sponsorship
Work visa
Flexible hours
RunPod
United States
1 day ago
NPI Manufacturing Engineer - AI Compute Hardware
$160k - $275k
...building next-generation AI compute infrastructure... ...scale LLM training and inference. We’re looking for an... ...hands-on NPI Manufacturing Engineer to lead our AI chip,... ...OfferTime off: 4 weeks PTO (accrued) + 12 company... ...Holidays + up to 3 weeks remote workHealth: Company-...
Remote work
Daily paid
Full time
Work experience placement
Work at office
Local area
Monday to Friday
Flexible hours
MatX
Mountain View, CA
3 days ago
Senior Developer Experience Engineer
...independent advisors a modern, AI-native home. Savvy... ...developer experience engineer. Coding agents are... ...access without giving them unlimited access. WHAT WE'RE... ...building cloud or remote development environments... ...package Unlimited PTO + paid company holidays...
Remote work
Work at office
Local area
Immediate start
Savvy Wealth, Inc.
Eastern, KY
3 days ago
Senior Value Engineer - Technology Consultant
$131.25k - $153.75k
...to industrialize Enterprise AI. At our core is the Celonis Context... ....The Role:As a Senior Value Engineer, you are spearheading our... ...Work-Life Integration: Enjoy Unlimited PTO (in applicable regions) and generous... ...work model that balances remote focus with vibrant office...
Remote work
Full time
Work experience placement
Work at office
Local area
Worldwide
Flexible hours
Celonis
New York, NY
22 hours ago
Forward Deployed Engineer (AI & Tech)
...startup that provides an AI-powered platform to... ...alongside our product and engineering team, while dedicating... ...: (In-Office or Remote) \n \n Outcomes:... ...Train attorneys and staff, measure adoption and... ...FSA/HSA benefits \n Unlimited PTO \n Bonus opportunities...
Remote work
Work at office
Bridge Legal
Mundelein, IL
2 days ago
Senior QA Engineer
4. Senior QA Engineer# Senior QA Engineer## DescriptionCaylent is an AI-first cloud services company that... ...come first.We are a fully remote global company with... ...architectures (Lambda, API Gateway, DynamoDB, Step... ...learning and development- Unlimited paid time off- 10 paid...
Remote work
Contract work
Work at office
Immediate start
Flexible hours
Shift work
Bazeta
Eastern, KY
1 day ago
Senior QA Engineer
$80k - $150k
...personal and shared workstations, remote teams, and offline... ...The role As our senior QA engineer, you will own quality across... ...QA tooling and practice. AI-assisted workflow. We use AI... ...Flexible Spending Account (FSA) ~ Unlimited PTO under our PTO policy ~8 company...
Remote work
Permanent employment
Full time
Temporary work
Immediate start
Relocation package
Flexible hours
Society of Defense Financial Management
Bozeman, MT
22 hours ago
GATEWAY AUTOMATION ENGINEER
...pipelines supporting enterprise API Gateway implementations. Required... ...Work Location Hybrid / Remote. We are an Equal... ...Information Technology (IT) engineering services and solutions and non... ...• 11 Paid Holidays!! • 15 PTO Days! • Veteran Hiring Preference...
Remote work
For contractors
For subcontractor
Worldwide
Constellation West
United States
3 days ago
Principal Machine Learning Operations Engineer
$158k - $294k
...hands-on Principal MLOps Engineer & Functional Lead to... ...Learning and Generative AI infrastructure. In this... ...throughput, low-latency model inference pipelines, utilizing... ..., and vision coverage, unlimited paid time off, and... ...resident and this role is a remote role, you can receive...
Remote work
Definitive Healthcare
Framingham, MA
4 days ago
Data Integration Engineer
$130k - $150k
...Clarium is fixing that. Our AI-powered platform, Astra OS, gives... ...health systems, we need an engineer who can own that work end to... ...proportionate to your salary Fully remote, with a NYC co-working space... ...for in-person time Unlimited PTO Top-tier health, vision,...
Remote work
Clarium
Eastern, KY
3 days ago
Site Reliability Engineer II
$95k - $171k
...passionate about cutting-edge AI infrastructure? Do... ...? Join the Akamai Inference Cloud Team The... ...As an Site Reliability Engineer II, you will be responsible... ...and inspire you! #LI-Remote Compensation Akamai... ...vacation (in the form of PTO), sick time, family...
Remote work
Permanent employment
Work experience placement
Work at office
Work from home
Worldwide
Flexible hours
Akamai
Cambridge, MA
3 days ago
Robotics Software Engineer
...Intelligence called Active Inference, letting robots learn resilient... ...development. We're a hybrid/remote team that values work-life... ...degree in Computer Science or Engineering. ~4+ years of relevant... ...~12 paid holidays ~ Unlimited PTO, 2 week minimum ~ Flexible...
Remote work
Immediate start
Flexible hours
ThoughtForge
Oakland, CA
22 hours ago
DevSecOps Project Lead (Sr DevSecOps Engineer)
$175k - $215k
.... ABOUT DEFCON AI RESILIENCE IN THE... ..., and software engineering for resilient optimization... ...and accreditation staff. We need... .... This is a fully remote role with occasional... ...managed inference services inside a... ...and your family ~ Unlimited PTO, with your manager...
Remote work
Full time
Contract work
For subcontractor
Immediate start
Flexible hours
Red Cell Partners
United States
10 days ago
Staff User Researcher
...labels, order tracking, AI predictive delivery,... ...AfterShip operates with an engineering-driven,... ...Your Mission: As a Staff User Researcher, you'll... ...User Research. This is a remote position, with a preference... ...including company match Unlimited PTO Annual learning &...
Remote work
Work at office
Local area
Immediate start
Work from home
Worldwide
Flexible hours
AfterShip
Eastern, KY
4 days ago
Data Center Operations Engineer
$75k - $95k
...Data Center Operations Engineer Department: Infrastructure... ...the Austin metro area; no remote). ~ Experience with DCIM... ...Automation-oriented mindset with an AI-native posture (active user... ...with company match, and an unlimited Paid Time Off (PTO) policy that empowers you...
Remote work
Full time
Local area
Worldwide
Brivo
West Lake Hills, TX
22 hours ago
Senior Network Engineer Consultant
$155k - $175k
...seeking a Senior Network Engineer Consultant (Independent... ...re-platforming and an AI-first technology stack.... ...and redundant default-gateway strategies. Design inter... ...-ID, GlobalProtect remote access, and integration... ...designs for AI training and inference traffic where standards...
Remote work
Contract work
For contractors
Local area
University Information Technology - Indiana Wesleyan Univers...
Indianapolis, IN
10 hours ago
Lead Value Engineer - Energy
$183k - $217k
...to industrialize Enterprise AI. At our core is the Celonis Context... ...are looking for a Lead Value Engineer to own customer success and... ...) OR Greater Houston Area (Remote)The work you’ll do:Value... ...Work-Life Integration: Enjoy Unlimited PTO (in applicable regions) and generous...
Remote work
Full time
Work at office
Local area
Worldwide
Flexible hours
Celonis
New York, NY
4 days ago
Senior Developer Relations Engineer LocalStack · USD 161k-241k/yr San Francisco, CA, US Workplace 6
...Cloud Sandbox for Developers and AI Agents We are a fast-growing... ...across GTM, operations and engineering. In 2025 we almost doubled in... ...office in Vienna/Austria and remote team members from 25... ...remote Competitive salary Unlimited PTO 401k and private medical Annual...
Remote work
Work at office
Local area
Content Creators
Brooklyn, NY
12 hours ago
ASIC Design Verification Engineer
$200k - $350k
...Positron AI specializes in developing custom hardware... ...to accelerate AI inference. These inference systems... ...ASIC Design Verification Engineer, you will play a... ...work environment with remote work options Compensation... ...off and flexibility ~ Unlimited paid time off — we encourage...
Remote work
H1b
Home office
Flexible hours
Positron AI
Austin, TX
22 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff AI Inference Gateway Engineer Remote, Unlimited PTO. Be the first to apply!