ML Inference Systems Engineer - Remote, Scalable, Low-Latency
Atlassian
Seattle, WA
- Remote job
At Atlassian, the ML System Engineer will design and optimize large-scale model serving systems, spanning distributed infrastructure to low-level GPU kernel optimizations. You’ll own end-to-end components from caching and batching to auto-scaling and deployment. The role emphasizes building reliable, high-concurrency serving systems, benchmarking and tuning inference engines, and partnering with senior ML engineers to deploy open-source LLMs. #J-18808-Ljbffr Atlassian
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the ML Inference Systems Engineer - Remote, Scalable, Low-Latency in Seattle, WA vacancy
- At Atlassian, the ML System Engineer will design and optimize large-scale model serving systems, spanning distributed infrastructure to low-level GPU kernel optimizations. You’ll own end-to-... ...systems, benchmarking and tuning inference engines, and partnering with senior...Remote job
- ...Palo Alto seeks a Software Engineer, Inference (AI Data Engineering) to design... ...throughput AI model serving systems. You will own distributed... ...teams to deliver reliable, scalable inference that powers mission... ...kernels, quantization, and low-level optimizations, reporting...Suggested
$150k - $220k
...processed more than 20 billion inference requests. We closed a $100M... ...depend on. We're a small, remote-first team. We take ownership... .... We're looking for a ML Systems Engineer, Inference. We want Runpod to... ...will show up directly in the latency and cost our customers experience...Remote workFull timeRunpod
Remote18 days ago$178.2k - $232.65k
Engineering | Seattle, United States | Remote, Remote | San Francisco, United... ...entity. As a ML System Engineer on the... ...ML Platform’s Inference team, you will... ...scaling) to deep low-level optimizations... ...and implement scalable distributed... ...cache). Optimize latency and throughput...Remote workWork at officeLocal area- NVIDIA Corporation is seeking a Senior Systems Software Engineer for QoS in Santa Clara, CA, with remote options available. You will design, develop, and optimize high-performance C++ software for ultra-low-latency streaming, contributing to GeForce NOW and future automotive...Remote job
- ...from home, or mix the two to fit their needs. As an ML System Engineer on the AI & ML Platform’s Inference team, you’ll design and optimize large-scale model serving... ...-to-end, owning distributed infrastructure and deep low-level optimizations. You’ll collaborate with senior...Work at officeWork from home
$180k - $250k
...Title: Senior Software Engineer (Low-Latency Trading Systems) Location: Chicago, IL Compensation: $180k - $250k + Annual Bonus (Ranging from $1... ...Low-Latency Trading Systems Type: Full-Time / Hybrid Remote We’re partnered with an established proprietary trading...Remote workFull timeStonepath
Chicago, IL2 days ago$145k - $165k
...ML Systems Engineer Bright Vision Technologies is a technology... .... Location: 100% Remote (U.S.) Position Type:... ...performance, highly reliable inference platforms for serving... ...trade-offs between latency, throughput, cost, and... ...operating high-throughput, low-latency services in...Remote workFull timeH1bVisa sponsorshipBright Vision Technologies
United States2 days ago- Spencer Logic, LLC. seeks a veteran backend engineer to design and implement distributed, low-latency systems powering multi-region trading infrastructure in New York/Remote. You will build real-time data pipelines and ML-enabled risk modules for high-stakes production...Remote job
$236.7k - $309.03k
...Machine Learning Systems Engineer (GenAI Products &... ..., United States | Remote, Remote | Mountain... ...Design and Build ML Systems Architect and implement scalable systems for training... ...services. Optimize latency, throughput, and resource... ...model training, inference pipelines, or...Remote workWork at officeLocal area- ...impact. We look for low-ego individuals who... ...looking for talented systems developers and... ...of the art in LLM inference systems and optimization... ...push the frontier of latency, throughput, scalability, and cost. Beyond... ...embrace AI-native engineering , using AI not only...
- ...continue growing the firm. We're fully remote, with team members across the U.S.... ...role Ondo operates real-time trading systems that run around the clock across traditional... ...and crypto venues. The platform spans low-latency Rust engines, a fleet of Go services for trading,...Remote workFull timeFlexible hours
Ondo
United States24 days ago $192.5k - $290k
...Senior Principal Systems Engineer - Humanoid Robotics... ...engineers and AI/ML scientists while staying... ...: Design scalable, modular software... ...to optimize system latency, compute allocation... ...RTOS, FreeRTOS or low-level embedded control... ...and edge AI inference platforms....Remote workLocal areaCerence
United States17 hours ago- ...ML Systems Engineer As an ML systems engineer with Minerva you will work... ...today. We are deliberately low-profile: a team of around 60... ...evaluation, optimisation of inference on edge devices or deployment... ...home office budget if you work remotely The full detail comes...Remote workWork at officeHome officeRelocation package
Minerva Defense, Inc.
United States3 days ago $120 per hour
.... Position: MLOps Engineer, LLM Systems (Serving, GPU Kernels,... .../hour Location: Remote Commitment: 40 hours... ..., debugging , and inference serving . Write... ...model performance on ML systems and training... ...serving throughput and latency trade-offs. Collaborate...Remote jobContract workSummer workMercor
New York, NYa month ago- ...Staff Site Reliability Engineer at TENEX TENEX is... ...responsible for ensuring the scalability, reliability, and... ...System Resilience: Design, build... ...optimizing infrastructure for low-latency, high-throughput AI workloads... ...infrastructure. AI/ML Infrastructure: Experience...Remote workWork from home
TenEx
United States4 days ago $204k - $216k
...silos, in legacy systems, in the heads of a... ...build and run the inference infrastructure that... ...serving, scaling, latency, and cost. Every time... ..., and platform engineering, and you make the... ...right. The AI/ML Infrastructure and... ...answers, and keep it low as the platform...Sapience AI Corporation
Los Angeles, CA6 days ago- Multi-Strategy Digital Asset Fund in New York seeks a Senior Software Engineer specializing in OTC to strengthen our low-latency trading platform. You will design and maintain real-time systems with microsecond precision, supporting trade flow, risk, and internal reporting...
- TXSE is hiring a highly skilled Low-Latency Software Engineer to design, develop, and optimize the core infrastructure of our equities trading platform in Dallas. You will focus on ultra-low-latency systems, matching engines, and market data distribution to enable fast...
- ...compatibility with existing systems and enterprise... ..., and platform engineering teams.... ...improve performance, scalability, reliability, and... ...experience supporting AI/ML platforms, MLOps workflows... ...model serving, inference optimization, or... ...experience REMOTE WORK NOTICE: This...Remote workWork at office
- ...electronic trading connectivity infrastructure and high-impact systems that handle order flow across major markets. You will design,... ...brokers, exchanges, and internal systems. The role emphasizes low-latency design and multi-market connectivity. #J-18808-Ljbffr C2R Ventures
$170k - $300k
...building large in-house AI/ML infrastructure. Built by engineers, for engineers. From... ...orchestration to inference optimization, we own... ...for a Lead Software Systems Engineer - GPU... ...performance optimization, low-level programming).... ...caregivers. ~ Remote work reimbursement:...Remote workTemporary workImmediate startNebius
United States4 days ago$83.52k - $125.28k
...seeking a Real-Time Inference Engineering Lead (FTE /... ...provides standardized, scalable model-serving... ...and industrialize low-latency, resilient model-... ...science, and ML engineering teams... ...with enterprise systems. Engineer Kubernetes... ...positions offer remote or hybrid work...Remote workTemporary workWork at officeFlexible hoursNTT DATA, Inc.
Charlotte, NCa month ago- ...Senior AI Systems Quality Engineer At Abacus Insights, we're building AI-powered... ...on establishing repeatable, scalable quality practices rather... ...hallucinations, relevance, latency, cost) and integrate them into... ...training or certification in AI/ML systems (e.g., ISTQB AI...Remote workLocal areaHome office
Abacus Insights
United States18 hours ago - ...expectations** For Remote Roles : If this... ...with other engineering teams across the organization... ...machine learning (ML) and hybrid ML/... ...delivery of safe, scalable, and high-impact... ...bar for ML systems company-wide.... ...model training and inference (including LLM serving...Remote workWork at officeFlexible hours
PointClickCare
Remote1 day ago $140k - $170k
...C++ Developer (Low Latency/HFT) Salary: $140k-$170k +... ...4 days onsite, 1 day remote Qualifications... ...in Computer Science, Engineering, Mathematics, Physics... ...applications and market access systems in modern C++.... ...for speed, throughput, scalability, and reliability,...Remote workFull timeWorldwideRequest Technology, LLC
Woodridge, IL14 hours ago$200k - $400k
..."assistant" Role: Low Latency Linux Expert - ULL & Trading... ...+ Bonus Location: Remote (US or Canada)... ...knowledgeable Platform Engineer to work on their low latency... ...solutions for scalable deployment across private... ...and optimising Linux systems. Configuration Management...Remote workImmediate startHunter Bond Ltd
United States4 days ago$122k - $214k
...partner is looking for a Lead Engineer - Agentic AI Systems based in United States.... .... You will help build scalable model-serving and MLOps/... ...multimodal models, and low-latency edge inference. Design scalable... ...performance. Primarily remote work arrangement, with...Remote workFull time- Temporal in New York City is seeking a platform engineer to own the core infrastructure. You will manage bare-metal fleets across regions... ..., configuration, and observability, with a focus on latency-sensitive services and Solana validator support. You will design...Remote job
- ...position can be fully REMOTE with travel to... ...high-level system architecture... ...future-proof, scalable, and high-performance... ..., power, latency, cost, and manufacturability... ...high-speed, low-latency... ...functionally with engineering, product... ...of compute, AI/ML, networking, and...Remote work
Career Connections, LLC.
United States2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to ML Inference Systems Engineer - Remote, Scalable, Low-Latency. Be the first to apply!
Related searches
- senior ml engineer Seattle, WA
- machine learning ai engineer Seattle, WA
- machine learning software engineer Seattle, WA
- ai ml engineer Seattle, WA
- machine learning engineer Seattle, WA
- computer vision machine learning engineer Seattle, WA
- system performance engineer Seattle, WA
- active directory systems engineer Seattle, WA
- senior linux systems engineer Seattle, WA
- software system engineer Seattle, WA