ML Inference Systems Engineer - Remote, Scalable, Low-Latency
Atlassian Corp.
Brooklyn, NY
- Remote job
At Atlassian, the ML System Engineer will design and optimize large-scale model serving systems, spanning distributed infrastructure to low-level GPU kernel optimizations. You’ll own end-to-end components from caching and batching to auto-scaling and deployment. The role emphasizes building reliable, high-concurrency serving systems, benchmarking and tuning inference engines, and partnering with senior ML engineers to deploy open-source LLMs. #J-18808-Ljbffr Atlassian Corp.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the ML Inference Systems Engineer - Remote, Scalable, Low-Latency in Brooklyn, NY vacancy
- At Atlassian, the ML System Engineer will design and optimize large-scale model serving systems, spanning distributed infrastructure to low-level GPU kernel optimizations. You’ll own end-to-... ...systems, benchmarking and tuning inference engines, and partnering with senior...Remote job
- ...Palo Alto seeks a Software Engineer, Inference (AI Data Engineering) to design... ...throughput AI model serving systems. You will own distributed... ...teams to deliver reliable, scalable inference that powers mission... ...kernels, quantization, and low-level optimizations, reporting...Suggested
$150k - $220k
...processed more than 20 billion inference requests. We closed a $100M... ...depend on. We're a small, remote-first team. We take ownership... .... We're looking for a ML Systems Engineer, Inference. We want Runpod to... ...will show up directly in the latency and cost our customers experience...Remote workFull timeRunpod
Remote18 days ago$178.2k - $232.65k
Engineering | Seattle, United States | Remote, Remote | San Francisco, United... ...entity. As a ML System Engineer on the... ...ML Platform’s Inference team, you will... ...scaling) to deep low-level optimizations... ...and implement scalable distributed... ...cache). Optimize latency and throughput...Remote workWork at officeLocal area$190k - $260k
...are building AI systems. We believe that... ...of researchers, engineers, designers, and more... ...high-performance, scalable and reliable... ...to production in low latency, high throughput,... ...and throughput of inference.Strong understanding... ...offices if you are remote, plus an annual...Remote workFull timeWork experience placementWork at officeLocal areaHome officeCohere
New York, NY2 days ago- NVIDIA Corporation is seeking a Senior Systems Software Engineer for QoS in Santa Clara, CA, with remote options available. You will design, develop, and optimize high-performance C++ software for ultra-low-latency streaming, contributing to GeForce NOW and future automotive...Remote job
- ...from home, or mix the two to fit their needs. As an ML System Engineer on the AI & ML Platform’s Inference team, you’ll design and optimize large-scale model serving... ...-to-end, owning distributed infrastructure and deep low-level optimizations. You’ll collaborate with senior...Work at officeWork from home
$180k - $250k
...Title: Senior Software Engineer (Low-Latency Trading Systems) Location: Chicago, IL Compensation: $180k - $250k + Annual Bonus (Ranging from $1... ...Low-Latency Trading Systems Type: Full-Time / Hybrid Remote We’re partnered with an established proprietary trading...Remote workFull timeStonepath
Chicago, IL2 days ago$145k - $165k
...ML Systems Engineer Bright Vision Technologies is a technology... .... Location: 100% Remote (U.S.) Position Type:... ...performance, highly reliable inference platforms for serving... ...trade-offs between latency, throughput, cost, and... ...operating high-throughput, low-latency services in...Remote workFull timeH1bVisa sponsorshipBright Vision Technologies
United States2 days ago$236k - $330k
...impact. We look for low-ego individuals who... ...looking for talented systems developers and researchers... ...of the art in LLM inference systems and... ...push the frontier of latency, throughput, scalability, and cost.Beyond optimizing... ...embrace AI-native engineering, using AI not only...Snowflake
Bellevue, WA4 days ago- Spencer Logic, LLC. seeks a veteran backend engineer to design and implement distributed, low-latency systems powering multi-region trading infrastructure in New York/Remote. You will build real-time data pipelines and ML-enabled risk modules for high-stakes production...Remote job
$236.7k - $309.03k
...Machine Learning Systems Engineer (GenAI Products &... ..., United States | Remote, Remote | Mountain... ...Design and Build ML Systems Architect and implement scalable systems for training... ...services. Optimize latency, throughput, and resource... ...model training, inference pipelines, or...Remote workWork at officeLocal area- ...are currently seeking a On-Premise LLM Inference & GPU Systems Engineer to join our team in Charlotte, North... ...tuning, batching strategies, and latency optimization. Manage workload orchestration... ...’s needs. While many positions offer remote or hybrid work options, these...Remote workWork at officeFlexible hours
NTT DATA
Charlotte, NC4 days ago - ...and Roku. The systems and solutions... ...scale and with low latency. We use Machine... ...Learning and Inference Platform that... ...experience in ML serving, high-... ...excited to mentor engineers, innovate at... ..., and scalability of online inference... ...flexible for remote work, except for...Remote workWork at officeLocal areaMonday to ThursdayFlexible hours
Roku
Austin, TX2 days ago - ...continue growing the firm. We're fully remote, with team members across the U.S.... ...role Ondo operates real-time trading systems that run around the clock across traditional... ...and crypto venues. The platform spans low-latency Rust engines, a fleet of Go services for trading,...Remote workFull timeFlexible hours
Ondo
United States24 days ago - ...their business systems through natural... ...Moveworks’ Reasoning Engine and natural... ...intersection of ML systems, platform... ...data pipelines, inference services, model... ...product.Improve the scalability, availability, latency, and cost... ...personas (flexible, remote, or required in...Remote workWork at officeImmediate startFlexible hours
Moveworks
Mountain View, CA4 days ago $295k
...who are building AI systems. We believe that... ...team of researchers, engineers, designers, and... ...fast, reliable, and scalable model training —... ...the full stack of ML systems, this role... ...engineering, profiling, or low-level systems.... ...role can be based remotely or from one of our...Remote workFull timeWork at officeLocal areaHome officeCohere
New York, NY2 days ago$192.5k - $290k
...Senior Principal Systems Engineer - Humanoid Robotics... ...engineers and AI/ML scientists while staying... ...: Design scalable, modular software... ...to optimize system latency, compute allocation... ...RTOS, FreeRTOS or low-level embedded control... ...and edge AI inference platforms....Remote workLocal areaCerence
United States16 hours ago$171.7k - $303.9k
...The Data Labeling Engineering team designs, builds... ..., and AI/ML, defining the strategies... ...across teams and systems that unblock the next... ..., cost, and latency goals.Level up how... ...implement, and test scalable, high‑performance... ...States of America; Remote - WashingtonType:...Remote workFull timeLocal areaWork from homeRelocation packageFlexible hoursGeneral Motors
Sunnyvale, TX3 days ago- ...ML Systems Engineer As an ML systems engineer with Minerva you will work... ...today. We are deliberately low-profile: a team of around 60... ...evaluation, optimisation of inference on edge devices or deployment... ...home office budget if you work remotely The full detail comes...Remote workWork at officeHome officeRelocation package
Minerva Defense, Inc.
United States3 days ago $83.52k - $125.28k
...seeking a Real-Time Inference Engineering Lead (FTE /... ...provides standardized, scalable model-serving... ...and industrialize low-latency, resilient model-... ...data science, and ML engineering teams... ...with enterprise systems.Engineer Kubernetes... ...positions offer remote or hybrid work...Remote workFull timeTemporary workWork at officeFlexible hoursNTT DATA
Charlotte, NC6 days ago- ...their business systems through natural... ...Moveworks’ Reasoning Engine and natural... ...cutting edge ML infrastructure... ...distributed training and inference pipeline for... ...framework, LLM latency optimization,... ...challenges on scalability of services as... ...(flexible, remote, or required in...Remote workPermanent employmentWork at officeFlexible hours
Moveworks
Mountain View, CA4 days ago $120 per hour
.... Position: MLOps Engineer, LLM Systems (Serving, GPU Kernels,... .../hour Location: Remote Commitment: 40 hours... ..., debugging , and inference serving . Write... ...model performance on ML systems and training... ...serving throughput and latency trade-offs. Collaborate...Remote jobContract workSummer workMercor
New York, NYa month ago- ...Responsibilities As a ML System Engineer on the AI & ML Platform’s Inference team, you will design... ..., auto-scaling) to deep low-level optimizations (GPU... ...Architect and implement scalable distributed infrastructure... ...global KV cache).Optimize latency and throughput of model...Work at officeLocal area
Atlassian
San Francisco, CA3 days ago - ...Staff Site Reliability Engineer at TENEX TENEX is... ...responsible for ensuring the scalability, reliability, and... ...System Resilience: Design, build... ...optimizing infrastructure for low-latency, high-throughput AI workloads... ...infrastructure. AI/ML Infrastructure: Experience...Remote workWork from home
TenEx
United States4 days ago $204k - $216k
...silos, in legacy systems, in the heads of a... ...build and run the inference infrastructure that... ...serving, scaling, latency, and cost. Every time... ..., and platform engineering, and you make the... ...right. The AI/ML Infrastructure and... ...answers, and keep it low as the platform...Sapience AI Corporation
Portland, OR6 days ago- ...compatibility with existing systems and enterprise... ..., and platform engineering teams.... ...improve performance, scalability, reliability, and... ...experience supporting AI/ML platforms, MLOps workflows... ...model serving, inference optimization, or... ...performed fully remote, hybrid, or onsite...Remote workFull timeWork at office
Applied Research Associates
Raleigh, NC3 days ago - Multi-Strategy Digital Asset Fund in New York seeks a Senior Software Engineer specializing in OTC to strengthen our low-latency trading platform. You will design and maintain real-time systems with microsecond precision, supporting trade flow, risk, and internal reporting...
- TXSE is hiring a highly skilled Low-Latency Software Engineer to design, develop, and optimize the core infrastructure of our equities trading platform in Dallas. You will focus on ultra-low-latency systems, matching engines, and market data distribution to enable fast...
- ...electronic trading connectivity infrastructure and high-impact systems that handle order flow across major markets. You will design,... ...brokers, exchanges, and internal systems. The role emphasizes low-latency design and multi-market connectivity. #J-18808-Ljbffr C2R Ventures
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to ML Inference Systems Engineer - Remote, Scalable, Low-Latency. Be the first to apply!
Related searches
- operations support system engineer Brooklyn, NY
- healthcare systems engineer Brooklyn, NY
- senior windows systems engineer Brooklyn, NY
- systems engineer Brooklyn, NY
- senior devops engineer remote Brooklyn, NY
- remote .net full stack web developer Brooklyn, NY
- nursing recruiter (remote) Brooklyn, NY
- clinical data coordinator remote Brooklyn, NY
- pmp - project manager - remote Brooklyn, NY
- part time project manager remote Brooklyn, NY