ML Systems Engineer: Scalable Inference Platform
Atlassian
At Atlassian, we hire people who can work from an office, from home, or mix the two to fit their needs. As an ML System Engineer on the AI & ML Platform’s Inference team, you’ll design and optimize large-scale model serving systems end-to-end, owning distributed infrastructure and deep low-level optimizations. You’ll collaborate with senior ML engineers to fine-tune and deploy open-source LLMs, build CI/CD pipelines for model deployment, and aim for billions of requests served reliably with low #J-18808-Ljbffr Atlassian
- ...At Atlassian, the ML System Engineer will design and optimize large-scale model serving systems, spanning distributed infrastructure to low... ..., high-concurrency serving systems, benchmarking and tuning inference engines, and partnering with senior ML engineers to deploy open...SuggestedRemote job
- ...reliable, field-ready AI systems that solve the... ...rigorous engineering with learning systems... ...are seeking a Staff ML Systems Engineer to... ...distributed systems, and platform engineering. You... ...for designing scalable systems that... ...learning training and inference systems. Familiarity...PlatformLocal area
$236k - $330k
...looking for talented systems developers and researchers... ...of the art in LLM inference systems and... ...latency, throughput, scalability, and cost.Beyond optimizing... ...We embrace AI-native engineering, using AI not only as... ...architectures, hardware platforms, workload...Platform- ...seeking a Senior Software Development Engineer for the EC2 Nitro ML platforms. You will drive development across... ..., and software stacks, focusing on scalable ML workloads. The role requires... ...or Rust on Linux, including build systems, version control, and unit testing....Platform
$178.2k - $232.65k
...Engineering | Seattle, United States | Remote, Remote | San Francisco, United... ...have a legal entity. As a ML System Engineer on the AI & ML Platform’s Inference team, you will design and optimize... ...to: Architect and implement scalable distributed infrastructure for model...PlatformWork at officeLocal areaRemote work- ...in any country where we have a legal entity. As a ML System Engineer on the AI & ML Platform’s Inference team, you will design and optimize large-scale model... ...role, you are expected to: Architect and implement scalable distributed infrastructure for model serving (load...PlatformWork at officeLocal area
- ...Adobe is seeking a Senior Staff Machine Learning Engineer for its GenAI Services team. You will design scalable inference pipelines, optimize models for latency, and... ...You will lead large-scale GPU-intensive GenAI systems, mentor engineers, and shape technical direction...
- ...Snowflake is building the next generation of AI-native inference systems. We seek experienced researchers and systems developers to advance LLM inference, optimization, and platform-wide performance across GPUs, CPUs, and distributed runtimes. You will collaborate...Platform
$175k - $200k
...Machine Learning Engineer Truveta is the world... ...provider led data platform with a vision of... ...adaptive agentic systems and fine-tuned foundation... .... You’ll blend ML craftsmanship with... ...to create scalable, self-improving AI... ...interpretability, and inference performance. Think...PlatformFor contractorsVisa sponsorshipWork visaFlexible hours$106.9k - $160.4k
...are seeking a skilled ML Engineer to design, build, and... ...solutions that are reliable, scalable, secure, and... ...operationalizing machine learning systems across Weyerhaeuser’s... ...product managers, and platform teams to build... ...deploy batch and real-time inference solutions using cloud-...PlatformFull timeTemporary work$203.5k - $299.3k
...generation of causal decisioning systems for New Verticals:... ...Causal Machine Learning Engineer to help build the causal ML foundation behind how DoorDash... ...metrics, experimentation platforms, counterfactual policy... ...experience with causal inference, econometrics, experimentation...PlatformHourly payWork at officeLocal areaRemote workFlexible hours$152k - $228k
...Senior ML Engineer About Invoca Invoca is an... ...powered revenue execution platform that brings together... ...and fine-tuning through inference optimization and... ...Own Production ML as a System, Not a One-Off Deployment... ...throughput; build robust, scalable APIs for internal and...PlatformCurrently hiringRemote workFlexible hours- ...Inc. in Seattle, WA is seeking a Sr. Software Development Engineer for the Inference Team on AWS Neuron to deliver high-performance model inference... ...model development, compiler, and runtime teams to ensure scalable, production-ready performance. #J-18808-Ljbffr Jobleads...
- ...can thrive.Job DescriptionThe AI Inference Engineer plays a critical role in the AI... ...hardware acceleration, designing scalable infrastructure, and monitoring system performance. Key... ...including Docker, Kubernetes, and cloud platforms such as AWS, GCP, and Azure. Hardware...PlatformFull timeLocal areaImmediate start
- ...seeking an experienced AI/ML Technical Program Manager (Inference) to lead cross-functional... ...across inference platform delivery, customer onboarding... ...optimization. You will partner with Engineering, Product, Infrastructure,... ...to-Market teams to drive scalable, reliable production...Platform
- ...reliable, field-ready AI systems that solve the... ...combining rigorous engineering with learning systems... ...About This Role Modern ML systems improve... ...researchers, labeling, Data Platform, and ML Platform... .... Develop scalable batch and offline inference pipelines for auto-labeling...PlatformLocal area
$176.76k - $232k
...and building the data and AI platforms and products that enable... ...responsibilities As a Senior AI/ML Engineer, you will lead the delivery of scalable AI/ML solutions to business... ...to architectures and system design for serving AI/ML inference solutions in production. You...PlatformPermanent employmentFull timeContract workPart timeWork visa$148.7k - $201.2k
...for AI training and inference? Want to do industry... ...high performance and scalability in AI/ML and HPC workloads.... ...you. The AWS Hardware Engineering team creates server... ...scale and curious how systems and software... ...next-generation AWS platforms. You will have a direct...PlatformInternshipLocal areaFlexible hours$209k - $313k
...other digital services.Snap Engineering teams build fun and technically... ...complexity, bias/variance, scalability, and interpretabilityConduct... ...Strong understanding of causal inference and modern approaches to estimating... ...tests) and leveraging causal ML in production...Full timeLive inWork at officeLocal area- ...take your software engineering career to the next... ..., stable, and scalable technology products... ...coding hygiene and system architectureRequired... ...with emphasis on ML systems.Hands-on experience... ...more public cloud platforms (AWS, GCP)... ...Serving, Triton Inference Server)Familiarity...Platform
- ...Algorithm team is the core engine driving the ultimate... ...international platform. At the intersection of... ...search, and recommendation systems that connect millions... ...ETA prediction, Causal Inference for dynamic pricing,... ...problems into highly scalable algorithmic solutions....Platform
- ...data mining, and causal inference methods.At TikTok, we... ...a global e-commerce platform that connects millions... ...As a Machine Learning Engineer focused on demand forecasting... ...behavior.5. Build scalable and efficient data... ...models into production systems and ensure reliable and...Platform
- ...mobile advertising platform. Focused on the... ...advertising intelligence systems using advanced... ...Machine Learning Engineers who are passionate... ...production-quality ML solutions using... ...frameworks. Develop scalable distributed... ...learning, causal inference, and optimization...Platform
$151.8k - $265.35k
...SeniorMachine Learning Engineers for our GenAI... ...engineers in building scalable, high-performance generative AI systems—powering features... ...develop efficient inference pipelines,... ...and mentor other ML engineers.Job ResponsibilitiesDesign... ..., and MLOps platforms.#FireflyGenAIAbout...PlatformFull timeTemporary workLocal areaWorldwide$98.8k - $148.2k
...Machine Learning Engineer to help operationalize... ...support reliable, scalable, secure delivery... ...machine learning systems across Weyerhaeuser... ...managers, and platform teams to apply standardized... ...experience with ML deployment... ...batch and real-time inference workloads using cloud...PlatformFull timeTemporary work- ...member of the Product and Engineering team at PitchBook,... ...(MLE) on the AI & ML (Insights) team, you... ...features on the PitchBook Platform. You will be deeply... ...models (LLMs), and scalable data systems. You will be expected... ...developing models that can infer meaning and structure...PlatformWork at officeRemote workVisa sponsorship
$150.75k - $241.2k
...a Machine Learning Engineer at Axon, you’ll help... ...alongside talented ML engineers and scientists... ..., where AI systems need to be accurate, scalable, secure, responsible... ...large-scale evaluation, inference optimization, data pipelines... ....Help build the platform behind Axon AI....PlatformWork experience placementWork at officeRemote work- ...Hiring: Machine Learning Engineer / Data Scientist (GenAI &... ...client is developing a highly scalable AI-driven translation platform capable of processing... ...large-scale machine learning systems that directly impact global... ...selecting the right AI/ML models for specific business...PlatformCurrently hiring
$184.5k
...Machine Learning Engineer At Expedia Group... ...machine learning–driven systems that power how our... ...our distribution platform for both travelers... ...evolve robust, scalable machine learning... ...problems into clear ML-driven solutions,... ...large-scale batch inference, including clear,...Platform$175k - $308.5k
...Senior Machine Learning Engineer Join a team at the forefront of ML infrastructure and... ...services. We build robust systems that connect scalable data pipelines with... ...scaled. We develop a platform for ML data and... ...), AI Ops, efficient inference, and a modern feature...PlatformRelocationFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to ML Systems Engineer: Scalable Inference Platform. Be the first to apply!
- computer vision machine learning engineer Seattle, WA
- machine learning software engineer Seattle, WA
- ai ml engineer Seattle, WA
- senior ml engineer Seattle, WA
- machine learning ai engineer Seattle, WA
- machine learning engineer Seattle, WA
- senior linux systems engineer Seattle, WA
- system engineer contract Seattle, WA
- senior staff systems engineer Seattle, WA
- microsoft systems engineer Seattle, WA





