Machine Learning Infrastructure Engineer
$105k - $143kBright Vision Technologies
This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential. Job Title: Machine Learning Infrastructure Engineer
Location: 100% Remote (U.S.)
Position Type: Full-time, Direct W2
Salary Range: $105,000–$143,000 Annually
Experience Required: 6+ years Sponsorship: U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position. Job Summary
We are seeking a Machine Learning Infrastructure Engineer to design, build, and operate high-performance, highly reliable inference platforms for serving large machine learning models in production. The role focuses on the systems engineering side of AI deployment, including request routing, batching, caching, autoscaling, GPU utilization, and end-to-end observability across diverse model workloads. The ideal candidate brings strong distributed systems and performance engineering expertise, has shipped serving systems at scale, and understands the trade-offs between latency, throughput, cost, and quality in ML serving. Required Qualifications
- Bachelor’s or Master’s degree in Computer Science or a related field.
- Six or more years of experience in distributed systems, infrastructure, or ML platform engineering.
- Strong proficiency in Python and a systems language such as Go, Rust, or C++.
- Deep experience operating high-throughput, low-latency services in production.
- Hands-on experience with LLM or large model inference frameworks such as vLLM or TensorRT-LLM.
- Strong understanding of GPU architecture, memory hierarchies, and accelerator utilization.
- Familiarity with Kubernetes, autoscaling, and modern cloud platforms.
- Experience with observability stacks including metrics, tracing, and structured logging.
- Solid grounding in performance engineering and capacity planning.
- Strong communication and incident response skills.
- Open-source contributions to model serving infrastructure.
- Experience with multi-region or globally distributed AI serving.
- Familiarity with model quantization, distillation, and compression techniques.
- Exposure to FinOps for AI workloads and cost-efficient serving design.
- Experience supporting external-facing AI APIs at scale.
Would you like to know more about this opportunity? For immediate consideration, please send your resume to View email address on us.fitly.work.
Bright Vision Technologies is an Equal Opportunity Employer.
Equal Employment Opportunity (EEO) Statement
Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall.
BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment.
$300k
...researchers, data scientists, and engineers, tackling the most... ...performance computing in deep learning, driving impactful discoveries... ...looking for a distributed ML infrastructure engineer to help extend and... ...Experience with large-scale machine learning workloads (strong ML...SuggestedFull timeFlexible hours$170k - $240k
...impact delivering-driven expert in ML Training Infrastructure with a strong ability to execute hands-on technical... ...model development initiatives. As a Senior ML Engineer, you will collaborate closely with machine learning engineers, research scientists, and other partners...SuggestedFull timeLocal areaRemote workWork from homeRelocationRelocation packageFlexible hours$92k - $138k
...streaming data, supporting analytics, product intelligence, machine learning pipelines, and business operations. As data volume... ...ML systems. We’re looking for a Machine Learning Engineer to join our Offline Infrastructure team. This is an ideal role for a recent university...SuggestedWork at officeWorldwideRelocation package$161.3k - $274.2k
..., California in 2004 when a visionary engineer, Fred Luddy, saw the potential to transform... ...You Will DoWe are looking for Senior Machine Learning engineers to join our GenAI Search... ...closely with the ranking, product, design, infrastructure and data science teams to drive our...SuggestedWork at officeRemote workFlexible hours$176.1k - $308.2k
...workflows, and continuously learn and adapt.Moveworks is trusted... ...automation with Moveworks’ Reasoning Engine and natural language... ...'ll collaborate closely with machine learning experts and cross-functional... ...our end-to-end product infrastructure with the utmost engineering...SuggestedWork at officeRemote workFlexible hours$230k - $300k
...with the right team to fulfill our mission: building the infrastructure layer for content intelligence.If you’re inspired to dream... ...information, visit About the RoleWe are seeking a Staff Machine Learning Engineer to provide technical leadership for our recommendation systems...Full timeLocal areaWork from home$160k - $225k
...will be used to expand our product and engineering teams, bringing our vision of... ...software has a clear playbook, building the infrastructure for autonomous, intelligent agents is... ...writing the manual. As an early Machine Learning Engineer at MAI, you won't just be writing...Full time- ...in our pursuit of excellence, constantly learning and evolving as we pave the way for a... ...your career! The Role As an ML Engineer within the Application Engineering team,... ...In order to set you up for success as a Machine Learning Engineer at Wayve, we’re looking...Full timeWork at officeWork from home
$160k - $200k
Santa Clara, CAData Engineering - Machine Learning and Data Engineer /Full-time /HybridPlusAI is a Physical AI company pioneering AI-based virtual... ...to join its fast-growing teams.As a Senior ML Infrastructure Engineer at Plus, you will design scalable architectures...Full time$153.2k - $234.1k
...Our team is developing and deploying machine learning solutions that support safe and reliable... ...world scenarios. As a Senior ML Infra Engineer, you will work on the core systems... ...distributed systems, applications, or ML infrastructure. Experience designing robust services...Full timeLocal areaRemote workWork from homeRelocation packageFlexible hours$124k - $250k
...in the LifeAs a member of our software engineering infra team, you'll solve technical challenges... ...implementing state-of-the-art software infrastructure. The team builds a high-performance,... ...legally protected characteristics. Learn more about EEO rights as an applicant here...$155.42k - $205.9k
...efforts. We’re proud to serve as the infrastructure platform for teams developing autonomous... ...validation of state-of-the-art (SOTA) machine learning models, with a focus on performance,... ...are seeking a Senior ML Infrastructure engineer to help build and scale robust Compute...Full timeLocal areaRemote workWork from homeRelocationRelocation packageFlexible hours$119.22k - $187.5k
...DescriptionThe Role: We are looking for a Software Engineer to join our team and help us scale our... ...with Kubernetes at Scale Experience infrastructure applications or similar experience... ...can focus on realizing your ambitions. Learn how GM supports a rewarding career that...Full timeLocal areaWork from homeRelocationRelocation packageFlexible hours$150k
...researchers, data scientists, and engineers, tackling the most... ...performance computing in deep learning, driving impactful discoveries... ...pioneers. The Role As a Machine Learning Engineer at the... ...Machine Learning (ML) models, ML infrastructure, Natural Language Processing...Full timeWorldwideVisa sponsorship- ...delivered for millions of patients worldwide. We’re a team of engineers, clinicians, and innovators united by one purpose: to make... ...of the lung, to take a biopsy at a target location. As a machine learning engineer on the Ion project, you will join a small team of experts...Full timeLocal areaWorldwideFlexible hours
- ...About Voltai Voltai is developing world models, and agents to learn, evaluate, plan, experiment, and interact with the physical... ...four US presidents. What we're Looking For Strong AI/ML engineering skills from top tier CS, EECS, Math and Physics programs. Proven...Full time
$153.2k - $234.1k
...autonomous driving? Join the Embodied AI Infra Foundation team at General Motors, where we build the critical infrastructure that powers every machine learning engineer working on our cutting-edge Autonomous Driving models. From foundational models to state-of-the-art...Full timeWork at officeLocal areaRemote workWork from homeRelocationRelocation packageFlexible hours$175k - $275k
...curated datasets, or full-cycle data engineering, Abaka AI provides the foundation for... ...the Role We’re hiring our first Machine Learning Engineer in the United States, a... ...experimentation frameworks, distributed infrastructure, and internal best practices. Your work...Full timeImmediate startFlexible hours$150k
...class researchers, data scientists, and engineers, tackling the most fundamental and impactful... ...for high-performance computing in deep learning, driving impactful discoveries that... ...forefront of optimizing performance for the machine learning software stacks, especially at...Full timeWork experience placementVisa sponsorship- ...simplify tasks, save time, and enhance learning and creativity. Our technology is designed... ...Mistral AI is seeking a Applied AI Engineer to facilitate the adoption of its products... ...understanding of concepts and algorithms underlying machine learning and LLMs • You're experienced...Full timeWork at officeVisa sponsorship
$132k - $189k
...and environmental conditions.Build software tools, utilizing machine learning (ML) automation to streamline image quality (IQ) tuning,... ...workflows.Minimum qualifications:Bachelor’s degree in Electrical Engineering, Computer Science, Imaging Science, Physics, or a related...$195k - $230k
...with the right team to fulfill our mission: building the infrastructure layer for content intelligence.If you’re inspired to dream... ..., visit About the RoleWe are looking for a Senior Machine Learning Engineer to help evolve our large-scale recommendation systems and...Full timeLocal areaWork from home$230k - $265k
...ML and work alongside industry-veteran scientists and engineers. As a Senior Machine Learning Engineer, you’ll bring your strong software... ...long-term maintenance.Partner deeply with product, and infrastructure teams to develop and translate cutting-edge research...Permanent employment$209k - $313k
...themselves, live in the moment, learn about the world, and have... ...other digital services.Snap Engineering teams build fun and... ...forefront.We’re looking for a Machine Learning Engineer to join Snap... ...with machine learning, ranking infrastructures, and system designIf you have...Full timeLive inWork at officeLocal area$150k - $230k
...with the right team to fulfill our mission: building the infrastructure layer for content intelligence.If you’re inspired to dream... ..., visit About the RoleWe are looking for a hands-on Machine Learning Engineer to drive the post-training of our large language models,...Full timeLocal areaWork from home- ...delivered for millions of patients worldwide.We’re a team of engineers, clinicians, and innovators united by one purpose: to make... ...and implementing user-facing software and computer vision / machine learning algorithmsIterating with user feedback and delivering production...Local areaWorldwideFlexible hours
$173k - $259k
...themselves, live in the moment, learn about the world, and have... ...other digital services.Snap Engineering teams build fun and... ...forefront.We’re looking for a Machine Learning Engineer to join Snap... ...with machine learning, ranking infrastructures, and system designIf you have...Full timeLive inWork at officeLocal area$119.25k - $150.85k
...Deployment & Inference Solutions team deploys machine learning models from training frameworks (e.g.,... ...Escalade IQ, and we’re hiring engineers to help deliver the next generation of... ...and inference benchmarking/profiling infrastructure. Pair with senior engineers on deployment...Full timeInternshipLocal areaWork from homeRelocation packageFlexible hours$166k - $244k
...the world’s most important infrastructure challenges: helping the energy... ...in energy, AI, software engineering, and products to build tools... ...that matters at global scale. Learn more about our team and our... ...looking for an early career Machine Learning Engineer to join our...Full timeFlexible hours$190k - $300k
...with the right team to fulfill our mission: building the infrastructure layer for content intelligence.If you’re inspired to dream... ...information, visit About the RoleWe are looking for a Machine Learning Engineer to build intelligent systems that connect consumers with...Full timeInternshipLocal areaWork from home
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Machine Learning Infrastructure Engineer. Be the first to apply!
- ai ml engineer Mountain View, CA
- senior ml engineer Mountain View, CA
- computer vision machine learning engineer Mountain View, CA
- machine learning engineer Mountain View, CA
- machine learning ai engineer Mountain View, CA
- machine learning software engineer Mountain View, CA
- infrastructure engineering manager Mountain View, CA
- data infrastructure engineer Mountain View, CA
- senior infrastructure engineer Mountain View, CA
- remote infrastructure engineer Mountain View, CA


