Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Machine Learning Infrastructure Engineer

$105k - $143k
Full-time

Bright Vision Technologies

Machine Learning Infrastructure Engineer – Remote

Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States.
This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.

Job Title:  Machine Learning Infrastructure Engineer
Location: 100% Remote (U.S.)
Position Type: Full-time, Direct W2
Salary Range: $105,000–$143,000 Annually
Experience Required: 6+ years

Sponsorship:  U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position.

Job Summary
We are seeking a Machine Learning Infrastructure Engineer to design, build, and operate high-performance, highly reliable inference platforms for serving large machine learning models in production. The role focuses on the systems engineering side of AI deployment, including request routing, batching, caching, autoscaling, GPU utilization, and end-to-end observability across diverse model workloads. The ideal candidate brings strong distributed systems and performance engineering expertise, has shipped serving systems at scale, and understands the trade-offs between latency, throughput, cost, and quality in ML serving.

Required Qualifications
  • Bachelor’s or Master’s degree in Computer Science or a related field.
  • Six or more years of experience in distributed systems, infrastructure, or ML platform engineering.
  • Strong proficiency in Python and a systems language such as Go, Rust, or C++.
  • Deep experience operating high-throughput, low-latency services in production.
  • Hands-on experience with LLM or large model inference frameworks such as vLLM or TensorRT-LLM.
  • Strong understanding of GPU architecture, memory hierarchies, and accelerator utilization.
  • Familiarity with Kubernetes, autoscaling, and modern cloud platforms.
  • Experience with observability stacks including metrics, tracing, and structured logging.
  • Solid grounding in performance engineering and capacity planning.
  • Strong communication and incident response skills.
Preferred Qualifications
  • Open-source contributions to model serving infrastructure.
  • Experience with multi-region or globally distributed AI serving.
  • Familiarity with model quantization, distillation, and compression techniques.
  • Exposure to FinOps for AI workloads and cost-efficient serving design.
  • Experience supporting external-facing AI APIs at scale.
How to Apply
Would you like to know more about this opportunity? For immediate consideration, please send your resume to View email address on us.fitly.work.
Bright Vision Technologies is an Equal Opportunity Employer.

Equal Employment Opportunity (EEO) Statement

Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall.

BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment.

Vacancy posted 24 days ago
Similar jobs that could be interesting for youBased on the Machine Learning Infrastructure Engineer in Mountain View, CA vacancy
  • $300k

     ...researchers, data scientists, and engineers, tackling the most...  ...performance computing in deep learning, driving impactful discoveries...  ...looking for a distributed ML infrastructure engineer to help extend and...  ...Experience with large-scale machine learning workloads (strong ML... 
    Suggested
    Full time
    Flexible hours

    Institute Of Foundation Models

    Sunnyvale, CA
    13 hours ago
  • $170k - $240k

     ...impact delivering-driven expert in ML Training Infrastructure with a strong ability to execute hands-on technical...  ...model development initiatives. As a Senior ML Engineer, you will collaborate closely with machine learning engineers, research scientists, and other partners... 
    Suggested
    Full time
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    2 days ago
  • $92k - $138k

     ...streaming data, supporting analytics, product intelligence, machine learning pipelines, and business operations. As data volume...  ...ML systems. We’re looking for a Machine Learning Engineer to join our Offline Infrastructure team. This is an ideal role for a recent university... 
    Suggested
    Work at office
    Worldwide
    Relocation package

    Unity

    Mountain View, CA
    3 days ago
  • $161.3k - $274.2k

     ..., California in 2004 when a visionary engineer, Fred Luddy, saw the potential to transform...  ...You Will DoWe are looking for Senior Machine Learning engineers to join our GenAI Search...  ...closely with the ranking, product, design, infrastructure and data science teams to drive our... 
    Suggested
    Work at office
    Remote work
    Flexible hours

    Moveworks

    Mountain View, CA
    1 day ago
  • $176.1k - $308.2k

     ...workflows, and continuously learn and adapt.Moveworks is trusted...  ...automation with Moveworks’ Reasoning Engine and natural language...  ...'ll collaborate closely with machine learning experts and cross-functional...  ...our end-to-end product infrastructure with the utmost engineering... 
    Suggested
    Work at office
    Remote work
    Flexible hours

    Moveworks

    Mountain View, CA
    1 day ago
  • $230k - $300k

     ...with the right team to fulfill our mission: building the infrastructure layer for content intelligence.If you’re inspired to dream...  ...information, visit About the RoleWe are seeking a Staff Machine Learning Engineer to provide technical leadership for our recommendation systems... 
    Full time
    Local area
    Work from home

    News Break

    Mountain View, CA
    3 days ago
  • $160k - $225k

     ...will be used to expand our product and engineering teams, bringing our vision of...  ...software has a clear playbook, building the infrastructure for autonomous, intelligent agents is...  ...writing the manual. As an early Machine Learning Engineer at MAI, you won't just be writing... 
    Full time

    Mai

    Mountain View, CA
    13 hours ago
  •  ...in our pursuit of excellence, constantly learning and evolving as we pave the way for a...  ...your career! The Role   As an  ML Engineer within the Application Engineering team,...  ...In order to set you up for success as a Machine Learning Engineer at Wayve, we’re looking... 
    Full time
    Work at office
    Work from home

    Wayve

    Sunnyvale, CA
    13 hours ago
  • $160k - $200k

    Santa Clara, CAData Engineering - Machine Learning and Data Engineer /Full-time /HybridPlusAI is a Physical AI company pioneering AI-based virtual...  ...to join its fast-growing teams.As a Senior ML Infrastructure Engineer at Plus, you will design scalable architectures... 
    Full time

    Plus.ai

    Santa Clara, CA
    3 days ago
  • $153.2k - $234.1k

     ...Our team is developing and deploying machine learning solutions that support safe and reliable...  ...world scenarios. As a Senior ML Infra Engineer, you will work on the core systems...  ...distributed systems, applications, or ML infrastructure. Experience designing robust services... 
    Full time
    Local area
    Remote work
    Work from home
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    1 day ago
  • $124k - $250k

     ...in the LifeAs a member of our software engineering infra team, you'll solve technical challenges...  ...implementing state-of-the-art software infrastructure. The team builds a high-performance,...  ...legally protected characteristics. Learn more about EEO rights as an applicant here... 

    AppLovin

    Palo Alto, CA
    3 days ago
  • $155.42k - $205.9k

     ...efforts. We’re proud to serve as the infrastructure platform for teams developing autonomous...  ...validation of state-of-the-art (SOTA) machine learning models, with a focus on performance,...  ...are seeking a Senior ML Infrastructure engineer to help build and scale robust Compute... 
    Full time
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    2 days ago
  • $119.22k - $187.5k

     ...DescriptionThe Role: We are looking for a Software Engineer to join our team and help us scale our...  ...with Kubernetes at Scale Experience infrastructure applications or similar experience...  ...can focus on realizing your ambitions. Learn how GM supports a rewarding career that... 
    Full time
    Local area
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    3 days ago
  • $150k

     ...researchers, data scientists, and engineers, tackling the most...  ...performance computing in deep learning, driving impactful discoveries...  ...pioneers. The Role As a Machine Learning Engineer at the...  ...Machine Learning (ML) models, ML infrastructure, Natural Language Processing... 
    Full time
    Worldwide
    Visa sponsorship

    Institute Of Foundation Models

    Sunnyvale, CA
    13 hours ago
  •  ...delivered for millions of patients worldwide. We’re a team of engineers, clinicians, and innovators united by one purpose: to make...  ...of the lung, to take a biopsy at a target location. As a machine learning engineer on the Ion project, you will join a small team of experts... 
    Full time
    Local area
    Worldwide
    Flexible hours

    Intuitive & Co

    Sunnyvale, CA
    13 hours ago
  •  ...About Voltai Voltai is developing world models, and agents to learn, evaluate, plan, experiment, and interact with the physical...  ...four US presidents. What we're Looking For Strong AI/ML engineering skills from top tier CS, EECS, Math and Physics programs. Proven... 
    Full time

    Voltai

    Palo Alto, CA
    13 hours ago
  • $153.2k - $234.1k

     ...autonomous driving? Join the Embodied AI Infra Foundation team at General Motors, where we build the critical infrastructure that powers every machine learning engineer working on our cutting-edge Autonomous Driving models. From foundational models to state-of-the-art... 
    Full time
    Work at office
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    2 days ago
  • $175k - $275k

     ...curated datasets, or full-cycle data engineering, Abaka AI provides the foundation for...  ...the Role   We’re hiring our first Machine Learning Engineer in the United States, a...  ...experimentation frameworks, distributed infrastructure, and internal best practices. Your work... 
    Full time
    Immediate start
    Flexible hours

    Abaka Ai

    Palo Alto, CA
    13 hours ago
  • $150k

     ...class researchers, data scientists, and engineers, tackling the most fundamental and impactful...  ...for high-performance computing in deep learning, driving impactful discoveries that...  ...forefront of optimizing performance for the machine learning software stacks, especially at... 
    Full time
    Work experience placement
    Visa sponsorship

    Institute Of Foundation Models

    Sunnyvale, CA
    13 hours ago
  •  ...simplify tasks, save time, and enhance learning and creativity. Our technology is designed...  ...Mistral AI is seeking a Applied AI Engineer to facilitate the adoption of its products...  ...understanding of concepts and algorithms underlying machine learning and LLMs • You're experienced... 
    Full time
    Work at office
    Visa sponsorship

    Mistral Ai

    Palo Alto, CA
    13 hours ago
  • $132k - $189k

     ...and environmental conditions.Build software tools, utilizing machine learning (ML) automation to streamline image quality (IQ) tuning,...  ...workflows.Minimum qualifications:Bachelor’s degree in Electrical Engineering, Computer Science, Imaging Science, Physics, or a related... 

    Google

    Mountain View, CA
    13 hours ago
  • $195k - $230k

     ...with the right team to fulfill our mission: building the infrastructure layer for content intelligence.If you’re inspired to dream...  ..., visit About the RoleWe are looking for a Senior Machine Learning Engineer to help evolve our large-scale recommendation systems and... 
    Full time
    Local area
    Work from home

    News Break

    Mountain View, CA
    3 days ago
  • $230k - $265k

     ...ML and work alongside industry-veteran scientists and engineers. As a Senior Machine Learning Engineer, you’ll bring your strong software...  ...long-term maintenance.Partner deeply with product, and infrastructure teams to develop and translate cutting-edge research... 
    Permanent employment

    Otter.ai

    Mountain View, CA
    3 days ago
  • $209k - $313k

     ...themselves, live in the moment, learn about the world, and have...  ...other digital services.Snap Engineering teams build fun and...  ...forefront.We’re looking for a Machine Learning Engineer to join Snap...  ...with machine learning, ranking infrastructures, and system designIf you have... 
    Full time
    Live in
    Work at office
    Local area

    Snap

    Palo Alto, CA
    1 day ago
  • $150k - $230k

     ...with the right team to fulfill our mission: building the infrastructure layer for content intelligence.If you’re inspired to dream...  ..., visit About the RoleWe are looking for a hands-on Machine Learning Engineer to drive the post-training of our large language models,... 
    Full time
    Local area
    Work from home

    News Break

    Mountain View, CA
    3 days ago
  •  ...delivered for millions of patients worldwide.We’re a team of engineers, clinicians, and innovators united by one purpose: to make...  ...and implementing user-facing software and computer vision / machine learning algorithmsIterating with user feedback and delivering production... 
    Local area
    Worldwide
    Flexible hours

    Intuitive Surgical

    Sunnyvale, CA
    3 days ago
  • $173k - $259k

     ...themselves, live in the moment, learn about the world, and have...  ...other digital services.Snap Engineering teams build fun and...  ...forefront.We’re looking for a Machine Learning Engineer to join Snap...  ...with machine learning, ranking infrastructures, and system designIf you have... 
    Full time
    Live in
    Work at office
    Local area

    Snap

    Palo Alto, CA
    1 day ago
  • $119.25k - $150.85k

     ...Deployment & Inference Solutions team deploys machine learning models from training frameworks (e.g.,...  ...Escalade IQ, and we’re hiring engineers to help deliver the next generation of...  ...and inference benchmarking/profiling infrastructure. Pair with senior engineers on deployment... 
    Full time
    Internship
    Local area
    Work from home
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    2 days ago
  • $166k - $244k

     ...the world’s most important infrastructure challenges: helping the energy...  ...in energy, AI, software engineering, and products to build tools...  ...that matters at global scale. Learn more about our team and our...  ...looking for an early career Machine Learning Engineer to join our... 
    Full time
    Flexible hours

    X Company

    Mountain View, CA
    3 days ago
  • $190k - $300k

     ...with the right team to fulfill our mission: building the infrastructure layer for content intelligence.If you’re inspired to dream...  ...information, visit About the RoleWe are looking for a Machine Learning Engineer to build intelligent systems that connect consumers with... 
    Full time
    Internship
    Local area
    Work from home

    News Break

    Mountain View, CA
    13 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Machine Learning Infrastructure Engineer. Be the first to apply!