Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Machine Learning Infrastructure Engineer

$105k - $143k
Full-time

Bright Vision Technologies

Machine Learning Infrastructure Engineer – Remote

Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States.
This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.

Job Title:  Machine Learning Infrastructure Engineer
Location: 100% Remote (U.S.)
Position Type: Full-time, Direct W2
Salary Range: $105,000–$143,000 Annually
Experience Required: 6+ years

Sponsorship:  U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position.

Job Summary
We are seeking a Machine Learning Infrastructure Engineer to design, build, and operate high-performance, highly reliable inference platforms for serving large machine learning models in production. The role focuses on the systems engineering side of AI deployment, including request routing, batching, caching, autoscaling, GPU utilization, and end-to-end observability across diverse model workloads. The ideal candidate brings strong distributed systems and performance engineering expertise, has shipped serving systems at scale, and understands the trade-offs between latency, throughput, cost, and quality in ML serving.

Required Qualifications
  • Bachelor’s or Master’s degree in Computer Science or a related field.
  • Six or more years of experience in distributed systems, infrastructure, or ML platform engineering.
  • Strong proficiency in Python and a systems language such as Go, Rust, or C++.
  • Deep experience operating high-throughput, low-latency services in production.
  • Hands-on experience with LLM or large model inference frameworks such as vLLM or TensorRT-LLM.
  • Strong understanding of GPU architecture, memory hierarchies, and accelerator utilization.
  • Familiarity with Kubernetes, autoscaling, and modern cloud platforms.
  • Experience with observability stacks including metrics, tracing, and structured logging.
  • Solid grounding in performance engineering and capacity planning.
  • Strong communication and incident response skills.
Preferred Qualifications
  • Open-source contributions to model serving infrastructure.
  • Experience with multi-region or globally distributed AI serving.
  • Familiarity with model quantization, distillation, and compression techniques.
  • Exposure to FinOps for AI workloads and cost-efficient serving design.
  • Experience supporting external-facing AI APIs at scale.
How to Apply
Would you like to know more about this opportunity? For immediate consideration, please send your resume to View email address on us.fitly.work.
Bright Vision Technologies is an Equal Opportunity Employer.

Equal Employment Opportunity (EEO) Statement

Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall.

BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment.

Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Machine Learning Infrastructure Engineer in Redwood City, CA vacancy
  • Machine Learning EngineerCompany OverviewBased in Los Angeles, California, the company specializes in transforming complex, multi-source data...  ...and operational excellence.Role SummaryThe Machine Learning Engineer will play a critical role in designing, training, deploying,... 
    Suggested

    Robert Half

    Menlo Park, CA
    5 days ago
  • $295.25k - $345.04k

     ...to Roblox to explore, create, play, learn, and connect with friends in 3D immersive...  ..., we are building large scale ads machine learning infrastructure to deliver more value to our users and...  ...As a Machine Learning Infrastructure Engineer, you’ll build scalable, reliable, and... 
    Suggested
    Full time
    Work experience placement
    H1b
    Work at office
    Local area
    Visa sponsorship
    Monday to Friday

    Roblox

    San Mateo, CA
    3 days ago
  • $199k - $234k

     ...partner to growth, product, and data engineering—translating complex financial data into...  ...—this is the team for you!As a Staff Machine Learning Engineer on the AI R&D team, you will...  ...in Python and familiarity with ML infrastructure tooling.WHAT WE OFFERChallenging, high... 
    Suggested
    Work at office
    Flexible hours
    Shift work
    3 days per week

    Robinhood Financial

    Menlo Park, CA
    3 days ago
  • $225k - $250k

     ...through Suki Platform, our proprietary AI infrastructure.Clinicians using Suki spend over 70%...  ....What will you do everyday?The Machine Learning team forms the core of Suki's product,...  ...gets it: We’re former Googlers, Apple engineers, Stanford docs, and healthcare veterans... 
    Suggested

    Suki

    Redwood City, CA
    2 days ago
  • $260k - $330k

     ...commerce media across CTV, mobile app, and omnichannel environments.About the Role:We are looking for a Senior Principal Machine Learning Engineer to help build the next generation of performance optimization capabilities for PubMatic’s Activate platform.This role is focused... 
    Suggested
    Work at office
    Remote work

    PubMatic

    Redwood City, CA
    3 days ago
  • $170k - $225k

     ...with human-like skill, awareness, and learning capabilities. Our systems are...  ...reality!About the RoleAs a Senior/Staff Machine Learning Engineer, you will be working on a myriad of...  ...deploymentExperience with cloud-based infrastructure (AWS, GCP, Azure) and containerized... 
    Worldwide

    Dexterity

    Redwood City, CA
    2 days ago
  •  ...Snowflake is seeking a Senior Manager, Applied Field Engineering - AI/ML Product Specialists to lead a high-performing team of AI/ML experts at the intersection of product, field, and customer success. You’ll drive adoption, translate customer experience into product insights... 

    Snowflake Computing

    Menlo Park, CA
    3 days ago
  • $250k - $350k

     ...alongside some of the world's leading ML systems engineers, including leaders behind Megatron-LM,...  ...ML Systems Engineers to build the agentic infrastructure powering our large-scale training, inference, and reinforcement learning. You'll own critical pieces of the ML systems... 
    Visa sponsorship

    Periodic Labs

    Menlo Park, CA
    2 days ago
  • $250k - $320k

    Staff Infrastructure Engineer We are partnered with a Stealth AI Lab (backed by top-tier investors and advised by pioneering figures in generative and interactive media) that is hiring a Staff Infrastructure Engineer. The company pushes the boundaries of real-time generative... 
    Full time
    Immediate start

    Strativ Group

    Menlo Park, CA
    2 days ago
  •  ...from copilots to autonomous agents is creating an entirely new infrastructure layer, and we're building it.   zaimler is the context...  ...retrieve.   zaimler was founded by Biswajit Das (ex-VP Engineering, Truera), a Data Infra veteran and former Chief Architect at... 
    H1b
    Visa sponsorship
    Shift work

    zaimler

    San Mateo, CA
    24 days ago
  • $140k - $160k

     ...Exponent Exponent is the only premium engineering and scientific consulting firm with the...  ...mentoring, sponsorship, and a culture of learning. Thanks for your interest in joining our...  ...We are currently seeking a Machine Learning Engineer for our Mechanical Engineering... 
    Full time
    Work at office
    Flexible hours

    Exponent

    Menlo Park, CA
    2 days ago
  • $125k - $150k

     ...results. We are looking for a dynamic Data Scientist/ML Engineer to join our team. The Data Scientist/ML Engineer will work directly...  ...not limited to: Research, design, implement, and deploy Machine Learning algorithms for enterprise applications. Assist and enable... 
    Temporary work
    Work experience placement

    CATHEXIS

    Redwood City, CA
    8 days ago
  •  ...toolkit for downstream applications in molecular design.Thoughtfully execute deep learning experiments to improve performance of models or develop new functionality (e.g. loop engineering, structure prediction of protein-protein complexes).Work closely with software engineers... 
    Work at office
    Remote work

    Diffuse Bio

    Redwood City, CA
    2 days ago
  • $140k - $240k

     ...renewables. The founding team of Stanford engineers was named Forbes 2019 30 Under 30 and...  ...forecasting presents unusually rich machine learning problems: enormous, messy datasets;...  ...down another 1% of model improvement.Infrastructure and systems — Turn successful experiments... 

    WindBorne Systems

    Redwood City, CA
    2 days ago
  • $139.7k - $216.5k

     ..., California in 2004 when a visionary engineer, Fred Luddy, saw the potential to transform...  ...You Will DoWe are looking for Machine learning engineers to join our GenAI Search Platform...  ...with the ranking, product, design, infrastructure and data science teams to drive our agentic... 
    Work at office
    Remote work
    Flexible hours

    Moveworks

    Mountain View, CA
    5 days ago
  •  ...Job Description About the Role This is a hands-on infrastructure engineering role at an early-stage enterprise AI company building a...  ...Looking For ~5+ years of experience building and operating machine learning inference systems, model-serving platforms, or ML... 

    Clera

    San Mateo, CA
    4 days ago
  • $180k

     ...small, highly motivated, and focused on engineering excellence. This organization is for...  .... ABOUT THE ROLE: As an ML Infrastructure Engineer, you will play a pivotal role...  ...reliability, and efficiency of large-scale machine learning systems Working across the full... 
    Temporary work
    Work experience placement

    SpaceXAI

    Palo Alto, CA
    15 days ago
  • $157.59k - $203.94k

     ...DescriptionJob DescriptionThis ML Platform Engineer will have the unique opportunity to...  .... Through the operationalization of machine learning models, data pipelines, and advanced analytics...  ...build and maintain the ML and data infrastructure that supports Quality Performance and... 
    Full time
    Contract work
    For contractors
    Local area
    Worldwide

    GILEAD Sciences

    Foster, CA
    5 days ago
  • $230k - $300k

     ...with the right team to fulfill our mission: building the infrastructure layer for content intelligence.If you’re inspired to dream...  ...information, visit About the RoleWe are seeking a Staff Machine Learning Engineer to provide technical leadership for our recommendation systems... 
    Full time
    Local area
    Work from home

    News Break

    Mountain View, CA
    3 days ago
  •  ...soon giving countless hours back to our customers so they can spend more time on the things they value most. As a Machine Learning Research Engineer, you will work on the software and algorithms that enable our robots to complete dexterous manipulation tasks in home... 

    Sunday

    Redwood City, CA
    5 days ago
  • $124k - $250k

     ...in the LifeAs a member of our software engineering infra team, you'll solve technical challenges...  ...implementing state-of-the-art software infrastructure. The team builds a high-performance,...  ...legally protected characteristics. Learn more about EEO rights as an applicant here... 

    AppLovin

    Palo Alto, CA
    2 days ago
  • $140k - $240k

    Machine Learning Research Engineer, Applied Research WindBorne Systems is supercharging weather forecasts with a unique proprietary data source: a global constellation of next-generation smart weather balloons targeting the most critical atmospheric data. We design, manufacture... 
    Work at office

    Convectivecapital

    Redwood City, CA
    1 day ago
  • $254k - $350k

     ...architect and optimize high-performance deep learning models that generate dense, temporally...  ...dependency on sparse sensor modalities .Engineer temporal processing modules to improve...  ...or PhD in Computer Science, Robotics, Machine Learning, or related field with 6+ years... 
    Full time
    Temporary work
    Relocation package

    Zoox

    Foster, CA
    4 days ago
  • $209k - $313k

     ...themselves, live in the moment, learn about the world, and have...  ...other digital services.Snap Engineering teams build fun and...  ...forefront.We’re looking for a Machine Learning Engineer to join Snap...  ...with machine learning, ranking infrastructures, and system designIf you have... 
    Full time
    Live in
    Work at office
    Local area

    Snap

    Palo Alto, CA
    5 days ago
  • $166k - $244k

     ...the world’s most important infrastructure challenges: helping the energy...  ...in energy, AI, software engineering, and products to build tools...  ...that matters at global scale. Learn more about our team and our...  ...looking for an early career Machine Learning Engineer to join our... 
    Full time
    Flexible hours

    X Company

    Mountain View, CA
    3 days ago
  • $230k - $265k

     ...ML and work alongside industry-veteran scientists and engineers. As a Senior Machine Learning Engineer, you’ll bring your strong software...  ...long-term maintenance.Partner deeply with product, and infrastructure teams to develop and translate cutting-edge research... 
    Permanent employment

    Otter.ai

    Mountain View, CA
    2 days ago
  • $158.4k - $217.8k

     ...to choose between performance and sustainability, design and engineering, ambition and integrity. In Lucid Air and Lucid Gravity, we...  ...redefine what’s possible and shape the future of mobility.Senior Machine Learning Engineer, End-to-End Planning Role:Develop and maintain high... 

    Lucid Motors

    Newark, CA
    3 days ago
  • $173k - $259k

     ...themselves, live in the moment, learn about the world, and have...  ...other digital services.Snap Engineering teams build fun and...  ...forefront.We’re looking for a Machine Learning Engineer to join Snap...  ...with machine learning, ranking infrastructures, and system designIf you have... 
    Full time
    Live in
    Work at office
    Local area

    Snap

    Palo Alto, CA
    5 days ago
  • $188.5k - $282.7k

     ...SAGE, Rubrik's Semantic AI Governance Engine, which is the first system designed to...  ...Performance Model Serving and Inference Infrastructure (25% of time)Designing multi-stage...  ...degree (or higher) in Computer Science, Machine Learning, Computer Engineering, Statistics, or... 
    Permanent employment
    Local area

    Rubrik

    Palo Alto, CA
    6 days ago
  • $163.42k - $285.98k

     ...in our recruiting process here.With more than 600 million users around the world and 300 billion ideas saved, Pinterest Machine Learning engineers build personalized experiences to help Pinners create a life they love. With just over 4,000 global employees, our teams... 
    Local area
    Relocation package

    Pinterest

    Palo Alto, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Machine Learning Infrastructure Engineer. Be the first to apply!