Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Infrastructure Engineer

$100k - $150k

Bright Vision Technologies

Bright Vision Technologies is a forward-thinking software development company dedicated to building innovative solutions that help businesses automate and optimize their operations. We leverage cutting-edge technologies to create scalable, secure, and user-friendly applications.
As we continue to grow, we're looking for a skilled AI Infrastructure Engineer to join our dynamic team and contribute to our mission of transforming business processes through technology.
This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.

Job Title: AI Infrastructure Engineer
Location: 100% Remote (Continental United States)
Position Type: In-house Bright Vision Technologies SOW engagement (no third-party client or vendor)
Salary: $100K - $150K

Experience: 6+ years
Sponsorship: No new H1B sponsorship available. H1B transfers welcomed for qualified candidates.
Employment Type: Full-time, direct W2 with Bright Vision Technologies (no C2C, no 1099, no third-party)
Engagement: Long-term, multi-year, aligned to the Bright Vision SOW delivery roadmap
Compensation: Competitive base salary commensurate with experience, plus benefits.

Employment Terms & Visa Policy
This is a 100% remote, full-time, direct W2 position with Bright Vision Technologies.
This role is part of Bright Vision Technologies' in-house Statement of Work (SOW) engagement. The client, end customer, and employer for this position is Bright Vision Technologies - there is no third-party client, vendor, or implementation partner involved.
We do not engage in C2C, 1099, or third-party arrangements for this role.

BUT STRICTLY NO C2C/1099/3RD PARTY COMPANIES. ALL OUR ROLES ARE W2 AND NO 3RD PARTY BROKERING PLEASE.
Candidates must be willing to work directly as a full-time W2 employee of Bright Vision Technologies and contribute to our in-house SOW deliverables.
No new H1B sponsorship is available for this role.

However, candidates who are currently on a valid H1B visa and require a transfer are welcome to apply. We will support H1B transfers for qualified candidates.
For every role, a technical coding assessment is mandatory. Please apply only if you are confident in your technical abilities and hands-on experience.

Job Summary
We are seeking an AI Infrastructure Engineer to design, build, and operate the platform layer that powers large-scale AI training and inference workloads. The role focuses on GPU clusters, distributed training frameworks, scheduling, storage performance, and developer experience for ML engineers and researchers, with strong emphasis on reliability, efficiency, and cost control. The ideal candidate has built or operated production AI infrastructure at scale, understands the interaction between hardware, kernel, scheduler, and ML framework, and brings strong software engineering discipline to platform work.

Key Responsibilities
  • Design and operate GPU and accelerator infrastructure for training and inference, spanning on-prem clusters, cloud-managed services, and hybrid configurations.
  • Build scheduling, queueing, and resource-sharing systems that maximize accelerator utilization across many teams.
  • Integrate frameworks such as PyTorch, JAX, DeepSpeed, FSDP, Megatron-LM, and Ray Train into a unified platform offering.
  • Operate high-performance storage systems and data pipelines that keep accelerators fed with training data at near-line-rate.
  • Design networking architectures supporting RDMA, InfiniBand, NCCL, and high-bandwidth collective communication.
  • Build observability for AI workloads including utilization, throughput, training stability, and failure-mode analytics.
  • Implement checkpointing, restart, and fault-tolerance patterns for long-running training jobs at scale.
  • Drive cost optimization across compute, storage, and networking through scheduling, spot capacity, and right-sizing.
  • Develop developer tooling and paved-road workflows that let researchers launch experiments safely and efficiently.
  • Partner with research and applied ML teams to plan capacity for upcoming training runs.
  • Implement security controls, isolation, and access management for multi-tenant AI infrastructure.
  • Drive automation across cluster provisioning, lifecycle management, and configuration enforcement.
  • Maintain runbooks, capacity dashboards, and operational documentation for the AI platform.
  • Stay current with AI infrastructure research, accelerator hardware, and emerging open-source AI tooling.
Required Qualifications
  • Bachelor's or Master's degree in Computer Science or a related field.
  • Six or more years of experience in infrastructure, platform, or HPC engineering.
  • Hands-on experience operating GPU clusters or large-scale ML training infrastructure.
  • Strong proficiency in Python and at least one systems language such as Go or C++.
  • Deep understanding of distributed training, accelerator architectures, and collective communication.
  • Experience with Kubernetes, Slurm, Ray, or similar scheduling systems for ML workloads.
  • Strong understanding of Linux internals, networking, and high-performance storage.
  • Experience with at least one major cloud provider's ML infrastructure offerings.
  • Strong software engineering practices including testing, CI/CD, and code review.
  • Excellent communication and cross-functional collaboration skills.
Preferred Qualifications
  • Experience operating InfiniBand or RDMA networking at scale.
  • Contributions to open-source ML infrastructure projects.
  • Familiarity with custom orchestrators or research-grade training stacks.
  • Exposure to frontier model training operations.
  • Experience with FinOps for AI workloads.

How to Apply
Would you like to know more about this opportunity?
For immediate consideration, please send your resume to [email protected]
Learn more about Bright Vision Technologies at
We recognize that our people are our strength, and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company.
We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs.
Bright Vision Technologies is an Equal Opportunity Employer, including Disability/Veterans.
Position offered by "No Fee Agency."
Equal Employment Opportunity (EEO) Statement

Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall.

BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AI Infrastructure Engineer in Newark, CA vacancy
  • $100k - $150k

    Bright Vision Technologies is looking for an AI Infrastructure Engineer. This role is designed for building and operating the infrastructure for large-scale AI training and inference. The position requires 6+ years of experience in relevant fields and offers a competitive... 
    Suggested
    Remote job

    Bright Vision Technologies

    Newark, CA
    4 days ago
  •  ...A tech company specializing in AI infrastructure is seeking a Software Engineer to build a scalable compute platform for its generative video models. The ideal candidate will have over 5 years of experience in MLOps or AI infrastructure management, along with strong Python... 
    Suggested

    HeyGen

    Palo Alto, CA
    2 days ago
  •  ...AI Platform Engineer - Training & Inference Saviynt's AI-powered identity platform manages and governs human and non-human access to...  ...between self-hosted SLMs and cloud LLMs • Build RL training infrastructure: define Flyte workflows for RL pipelines (rollout, reward... 
    Suggested

    Saviynt

    Milpitas, CA
    5 days ago
  • $283.4k

    KLA is seeking a Sr. AI Infrastructure Software Engineer in Milpitas, California. This role focuses on C++ programming and involves designing core infrastructure for AI workloads. Join a top-notch team solving complex problems at the intersection of software and hardware... 
    Suggested

    Dormont Manufacturing Co

    Milpitas, CA
    2 days ago
  •  ...Senior Lead Software Engineer Be an integral part of an agile team that's constantly...  ...JPMorgan Chase within the Corporate Sector, Infrastructure Platforms team, you are an integral part...  ...scalable cloud platforms optimized for AI/ML workloads. Partner with AI teams... 
    Suggested
    For contractors

    Chase

    Palo Alto, CA
    5 days ago
  • Getaida, an innovative B2B enterprise AI company based in Palo Alto, is looking for a strong AI Engineer. The ideal candidate will have a solid background in building Large Language Models (LLMs) and an eye for new emerging models. This position involves collaborating... 

    Getaida

    Palo Alto, CA
    3 days ago
  • Medium is currently seeking an Associate Principal Software Engineer in California. In this role, you will be responsible for building AI interfaces, contributing to various cloud platforms, and developing scalable software solutions. Candidates should have 6-10 years of... 

    Medium

    Milpitas, CA
    3 days ago
  • $220k - $350k

    United States Digital Space LLC in California is seeking a skilled SR AI ENGINEER for platform infrastructure. You will build tools critical for operations at classified sites and ensure your work delivers high reliability in environments where support is limited. The ideal... 

    United States Digital Space LLC

    Palo Alto, CA
    2 days ago
  • $190k - $250k

     ...Employment Type Full time Location Type Hybrid Department AI We are looking for an AI Infra engineer to join our growing team. We work with Kubernetes,...  ..., C++, PyTorch, and primarily on AWS. As an AI Infrastructure Engineer, you will be partnering closely with our... 
    Full time

    Pantera Capital

    Palo Alto, CA
    5 days ago
  • Centaur Labs is seeking a Software Engineer (MTS) in Palo Alto, California, to join their Cloud Infrastructure team. In this role, you'll build and operate core platform...  ...Kubernetes, continuous deployment, and utilizes AI tooling in engineering workflows. Strong communication... 

    Centaur Labs

    Palo Alto, CA
    4 days ago
  • $125k - $220k

     ...actively developing the technologies to make this possible, with the ultimate goal of enabling human life on Mars. AI ENGINEER, PLATFORM INFRASTRUCTURE, SPECIAL PROGRAMS As an AI Engineer, Platform Infrastructure you will build the tooling, and work with our cleared engineers... 
    Permanent employment
    Temporary work
    Immediate start
    Weekend work

    United States Digital Space LLC

    Palo Alto, CA
    3 days ago
  • United States Digital Space LLC in Palo Alto is seeking an AI Engineer to develop crucial tooling and infrastructure aimed at enabling human life on Mars. This role requires expertise in Go Lang, Python, and Kubernetes. It'll involve designing deployment generators and... 

    United States Digital Space LLC

    Palo Alto, CA
    2 days ago
  • Wisq, Inc. in Redwood City, CA is seeking experienced AI engineers to tackle complex challenges in AI technology. The role demands expertise in LLM fine-tuning, distributed systems, and ML solutions, while working in a collaborative and hybrid/remote environment. Candidates... 
    Remote job

    Wisq, Inc.

    Redwood City, CA
    3 days ago
  • Snorkel is seeking a Senior Software Engineer for its AI Platform in Redwood City, CA, focusing on architecting solutions for synthetic data generation and large-scale AI systems. This hybrid role calls for extensive experience in cloud-native software systems and deep... 

    jobs.frontdoordefense.com - Jobboard

    Redwood City, CA
    6 days ago
  • Sage Care Inc is seeking a product-minded AI Engineer in Palo Alto, California, to build and improve their AI Voice platform. You will work on enhancing customer-facing systems, ship features, debug real-time issues, and collaborate with experienced engineers and product... 

    sagecare.com

    Palo Alto, CA
    3 days ago
  •  ...tackle complex technical challenges that push the boundaries of what AI can do: Build no-code agentic orchestration frameworks that...  ...and reduce hallucinations for nuanced business scenarios. Engineer scalable backend services that power intuitive UIs for seamless... 
    Remote work

    Wisq, Inc.

    Redwood City, CA
    3 days ago
  • $220k - $350k

    United States Digital Space LLC seeks a Principal AI Engineer to integrate AI capabilities for U.S. federal agencies. Responsibilities include designing and optimizing models and ensuring effective deployment. Candidates should have extensive software engineering experience... 

    United States Digital Space LLC

    Palo Alto, CA
    2 days ago
  • Rivian VW Group is searching for a Senior Software Engineer with a focus on agentic applications. You will lead architectural strategies for integrating LLMs within our systems and drive cognitive automation for enhanced efficiency. The ideal candidate would have 8+ years... 
    Full time
    Local area

    Rivian VW Group

    Palo Alto, CA
    3 days ago
  •  ...Labs in Palo Alto is looking for a seasoned Software Engineer to spearhead the development of an AI governance platform. Responsibilities include end-to-end software development, working with AWS cloud infrastructure, and leading technical execution on significant projects... 

    Centaur Labs

    Palo Alto, CA
    3 days ago
  • $180k

    xAI in Palo Alto is seeking exceptional engineers to integrate Grok into their Ads Platform. The role demands expertise in AI-powered advertising product development and includes responsibilities such as leveraging advanced AI models and managing revenue-generating systems... 

    xAI

    Palo Alto, CA
    2 days ago
  • $240k - $250k

    Ten Eleven Ventures is seeking a founding member of Saviynt's AI Security team to design and build AI security solutions for leading...  ...solutions, you will need at least 10 years of software engineering experience, particularly with Java and associated frameworks. The... 

    TenEleven Ventures

    Milpitas, CA
    3 days ago
  • A leading AI technology company in Palo Alto is looking for a seasoned professional to join their engineering team. The candidate will design and build core services for AI applications, ensuring scalability and reliability. A solid background in software development, especially... 

    Fiddler AI

    Palo Alto, CA
    2 days ago
  • Uniphore Technologies North America Inc is looking for a Senior Director of Engineering to lead the architecture and delivery of AI-driven products that utilize Large Language Models and Retrieval-Augmented Generation. This pivotal role will drive innovation in conversational... 

    Uniphore Technologies North America Inc

    Palo Alto, CA
    6 days ago
  • Voiceflow is seeking an experienced Director of Engineering to lead our engineering organization focused on AI and infrastructure. This role involves defining technical vision, scaling systems, and mentoring teams. The ideal candidate will have over 12 years in software... 

    Voiceflow

    Palo Alto, CA
    3 days ago
  • $100k - $150k

     ...to create scalable, secure, and user-friendly applications. As we continue to grow, we’re looking for a skilled AI Performance Optimization Engineer to join our dynamic team and contribute to our mission of transforming business processes through technology. This... 
    Full time
    H1b
    Local area
    Immediate start
    Remote work
    Visa sponsorship
    Work visa

    Bright Vision Technologies

    Newark, CA
    2 days ago
  • $80 - $90 per hour

     ...tech solutions that drive business transformation. As a leading product engineering firm based in Silicon Valley, we provide full-cycle product development, leveraging cutting-edge technologies in AI, ML, and data analytics. Our collaborative, inclusive culture fosters... 
    Hourly pay

    Bayrock Labs

    Newark, CA
    3 days ago
  •  ...AI Engineer Develop and implement deep learning models using PyTorch for applications such as NLP, computer vision, or recommendation systems. Design, train, and optimize neural networks to improve model accuracy, efficiency, and scalability. Collaborate with data engineers... 

    InterSources

    Fremont, CA
    5 days ago
  • Dome Systems Inc is seeking a Product Engineer to build software that addresses real customer problems across the stack. You will work in an AI-native environment contributing to backend services and tooling, focusing on delivering features end-to-end. The ideal candidate... 
    Remote work

    Dome Systems Inc

    Redwood City, CA
    4 days ago
  • Broadcom is looking for a Software Systems Engineer to join the VMware Cloud Foundation's AI and Advanced Services team in Palo Alto, California. You will play a key role in designing and implementing scalable solutions for a best-in-class private cloud AI platform, collaborating... 

    Israelvcforum

    Palo Alto, CA
    3 days ago
  • $150k - $200k

    A pioneering technology company is looking for a software engineer to enhance their developer infrastructure at their Redwood City office. The ideal candidate will manage CI/CD pipelines, automate testing procedures, and design device simulators to improve the efficiency... 
    Full time
    Work at office

    Epoch Biodesign

    Redwood City, CA
    6 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Infrastructure Engineer. Be the first to apply!