Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Early-Career AI Infra Engineer - Scale Production

DeepInfra

DeepInfra is building the AI infrastructure layer with a focus on open‑source models. We’re seeking early‑career software engineers (0–2 years) to design, build, and scale production systems that serve top open‑source AI models from Palo Alto. You’ll work with experienced engineers to create scalable inference platforms using Python, C++, and CUDA. You’ll learn rapidly by contributing to real production AI systems, running on modern GPU infrastructure, and participating in code reviews, design #J-18808-Ljbffr DeepInfra

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Early-Career AI Infra Engineer - Scale Production in Palo Alto, CA vacancy
  • TrueMeter is building an AI Energy Agent and seeks an AI-native Data Engineer to own data and AI infrastructure end-to-end, from pipelines to LLM workflows....  ..., TypeScript, and GCP; experience with time-series data and scalable infra is a plus. #J-18808-Ljbffr Pear VC
    Suggested

    Pear VC

    Palo Alto, CA
    3 days ago
  • $208.45k - $364.8k

    The Cache Infra team manages one of Pinterest's most vital backend...  ...operates at a massive scale, managing 100+ production clusters with 450M total...  ...and innovations related to AI. What You'll Do: Provide...  ...technologies. Maintain a high engineering standard for cache... 
    Suggested
    Work at office
    Relocation
    Relocation package

    Pinterest

    Palo Alto, CA
    5 days ago
  •  ...model capabilities. You will drive fine-tuning, reward modeling, and efficiency benchmarks, ensuring reliability and impact across production environments. The role requires a PhD or equivalent experience with hands-on SFT, RLHF/RLAIF, and distillation. You will... 
    Suggested

    Armadin

    Palo Alto, CA
    3 days ago
  • ServiceNow is looking for a Senior Software Engineer to join their Natural Language Understanding team in Mountain...  ...role, you will tackle engineering challenges related to AI agents and improve capabilities in production systems. The ideal candidate has over 8 years of... 
    Suggested

    ServiceNow

    Mountain View, CA
    5 days ago
  • $255k - $405k

    A leading AI technology company in California is seeking an experienced Android Developer to build and maintain production applications with a focus on integrating AI features. The ideal candidate will have over 3 years of experience in Android development using Kotlin... 
    Suggested

    A1 Services

    Palo Alto, CA
    5 days ago
  •  ...to build and maintain their core data infrastructure, leading projects from initiatives to production. The ideal candidate will have 5+ years of experience in backend engineering and proficiency in Python. If you're passionate about emerging technologies and enjoy working... 

    CTERA Networks Ltd

    Palo Alto, CA
    2 days ago
  • Unity Vector is seeking a Machine Learning Engineer for its Offline Infrastructure team in Mountain View...  ...and researchers. The role bridges research and production, turning advanced ideas into scalable systems for large‑scale ML pipelines and experimentation workflows. #J... 
    Entry level

    Unity

    Mountain View, CA
    2 days ago
  • $140k - $180k

     ...mode startup in Palo Alto, is seeking a Software Field Applications Engineer (FAE) to engage customers, support deployments, and handle technical implementations for their Nonstop AI software products. In this role, you will collaborate with the sales and engineering teams... 

    Delos Data

    Palo Alto, CA
    5 days ago
  • $280k - $350k

    Inworld AI is seeking a Staff / Principal Platform Engineer in Mountain View, CA. This role involves owning cloud infrastructure, enhancing software deployment with AI-powered tooling, and maintaining high-performance systems. Candidates should have 8-10 years of software... 
    Full time
    Work at office

    Inworld AI

    Mountain View, CA
    5 days ago
  • $180k - $250k

     ...possible with Generative AI in healthcare. Our infrastructure...  ...’re hiring an Applied AI Engineer to focus on building and scaling real‑world AI workflows....  ...agentic workflows and production‑grade integrations across...  ...the best work of their careers. Our employees are... 
    Live in
    Flexible hours

    Qualified Health

    Palo Alto, CA
    1 day ago
  • Kodiak Robotics, Inc. is seeking engineers to accelerate model training for autonomous driving data pipelines in Mountain View, CA. The...  ...accelerators. You will work with PyTorch, DeepSpeed, and related tools to scale multimodal sensor data across multi‑node GPU clusters, ensuring... 

    Kodiak

    Mountain View, CA
    5 days ago
  •  ...Accellor is an AI-native services firm purpose...  ...AI, data, and engineering capabilities. Our mission...  ...operationalize AI at scale and unlock sustained...  ...enterprise applications, and product engineering, tailored...  ...candidate may be early in their career but must be... 
    Entry level

    Accellor

    Mountain View, CA
    2 days ago
  • DeepInfra is hiring Software Engineers to design, build, and scale infrastructure for serving open‑source AI models in production. You’ll own end‑to‑end features, optimize performance, and work with Python, C++, CUDA, and NCCL while contributing to production model‑serving... 

    DeepInfra

    Palo Alto, CA
    2 days ago
  • $103.75k - $174.75k

     ...AI Engineer III New York, NY, United States Palo Alto...  ...differentiated products to providing world-class...  ...leader, and grow your career. Here, your voice and ideas...  ...operate responsibly and at scale across the enterprise....  ...projects. Internship or early-career experience in... 
    Entry level
    Full time
    Internship
    Shift work

    American Express

    Palo Alto, CA
    4 days ago
  • Fortinet in Sunnyvale, CA is seeking a Junior Applied AI Engineer- HRIS to help build intelligent, data-driven HR solutions. You will...  ...models, and workflow automation. Ideal for someone early in their career with a passion for applying AI to HR processes, you will collaborate... 
    Entry level

    Fortinet

    Sunnyvale, CA
    5 days ago
  • We’re building AI systems that handle real-world healthcare conversations at scale. This role owns the architecture, reliability...  ...our AI agents—from prototype to production. What You’ll Do Build and own...  ...them to production Mentor engineers and drive technical excellence... 

    High Trail

    Palo Alto, CA
    5 days ago
  •  ...over 80 million customers. As an AI Agents Applied Research/Engineering Lead in our The Digital Team, you...  ...planning, tool use, and safety; building production systems that perform under real-...  ...and dialogue policies. Scale LLM systems through caching, batching... 

    J.P. Morgan

    Palo Alto, CA
    20 days ago
  • SpaceX is seeking a Software Infrastructure Engineer for their Starlink project in Palo Alto, California. You will design and scale the infrastructure for the world's largest...  ...collaborating with software engineers to enhance product scalability. The ideal candidate will have... 

    SpaceX

    Palo Alto, CA
    5 days ago
  • $174k - $253k

    Google is seeking a Senior Software Engineer for Search Ads Infrastructure in Mountain View,...  ...in C++ programming and experience in large-scale system design. Responsibilities include developing...  ...optimizing existing infrastructure for AI capabilities. Competitive compensation... 

    Google

    Mountain View, CA
    5 days ago
  • NVIDIA in Santa Clara, CA is seeking an AI Networking Software Developer to join the AI Networking SW development and codesign team. You will work on AI networking frameworks and production tools for the world’s largest data centers and benchmarks, across hardware and software... 

    2100 NVIDIA USA

    Santa Clara, CA
    2 days ago
  • $136k - $200k

    Google is seeking a software engineer focused on machine learning and artificial intelligence...  ...You will develop LLM solutions for large-scale applications, employing innovative strategies...  ...projects that integrate cutting-edge AI technologies. Ideal candidates have strong... 

    Google

    Mountain View, CA
    5 days ago
  • $218.8k - $335.3k

    Job Description Staff AI/ML Engineer, AV ML Infra We're General Motors (GM), a company...  ..., enhance the productivity of ML engineers, and drive...  ...performance by running large-scale simulation workloads and managing...  ...how GM supports a rewarding career that rewards you personally... 
    Local area
    Work from home
    Flexible hours

    General Motors

    Sunnyvale, CA
    5 days ago
  • $180k - $210k

    Assured is looking for a Staff Cloud Infrastructure Engineer to modernize insurance through innovative cloud solutions. In this role, you'll design and scale core infrastructure, automate using Terraform, and collaborate with teams to enhance reliability. The position requires... 

    Assured

    Palo Alto, CA
    5 days ago
  • $168k - $322k

    NVIDIA in Santa Clara is hiring a Senior AI Platform Engineer to build and maintain next-gen AI-powered enterprise products. This role requires 10+ years of experience in cloud, platform, or SRE roles. Responsibilities include architecting infrastructure, mentoring, and... 

    NVIDIA

    Santa Clara, CA
    5 days ago
  • About JazzX AI Enterprises operating on institutional...  ...enterprises don't scale expertise—they lose it....  ...across industries. This is early-stage, hard, and...  ...market that actually run in production, handle real complexity...  ...As a Software Engineer, AI Platform, you will... 
    Worldwide

    JazzX AI

    Los Altos, CA
    5 days ago
  • About Unconventional Since 2022, AI has entered the mainstream, reshaping entire industries...  ...just in the datacenter, but at a global scale. At Unconventional, our mission is to...  ...Member of Technical Staff, Silicon Validation Engineer, you will be a foundational member of our... 
    Work at office

    Unconventional AI

    Palo Alto, CA
    5 days ago
  • Unity Technologies seeks a Machine Learning Engineer for its Offline Infrastructure team to scale data pipelines and ML workflows. You’ll help build systems...  ...to translate research ideas into reliable, scalable production systems powering ML at scale. #J-18808-Ljbffr... 
    Entry level

    Unity Technologies

    Mountain View, CA
    2 days ago
  •  ...understand the implications of AI and the impact that it...  ...their user base. AI Engineers, Data Science, and...  ...Microsoft) and Amit Paka (product leader at Microsoft,...  ...applications at production scale across industries have...  ...security. We are an early-stage startup and have... 
    Work at office
    Remote work
    2 days per week
    3 days per week

    Fiddler AI

    Palo Alto, CA
    4 days ago
  • $144k - $329.1k

     ...of diverse teams and take your career wherever you want it to go....  ...to leverage the power of data, AI, and emerging GenAI and Agentic...  ...capitalize on future opportunities, scale for growth, and mitigate risk...  ..., and overseeing the engineering and scaling of AI, GenAI, and... 
    Summer holiday
    Flexible hours

    EY

    Palo Alto, CA
    3 days ago
  •  ...shape the next frontier of AI-driven robotics! Dyna...  ...As a Senior Software Engineer for the Data & Eval Platform...  ...sensor streams and production‑ready ML models. This...  ...that are critical to our scaling. If you enjoy solving...  ...and Product teams. As an early member of the data team... 

    Dyna Robotics

    Redwood City, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Early-Career AI Infra Engineer - Scale Production. Be the first to apply!