Software Engineer Intern (AI Infrastructure / Training / Inference)
SpreeAI
Software Engineer Intern (AI Infrastructure / Training / Inference) About the Role We are hiring Software Engineers focused on AI Infrastructure to build the systems that enable frontier multimodal AI to operate reliably at production scale. This role exists because modern generative and vision models require infrastructure beyond traditional backend engineering — including GPU orchestration, large‑scale inference systems, performance optimization, and developer platforms that allow applied scientists to move fast without sacrificing reliability or cost efficiency. You will work on: Scalable model serving and inference pipelines Distributed GPU infrastructure Performance and cost optimization Reliability, observability, and production readiness You will operate at the boundary between systems engineering and machine learning — building the “paved roads” that allow advanced AI systems to scale safely and efficiently. What you'll do Design and build scalable infrastructure supporting training and inference workflows. Develop high-performance APIs and backend services for AI model serving. Optimize GPU utilization, latency, and throughput for multimodal workloads. Improve observability, monitoring, and reliability of AI systems. Partner closely with Applied Science teams to productionize research systems. Drive improvements in deployment workflows, automation, and platform usability. Qualifications Degree in Computer Science, Engineering, or comparable combination of education and practical experience. Strong object‑oriented programming skills (Python, C++, Java, Go, or similar). Strong data structures and algorithms foundations. Experience building production backend or distributed systems. Understanding of cloud infrastructure concepts and containerized systems. Preferred Qualifications Experience with Kubernetes, Docker, or container orchestration. Familiarity with GPU‑based ML workloads or distributed training/inference systems. Experience with model serving frameworks (vLLM, Triton, Ray Serve, or similar). Experience with observability tools and performance debugging. Familiarity with PyTorch or ML workflows. Interest in optimizing systems for efficiency, scalability, and developer velocity. Why Join SPREEAI? Real Impact & Ownership: This is an opportunity to shape a product and brand at the forefront of fashion‑tech innovation. Your design work will directly impact how thousands (eventually millions) of people experience shopping with SPREEAI – no bureaucratic layers, your ideas can go live and make a difference immediately. You’ll own projects that truly matter in the company’s growth. Visionary Team & Exposure: Work side‑by‑side with a passionate founding team and collaborate with industry visionaries. You’ll have direct access to our CEO and leadership, and even get to interact with world‑class advisors (our board includes an iconic fashion figure). It’s a chance to learn from and contribute to the best of both the tech and fashion worlds. Creative Freedom & Innovation: Join a high‑growth startup environment that celebrates bold ideas and moves at lightning speed. You’ll have the autonomy to introduce new design concepts, test emerging technologies, and innovate without red tape. If you’ve ever wanted to combine your love of design, luxury fashion, and cutting‑edge tech, you’ll have the freedom to do it here and see your vision realized. SPREEAI is a fast‑growing, innovative AI company at the forefront of fashion and e‑commerce, revolutionizing how consumers engage with fashion through lifelike photorealistic try‑on technology and hyper‑personalized shopping experiences. Our mission is to redefine the retail landscape with cutting‑edge AI solutions that blend high fashion and technology. We thrive in a dynamic, fast‑paced environment where creativity meets technology to drive real impact. If you are passionate about innovation and shaping the future of fashion, SPREEAI offers a platform to make your mark. #J-18808-Ljbffr
- A leading AI fashion-tech company is seeking a Software Engineer Intern to focus on building infrastructure for AI systems. This role involves designing scalable models, developing APIs, and optimizing for performance and reliability. An ideal candidate will have a strong...InternshipTrainingImmediate start
- A leading technology firm in San Francisco is seeking a skilled engineer to develop and optimize GPU infrastructure for AI model training. In this role, you'll lead technical decisions and work on scalable systems that enhance GPU optimization. Ideal candidates should have...InternshipTraining
- ...Type Hybrid Department Inference Model Serving Who are... ...serve humanity. We’re training and deploying frontier... ...enterprises who are building AI systems to power... ...team of researchers, engineers, designers, and more,... ...experience running production infrastructure at a large scale...TrainingFull timeWork experience placementWork at officeRemote workFlexible hours
- ...An innovative AI company is seeking a Software Engineer to develop infrastructure that supports AI training and inference workflows. This role requires strong object-oriented programming skills and a solid foundation in data structures and algorithms. The ideal candidate...Training
- ...the career network for the AI economy. 20 million knowledge... ...upskilling, from freelance AI training gigs to first internships to... ...Handshake is building the infrastructure layer that powers the next generation... ...our platform. As a Senior Software Engineer on our Agentic...InternshipTrainingFull timeFreelanceWork at officeRemote workFlexible hours
$187.5k - $395k
...Software Engineer, Inference Luma's mission is to build multimodal AI to expand human imagination and capabilities... ...we are working on training and scaling up... ...reliable & scalable infrastructure, which is going to become... ...Build internal tooling to measure,...Training- ...powers mission-critical inference for the world's most dynamic AI companies, like Cursor,... ...applied AI research, flexible infrastructure, and seamless developer... ...help build the platform engineers turn to to ship AI... ...customer SLOs. Design tight training and inference iteration...TrainingFlexible hours
$142.2k - $204.6k
...This Role As a software engineer for GenAI inference, you will help... ...distributed inference infrastructure - orchestrate across... ...learnings, contributing to internal best practices and... ...certifications and training, and specific work... ...is the data and AI company. More than...TrainingLocal areaWorldwide- ...group working across engineering, product,... ...the boundaries of AI capabilities while... ...for an experienced Software Engineer to help... ...machine learning infrastructure that powers OpenAI... ...teams to build, train, deploy, serve, monitor... ...real-time inference and serving infrastructure...Training
- ...Specter is creating a software-defined "control... ...the perception engine for a company's physical... ...world of physical AI and robotics. We... ...is hiring an ML infrastructure engineer to build... ...time perception and inference across our edge-... ...This role owns the training, deployment, and...Training
- ...access to cutting‑edge AI infrastructure previously reserved... ...seamlessly routes training and inference jobs across the world... ...Product Engineer, you will play a pivotal... ...Create automation and internal tooling to eliminate... ...environments. ~ Advanced software engineering skills;...TrainingFull timeRemote work
$170k - $216k
...The Simulation Infrastructure team creates reliable... ...evaluate the Waymo Driver's software stack at a massive... ...of customers Software Engineers, Product, Data Science... ...Build and evolve ML inference infrastructure for simulations... ...experience, relevant training and education, and...TrainingFull timeRemote work- ...powers mission-critical inference for the world’s most dynamic AI companies, like... ...AI research, flexible infrastructure, and seamless developer... ...help build the platform engineers turn to to ship AI... ...THE ROLE As a Senior Software Engineer – Model Training at Baseten, you’ll be...TrainingFlexible hours
$216k - $270k
...Scale Generative AI Platform) is... ...retrieval, inference, evaluation, and... ...for a strong engineer to join our team... ...our core infrastructure in a fast-paced... ...understanding of software engineering... ...data warehouses, internal APIs) *... ...education or training. Scale employees...TrainingFull time$184k - $259.44k
...Scale AI is seeking a highly skilled and motivated Software Engineer, Frontier AI Infrastructure to join our dynamic Public Sector... ...own the model inference layer - enabling state... ...education or training. Scale employees in... ...accordance with our internal policies and...TrainingFull timeWork at office3 days per weekEarly shift- ...our news and engineering blogs and... ...the future of AI and ML at Whatnot... ...the core infrastructure that powers machine... ...distributed training & high-throughput GPU inference. What you... ...~3+ years of software engineering experience... ...Pension plans internationally Monthly...TrainingWork experience placementWork at officeLocal areaRemote workWork from homeHome officeFlexible hours
- ...designing and running OpenAI’s LLM training and inference infrastructure that powers frontier models at massive... ...the Role We are looking for an engineer to design and implement the dataset... ...time data About OpenAI OpenAI is an AI research and deployment company dedicated...Training
$212k - $318.4k
...Software Engineer, ML platform and Infrastructure San Francisco Bay Area, California,... ...Learning, and Generative AI initiatives. You... ...of ML/Data/Inference platform capabilities... ...building innovative internal solutions that... ...processing and model training/fine‑tuning...TrainingRelocation- ...is to architect AI that learns from... ...new primitive for training efficient, large-... ...innovation and systems engineering paired with a... ...re looking for a Software Engineer to help... ...data and ML data infrastructure at Cartesia. This... ...model training, and inference — it is not a...TrainingWork at officeVisa sponsorshipFlexible hours
$320k
...Staff + Sr. Software Engineer, Cloud Inference San Francisco, CA About... ..., and steerable AI systems. We want AI... ...backend services and infrastructure that serve Claude... ...-functionally with internal inference, product... ...combination of education, training, and/or experience...TrainingWork at officeVisa sponsorshipFlexible hours$194k - $239k
...Senior Software Engineer, Infrastructure Hover helps people design, improve, and protect... ...love. With proprietary AI built on over a decade of... ...Someone who likes building internal tools and who thinks finding... ...the cost of management training, conferences, workshops, or...TrainingFull timeFor contractorsWork at officeLocal areaFlexible hours$100k - $300k
...Company Overview At Skild AI, we are building the world's first general... ...Overview We are looking for a Software Engineer to work at the forefront of developing... ...and optimizing the software infrastructure and tools necessary for training cutting-edge AI models. You will...Training$230k - $405k
...About the Team Compute Infrastructure builds the platform that turns... ...compute into a reliable engine for frontier AI. We design, provision, schedule... ...centers, orchestration software, agent infrastructure,... ...capacity online, optimize training workloads from profiler traces...Training- ...scale, supporting both internal research and external... ..., and responsible AI deployment over unchecked... ...About the role As a software engineer on the Fleet High... ...failure is key to research training progress and stable... ...our supercomputing infrastructure. Our team empowers strong...Training
$255k - $405k
...the Team The Agent Infrastructure team at OpenAI is... ...systems that enable training and deployment of highly useful AI agents, both internally and for the world.... ...issues, and develop software just as human SWEs do... ...Role As a Software Engineer on the Agent Infrastructure...TrainingWork at officeWorldwideRelocation package$204k - $259k
...Senior Software Engineer, Simulation ML Infrastructure Waymo is an autonomous driving technology company with the... ...Infrastructure team builds scalable AI/ML infrastructure to accelerate the... ...realistic environments for the testing and training of the Waymo Driver. To increase...TrainingFull timeRemote work- ...Python and Kubernetes Software Engineer - Data, AI/ML & Analytics Join to apply... ...public cloud and private infrastructure. As a software engineer on... ...Platform Software Engineer Intern/Co-op (Fall 2025) Software... ...Engineer, TypeScript - AI Training (Freelance, Remote) Software...InternshipTrainingFull timeFreelanceLocal areaRemote workWork from homeWorldwide
$230k
...cutting edge model training. We take data... ...and build any software needed for running... ...are looking for engineers to operate the next... ...engineering with hands-on infrastructure work on our... ...of Kubernetes internals, cluster scaling... ...OpenAI is an AI research and deployment...Training- ...advanced physics and AI to model catastrophic... ...product is a scalable risk engine. We stay when... ...Platform Engineering Intern, you’ll support and extend... ...by zero‑to‑one infrastructure in a fast‑moving startup... ...engineers to support training and inference pipelines Documenting...InternshipTrainingTemporary workH1bWork at officeRelocationVisa sponsorshipWork visaFlexible hoursShift work
$150k - $250k
...commercial self‑driving software to develop, test... ...for a Software Engineer with a focus on Onboard Infrastructure and Drivers to join... ...embedded devices, AI, computing hardware... ...location, across several internal levels. Actual... ...experience, relevant training, education, skill level...TrainingTemporary workWork at officeVisa sponsorshipFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer Intern (AI Infrastructure / Training / Inference). Be the first to apply!
- software sales engineer San Francisco, CA
- software engineer internship remote San Francisco, CA
- IT software developer San Francisco, CA
- new grad software engineer San Francisco, CA
- software engineer staff San Francisco, CA
- integration software engineer San Francisco, CA
- machine learning software engineer San Francisco, CA
- software engineer part time San Francisco, CA
- facebook software engineer San Francisco, CA
- senior robotics software engineer San Francisco, CA

