Software Engineer Intern (AI Infrastructure / Training / Inference)
SPREEAI
About The Role We are hiring Software Engineers focused on AI Infrastructure to build the systems that enable frontier multimodal AI to operate reliably at production scale. This role exists because modern generative and vision models require infrastructure beyond traditional backend engineering — including GPU orchestration, large-scale inference systems, performance optimization, and developer platforms that allow applied scientists to move fast without sacrificing reliability or cost efficiency. You Will Work On Scalable model serving and inference pipelines Distributed GPU infrastructure Performance and cost optimization Reliability, observability, and production readiness You will operate at the boundary between systems engineering and machine learning — building the “paved roads” that allow advanced AI systems to scale safely and efficiently. What You'll Do Design and build scalable infrastructure supporting training and inference workflows. Develop high-performance APIs and backend services for AI model serving. Optimize GPU utilization, latency, and throughput for multimodal workloads. Build distributed systems supporting large-scale generative models. Improve observability, monitoring, and reliability of AI systems. Partner closely with Applied Science teams to productionize research systems. Drive improvements in deployment workflows, automation, and platform usability. Qualifications Degree in Computer Science, Engineering, or comparable combination of education and practical experience. Strong object-oriented programming skills (Python, C++, Java, Go, or similar). Strong data structures and algorithms foundations. Experience building production backend or distributed systems. Understanding of cloud infrastructure concepts and containerized systems. Preferred Qualifications Experience with Kubernetes, Docker, or container orchestration. Familiarity with GPU-based ML workloads or distributed training/inference systems. Experience with model serving frameworks (vLLM, Triton, Ray Serve, or similar). Experience with observability tools and performance debugging. Familiarity with PyTorch or ML workflows. Interest in optimizing systems for efficiency, scalability, and developer velocity. Why Join SPREEAI? Real Impact & Ownership: This is an opportunity to shape a product and brand at the forefront of fashion-tech innovation. Your design work will directly impact how thousands (eventually millions) of people experience shopping with SPREEAI – no bureaucratic layers, your ideas can go live and make a difference immediately. You’ll own projects that truly matter in the company’s growth. Visionary Team & Exposure: Work side-by-side with a passionate founding team and collaborate with industry visionaries. You’ll have direct access to our CEO and leadership, and even get to interact with world-class advisors (our board includes an iconic fashion figure). It’s a chance to learn from and contribute to the best of both the tech and fashion worlds. Creative Freedom & Innovation: Join a high-growth startup environment that celebrates bold ideas and moves at lightning speed. You’ll have the autonomy to introduce new design concepts, test emerging technologies, and innovate without red tape. If you’ve ever wanted to combine your love of design, luxury fashion, and cutting-edge tech, you’ll have the freedom to do it here and see your vision realized. SPREEAI is a fast-growing, innovative AI company at the forefront of fashion and e-commerce, revolutionizing how consumers engage with fashion through lifelike photorealistic try-on technology and hyper-personalized shopping experiences. Our mission is to redefine the retail landscape with cutting-edge AI solutions that blend high fashion and technology. We thrive in a dynamic, fast-paced environment where creativity meets technology to drive real impact. If you are passionate about innovation and shaping the future of fashion, SPREEAI offers a platform to make your mark. #J-18808-Ljbffr SPREEAI
- ...scalable model serving and inference pipelines for multimodal AI models. Develop and... ...performance and cost of training and inference workloads... ...Computer Science, Electrical Engineering, or a related field.... ...team, and passion for AI infrastructure. #J-18808-Ljbffr Gravity...InternshipTraining
- A leading fashion-tech AI company in San Francisco is seeking Software Engineers to build cutting-edge AI infrastructure. You will be responsible for designing scalable systems that support training and inference workflows, improving the reliability of AI systems and optimizing...InternshipTraining
- A leading technology firm in San Francisco is seeking a skilled engineer to develop and optimize GPU infrastructure for AI model training. In this role, you'll lead technical decisions and work on scalable systems that enhance GPU optimization. Ideal candidates should have...InternshipTraining
$150k - $250k
...Get AI-powered advice on this... ...starting with expert software developers.... ...fields: engineering, research, operations... ...modeling, infrastructure, and product teams... ...Shape internal tools that support... ...Startup by 2x Inferred from the... ...Engineer - Post-training Alameda, CA...InternshipTrainingFull timeSummer workRemote workFlexible hours- ...serve humanity. We’re training and deploying... ...who are building AI systems to power magical... ...Site Reliability Engineer to join the Model... ...with internal developers and influence the Infrastructure team’s roadmap based... ...and throughput of inference. Strong understanding...TrainingFull timeWork experience placementWork at officeRemote workFlexible hours
$200k - $250k
Role Overview As a Software Engineer on the Core Infrastructure team at Harvey, you will design... ...interaction with Harvey’s AI platform, processing... ...deployments Mentor junior and intern engineers and raise the... ...routes millions of daily inference requests while maintaining...InternshipWorldwideRelocation package$310k
...the Team OpenAI's Inference team powers the... ...fast-moving team of engineers focused on... ...boundaries of what AI can do. We're expanding... ..., building the infrastructure needed to serve... ...re looking for a software engineer to help... ...with researchers training these models and...Training$185k - $250k
...mission‑critical inference for the world’s most dynamic AI companies, like Cursor... ..., flexible infrastructure, and seamless developer... ...the platform engineers turn to to ship AI... ...products. THE ROLE As a Software Engineer on the... ...frontier models Model training built for...TrainingFlexible hours- ...group working across engineering, product,... ...the boundaries of AI capabilities while... ...for an experienced Software Engineer to help... ...machine learning infrastructure that powers OpenAI... ...teams to build, train, deploy, serve, monitor... ...real-time inference and serving infrastructure...Training
- ...access to cutting‑edge AI infrastructure previously reserved... ...seamlessly routes training and inference jobs across the world... ...Product Engineer, you will play a pivotal... ...Create automation and internal tooling to eliminate... ...environments. Advanced software engineering skills;...TrainingFull timeRemote work
- ...Cloud, is a leader in AI cloud infrastructure serving tens of... ...of distributed AI training and inference, raw GPU and CPU horsepower... ...Infrastructure Engineering organization forges... ...experienced Senior Software Engineer to join... ...with Linux kernel internals and system‑level programming...TrainingWork at officeLocal areaWork from home
- Software Engineer, AI Compute Infrastructure About HeyGen At HeyGen, our mission is to make visual storytelling... ...the-art AI models—from multimodal training data pipelines to high-throughput,... ...utilization across thousands of devices for inference, training, data processing and...TrainingFull time
- ...'re looking for a Staff Software Engineer - Computer Vision Deployment... ...to build and scale the infrastructure that powers our AI-driven warehouse... ...computer vision models — from training pipelines through... ...serving for low-latency inference at scale. You\'ll work closely...TrainingWork at office3 days per week
$165k - $330k
Baseten powers mission‑critical inference for the world’s most dynamic AI companies, such as Cursor,... ...applied AI research, flexible infrastructure, and seamless developer... ...and Conviction. THE ROLE As a Software Engineer on the Training Infrastructure team, you’ll architect...TrainingFlexible hours$200k - $240k
...computer vision and AI to enable existing security... ...’re hiring a strong software engineer to own the ML Infrastructure that powers how Voxel trains and ships vision... ...models to optimized inference formats (TensorRT, ONNX... ...improving systems that internal teams depend on....TrainingWork at officeFlexible hours- ...builds the shared infrastructure that helps... ...throughput batch inference, and fine‑tuning... ...for Generative AI at DoorDash,... ...and inference engines, fine‑tuning and training pipelines, GPU... ...real customer and internal automation use... ...experience in software engineering. Deep...TrainingHourly payWork at officeFlexible hours
$184k - $259.44k
Scale AI is seeking a highly skilled and motivated Software Engineer, Frontier AI Infrastructure to join our dynamic Public Sector... ...own the model inference layer - enabling state... ...education or training. Scale employees in... ...accordance with our internal policies and...TrainingFull timeWork at office3 days per weekEarly shift- Senior Software Engineer - AI Inference Systems AI needs far more compute than exists today, but simply... ...hardware, solving one of the biggest infrastructure challenges in modern AI. What's in... .... The role This isn't a model training role. You’ll focus on building and...Training
- ...serve humanity. We’re training and deploying frontier... ...enterprises who are building AI systems to power... ...team of researchers, engineers, designers, and more,... ...generation of agentic AI infrastructure at Cohere. This team... ...infrastructure, edge inference, or browser‑native models...TrainingFull timeWork at officeRemote workFlexible hours
- ...designing and running OpenAI’s LLM training and inference infrastructure that powers frontier models at massive... ...the Role We are looking for an engineer to design and implement the dataset... ...time data About OpenAI OpenAI is an AI research and deployment company dedicated...Training
$150k - $200k
Join to apply for the Software Engineer, Full Stack role at... ...reliability demanded new infrastructure. Founded by a team... ...Holder due to ITAR (International Traffic in Arms Regulations... .... Software Engineer, AI Intern (Summer 2025)... ...Engineer - Post-training Palo Alto, CA $180,00...InternshipTrainingFull timeSummer workRelocation- Build the data infrastructure that powers robots in... ...robotics and Physical AI teams use to... ...to develop, test, train, deploy, and operate... ...Machine Learning Engineer to join our team building... ...and owning inference infrastructure — model... ...writing software in Python, Rust, C++...InternshipTrainingRemote work
$215k - $290k
Get AI-powered advice on this job and more... ...Senior Backend Engineer, you’ll shape the... ...passion for impactful software. Thrive in fast-... ...Retell AI by 2x Inferred from the description... ...Engineer, AI Intern (Fall 2025) San Francisco... ...Engineer - Post-training San Francisco, CA...InternshipTrainingFull timeWork at officeWork from homeVisa sponsorshipFlexible hours- Gravity Engineering Services Pvt Ltd. is seeking an intern to design and implement scalable model serving... ...for multimodal AI models. You will work on... ...performance and cost for training workloads while collaborating... ...teams to enhance AI infrastructure. The ideal candidate is...InternshipTraining
$176k - $230k
...Over the last decade, software has transformed the digital... ...Atoms builds Physical AI— real-world robots for... .... We are roboticists, engineers, operators, and... ...Machine Learning and AI Infrastructure team, which is focused... ...scientists manage full training lifecycle from data...TrainingFull timeTemporary workWork at officeFlexible hours$180k - $280k
...building the foundational infrastructure to train specialized AI agents. We turn real‑... ...loop, not a wrapper. Our engineers work at the core of the RL... ...real usage. We already ship software that leading AI teams... ...automation infrastructure, internal tools, and customer‑facing...TrainingFull timeRelocation package$204k - $259k
...states. The Simulation ML Infrastructure team builds scalable AI/ML infrastructure to... ...environments for the testing and training of the Waymo Driver. To... ...This role reports to an Engineering Manager. You will: Be... ...5+ years of professional software engineering experience, with...TrainingFull timeRemote work$230k - $405k
About The Team Compute Infrastructure builds the platform that turns... ...compute into a reliable engine for frontier AI. We design, provision, schedule... ...centers, orchestration software, agent infrastructure,... ...capacity online, optimize training workloads from profiler traces...Training$405k
...and steerable AI systems. We want... ...researchers, engineers, policy... ...Role Anthropic's Inference organization serves... ...with many internal consumers, who... ...Anthropic's central Infrastructure org on the... ...Have significant software engineering... ...of education, training, and/or experience...TrainingWork at officeVisa sponsorshipFlexible hours$145.4k - $188.1k
...personalized guidance to AI tools and a best-in-... ...The Machine Learning Infrastructure Team At Thumbtack, our... ...experiences. We empower product engineering teams by providing... .... The challenge As a Software Engineer on the ML... ...traditional ML model training and serving systems,...TrainingSeasonal workLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer Intern (AI Infrastructure / Training / Inference). Be the first to apply!
- ngo software engineer San Francisco, CA
- software developer San Francisco, CA
- software developer internship no experience San Francisco, CA
- junior software developer San Francisco, CA
- part time software developer remote San Francisco, CA
- financial software developer San Francisco, CA
- senior software engineer ruby on rails San Francisco, CA
- software engineer amazon San Francisco, CA
- senior software design engineer San Francisco, CA
- software engineer part time San Francisco, CA

