Edge Transformer Inference Tech Lead
OpenAI
A leading AI research firm in San Francisco is seeking a Technical Lead to join its Future of Computing Research team. This role involves evaluating silicon platforms and optimizing model architectures while working in a hybrid model. Ideal candidates have expertise in evaluating workloads on accelerators, understanding transformer models, and leading teams focused on performance-critical software. The position offers relocation assistance and is centered on deploying cutting-edge AI technology responsibly and effectively. #J-18808-Ljbffr OpenAI
$250k
...Edge AI is a production requirement across automotive, robotics... ...models are doing in the field. Inference latency, memory pressure,... ...the resources needed to build transformational companies. We've launched 17... ...Ability to attract, hire and lead world‑class teams. Demonstrated...Suggested$58 - $63 per hour
...Research Intern, Inference (Fall 2026) San Francisco About The... ...critical intersection of cutting-edge model architectures, high-... ...Python Familiarity with Transformer architectures and recent developments... ...systems. Publications at leading conferences in machine...TransformerHourly payInternship- We're looking for an ML Inference Engineer with deep expertise in high-performance ML engineering... ..., and shaping Reactor's competitive edge in ultra-low-latency, high-throughput... ...hardware (NVIDIA) Strong understanding of transformer architectures and modern ML optimization...TransformerFull timeVisa sponsorshipRelocation package
$220k
We build and run the inference engine behind every Perplexity query and deploy dozens of model architectures at scale with tight latency... ...Of Real Work The Team Does New models support. Support transformer-based retrieval, text-generation, and multimodal models in our...Transformer- ...'re looking for a Founding Engineer, ML Inference with deep expertise in high-performance... ...performance, and shaping the competitive edge in ultra-low-latency, high-throughput environments... ...as needed Strong understanding of transformer architectures and modern ML model...TransformerRelocationVisa sponsorshipRelocation package
- ...team to build and ship cutting edge models and experiences. We're funded by leading investors at Index Ventures and... ...About the Role We're hiring an Inference Engineer to advance our mission... ...cutting edge foundation models using Transformers, SSMs and hybrid models. Work...TransformerWork at officeVisa sponsorshipFlexible hours
- ...fast data flywheel across multiple data modalities Deep debug failure modes in transformer and diffusion policy field deployments Optimize policies for real-time (~10hz) inference on edge hardware What you bring Experience deploying robot policies on hardware. No preference...TransformerTemporary work
- ...exceptional people to help us get there. The Opportunity Our Edge Inference team compiles Liquid Foundation Models into optimized machine... ...device AI possible. You will work directly with the technical lead on problems that require deep understanding of both ML architectures...
- ...and low-level systems engineering. Beyond inference, you'll profile and optimize the entire... ...with ML model architectures (transformers, CNNs) and the ability to reason about computational... ...autonomous vehicles, robotics, or IoT/edge devices Deep knowledge of CUDA, TensorRT...TransformerLocal area
- ...Engineer Baseten powers mission-critical inference for the world's most dynamic AI... ...at the frontier of AI to bring cutting-edge models into production. We're growing quickly... ...Nice to Have: Experience with Transformer models and attention optimization (e.g.,...TransformerFlexible hours
- ...BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies... ...operating at the frontier of AI to bring cutting-edge models into production. We're growing... ...cutting‑edge LLM models with industry-leading performance, scalability, reliability, and...Flexible hours
- ...state-of-the-art infrastructure to enable efficient and scalable inference for large language models (LLMs). Our mission is to optimize... ...inference. Optimization Techniques: Deep understanding of Transformer architectures and LLM/VLM/Diffusion model optimization . Knowledge...Transformer
$200k - $400k
About The Role We're looking for an inference runtime engineer to push the boundaries of what's possible in LLM and diffusion model serving... ...science, engineering, or similar. Deep understanding of transformer architectures and their variants. Strong programming skills in...TransformerRemote workVisa sponsorshipShift work- Member of Technical Staff — ML Systems & Inference Employment Type: Full-time Workplace: On... ...or low-level optimization. We work with leading AI labs, hyperscalers, and AI-native... ...architectures, attention mechanisms, and transformer inference behavior Experience with batching...TransformerFull time
$405k
About the role Anthropic's Inference organization serves Claude to millions... ...Engineer to be a technical lead for Inference Runtime: the... ...their own specialization, and edge cases stitch back into the core... ...scheduling environments Prior tech lead experience on a developer...Work at officeVisa sponsorshipFlexible hours- ...Engineer Intern (AI Infrastructure / Training / Inference) About the Role We are hiring Software... ...and brand at the forefront of fashion‑tech innovation. Your design work will... ...love of design, luxury fashion, and cutting‑edge tech, you’ll have the freedom to do it here...InternshipImmediate start
- ...machine learning systems that power real-time perception and inference across our edge-cloud platform. This role owns the training, deployment,... ...architectures and their deployment tradeoffs (YOLO, transformers, CNNs, real-time detection/tracking). Hands-on experience...Transformer
$342k
...infrastructure execution-translating cutting‑edge compute roadmaps into scalable,... ...We are seeking a CPU & Storage Technical Lead to define and drive the server compute and... ...storage systems are optimized for training, inference, and supporting services. You will work...Local area- ...cloud deployment — ensuring our cutting-edge computer vision and multi-modal AI systems... ...optimize model serving for low-latency inference at scale. You\'ll work closely with our... ...learning models such as auto-regressive transformers and familiarity with inference optimization...TransformerWork at office3 days per week
- ...Vision encoders, etc.) onto edge devices, especially mobile NPUs... ..., memory, power/thermal), lead model-side optimization strategy... ...with at least one of: LLM inference optimization (quantization, attention... ...understanding across transformers / conformers / diffusion-vocoders...TransformerFull time
- ...Montreal Employment Type Full time Location Type Hybrid Department Inference Model Serving Who are we? Our mission is to scale intelligence... ...and work environment Work closely with a team on the cutting edge of AI research Weekly lunch stipend, in-office lunches & snacks...Full timeWork experience placementWork at officeRemote workFlexible hours
- Dormont Manufacturing Co is looking for a Tech Lead / Staff-Level Engineer in San Francisco, CA. In this role, you will drive improvements in model serving efficiency, mentor junior engineers, and enhance system performance to support multimodal AI applications. The ideal...Relocation package
- A tech company specializing in AI infrastructure is seeking a skilled professional to build scalable infrastructure for AI model training and inference. You will lead architectural decisions and work with core systems that power their GPU optimization platform. Candidates...
- A cutting-edge AI infrastructure startup is seeking a Kubernetes DevOps Engineer to join their innovative team in San Francisco. The role involves building and maintaining production-grade Kubernetes clusters across various environments, focusing on high-performance GPU...
$248.8k - $311k
...automation. Role Overview As the Technical Lead Manager (TLM) for the Physical AI team of... ...you will bridge the gap between cutting‑edge Machine Learning research and physical... ...proficiency in PyTorch, with deep knowledge of Transformer architectures, Attention mechanisms, and...TransformerFull time- ABOUT BASETEN Baseten powers mission‑critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge... ...companies operating at the frontier of AI to bring cutting‑edge models into production. We're growing quickly and recently...Work experience placementFlexible hours
- ...Engineer to develop infrastructure that supports AI training and inference workflows. This role requires strong object-oriented... ...infrastructure, and enhance system reliability. Join a cutting-edge team revolutionizing the fashion and e-commerce landscape. #J-1...
$197.3k - $225.1k
...Lead AI Engineer (FM Hosting, LLM Inference) Overview At Capital One, we are creating responsible and reliable AI systems, changing banking for... ...infrastructure. At Capital One, you will help bring the transformative power of emerging AI capabilities to reimagine how...Full timePart timeLocal area- The Role Our generative AI-powered products are transforming the practice of medicine—and the inference systems that power them need to be fast, reliable, and world... ...-class. We’re looking for an Engineering Manager to lead and grow our Model Inference team. The Inference...TransformerHourly payFull timeFlexible hours
$250k - $350k
A cutting-edge AI research startup in San Francisco is seeking a talented individual... ...training using PyTorch, strong knowledge of transformer architectures, and familiarity with... ...compensation between $250,000 - $350,000 plus equity and benefits. #J-18808-Ljbffr InferenceTransformer
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Edge Transformer Inference Tech Lead. Be the first to apply!
- technical lead manager San Francisco, CA
- technical lead San Francisco, CA
- technical leader San Francisco, CA
- transformer San Francisco, CA
- technology internship San Francisco, CA
- cardiac tech San Francisco, CA
- design technology San Francisco, CA
- instructional technology specialist San Francisco, CA
- operations tech San Francisco, CA
- technology sales associate San Francisco, CA

