Inference Software Engineer: High-Performance Transformers
Etched.ai, Inc.
Etched.ai, Inc. is looking for candidates to support porting AI models to its innovative architecture in San Jose, California. Responsibilities include enhancing runtime environments and optimizing performance layers. Ideal applicants are proficient in C++ or Rust and have experience with distributed software systems. Benefits include a housing subsidy, relocation support, and comprehensive health packages. Join a fully in-person team that values engineering and research collaboration. #J-18808-Ljbffr
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Inference Software Engineer: High-Performance Transformers in San Jose, CA vacancy
$2,000 per month
...the world’s first AI inference system purpose-built for transformers - delivering over 10x higher performance and dramatically... ...staffed by leading engineers, Etched is redefining... ...distributed software systems like Linux... ...TPUs), Compilers, or high-speed interconnects...TransformerPerformanceWork at officeRelocation packageEtched.ai, Inc.
San Jose, CA1 day ago$124k - $195.5k
...NVIDIA Gruppe is looking for a passionate Software Engineer to join its TensorRT team in Santa Clara, California. This role involves designing and developing high-performance AI inference solutions while contributing to performance optimizations and collaborating with...PerformanceNVIDIA Gruppe
Santa Clara, CA1 day ago$152k - $241.5k
...NVIDIA Gruppe is seeking a Senior Software Engineer – AI Inference in Santa Clara, California. This role involves enhancing open-source LLM serving optimizations and implementing high-performance runtime capabilities. Candidates should have 5+ years of experience in building...PerformanceNVIDIA Gruppe
Santa Clara, CA1 day ago- ...large language model inference? Join NVIDIA’s TensorRT... .... We build the software stack that enables Large... ...optimizations tailored for transformer‑based models running... ...robotics to deliver high‑performance, production‑ready... ...Electrical/Computer Engineering, or a closely related...TransformerPerformance
NVIDIA Gruppe
Santa Clara, CA1 day ago $2,000 per month
...the world's first AI inference system purpose-built for transformers - delivering over 10x higher performance and dramatically... ...staffed by leading engineers, Etched is redefining... ...drivers ensuring high reliability, informative... ...Collaborate with software and hardware teams...TransformerPerformanceWork at officeRelocation packageETCHED LLC
San Jose, CA6 days ago$2,000 per month
...the world’s first AI inference system purpose-built for transformers - delivering over 10x higher performance and dramatically... ...staffed by leading engineers, Etched is redefining... ...the accelerator software that makes it usable... ...memory management, high-throughput low-latency...TransformerPerformanceWork at officeRelocation packageEtched.ai, Inc.
San Jose, CA2 days ago$2,000 per month
...the world's first AI inference system purpose-built for transformers - delivering over 10x higher performance and dramatically... ...staffed by leading engineers, Etched is redefining... ...We are seeking highly motivated and detail-oriented software engineers to join our...TransformerPerformanceWork at officeRelocation packageETCHED LLC
San Jose, CA5 days ago$152k - $241.5k
...NVIDIA seeks a senior software engineer to join the AI... ...within LLM training and inference stacks. A strong passion... ...ML) for comprehensive performance analysis and... ...includes a focus on high-performance networking... ...ability to apply GNNs/transformers-based optimization to...TransformerPerformanceNVIDIA
Santa Clara, CA3 days ago$269.1k - $307.2k
...Distinguished Software Engineer - IFX As a Distinguished Engineer... ...system that delivers high‑scale developer and... ...available, high‑performance systems will drive our... ...ML/DL model training, inference, feature pipelines, pre... ...and fine‑tuning of transformer‑based models, and generative...TransformerPerformanceLocal areaCapital One National Association
San Jose, CA1 day ago$2,000 per month
...building the world's first AI inference system purpose-built for transformers - delivering over 10x higher performance and dramatically lower cost... ...and staffed by leading engineers, Etched is redefining the infrastructure... .... We are seeking a highly skilled engineer to design...TransformerPerformanceWork at officeRelocation packageETCHED LLC
San Jose, CA3 days ago$160k - $200k
...leakage. Build a highly scalable pipeline... ...features. Mentor junior engineers on secure backend... ...of high-quality software features while... ...model inference pipelines, fine‑tuning... ...data caching, and performance optimization. Knowledge... ...as Hugging Face Transformers or LangChain for...TransformerPerformanceFull timeFortinet
Sunnyvale, CA5 days ago$124k - $195.5k
...looking for a Deep Learning Software Engineer, TensorRT Performance! NVIDIA is seeking an... ...performance of NVIDIA’s inference ecosystem! NVIDIA is rapidly... ...and workloads (e.g. Transformers, Recommenders, ASR, TTS,... ...opportunity employer. As we highly value diversity in our current...TransformerPerformanceRemote workNVIDIA
Santa Clara, CA6 days ago$269.1k - $307.2k
...Distinguished Software Engineer - IFX As a Distinguished... ...system delivering the high-scale developer and runtime... ...available and high performance systems to develop... ...training, model inference and feature generation... ...training and fine tuning Transformer-based models as well...TransformerPerformanceFull timePart timeLocal areaCapital One
San Jose, CA5 days ago- ...Senior Staff AI Infra Engineer who is passionate about improving the performance of key applications and... ...of hardware and software to optimize performance... ...accelerate LLM training and inference on AMD GPUs, improving... ...understanding of transformer-based architectures and...TransformerPerformance
Advanced Micro Devices , Inc.
Santa Clara, CA6 days ago - ...Senior Staff Field Applications Engineer - High Voltage Job Description... ...V to 48V DCX (LLC-based DC transformers) ~800V to 12V direct... ...bring-up and validation ~ Performance optimization and characterization... ...explore our hardware and software capabilities and try new...TransformerPerformanceTemporary workLocal areaRemote workFlexible hoursShift work
Renesas
San Jose, CA6 days ago $184k - $287.5k
...NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference for our growing team. As a key contributor, you will help design, build,... ...team is responsible for developing and maintaining high-performance deep learning frameworks, including SGLang and...PerformanceNVIDIA Gruppe
Santa Clara, CA1 day ago$152k - $241.5k
...application is built. We are seeking a Senior Software Engineer – AI Inference to advance open‑source LLM serving... ...the underlying stack that enables high‑throughput, low‑latency inference at... ...an engineer who enjoys digging into performance bottlenecks, designing pragmatic...PerformanceNVIDIA Gruppe
Santa Clara, CA2 days ago$152k - $241.5k
...We are now looking for a Senior Software Engineer for Deep Learning Inference! Would you like to make a big impact in Deep Learning by helping build... ...performanceDevelop components of TensorRT, NVIDIA’s SDK for high-performance deep learning inference.Closely follow academic...PerformanceNVIDIA
Santa Clara, CA1 day ago- ...enhancing GPU kernel performance, accelerating deep learning... ...LLM and Multimodal inference at scale across multi-... ...across internal GPU software teams and engage with... .... THE PERSON: Skilled engineer with strong technical... ...efforts, and deliver high‑quality solutions. Strong...Performance
Advanced Micro Devices , Inc.
Santa Clara, CA1 day ago $152k - $241.5k
...seeking talented and motivated engineers to join our TensorRT team... ...-leading deep learning inference software for NVIDIA AI accelerators.... ...Knowledge of close-to-metal performance analysis, optimization techniques... ...employer. As we highly value diversity in our current...PerformanceNVIDIA
Santa Clara, CA4 days ago- ...senior member of the LLM inference framework team, you... ...runtime layer, driving performance, scalability, and... ...intersection of inference engines, distributed systems,... ...PyTorch, TensorFlow) for high-throughput and... ...kernel development Software Engineering ~ Expertise...Performance
Advanced Micro Devices , Inc.
Santa Clara, CA3 days ago $165k - $242k
...Senior Software Engineer II, Inference Sunnyvale, CA / Bellevue, WA CoreWeave is The Essential Cloud... ...CoreWeave combines superior infrastructure performance with deep technical expertise to... ...leveraging custom accelerators for high-efficiency workloads ~ Hands-on...PerformancePermanent employmentTemporary workCasual workWork at officeRemote workFlexible hoursShift workCoreWeave
Sunnyvale, CA4 days ago- ...deliver industry‑leading training and inference speeds and empowers machine... ...to deploy 750 megawatts of scale, transforming key workloads with ultra high‑speed inference. About The Role We are hiring a Senior Performance Engineer to join our Product team. You are an...TransformerPerformanceContract workShift work
$156k - $316.8k
...Responsibilitie About the Team The Inference Infrastructure team is the... ...infrastructure that is highly performant, massively scalable, cost-... ..., and are looking for engineers passionate about cloud-native... ...completed a PhD degree in Software Development, Computer...PerformanceTemporary workLocal areaByteDance
San Jose, CA3 days ago$2,000 per month
...(Sohu) only supports transformers, but has an order of... ...of-thought reasoning. Software, LLM Compilation Software... ...issues that hurt performance. You will work with the... ...we will build a few highly-optimized fused... ...3+ years of software engineering experience Have experience...TransformerPerformanceWork at officeRelocation packageOpenReq
Cupertino, CA1 day ago$120k - $150k
...-based virtual driver software for factory-built autonomous... ...building a simulation engine that simulates the... ...its reliability and performance to unblock all technical... ...and experience in transformer and diffusion architectures... ..., learn and grow in a highly future‑oriented,...TransformerPerformanceImmediate startMedium
Santa Clara, CA1 day ago$184k - $287.5k
...Position Overview We are seeking highly skilled and motivated software engineers to join us and build AI inference systems that serve large-... ...and implement high-performance inference stacks, optimize... ...intelligence (AI) will fundamentally transform how people live and work....PerformanceNVIDIA Gruppe
Santa Clara, CA1 day ago$2,000 per month
...first product (Sohu) only supports transformers, but has an order of magnitude... ...deep chain-of-thought reasoning. Software Engineer, Infrastructure Performance Designing and writing software for... ...You may be a good fit if you Are highly technical Possess expert-level scripting...TransformerPerformanceWork at officeRelocation packageOpenReq
Cupertino, CA1 day ago- ...AI Compiler Engineer Locations available... ...focus on hardware-software co-design, you'll... ...to translate high-level AI models into... ...Pioneer new graph transformations, lowering,... ...Diagnose and crush performance bottlenecks with... ...understanding of AI inference workloads (CNNs,...TransformerPerformance
NXP Semiconductors
San Jose, CA2 days ago - ...00x better job search engine: fast, comprehensive,... ...deploying models, optimizing inference latency and throughput... ...the details of model performance, GPU utilization,... ...multi-GPU inference, or high-throughput inference... ...attention mechanisms, transformer optimization, or modern...TransformerPerformanceFull timeRelocation package
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Inference Software Engineer: High-Performance Transformers. Be the first to apply!
Related searches
- software engineer internship remote San Jose, CA
- IT software developer San Jose, CA
- software engineer staff San Jose, CA
- machine learning software engineer San Jose, CA
- software engineer part time San Jose, CA
- senior robotics software engineer San Jose, CA
- software engineer entry level San Jose, CA
- software development engineer aws San Jose, CA
- startup software engineer San Jose, CA
- rust software engineer San Jose, CA