AI Infrastructure Engineer

About the Position We are seeking a senior AI Inference Infrastructure Software Engineer with extensive experience designing, building, and optimizing high‑performance, scalable inference systems for Large Language Models (LLMs) and Vision‑Language Models (VLMs). The role focuses on delivering production‑grade software that powers real‑world applications of LLMs/VLMs across cloud, edge, and hybrid edge‑cloud environments. Roles and Responsibilities Design and implement scalable inference systems for LLMs and VLMs across cloud, edge, and hybrid platforms. Develop and optimize custom kernels and operators for GPU, NPU, DSP, and other accelerator hardware to improve throughput, latency, and memory efficiency. Integrate advanced optimization techniques (KV‑cache management, tensor/model parallelism, quantization, memory‑efficient execution) into production inference pipelines. Partner with system and hardware teams to ensure tight hardware‑software integration and optimal performance across diverse compute environments. Translate architectural requirements into robust, maintainable, production‑ready software that meets performance, safety, and reliability standards. Define and drive the evolution roadmap for LLM/VLM inference in the AIOS stack, ensuring scalability and adaptability to new workloads. Stay ahead of industry trends and competitor solutions, applying best practices from AI and large‑scale systems engineering. Qualifications 5+ years of hands‑on software development experience building and optimizing AI inference systems at scale. Direct experience with LLM/VLM model internals, including Transformer‑based architectures, inference bottlenecks, and optimization techniques. Strong expertise in performance engineering: kernel development, parallelism strategies, memory optimization, and distributed inference systems. Proficiency with GPU/NPU programming (CUDA or vendor‑specific SDKs), compiler toolchains, and deep learning frameworks (PyTorch or TensorFlow). Strong programming skills in C/C++, with a track record of delivering high‑performance, production‑grade software. Solid foundation in computer architecture, systems programming, and embedded systems. BS/MS in Computer Science, Computer Engineering, or related field. Excellent communication and collaboration skills, with the ability to work across cross‑functional teams. Preferred Qualifications Master’s or PhD in Computer Science, Electrical/Computer Engineering, or related field. 5+ years industry experience building inference serving systems for large models (batching, scheduling, caching, load balancing). Expertise in hardware‑aware model optimization (kernel fusion, mixed precision, quantization, pruning). Familiarity with edge and embedded AI, including real‑time constraints and limited‑resource optimization. Contributions to widely used AI frameworks, libraries, or performance‑critical software (open source or proprietary). Compensation US base salary range: $163,500.00 – $212,400.00. Individual pay is determined by location and other factors. Benefits Health: Anthem Blue Cross, HSA, and Kaiser HMO medical plans with $0 employee coverage. Dental (including orthodontic) and vision plans with $0 employee coverage. Company‑paid HSA contribution when enrolled in the high‑deductible Anthem plan. Healthcare and dependent care flexible spending accounts (FSA). 401(k) with brokerage link option. Life insurance, AD&D, short‑term and long‑term disability insurance. Employee assistance program, sick and vacation time, 13 paid holidays per year. Paid parental leave: first 8 weeks at full pay (eligible after 90 days). Paid disability leave: first 6 weeks at full pay (eligible after 90 days). Voluntary benefits: life, AD&D, pet insurance, commuter benefits, mobile cell phone credit. Free lunch and snacks, onsite gym, employee discounts and perks program. #J-18808-Ljbffr