Senior ML Serving Engineer for LLMs & Inference (San Jose)
Full-time
Alldus
A tech company in AI/ML is seeking a Senior Software Engineer specializing in ML Serving to build robust infrastructure for ML models. The ideal candidate has 5+ years of experience in software engineering, with a focus on ML serving. Proficiency in Python and knowledge of various serving frameworks are essential. This full-time role is located in San Jose, California and offers a competitive salary.
#J-18808-Ljbffr
Vacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the Senior ML Serving Engineer for LLMs & Inference (San Jose) in San Jose, CA vacancy
- ...Machine Learning Engineer, LLM Fine‑... ...Location: San Jose, CA (Onsite)... ...privacy‑first ML pipelines on AWS... ...dependable model serving: Bedrock model... ...latency self‑hosted inference (vLLM/TensorRT‑... ...productization: integrate LLMs with internal... .... Seniority Level Mid‑Senior...SuggestedFull time
First Soft Solutions LLC
San Jose, CA3 hours ago - ...An innovative AI company in San Jose is seeking a skilled Machine Learning Engineer with expertise in developing LLMs and VLMs. The ideal candidate will have a strong education background and proven experience in natural language processing and computer vision. This role...SuggestedFull time
Tensor
San Jose, CA3 hours ago $180k - $220k
Senior Software Engineer - ML/LLM Serving This range is provided by Alldus. Your actual pay... ...ML models including both LLMs and classical ML. The Role... ...powers the deployment and inference of machine learning... ...and seniority levels) – San Jose, CA (examples of similar...SeniorFull timeFlexible hoursAlldus
San Jose, CA3 hours ago$75k - $300k
...Machine Learning Engineer: LLM, VLM/VLA and reasoning models Tensor... ..., Tensor is headquartered in San Jose, California, with offices in Barcelona... ...an alternative path where AGI serves only you, and is controlled... ...in developing and deploying LLMs and VLMs, to join our AGI team...SuggestedFull timeTensor
San Jose, CA3 hours ago$150k - $275k
...A leading AI infrastructure company based in San Jose is seeking a highly skilled Supercomputing Engineer specialized in networking. This role involves developing... ...and optimizing software communication across inference nodes. Candidates should have strong C/C++ skills...SeniorFull timeRelocation packageEtched
San Jose, CA3 hours ago$75k - $300k
...Senior/Staff Data Scientist - Safety Assessment Tensor is an agentic AI company dedicated... ...Valley, Tensor is headquartered in San Jose, California, with offices in Barcelona, Singapore... ...re forging an alternative path where AGI serves only you, and is controlled solely by you...SeniorFull timeTensor
San Jose, CA3 hours ago- ...BDO USA is seeking a State & Local Tax Director in San Jose, California. In this pivotal role, you will support Principals and the broader... ...and consulting services, handling agency inquiries, and serving as an industry expert in SALT matters. A Bachelor's degree in Accounting...SeniorFull timeLocal area
BDO USA
San Jose, CA3 hours ago - ...A leading accounting firm in San Jose is seeking an experienced professional to serve as the primary engagement manager for tax services. Candidates should possess a Bachelor's degree in accounting, a minimum of 7 years of experience, and a CPA license. This role emphasizes...SeniorFull time
Ledger Executive Search
San Jose, CA3 hours ago - A leading digital asset exchange in San Jose is looking for an experienced Mobile Engineer to develop features for their Android app serving millions of users. The candidate must have over 5 years of experience in Android development, familiarity with UI kits, and proficiency...SeniorFull time
Okx
San Jose, CA3 hours ago - An innovative firm is seeking a Senior Machine Learning Engineer to lead the development of cutting-edge machine learning models that enhance personalized customer experiences. This role offers the opportunity to work on complex, large-scale projects that significantly...SeniorFull time
Adobe Inc.
San Jose, CA3 hours ago - ...RYDE - Assist seniors in San Jose with transportation Join to apply for the RYDE - Assist seniors in San Jose with transportation role at... ...family support, referrals, education, and case management. They serve homeless and low‑income individuals and families in Cupertino...SeniorPart timeLocal areaMonday to FridayWeekend work
West Valley Community Services
San Jose, CA3 hours ago - ...A leading AI company in San Jose is seeking an innovative engineer to research and design computer vision methods for autonomous vehicles. The role requires strong programming skills in C++ and Python, along with a background in Machine Learning and Computer Vision. Candidates...Full time
Tensor
San Jose, CA3 hours ago $231.5k - $341k
...execution excellence. We are seeking a Senior Director of Program Enablement & Operations to serve as the operational nerve center of Hardware Engineering, owning end‑to‑end program execution... ...(United States). Primary Location: San Jose, California, United States....SeniorFull timeLocal areaShift workAltera
San Jose, CA3 hours ago- ...(Core Focus) # Lighthouse Customer Co‑Engineering # Influencing Robotics Reference Architectures... ...Multi‑modal perception stacks Serve as a bridge between lighthouse deployments... .... Deep understanding of: AI inference runtimes and deployment tradeoffs System...SeniorFull time
Advanced Micro Devices
San Jose, CA3 hours ago - ...San Jose, CA, United States Job Description The Power Solutions Group (PSG... ...applications. This role serves as the organization's senior solution architect and technical strategist... ...and technology planning. Mentor engineering leaders and technical staff across...SeniorFull timeLocal area
onsemi
San Jose, CA3 hours ago $75k - $400k
...Senior Electrical Engineer: Infotainment Systems Tensor is an agentic AI company dedicated to building... ...Valley, Tensor is headquartered in San Jose, California, with offices in... ...forging an alternative path where AGI serves only you, and is controlled solely by...SeniorPart timeTensor
San Jose, CA3 hours ago$231.1k - $358.2k
...SoC Architect Job Location: San Jose, CA (This position requires a... ...model, sensor, or modality. Edge ML applications that run... ...collaboration with Silicon and Software Engineering. Identify architecture... ...architectural vision into implementation. Serve as the ultimate technical...SeniorFull timeWork at officeSiMa.ai
San Jose, CA3 hours ago$75k - $400k
...Valley, Tensor is headquartered in San Jose, California, with offices in Barcelona... ...an alternative path where AGI serves only you, and is controlled solely by... ...We are looking for an experienced Senior Control Software Engineer to lead the development of advanced...SeniorFull timeTensor
San Jose, CA3 hours ago- ...seeks Sr. Machine Learning Engineer in San Jose, CA. Job... ...with data engineering for LLMs: data cleaning, synthesis... ...benchmarks (1 year). Production ML systems and MLOps: model deployment, inference optimization,... ...frameworks (vLLM, Ray Serve, Triton, Cosmos) (2 years...SeniorLocal areaRemote workMonday to Friday
PayPal
San Jose, CA15 hours ago - ...Unchain Data in San Jose, California, is seeking a Sr Data Scientist to leverage analytical expertise in fraud analytics. The role involves utilizing machine learning techniques to identify complex fraud patterns and providing technical guidance across teams. The ideal...SeniorFull time
Unchain Data
San Jose, CA3 hours ago - ...We are seeking a visionary Senior Principal Software Engineer / Technical Staff Member to... ..., Bash, Perl, or TCL. AI/ML Practice: Practical experience deploying local LLMs, building Retrieval-Augmented... ...Province: California City: San Jose Equal Opportunity...SeniorFull timeTemporary workFor contractorsWork at officeLocal area
Celestica
San Jose, CA3 hours ago - ...Cadence Design Systems is seeking an experienced C++ software engineer for the Protium Software Development Team in San Jose, California. The role focuses on developing and enhancing FPGA-Based Prototyping products for high-profile companies in technology. The ideal...SeniorFull time
Cadence Design Systems
San Jose, CA3 hours ago - ## .Senior Director, Electrical Engineering page is loaded## Senior Director, Electrical Engineeringlocations: San Jose, Californiatime type: Full timeposted on: Posted Todayjob requisition... ...impacting long‐term company positioning* Serve as a senior technical interface with...SeniorFull timeWork at officeWorldwideShift work
Bloom Energy
San Jose, CA3 hours ago $184k - $260k
...A leading technology company in San Jose is seeking a Senior Principal System Validation Engineer. This position involves developing and executing validation tests for cutting-edge Data Center equipment. The ideal candidate has a strong technical background in Electrical...SeniorFull timeAstera Labs
San Jose, CA3 hours ago$210k - $255k
...A leading semiconductor company in San Jose is looking for an experienced product manager to define and deliver innovative silicon and software solutions. The role requires strong leadership and communication skills, with 5-10 years of experience in product management...SeniorFull timeAstera Labs
San Jose, CA3 hours ago$177.69k - $341.73k
A leading technology team in San Jose is seeking a Machine Learning Engineer to develop and maintain large-scale ML systems. The ideal candidate has strong programming skills in languages like Python or Go, and is familiar with Kubernetes and distributed systems. This...Full timeByteDance
San Jose, CA3 hours ago- ...Cadence Design Systems, Inc. is seeking an experienced C++ Software Engineer for its Protium Software Development Team in San Jose, California. You will enhance and support FPGA-based prototyping products, focusing on timing flow and algorithm development. The role requires...SeniorFull time
Cadence Design Systems, Inc.
San Jose, CA3 hours ago - ...A leading semiconductor firm located in San Jose is seeking a Principal/Senior Principal Post-Silicon Validation Engineer. This role involves developing and executing validation tests for semiconductor products, analyzing results, and ensuring designs meet specifications...SeniorFull time
Astera Labs
San Jose, CA3 hours ago $159k - $288k
...Senior Tax Manager - Global Monetization Product & Technology Location: San Jose Team: Finance Employment Type: Regular Job Code: A60684 About the team: The Tax... ...business models across multiple jurisdictions. Serve as the primary tax advisor for assigned...SeniorFull timeTemporary workLocal areaByteDance
San Jose, CA3 hours ago- ...An innovative AI company based in San Jose is looking for a Senior/Staff Data Scientist. You will work on evaluating safety performance for autonomous driving technology. The ideal candidate has at least 5 years in data science, holds a degree in a related field, and...SeniorFull time
Tensor
San Jose, CA3 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior ML Serving Engineer for LLMs & Inference (San Jose). Be the first to apply!
Related searches
- machine learning engineer San Jose, CA
- senior vice president communications San Jose, CA
- senior manager quality engineering San Jose, CA
- senior device engineer San Jose, CA
- sr operations manager San Jose, CA
- senior supervisor San Jose, CA
- senior platform engineer San Jose, CA
- senior clinical data manager San Jose, CA
- senior application developer San Jose, CA
- senior director clinical operations San Jose, CA