Principal AI Performance Engineer
$262.7k - $355.4kArm, Inc.
Job Summary
Are you passionate about optimizing AI workloads and delivering real-world performance improvements on edge devices?
Job Summary
Are you passionate about optimizing AI workloads and delivering real-world performance improvements on edge devices? We're looking for an experienced engineer to help customers achieve best-in-class inference performance for production AI models running on Arm technology. This role is based in San Jose, with significant time spent working directly with customers across the Bay Area.
Job Description
In this role, you will work closely with customers to optimize AI workloads targeting Arm technology, focusing on achieving best-in-class performance and power efficiency. Using your experience with Arm's AI optimization tools and your understanding of hardware architectures, you will develop kernel level implementations across a range of DNN models, optimizing for power and performance. In collaboration with multiple teams across Arm's engineering organization, you will diagnose and resolve performance challenges, and use these insights to influence Arms IP and tooling roadmaps. This role requires strong coding and communication skills; you'll translate complex technical challenges into clear insights, presenting progress and recommendations to audiences ranging from engineers to senior leadership.
Responsibilities
Develop highly optimized solutions for AI workloads, from kernel level to system level, to meet the needs of the customer application.
Create production quality reference implementations, documentation, and performance focused technical content
Act as a technical bridge between customers and internal teams, driving resolution of complex performance issues
Influence Arm's IP and software roadmap through insights gained from real-world customer use cases
Required Skills and Experience :
Experience optimizing DNNs in Triton, CUDA or other kernel level programming language
Deep understanding of parallel computing, memory hierarchies and performance optimization techniques for DNNs
Strong programming skills in Python and C++, a solid experience with modern AI frameworks and execution models, experience with profiling and analysis tools
Strong communication and interpersonal skills
Nice To Have:
Experience in a customer facing or field engineering environment
Experience within the Arm ecosystem
Background in AI performance optimization for edge devices
We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.
In Return
Joining Arm means stepping into a career-defining opportunity. You'll occupy a central role in the company's most critical initiatives. These initiatives build how Arm innovates, scales, and partners globally.
Additional Information
Please note this role does not meet the eligibility requirements for sponsorship, and therefore the successful candidate must have the right to work in the US without relying on sponsorship by Arm.
10x Mindset at Arm
At Arm, we believe progress happens when people are empowered to think bigger and push beyond what seems possible. Our 10x mindset is about curiosity, ambition and creating impact that will be used by millions. We learn fast, prioritise collaboration and turn bold ideas into real technology. We look for people who are inspired by this way of working and want to grow in an environment where bold ideas are welcomed. Read more about how we bring the 10x mindset to life on the Arm blog.
Salary Range:
$262,700-$355,400 per year
We value people as individuals and our dedication is to reward people competitively and equally for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.
Our 10x Mindset
At Arm, we believe progress happens when people are empowered to think bigger and push beyond what seems possible. Our 10x mindset is about curiosity, ambition and creating impact that will be used by millions. We learn fast, prioritise collaboration and turn bold ideas into real technology. We look for people who are inspired by this way of working and want to grow in an environment where bold ideas are welcomed. Discover how the 10x mindset shapes life at Arm:
Use of AI in Your Application
At Arm, we embrace the benefits AI can bring, including in recruitment. You may use AI to support your preparation, such as improving the clarity of written responses, practicing interview questions, or learning more about our industry. However, your application and interview responses must reflect your own thinking, experience, and abilities. We want to understand your authentic perspective, creativity, and approach to problem solving. As such, you may not use AI to complete assigned tasks as part of any assessments. If you plan to use AI-supported or assistive technologies as part of a reasonable adjustment, please contact View email address on sanjosejobsite.com so we can support you.
Recruitment Adjustments and Accommodations
At Arm, we want to build extraordinary teams. If you need an adjustment or an accommodation during the recruitment process, please email View email address on sanjosejobsite.com . To note, by sending us the requested information, you consent to its use by Arm to arrange for appropriate accommodations. All accommodation or adjustment requests will be treated with confidentiality, and information concerning these requests will only be disclosed as necessary to provide the accommodation. Although this is not an exhaustive list, examples of support include breaks between interviews, having documents read aloud, or office accessibility. Please email us about anything we can do to accommodate you during the recruitment process.
Hybrid Working
Arm's approach to hybrid working is designed to create a working environment that supports both high performance and personal wellbeing. We believe in bringing people together face to face to enable us to work at pace, whilst recognizing the value of flexibility. Within that framework, we empower groups/teams to determine their own hybrid working patterns, depending on the work and the team's needs. Details of what this means for each role will be shared upon application. In some cases, the flexibility we can offer is limited by local legal, regulatory, tax, or other considerations, and where this is the case, we will collaborate with you to find the best solution. Please talk to us to find out more about what this could look like for you.
Equal Opportunities
Arm is an equal opportunity employer, committed to providing an environment of mutual respect where equal opportunities are available to all applicants and colleagues. We are a diverse organization of dedicated and innovative individuals, and don't discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
J-18808-Ljbffr
- ...California or Austin, TexasNXP is searching for a hands-on AI Compiler Engineer who thrives at the convergence of cutting-edge AI, compiler... ...aligning silicon and code for maximum impact.Diagnose and crush performance bottlenecks with AI-enabled profiling and diagnostics,...PrincipalPerformanceFull timeWork at officeLocal area
- ...next-generation computing experiences—from AI and data centers, to PCs, gaming and... ...runtime, libraries, models, frameworks, and performance optimization layers. The role also... ...tier AI customers. Workload Performance Engineering: Lead the profiling, analysis, and tuning...PrincipalPerformance
$262.7k - $355.4k
Job Summary:Are you passionate about optimizing AI workloads and delivering real-world performance improvements on edge devices?We’re looking for an experienced engineer to help customers achieve best-in-class inference performance for production AI models running on Arm...PrincipalPerformanceWork at officeLocal area$250.44k - $375.67k
...for every OK-er.About the OpportunityWe are looking for a Principal AI Engineer to lead the architecture and deployment of large-scale, LLM... ...simulations, and continuous learning pipelines for Chatbot performance optimization.Design multi-level intent routing, classifier...PrincipalPerformance$270k - $340k
...physical artificial intelligence (“AI”) solutions, and other... ...members.What You’ll Do:As a Principal AI and ML fundamentalist who... ...Collaborate with other researcher engineers to prototype and validate... ...business. We drive a pay-for-performance culture and reward performance...PrincipalPerformanceLocal areaWorldwideVisa sponsorship$183.6k - $297k
..., Integrity, and Inclusion. We weave AI into the fabric of everything we do and... ...and resolve incidents at scale. As a Principal Software Engineer, you will own the technical vision... ...or similar techniques to optimize LLM performance and reduce inference costSolid skills...PrincipalPerformanceFull timeWork at office$249k
...their best work. Join us and build for travelers everywhere.Principal Data & AI Engineer, Reporting and InsightsIntroduction to the Team: Our... ...how Expedia Group transforms operational, portfolio, and performance data into trusted executive insights. You will bring together...PrincipalPerformanceFull timeWork at office$260.36k - $358k
...Intelligent Edge. ADI combines analog, digital, AI, and software technologies into solutions... ...We’re looking for Deep Agentic Reasoning Engineer (open rank) to design and build... ...This position qualifies for a discretionary performance-based bonus which is based on personal and...PrincipalPerformancePermanent employmentFull timeWork at officeDay shift$260.36k - $358k
...Intelligent Edge. ADI combines analog, digital, AI, and software technologies into... ...and X.About the Role We are seeking a Principal AI Engineer in Time-Series & Sensor Foundation... ...robustness, interpretability, and hardware performance metrics. Apply alignment and fine-...PrincipalPerformancePermanent employmentFull timeWork at officeDay shift$197.85k - $329.75k
...BMC, we don’t do ordinary. Across BMC, our AI teams are building the next generation of... ..., messaging systems, and workflow engines. Build and deploy RAG solutions using... ...knowledge sources. Optimize AI workflows for performance, scalability, reliability, and cost...PrincipalPerformanceLocal area$182k - $273k
AI Accelerator Software Principal Engineer - Runtime Library Ampere is a semiconductor design company for a new era, leading the future of computing... ...an innovative approach to CPU design focused on high-performance, energy efficient AI compute. As a pioneer in the new...PrincipalPerformanceLocal area$185.2k - $299.48k
Job Summary As a Principal AI Engineer for the Enterprise AI Platform, you will be a pivotal technical leader driving the design and hands‑on... ...design of large‑scale distributed AI/ML systems, ensuring performance, reliability, and security. Proactively collaborate with executive...PrincipalPerformance$185.2k - $299.48k
...Execution, Integrity, and Inclusion. We weave AI into the fabric of everything we do... .... Job Summary We are hiring AI Engineers at the Principal and Senior Principal levels to join our... ...and golden datasets. Design cost and performance optimization engines that dynamically...PrincipalPerformanceFull timeWork at office$223k - $306.5k
...Execution, Integrity, and Inclusion. We weave AI into the fabric of everything we do... ...world. Job Summary As a Sr Principal AI Engineer, you will join a dynamic team to pioneer... ...outputs, and model latency. Cost & Performance Optimization: Create architecture that...PrincipalPerformanceFull timeWork at office$231k - $378k
...The work location of this role is hybrid, meaning it will be performed both from home and from a LinkedIn office on select days,... ...people, knowledge, and opportunities.What This Role Is:As a Principal AI Engineer on LinkedIn Search, you will serve as the technical...PrincipalPerformanceFor contractorsWork at officeFlexible hoursShift work$170k - $225k
...everywhere.Fortinet is seeking an experienced and innovative Principal AI Security Engineer to join our Corporate Information Security team. As an AI... ...closely with development teams, conduct code reviews, perform AI Red Teaming assessments, to identify vulnerabilities...PrincipalPerformanceFull timeWork experience placementRemote workWorldwide$296.3k - $423.9k
...a global scale. We are looking for a Principal Technical Lead Manager (TLM) to lead the... ...Generation team within the Embodied AI organization. This role combines deep... ...world scenarios. You will lead a high-performing team of engineers building ML-driven trajectory generation...PrincipalPerformanceFull timeLocal areaRemote workWork from homeRelocationRelocation packageFlexible hours- ...cloud to edge. As part of the AI & Developer Platforms team,... ...and balance tradeoffs across performance, deployment, and ecosystem constraints... ...contributor role for a principal level researcher who can... ...Cognitive Psychology, UX Design, Engineering Design or a related field, or...PrincipalPerformanceWork at officeLocal areaRelocation
- ...Description Job Description Accellor is an AI-native services firm purpose-built for... ...outcomes through advanced AI, data, and engineering capabilities. Our mission is to... ...across the full AI platform — from GPU-level performance and distributed inference to product-...PrincipalPerformance
$231k
...work. Join us and build for travelers everywhere. Principal AI Forward Deployed Engineer Introduction to the Team: Within CTO... ...range, based on ongoing, demonstrated, and sustained performance in the role. The total cash range for this position in...PrincipalPerformanceWork at office- Job DescriptionAdvantest is seeking a Senior Principal AI Test Automation Engineer todesign and deliver reliable automation for complex engineering and productiontest environments.This role combines advanced test engineering, software automation, CI/CD, andAI-enabled workflows...Principal
$248k - $391k
Today, NVIDIA is tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU... ...we can make a lasting impact on the world.We are seeking a Principal AI Workflow Engineer to join the Enterprise Integration and API Team, playing a...PrincipalFull time$152k - $241.5k
We are seeking a Senior AI/ML Performance and Efficiency Engineer, GPU Clusters at NVIDIA to join our AI Efficiency efforts. As an Engineer, you will have a pivotal role in enhancing efficiency for our researchers by implementing progressions throughout the entire stack...PerformanceFull timeRemote work$224k - $356.5k
...tapping into the unlimited potential of AI to define the next era of computing. An... ...harnesses, and models on representative NVIDIA engineering workflows, comparing task success,... ...time by an order of magnitude.Optimize for performance and cost by identifying bottlenecks...PerformanceFull timeWork experience placement$184k - $287.5k
We are seeking a Senior AI Developer Technology (DevTech) Engineer to accelerate the frontier of generative AI training and inference. Our team is the... .... We dive deep into customer projects to accelerate performance, eliminate bottlenecks, and partner with a vibrant developer...PerformanceFull timeWorldwide$152k - $241.5k
We are now looking for a Senior AI Frameworks Engineer (C++/Python)! NVIDIA's high-performance computing platforms are powering the AI revolution across many applications and industries. Within our software stack, CUTLASS stands out as a popular open-source ecosystem dedicated...PerformanceFull time$152k - $241.5k
...breakthroughs in gaming, computer graphics, high-performance computing, and artificial intelligence.... ...powers everything from generative AI to autonomous systems, and we continue... ..., and tools that enable researchers and engineers to develop the next generation of AI/ML...PerformanceFull time$152k - $241.5k
We are looking for outstanding Senior High Performance AI Engineers to build the next generation of agentic AI systems for the CUDA ecosystem. Our team works across the full agentic AI stack—from training and improving models, to designing agent architectures and multi...PerformanceFull timeRemote work$221.2k - $387.1k
Company DescriptionIt all started when engineer Fred Luddy wrote code that automated a tedious... ...work. Today, ServiceNow is the AI control tower for business reinvention. Our... ...customer service, and field service. As Principal Forward Deployed Engineer, you are the lead...PrincipalWork at officeImmediate startRemote workFlexible hours$176k - $276k
NVIDIA is looking for an experienced HPC-AI Engineer to join the Networking Clusters Solutions Infrastructure team. we are focused on... ...systems specialist to architect, develop and bring up large scale performance platforms.What you will be doing:Design, implement and...PerformanceFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal AI Performance Engineer. Be the first to apply!
- director software engineering San Jose, CA
- principal cloud engineer San Jose, CA
- general engineer San Jose, CA
- chief design engineer San Jose, CA
- senior civil engineer project manager San Jose, CA
- senior director engineering San Jose, CA
- data center chief engineer San Jose, CA
- director of product engineering San Jose, CA
- chief engineer San Jose, CA
- senior principal engineer San Jose, CA



