Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal AI Performance Engineer

$262.7k - $355.4k

Arm, Inc.

Job Summary

Are you passionate about optimizing AI workloads and delivering real-world performance improvements on edge devices?
Job Summary

Are you passionate about optimizing AI workloads and delivering real-world performance improvements on edge devices? We're looking for an experienced engineer to help customers achieve best-in-class inference performance for production AI models running on Arm technology. This role is based in San Jose, with significant time spent working directly with customers across the Bay Area.
Job Description

In this role, you will work closely with customers to optimize AI workloads targeting Arm technology, focusing on achieving best-in-class performance and power efficiency. Using your experience with Arm's AI optimization tools and your understanding of hardware architectures, you will develop kernel level implementations across a range of DNN models, optimizing for power and performance. In collaboration with multiple teams across Arm's engineering organization, you will diagnose and resolve performance challenges, and use these insights to influence Arms IP and tooling roadmaps. This role requires strong coding and communication skills; you'll translate complex technical challenges into clear insights, presenting progress and recommendations to audiences ranging from engineers to senior leadership.
Responsibilities

Develop highly optimized solutions for AI workloads, from kernel level to system level, to meet the needs of the customer application.
Create production quality reference implementations, documentation, and performance focused technical content
Act as a technical bridge between customers and internal teams, driving resolution of complex performance issues
Influence Arm's IP and software roadmap through insights gained from real-world customer use cases
Required Skills and Experience :

Experience optimizing DNNs in Triton, CUDA or other kernel level programming language
Deep understanding of parallel computing, memory hierarchies and performance optimization techniques for DNNs
Strong programming skills in Python and C++, a solid experience with modern AI frameworks and execution models, experience with profiling and analysis tools
Strong communication and interpersonal skills
Nice To Have:

Experience in a customer facing or field engineering environment
Experience within the Arm ecosystem
Background in AI performance optimization for edge devices
We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.
In Return

Joining Arm means stepping into a career-defining opportunity. You'll occupy a central role in the company's most critical initiatives. These initiatives build how Arm innovates, scales, and partners globally.
Additional Information

Please note this role does not meet the eligibility requirements for sponsorship, and therefore the successful candidate must have the right to work in the US without relying on sponsorship by Arm.
10x Mindset at Arm

At Arm, we believe progress happens when people are empowered to think bigger and push beyond what seems possible. Our 10x mindset is about curiosity, ambition and creating impact that will be used by millions. We learn fast, prioritise collaboration and turn bold ideas into real technology. We look for people who are inspired by this way of working and want to grow in an environment where bold ideas are welcomed. Read more about how we bring the 10x mindset to life on the Arm blog.
Salary Range:

$262,700-$355,400 per year
We value people as individuals and our dedication is to reward people competitively and equally for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.
Our 10x Mindset

At Arm, we believe progress happens when people are empowered to think bigger and push beyond what seems possible. Our 10x mindset is about curiosity, ambition and creating impact that will be used by millions. We learn fast, prioritise collaboration and turn bold ideas into real technology. We look for people who are inspired by this way of working and want to grow in an environment where bold ideas are welcomed. Discover how the 10x mindset shapes life at Arm:
Use of AI in Your Application

At Arm, we embrace the benefits AI can bring, including in recruitment. You may use AI to support your preparation, such as improving the clarity of written responses, practicing interview questions, or learning more about our industry. However, your application and interview responses must reflect your own thinking, experience, and abilities. We want to understand your authentic perspective, creativity, and approach to problem solving. As such, you may not use AI to complete assigned tasks as part of any assessments. If you plan to use AI-supported or assistive technologies as part of a reasonable adjustment, please contact View email address on sanjosejobsite.com so we can support you.
Recruitment Adjustments and Accommodations

At Arm, we want to build extraordinary teams. If you need an adjustment or an accommodation during the recruitment process, please email View email address on sanjosejobsite.com . To note, by sending us the requested information, you consent to its use by Arm to arrange for appropriate accommodations. All accommodation or adjustment requests will be treated with confidentiality, and information concerning these requests will only be disclosed as necessary to provide the accommodation. Although this is not an exhaustive list, examples of support include breaks between interviews, having documents read aloud, or office accessibility. Please email us about anything we can do to accommodate you during the recruitment process.
Hybrid Working

Arm's approach to hybrid working is designed to create a working environment that supports both high performance and personal wellbeing. We believe in bringing people together face to face to enable us to work at pace, whilst recognizing the value of flexibility. Within that framework, we empower groups/teams to determine their own hybrid working patterns, depending on the work and the team's needs. Details of what this means for each role will be shared upon application. In some cases, the flexibility we can offer is limited by local legal, regulatory, tax, or other considerations, and where this is the case, we will collaborate with you to find the best solution. Please talk to us to find out more about what this could look like for you.
Equal Opportunities

Arm is an equal opportunity employer, committed to providing an environment of mutual respect where equal opportunities are available to all applicants and colleagues. We are a diverse organization of dedicated and innovative individuals, and don't discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

J-18808-Ljbffr

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Principal AI Performance Engineer in San Jose, CA vacancy
  •  ...California or Austin, TexasNXP is searching for a hands-on AI Compiler Engineer who thrives at the convergence of cutting-edge AI, compiler...  ...aligning silicon and code for maximum impact.Diagnose and crush performance bottlenecks with AI-enabled profiling and diagnostics,... 
    Principal
    Performance
    Full time
    Work at office
    Local area

    NXP Semiconductors

    San Jose, CA
    2 days ago
  •  ...next-generation computing experiences—from AI and data centers, to PCs, gaming and...  ...runtime, libraries, models, frameworks, and performance optimization layers. The role also...  ...tier AI customers. Workload Performance Engineering: Lead the profiling, analysis, and tuning... 
    Principal
    Performance

    AMD

    San Jose, CA
    2 days ago
  • $262.7k - $355.4k

    Job Summary:Are you passionate about optimizing AI workloads and delivering real-world performance improvements on edge devices?We’re looking for an experienced engineer to help customers achieve best-in-class inference performance for production AI models running on Arm... 
    Principal
    Performance
    Work at office
    Local area

    ARM

    San Jose, CA
    1 day ago
  • $250.44k - $375.67k

     ...for every OK-er.About the OpportunityWe are looking for a Principal AI Engineer to lead the architecture and deployment of large-scale, LLM...  ...simulations, and continuous learning pipelines for Chatbot performance optimization.Design multi-level intent routing, classifier... 
    Principal
    Performance

    OKX

    San Jose, CA
    4 days ago
  • $270k - $340k

     ...physical artificial intelligence (“AI”) solutions, and other...  ...members.What You’ll Do:As a Principal AI and ML fundamentalist who...  ...Collaborate with other researcher engineers to prototype and validate...  ...business. We drive a pay-for-performance culture and reward performance... 
    Principal
    Performance
    Local area
    Worldwide
    Visa sponsorship

    Archer Aviation

    San Jose, CA
    1 day ago
  • $183.6k - $297k

     ..., Integrity, and Inclusion. We weave AI into the fabric of everything we do and...  ...and resolve incidents at scale. As a Principal Software Engineer, you will own the technical vision...  ...or similar techniques to optimize LLM performance and reduce inference costSolid skills... 
    Principal
    Performance
    Full time
    Work at office

    Palo Alto Networks

    Santa Clara, CA
    4 days ago
  • $249k

     ...their best work. Join us and build for travelers everywhere.Principal Data & AI Engineer, Reporting and InsightsIntroduction to the Team: Our...  ...how Expedia Group transforms operational, portfolio, and performance data into trusted executive insights. You will bring together... 
    Principal
    Performance
    Full time
    Work at office

    Expedia

    San Jose, CA
    1 day ago
  • $260.36k - $358k

     ...Intelligent Edge. ADI combines analog, digital, AI, and software technologies into solutions...  ...We’re looking for Deep Agentic Reasoning Engineer (open rank) to design and build...  ...This position qualifies for a discretionary performance-based bonus which is based on personal and... 
    Principal
    Performance
    Permanent employment
    Full time
    Work at office
    Day shift

    Analog Devices

    San Jose, CA
    12 hours ago
  • $260.36k - $358k

     ...Intelligent Edge. ADI combines analog, digital, AI, and software technologies into...  ...and X.About the Role We are seeking a Principal AI Engineer in Time-Series & Sensor Foundation...  ...robustness, interpretability, and hardware performance metrics. Apply alignment and fine-... 
    Principal
    Performance
    Permanent employment
    Full time
    Work at office
    Day shift

    Analog Devices

    San Jose, CA
    12 hours ago
  • $197.85k - $329.75k

     ...BMC, we don’t do ordinary. Across BMC, our AI teams are building the next generation of...  ..., messaging systems, and workflow engines. Build and deploy RAG solutions using...  ...knowledge sources. Optimize AI workflows for performance, scalability, reliability, and cost... 
    Principal
    Performance
    Local area

    BMC Software, Inc.

    Santa Clara, CA
    2 days ago
  • $182k - $273k

    AI Accelerator Software Principal Engineer - Runtime Library Ampere is a semiconductor design company for a new era, leading the future of computing...  ...an innovative approach to CPU design focused on high-performance, energy efficient AI compute. As a pioneer in the new... 
    Principal
    Performance
    Local area

    Ampere Computing LLC

    Santa Clara, CA
    4 days ago
  • $185.2k - $299.48k

    Job Summary As a Principal AI Engineer for the Enterprise AI Platform, you will be a pivotal technical leader driving the design and hands‑on...  ...design of large‑scale distributed AI/ML systems, ensuring performance, reliability, and security. Proactively collaborate with executive... 
    Principal
    Performance

    Palo Alto Networks

    Santa Clara, CA
    3 days ago
  • $185.2k - $299.48k

     ...Execution, Integrity, and Inclusion. We weave AI into the fabric of everything we do...  .... Job Summary We are hiring AI Engineers at the Principal and Senior Principal levels to join our...  ...and golden datasets. Design cost and performance optimization engines that dynamically... 
    Principal
    Performance
    Full time
    Work at office

    Palo Alto Networks

    Santa Clara, CA
    12 hours ago
  • $223k - $306.5k

     ...Execution, Integrity, and Inclusion. We weave AI into the fabric of everything we do...  ...world. Job Summary As a Sr Principal AI Engineer, you will join a dynamic team to pioneer...  ...outputs, and model latency. Cost & Performance Optimization: Create architecture that... 
    Principal
    Performance
    Full time
    Work at office

    Palo Alto Networks, Inc.

    Santa Clara, CA
    4 days ago
  • $231k - $378k

     ...The work location of this role is hybrid, meaning it will be performed both from home and from a LinkedIn office on select days,...  ...people, knowledge, and opportunities.What This Role Is:As a Principal AI Engineer on LinkedIn Search, you will serve as the technical... 
    Principal
    Performance
    For contractors
    Work at office
    Flexible hours
    Shift work

    Linkedin

    Mountain View, CA
    1 day ago
  • $170k - $225k

     ...everywhere.Fortinet is seeking an experienced and innovative Principal AI Security Engineer to join our Corporate Information Security team. As an AI...  ...closely with development teams, conduct code reviews, perform AI Red Teaming assessments, to identify vulnerabilities... 
    Principal
    Performance
    Full time
    Work experience placement
    Remote work
    Worldwide

    Fortinet

    Sunnyvale, CA
    4 days ago
  • $296.3k - $423.9k

     ...a global scale.  We are looking for a Principal Technical Lead Manager (TLM) to lead the...  ...Generation team within the Embodied AI organization. This role combines deep...  ...world scenarios. You will lead a high-performing team of engineers building ML-driven trajectory generation... 
    Principal
    Performance
    Full time
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    4 days ago
  •  ...cloud to edge. As part of the AI & Developer Platforms team,...  ...and balance tradeoffs across performance, deployment, and ecosystem constraints...  ...contributor role for a principal level researcher who can...  ...Cognitive Psychology, UX Design, Engineering Design or a related field, or... 
    Principal
    Performance
    Work at office
    Local area
    Relocation

    ARM

    San Jose, CA
    1 day ago
  •  ...Description Job Description Accellor is an AI-native services firm purpose-built for...  ...outcomes through advanced AI, data, and engineering capabilities. Our mission is to...  ...across the full AI platform — from GPU-level performance and distributed inference to product-... 
    Principal
    Performance

    Accellor

    Mountain View, CA
    27 days ago
  • $231k

     ...work. Join us and build for travelers everywhere. Principal AI Forward Deployed Engineer Introduction to the Team: Within CTO...  ...range, based on ongoing, demonstrated, and sustained performance in the role. The total cash range for this position in... 
    Principal
    Performance
    Work at office

    Expedia Group

    San Jose, CA
    4 hours ago
  • Job DescriptionAdvantest is seeking a Senior Principal AI Test Automation Engineer todesign and deliver reliable automation for complex engineering and productiontest environments.This role combines advanced test engineering, software automation, CI/CD, andAI-enabled workflows... 
    Principal

    Advantest

    San Jose, CA
    3 days ago
  • $248k - $391k

    Today, NVIDIA is tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU...  ...we can make a lasting impact on the world.We are seeking a Principal AI Workflow Engineer to join the Enterprise Integration and API Team, playing a... 
    Principal
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $152k - $241.5k

    We are seeking a Senior AI/ML Performance and Efficiency Engineer, GPU Clusters at NVIDIA to join our AI Efficiency efforts. As an Engineer, you will have a pivotal role in enhancing efficiency for our researchers by implementing progressions throughout the entire stack... 
    Performance
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    4 days ago
  • $224k - $356.5k

     ...tapping into the unlimited potential of AI to define the next era of computing. An...  ...harnesses, and models on representative NVIDIA engineering workflows, comparing task success,...  ...time by an order of magnitude.Optimize for performance and cost by identifying bottlenecks... 
    Performance
    Full time
    Work experience placement

    Nvidia

    Santa Clara, CA
    12 hours ago
  • $184k - $287.5k

    We are seeking a Senior AI Developer Technology (DevTech) Engineer to accelerate the frontier of generative AI training and inference. Our team is the...  .... We dive deep into customer projects to accelerate performance, eliminate bottlenecks, and partner with a vibrant developer... 
    Performance
    Full time
    Worldwide

    Nvidia

    Santa Clara, CA
    2 days ago
  • $152k - $241.5k

    We are now looking for a Senior AI Frameworks Engineer (C++/Python)! NVIDIA's high-performance computing platforms are powering the AI revolution across many applications and industries. Within our software stack, CUTLASS stands out as a popular open-source ecosystem dedicated... 
    Performance
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $152k - $241.5k

     ...breakthroughs in gaming, computer graphics, high-performance computing, and artificial intelligence....  ...powers everything from generative AI to autonomous systems, and we continue...  ..., and tools that enable researchers and engineers to develop the next generation of AI/ML... 
    Performance
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $152k - $241.5k

    We are looking for outstanding Senior High Performance AI Engineers to build the next generation of agentic AI systems for the CUDA ecosystem. Our team works across the full agentic AI stack—from training and improving models, to designing agent architectures and multi... 
    Performance
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    4 days ago
  • $221.2k - $387.1k

    Company DescriptionIt all started when engineer Fred Luddy wrote code that automated a tedious...  ...work. Today, ServiceNow is the AI control tower for business reinvention. Our...  ...customer service, and field service. As Principal Forward Deployed Engineer, you are the lead... 
    Principal
    Work at office
    Immediate start
    Remote work
    Flexible hours

    ServiceNow

    Santa Clara, CA
    3 days ago
  • $176k - $276k

    NVIDIA is looking for an experienced HPC-AI Engineer to join the Networking Clusters Solutions Infrastructure team. we are focused on...  ...systems specialist to architect, develop and bring up large scale performance platforms.What you will be doing:Design, implement and... 
    Performance
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal AI Performance Engineer. Be the first to apply!