Principal AI Engineer
Salesforce
AI Platform Engineer
Salesforce is the #1 AI CRM, where humans with agents drive customer success together. Here, ambition meets action. Tech meets trust. And innovation isn't a buzzword — it's a way of life. The world of work as we know it is changing and we're looking for Trailblazers who are passionate about bettering business and the world through AI, driving innovation, and keeping Salesforce's core values at the heart of it all.
Ready to level-up your career at the company leading workforce transformation in the agentic era? You're in the right place! Agentforce is the future of AI, and you are the future of Salesforce.
We are seeking a highly skilled AI Platform Engineer to play a pivotal role in building the next generation of our ML/AI platform that doesn't just support ML models, but powers autonomous AI agents at enterprise scale. This role sits at the intersection of platform infrastructure and agent systems engineering. You'll build and maintain the core infrastructure, CI/CD pipelines, and platform services that underpin our machine learning initiatives and go further in designing the harnesses, sandboxes, and evaluation frameworks that let AI agents be developed, tested, and trusted in production. You'll work on systems that directly impact marketing, sales, service, and product growth verticals across the organization. This isn't a traditional infrastructure role. You should be comfortable wearing multiple hats of software engineering, agent systems design, and evaluation tooling. We're looking for engineers who think in flywheels: build →evaluate → improve → ship → repeat.
What You'll Do
- Design and build agent harness infrastructure: the scaffolding that wraps LLM calls, manages tool use, handles retries, enforces policy, and feeds results back into iterative improvement loops.
- Implement agentic loop patterns with multi-turn reasoning, tool orchestration, memory management, and structured output handling as reusable platform primitives
- Build the agent flywheel: automated pipelines that collect agent traces, surface regressions, route failures to evaluation, and close the loop from production signal back to prompt/model improvement
- Own the end-to-end lifecycle from agent experiment to production deployment, including versioning, rollout controls, and rollback mechanisms
- Build sandboxed execution environments for agent tools with isolating code execution, API calls, and file system access so agents can act without unconstrained blast radius
- Design tiered autonomy models: define which actions agents can take automatically, which require human approval, and which are off-limits and enforced at the infrastructure layer
- Implement replay and dry-run capabilities so new agent versions can be tested against real traces before going live
- Implement evaluation frameworks for agent behavior using a combination of vendor, open source or in house built tools — covering task success, tool selection accuracy, trajectory evaluation, hallucination rates, latency, and cost
- Build and maintain eval datasets, golden trace libraries, and regression test suites that run automatically on every agent code change
- Instrument agent traces end-to-end: LLM calls, tool invocations, intermediate reasoning, final outputs — surfaced in Grafana or equivalent observability tooling
- Define and track agent quality metrics over time; own the signal that tells the team whether agents are getting better or worse
- Drive continuous quality, latency, and cost improvements across deployed agents by closing the loop between production traces, evaluations, and agent design. Optimization may be done through a variety of techniques e.g. prompt tuning, tool calling optimizations, context engineering, right-sizing model selection per task and explore distillation or fine-tuning (SFT, DPO, RLHF) on curated trace data to name a few
- Validate every optimization through A/B tests, shadow deployments, and replay against golden traces, with the eval suite gating rollout so wins are real and regressions are caught before they reach users
- Build and optimize CI/CD pipelines (GitHub Actions, ArgoCD) that cover not just code deployment but agent evaluation gates — no agent ships without passing its eval suite
- Automate Docker and package builds, security scanning, and agent integration tests as first-class pipeline steps
- Design self-healing CI patterns where agent-based automation can diagnose and fix common pipeline failures
- Build internal tools and developer self-service interfaces that let ML engineers and data scientists iterate on agents without platform team involvement
- Maintain a comprehensive view of how all platform components -> infrastructure, agent harnesses, evaluation pipelines, observability — work together
- Create architecture diagrams and drive long-term platform vision; own the "how does this scale to 10x" conversation
- Establish alerting (Grafana, PagerDuty) for both traditional platform health and agent-specific signals (error rates, tool call failures, eval score drift)
- Ensure all agent infrastructure adheres to security best practices: sandboxed execution, auditable traces, access controls on every tool
- Participate in security reviews; own compliance for agent workloads
What We're Looking For
- 9+ years as a Platform Engineer, ML Infrastructure Engineer, or Software Engineer
- Demonstrated experience building agent harness infrastructure using agentic loops, tool orchestration, structured output handling, multi-turn conversation management
- Hands-on experience with agent evaluation frameworks like Braintrust, LangSmith, or equivalent, including building eval datasets, running automated regression suites, and tracking quality metrics over time
- Strong understanding of sandboxing and safe agent execution like isolation patterns, tiered autonomy, blast radius controls
- Experience with context Engineering as it relates to Agent orchestration.
- Strong Python engineering skills for building scalable tools, automation, and platform components
- Deep expertise in AWS
- Extensive experience with CI/CD tooling, especially GitHub Actions and ArgoCD
- Proficiency in infrastructure-as-code (Terraform)
- Experience with containerization (Docker) and orchestration (Kubernetes)
- Experience with AgentOps concepts and production Multi Agent systems
- Strong problem-solving skills and ability to manage multiple priorities across a complex platform
- Preferred Qualifications (Bonus Points):
- Experience with Salesforce Ecosystem including Agentforce and Data360
- Experience with unstructured databases(vector or graph databases) and RAG pipelines
- Experience working with modern data platforms and real-time processing frameworks, including cloud data warehouses (e.g., snowflake), streaming technologies (e.g. kafka, flink)
Unleash Your Potential
When you join Salesforce, you'll be limitless in all areas of your life. Our benefits and resources support you to find balance and be your best, and our AI agents accelerate your impact so you can do your best. Together, we'll bring the power of Agentforce to organizations of all sizes and deliver amazing experiences that customers love. Apply today to not only shape the future — but to redefine what's possible — for yourself, for AI, and the world.
- ...We are seeking a Principal AI Engineer to design, build, and scale AI‑driven systems across our product platforms. This role is ideal for a deeply technical engineer who leads through hands‑on contribution, solves complex problems, and drives the adoption of AI into real...Suggested
$220k - $350k
...company is actively developing the technologies to make this possible, with the ultimate goal of enabling human life on Mars. PRINCIPAL AI ENGINEER, SPECIAL PROGRAMS This team focuses on engineering and deploying AI capabilities (models, APIs, tools, and integrations) for...SuggestedPermanent employmentTemporary workLocal areaImmediate startWeekend work- Unity Technologies is looking for a Principal Machine Learning Engineer in Mountain View, CA, to lead the integration of AI-driven models into game engines. The role involves optimizing multi-modal models for on-device use, ensuring performance within battery and memory...Suggested
$176.3k - $299.7k
...model This is a hybrid role based out of Palo Alto, CA. Hybrid is 3 days a week onsite, 2 days a week remote. Position Principal Agentic AI Engineer - BTP Product Management Regional Implementation Group (RIG) Overview We are seeking a Principal Agentic AI Engineer to...SuggestedRemote work2 days per week3 days per week- Intuit Inc. is looking for a self-motivated Principal AI Engineer to join their Foresight organization. This role involves leveraging AI to develop impactful, new products that enhance customer experiences. With over 8 years in AI development, candidates will collaborate...Suggested
- ...United States Digital Space LLC is seeking a Principal Security Software Engineer to leverage AI for automating security processes within the Starshield program. The ideal candidate will have a strong background in security software development and experience in designing...
- ...prosper. Intuit’s strategy is to be a global AI-driven expert platform delivering world-... ...platforms, enabling our scientists and engineers to move quickly from research to impact.... ...We are seeking a self-motivated, hands‑on Principal AI Engineer who operates with a high...Immediate startWorldwide
$296.3k
...future of transportation on a global scale. Role As a Principal Technical Lead in the Embodied AI organization, you will be a senior individual contributor... ...closely with cross‑functional teams, mentor ML engineers, and significantly shape the future of onboard ML capabilities...Local areaRemote workWork from homeRelocation packageFlexible hours$296.3k
Israelvcforum is seeking a Principal Technical Lead in the Embodied AI organization to design and deploy cutting-edge machine learning solutions for autonomous... ...focus will be on leading initiatives and mentoring engineers in a remote environment. Candidates must have a degree...Remote workRelocation package$250k - $350k
PRINCIPAL AI ENGINEER Technical Lead San Francisco, CA • Hybrid • $250K-$350K Join the Data Revolution at Prophecy About Prophecy Prophecy is revolutionizing enterprise data transformation with AI-native tools that turn data chaos into reliable insights. We’re not just...Remote workWorldwideFlexible hours$250k - $350k
Golang Works is seeking a Principal AI Engineer in Palo Alto, California. The role calls for a hands-on leader who will design innovative AI solutions, mentor team members, and manage cutting-edge AI projects. The ideal candidate will have over 7 years of experience and...Flexible hours$296.3k
General Motors is seeking a Principal Technical Lead to drive cutting-edge end-to-end machine learning solutions impacting autonomous... ...collaboration with cross-functional teams and mentorship of ML engineers. The ideal candidate will have expertise in large-scale foundation...- United States Digital Space LLC is seeking a Principal Software Engineer to define and drive the technical vision for their AI platform. The engineer will architect systems that empower teams to harness AI effectively, ensuring scalability and security. The ideal candidate...
- 慨正橡扯 is looking for a Principal AI/ML and Gen AI Engineer to join their team in Palo Alto, California. This role involves designing and scaling AI/ML infrastructure on AWS, developing advanced machine learning models, and leading productionalization efforts for Gen AI use...
$175.8k - $293k
...systems, and data that power the world’s largest organizations so they can seize a competitive advantage. We're looking for a Principal AI Engineer to architect, build, and harden the agentic AI systems that power our products. This is a hands‑on, full‑stack AI role: you'...- ...Role : Principal AI Engineer Location : Sunnyvale, USA (94085) Mandatory skills---React JS, Python, Go, PostgreSQL, Snowflake Agentic AI, Claude AI Detailed JD : 10 years of overall experience in software development. Proven experience in designing and...
- MixMode is seeking a Principal Software Engineer to innovate and develop kernels for our advanced AI compute engine based in Santa Clara, CA. This role demands expertise in software development for next-generation hardware with a strong requirement for knowledge in C/C++...
- CoreWeave is hiring a Principal Engineer to lead the design and evolution of its AI infrastructure's cluster orchestration systems. The role demands expertise in Kubernetes and Slurm, working directly on technology that influences how efficiently GPUs are utilized. Your...
$184k - $376k
...Director to lead the evolution of its core search experience using AI and machine learning. This role involves shaping how millions... ...The position requires over 10 years of experience in software engineering and/or machine learning, with a strong product mindset and...$148.7k - $297.3k
...with chronic pain and movement disorders, and liberate more than 500,000 people with diabetes from routine fingersticks. Principal AI/ML Engineer Location: Santa Clara, CA. What You’ll Work On Lead end-to-end ML solutions development and delivery, including data ingestion...$296.3k - $423.9k
...Job Overview We are seeking a Principal Technical Lead Manager (TLM) to lead the Trajectory Generation team within the Embodied AI organization at General Motors. The role combines... ...for driving. Mentor senior engineers and help develop the next generation of...Local areaRemote workFlexible hours$275.8k - $340.5k
...Position Overview The Principal AI/ML Engineer will lead a growing organization, guiding the AV ML Infra team in achieving its mission while shaping long‑term vision and execution strategies across GM’s AI and ML efforts. This leadership role will drive a transformative...Local areaRemote workRelocationRelocation packageFlexible hours$275.8k - $340.5k
...infrastructure designed to meet the unique demands of AI and ML innovation, supporting a wide... ..., enhance the productivity of ML engineers, and drive the adoption of cutting-edge ML... ...commercialization. Position Overview The Principal AI/ML Engineer will lead a growing...Local areaRemote workRelocationRelocation packageFlexible hours$167k - $270.5k
Palo Alto Networks, Inc. is seeking a Technical Leader to develop AI applications within the GTM/CX domain. This role involves defining the architecture for scalable AI/ML systems and leading the design of intelligent agents. Ideal candidates will have 15+ years of experience...- ...NVIDIA Gruppe is seeking a Principal AI and ML Infra Software Engineer to join our Hardware Infrastructure team in Santa Clara, CA. In this role, you'll work closely with AI research teams to enhance efficiency by addressing infrastructure deficiencies for GPU Clusters...
$272k - $431.25k
NVIDIA Corporation seeks a Principal AI and ML Infra Software Engineer in Santa Clara, California, to enhance the efficiency of AI/ML research on GPU Clusters. The role involves collaboration with various teams, monitoring infrastructure performance, and implementing improvements...$142.8k - $261.8k
...you will contribute significantly to the delivery of innovative AI solutions. You will work with a wide variety of clients to... ...complexities of modern robotics, digital twin applications, and software engineering. We'll look to you to provide technical leadership and perform...Full timeWork experience placementSummer holidayFlexible hours- Centaur Labs is seeking an experienced technical leader to drive innovations in Responsible AI. You will lead a team of experts to develop strategies and systems that facilitate AI ethics and performance at scale. With a focus on management and technical oversight, this...
- General Motors is seeking a Principal Technical Lead Manager (TLM) to lead the Trajectory Generation team in the Embodied AI organization. This role will drive technical vision in machine learning and robotics while focusing on autonomous driving. The ideal candidate will...Remote work
$160k - $210k
CommerceIQ in Mountain View, California, seeks an Engineering Leader for the AI Labs team to develop autonomous AI agents. This role involves recruiting a talented team, setting technical direction, and deploying solutions for Fortune 100 brands. The ideal candidate will...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal AI Engineer. Be the first to apply!
- principal developer Palo Alto, CA
- engineering director Palo Alto, CA
- senior chief engineer Palo Alto, CA
- chief engineer Palo Alto, CA
- data center chief engineer Palo Alto, CA
- senior civil engineer project manager Palo Alto, CA
- hotel chief engineer Palo Alto, CA
- principal infrastructure engineer Palo Alto, CA
- principal network engineer Palo Alto, CA
- principal cloud engineer Palo Alto, CA

