Software engineer - AI Agent Infra
$212.8kByteDance
Software Engineer - AI Agent Infra
Location: San Jose
Team: Technology
Employment Type: Regular
Job Code: A154953A
Responsibilities
Team Introduction We are building the dedicated AI Agent infrastructure and product platform for the Security organization, enabling different business teams to rapidly build, deploy, and scale AI Agents for real-world security use cases. Our mission is to turn the latest advances in LLMs, AI Agents, and applied AI systems into production-ready capabilities that power security workflows end to end — from intelligent assistance and automated analysis to workflow execution and decision support. We focus on building a platform that is not only powerful, but also secure, controllable, auditable, and scalable. You will work at the intersection of AI application engineering, agent infrastructure, and security productization, partnering closely with security experts and product teams to bring high-impact AI capabilities into complex business scenarios.
Responsibilities - Build the foundational AI Agent infrastructure for the Security organization, including agent runtime/frameworks, tool and plugin ecosystems, workflow orchestration, memory and knowledge/RAG systems, evaluation pipelines, observability, and cost governance.
- Design and develop the platform capabilities that enable multiple business teams to build and operate AI Agents efficiently, with strong guarantees around access control, auditing, isolation, governance, and reliability.
- Drive the implementation and iteration of AI Agent products and solutions for security scenarios, such as security operations assistance, investigation and triage, risk analysis, policy understanding and generation, automated Q&A, and intelligent workflow automation.
- Build robust backend services and APIs that support the full lifecycle of AI Agent applications, including integration with internal tools, data systems, and business workflows.
- Improve the quality and production readiness of AI applications through systematic work on evaluation, online experimentation, canary release, monitoring, fallback mechanisms, and performance optimization.
- Stay current with frontier AI technologies and apply them pragmatically in high-value security scenarios, working closely with domain experts to turn emerging capabilities into measurable business impact.
Qualifications
Minimum Qualifications - Bachelor's degree or above in Computer Science or a related field. - Proficiency in at least one programming language such as Go, Java, Python, C, C++, C#, or JavaScript, with strong backend engineering skills. - Strong computer science fundamentals, including data structures, algorithms, operating systems, networking, and databases. - Solid system design and engineering experience, with hands-on understanding of distributed systems, service architecture, caching, messaging, and high-availability backend services. - Strong problem-solving and execution skills, with the ability to collaborate effectively across engineering, product, and domain teams.
Preferred Qualifications - Experience in AI Agent systems, LLM applications, RAG, tool use, workflow orchestration, or AI application infrastructure. - Experience productionizing AI/ML applications, including areas such as evaluation, prompt/system optimization, online quality improvement, and reliability engineering. - Interest in applying advanced AI technologies to high-impact security and enterprise scenarios.
Job Information
For Pay TransparencyCompensation Description (Annually) The base salary range for this position in the selected city is $212800 - $450000 annually. Compensation may vary outside of this range depending on a number of factors, including a candidate's qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units. Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure). The Company reserves the right to modify or change these benefits programs at any time, with or without notice. For Los Angeles County (unincorporated) Candidates: Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment: 1. Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues; 2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems; and 3. Exercising sound judgment.
About Us
Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.
Why Join ByteDance
Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day. As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.
Diversity & Inclusion
ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.
Reasonable Accommodation
ByteDance is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at
$262k - $365k
Senior Staff Software Engineer, Infrastructure, Agents Infra Advanced Experience owning outcomes and decision making, solving ambiguous problems and influencing... ...as we continue to push technology forward. Applied AI builds conversational agents deployed at a large scale...SuggestedFull time$212.8k - $387.6k
.... 3 years experience as a senior development engineer. 3. 3 years experience of building large-scale... ...understanding of cloud infrastructure or AI infrastructure. 6. Familiar with at least one of the areas below: GPU Infra (GPU cluster management, job scheduling, collective...SuggestedTemporary workLocal area$166k - $244k
Senior Software Engineer, Infra, Vertex Gemini API+ Serving - Sunnyvale, CA, USA. About the job Google's software engineers develop the next‑generation... ...DeepMind to productize models and technology on the Vertex AI platform, bridging the gap between research and real‑world...SuggestedFull time$272k - $431.25k
...We are seeking a Principal AI and ML Infra Software Engineer, GPU Clusters at NVIDIA to join our Hardware Infrastructure team. As an Engineer, you will have a pivotal role in enhancing efficiency for our researchers by implementing progressions throughout the entire stack...Suggested$174k - $252k
Senior Software Engineer, ML Infrastructure, Core Infra corporate_fare Google place Sunnyvale, CA, USA Apply Qualifications... ...product teams including agent assist, dialogflow, and insights to... ...market, and scaling. The Cloud Applied AI (AAI) powers business growth with Gemini...SuggestedFull timeTemporary work$170.9k - $231.2k
...Senior Software Engineer, AI Agents Arm San Jose, CA, US Job Type: Full-Time Function: Engineering Software Industry: Frontier Tech Company Address: 110 Fulbourn Road, Cambridge, Cambs CB1 9NJ, GB About Arm Arm's foundational technology is defining...Full timeWork at officeLocal area$156k - $387.6k
...Software Engineer - LLM Applications and AI Agents Location: San Jose Employment Type: Regular Job Code: A00574A Responsibilities Join us in pushing the boundaries of AI technology and creating the next generation of intelligent systems that will transform data platforms...Temporary workLocal area$212.8k - $387.6k
...Senior Software Engineer, AI & Agent - TikTok Ecosystem & Platform Location: San Jose Employment Type: Regular Job Code: A126397A About the Team The TikTok PGC-Ecosystem & Platform team is a global team responsible for ensuring the health and sustainable growth of the...Temporary workLocal areaWorldwide$170k - $275k
...Software Engineer, Agent Harnessing Sunnyvale, California The future of defense will be decided by those who field intelligent machines at scale. At Scout AI, we're developing Fury, the first robotic foundation model for defense, to give U.S. forces overwhelming,...Full timeRelocation package$170k - $192k
...Ayar Labs in San Jose, CA is seeking a Sr. Engineer for Research Software & Modeling Infrastructure. The role involves designing and maintaining data schemas, building data pipelines, and integrating AI tools into workflows. Candidates should have a Bachelor's degree in...$156k - $316.8k
...Software Engineer - AI Agent Memory Infrastructure Location: San Jose Team: Technology Employment Type: Regular Job Code: A238905B Responsibilities Join ByteDance's AI Agent Memory Infrastructure team, where we build the core memory systems that power...Temporary workLocal area- A technology company in Cupertino is seeking a Software Engineer for Infrastructure Performance. This role involves designing and writing software for new model-specific ASICs, ensuring CI tests run efficiently, and assisting with server provisioning. Candidates should...Relocation package
$75k - $300k
...A cutting-edge AI company located in San Jose, California is looking for an experienced DevOps Engineer to join their infra team. The role involves overseeing Kubernetes environments and... ...tools for autonomous driving software. Candidates should have proficiency in...$218.8k - $335.3k
...About the team: The AV ML Infra team at GM builds end-to-end ML... ...to meet the unique demands of AI and ML innovation, supporting... ...enhance the productivity of ML engineers, and drive the adoption of cutting... ...design and build end-to-end software products , owning everything...Local areaWork from homeFlexible hours$174k - $252k
Senior Software Engineer, Infrastructure, Infra Spanner corporate_fare Google place Sunnyvale, CA, USA Bachelor’s degree or equivalent practical experience. 5 years of experience with software development in C++. 5 years of experience in performance analysis, debugging...Full time$170.5k - $315.49k
..., our journey is to transform AI into something safer, more trustworthy... ...The model is only half an agent; the harness is the other half... ...itself. This is core product engineering on an agent framework... ...or related STEM field 5+ years software development background Strong...Full timeInternshipLocal areaImmediate startShift work- ...About the team The AV ML Infra team builds end‑to‑end ML platforms and developer... ...‑facing products to support AI and ML innovation across teams such... ...As a Staff AI/ML Full‑Stack Engineer, you will design and build end‑to‑end software products, owning user‑facing interfaces...
- ...vehicle intelligence initiatives through next-generation AI Research. Responsibilities include building tools and... ...for large-scale research and collaborating with AI engineering teams to enhance self-driving software. The ideal applicant has strong software skills and analytical...
$207k - $307k
A leading tech company in Sunnyvale, CA is seeking a Software Engineer to lead the design and architecture of customer-facing systems. Applicants... ...in software development, focusing on distributed systems and AI/ML applications. You will drive project outcomes, implement...Full time$174k - $255k
Senior Software Engineer, Networking Switch Infra corporate_fare Google place Sunnyvale, CA, USA Apply Bachelor’s degree or equivalent practical experience. 5 years of experience with software development in one or more programming languages. 5 years of experience...Full time$147.4k - $272.1k
Software Engineer - AI Agents & Automation, Maps Data Tooling Cupertino, California, United States Software and Services Apple Maps is built on a continuously maintained data asset of extraordinary scale. As part of the Maps Data organization, we build the internal tools...Relocation- A leading technology company in California is looking for a Senior Software Engineer to develop cutting-edge AI and ML solutions. Responsibilities include writing and testing code, collaborating through design and code reviews, and contributing to documentation. Candidates...Full time
$275.8k - $340.5k
...vehicles, join us. About the team: The AV ML Infra team at GM builds ML infrastructure designed to meet the unique demands of AI and ML innovation, supporting a wide range... ..., enhance the productivity of ML engineers, and drive the adoption of cutting-edge ML techniques...Local areaRemote workWork from homeRelocationRelocation packageFlexible hours$156k - $387.6k
...Software Engineer/Researcher, AI-Native Database Systems Location: San Jose Team: Infrastructure... ...platforms, and real-time memory for AI agents. As a Senior Software Engineer or Researcher... ...search, and ANN indexing / AI infra or model-serving infrastructure (especially...Temporary workLocal area- ...NVIDIA Gruppe is seeking a Principal AI and ML Infra Software Engineer to join our Hardware Infrastructure team in Santa Clara, CA. In this role, you'll work closely with AI research teams to enhance efficiency by addressing infrastructure deficiencies for GPU Clusters...
$272k - $431.25k
NVIDIA Corporation seeks a Principal AI and ML Infra Software Engineer in Santa Clara, California, to enhance the efficiency of AI/ML research on GPU Clusters. The role involves collaboration with various teams, monitoring infrastructure performance, and implementing improvements...$147k - $237.5k
...Integrity, and Inclusion. We weave AI into the fabric of everything... .... Job Summary The ADEM engineering team is the engine of... ...Principal Engineer focused on the Agent, you will be at the center of... ...group is seeking a Principal Software Engineer to serve as a primary...Permanent employmentFull timeWork at officeLocal area- ...A cybersecurity technology firm in California seeks an Applied AI Engineer to architect and enhance AI-driven systems. Responsibilities include end-to-end feature ownership, collaborating with AI/ML teams, and integrating advanced AI solutions into operational workflows...Remote work
$140k - $215k
...security with the world's most advanced AI-native platform. We work on large scale... ...a Senior-to-Principal (Level 7) backend software Engineer to build out platform products which provide... ...or similar open source serverless infra-building framework(s) Contributed to the...Full timeWork experience placementWork at officeLocal area$153k - $222k
...the global adoption of safe, AI‑driven machines. Founded in 20... ...at Applied, we encourage all engineers to take ownership over technical... ...next generation self‑driving software Help scale end‑to‑end training... ...managed services at scale) ML infra fluency - has used and/or contributed...Full timeFor contractorsFor subcontractorCasual workWork at officeRemote workDay shift
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software engineer - AI Agent Infra. Be the first to apply!
- software developer internship no experience San Jose, CA
- federal - software developer San Jose, CA
- software engineer contract San Jose, CA
- part time software developer San Jose, CA
- software engineer healthcare San Jose, CA
- network software engineer San Jose, CA
- ngo software engineer San Jose, CA
- software development engineer aws San Jose, CA
- software developer internship San Jose, CA
- software developer intern San Jose, CA

