Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software engineer - AI Agent Infra

$212.8k

ByteDance

Software Engineer - AI Agent Infra

Location: San Jose

Team: Technology

Employment Type: Regular

Job Code: A154953A

Responsibilities

Team Introduction We are building the dedicated AI Agent infrastructure and product platform for the Security organization, enabling different business teams to rapidly build, deploy, and scale AI Agents for real-world security use cases. Our mission is to turn the latest advances in LLMs, AI Agents, and applied AI systems into production-ready capabilities that power security workflows end to end — from intelligent assistance and automated analysis to workflow execution and decision support. We focus on building a platform that is not only powerful, but also secure, controllable, auditable, and scalable. You will work at the intersection of AI application engineering, agent infrastructure, and security productization, partnering closely with security experts and product teams to bring high-impact AI capabilities into complex business scenarios.

Responsibilities - Build the foundational AI Agent infrastructure for the Security organization, including agent runtime/frameworks, tool and plugin ecosystems, workflow orchestration, memory and knowledge/RAG systems, evaluation pipelines, observability, and cost governance.

- Design and develop the platform capabilities that enable multiple business teams to build and operate AI Agents efficiently, with strong guarantees around access control, auditing, isolation, governance, and reliability.

- Drive the implementation and iteration of AI Agent products and solutions for security scenarios, such as security operations assistance, investigation and triage, risk analysis, policy understanding and generation, automated Q&A, and intelligent workflow automation.

- Build robust backend services and APIs that support the full lifecycle of AI Agent applications, including integration with internal tools, data systems, and business workflows.

- Improve the quality and production readiness of AI applications through systematic work on evaluation, online experimentation, canary release, monitoring, fallback mechanisms, and performance optimization.

- Stay current with frontier AI technologies and apply them pragmatically in high-value security scenarios, working closely with domain experts to turn emerging capabilities into measurable business impact.

Qualifications

Minimum Qualifications - Bachelor's degree or above in Computer Science or a related field. - Proficiency in at least one programming language such as Go, Java, Python, C, C++, C#, or JavaScript, with strong backend engineering skills. - Strong computer science fundamentals, including data structures, algorithms, operating systems, networking, and databases. - Solid system design and engineering experience, with hands-on understanding of distributed systems, service architecture, caching, messaging, and high-availability backend services. - Strong problem-solving and execution skills, with the ability to collaborate effectively across engineering, product, and domain teams.

Preferred Qualifications - Experience in AI Agent systems, LLM applications, RAG, tool use, workflow orchestration, or AI application infrastructure. - Experience productionizing AI/ML applications, including areas such as evaluation, prompt/system optimization, online quality improvement, and reliability engineering. - Interest in applying advanced AI technologies to high-impact security and enterprise scenarios.

Job Information

For Pay TransparencyCompensation Description (Annually) The base salary range for this position in the selected city is $212800 - $450000 annually. Compensation may vary outside of this range depending on a number of factors, including a candidate's qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units. Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure). The Company reserves the right to modify or change these benefits programs at any time, with or without notice. For Los Angeles County (unincorporated) Candidates: Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment: 1. Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues; 2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems; and 3. Exercising sound judgment.

About Us

Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

Why Join ByteDance

Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day. As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Diversity & Inclusion

ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

Reasonable Accommodation

ByteDance is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at

Vacancy posted 18 hours ago
Similar jobs that could be interesting for youBased on the Software engineer - AI Agent Infra in San Jose, CA vacancy
  • $262k - $365k

    Senior Staff Software Engineer, Infrastructure, Agents Infra Advanced Experience owning outcomes and decision making, solving ambiguous problems and influencing...  ...as we continue to push technology forward. Applied AI builds conversational agents deployed at a large scale... 
    Suggested
    Full time

    Google Inc.

    Sunnyvale, CA
    18 hours ago
  • $212.8k - $387.6k

     .... 3 years experience as a senior development engineer. 3. 3 years experience of building large-scale...  ...understanding of cloud infrastructure or AI infrastructure. 6. Familiar with at least one of the areas below: GPU Infra (GPU cluster management, job scheduling, collective... 
    Suggested
    Temporary work
    Local area

    ByteDance

    San Jose, CA
    2 days ago
  • $166k - $244k

    Senior Software Engineer, Infra, Vertex Gemini API+ Serving - Sunnyvale, CA, USA. About the job Google's software engineers develop the next‑generation...  ...DeepMind to productize models and technology on the Vertex AI platform, bridging the gap between research and real‑world... 
    Suggested
    Full time

    Carlsbad Tech

    Sunnyvale, CA
    2 days ago
  • $272k - $431.25k

     ...We are seeking a Principal AI and ML Infra Software Engineer, GPU Clusters at NVIDIA to join our Hardware Infrastructure team. As an Engineer, you will have a pivotal role in enhancing efficiency for our researchers by implementing progressions throughout the entire stack... 
    Suggested

    NVIDIA Gruppe

    Santa Clara, CA
    3 days ago
  • $174k - $252k

    Senior Software Engineer, ML Infrastructure, Core Infra corporate_fare Google place Sunnyvale, CA, USA Apply Qualifications...  ...product teams including agent assist, dialogflow, and insights to...  ...market, and scaling. The Cloud Applied AI (AAI) powers business growth with Gemini... 
    Suggested
    Full time
    Temporary work

    Google Inc.

    Sunnyvale, CA
    18 hours ago
  • $170.9k - $231.2k

     ...Senior Software Engineer, AI Agents Arm San Jose, CA, US Job Type: Full-Time Function: Engineering Software Industry: Frontier Tech Company Address: 110 Fulbourn Road, Cambridge, Cambs CB1 9NJ, GB About Arm Arm's foundational technology is defining... 
    Full time
    Work at office
    Local area

    Softbank Investment Advisers

    San Jose, CA
    3 days ago
  • $156k - $387.6k

     ...Software Engineer - LLM Applications and AI Agents Location: San Jose Employment Type: Regular Job Code: A00574A Responsibilities Join us in pushing the boundaries of AI technology and creating the next generation of intelligent systems that will transform data platforms... 
    Temporary work
    Local area

    Ellis Technologies, Inc.

    San Jose, CA
    13 hours ago
  • $212.8k - $387.6k

     ...Senior Software Engineer, AI & Agent - TikTok Ecosystem & Platform Location: San Jose Employment Type: Regular Job Code: A126397A About the Team The TikTok PGC-Ecosystem & Platform team is a global team responsible for ensuring the health and sustainable growth of the... 
    Temporary work
    Local area
    Worldwide

    Ellis Technologies, Inc.

    San Jose, CA
    13 hours ago
  • $170k - $275k

     ...Software Engineer, Agent Harnessing Sunnyvale, California The future of defense will be decided by those who field intelligent machines at scale. At Scout AI, we're developing Fury, the first robotic foundation model for defense, to give U.S. forces overwhelming,... 
    Full time
    Relocation package

    Scout AI

    Sunnyvale, CA
    2 days ago
  • $170k - $192k

     ...Ayar Labs in San Jose, CA is seeking a Sr. Engineer for Research Software & Modeling Infrastructure. The role involves designing and maintaining data schemas, building data pipelines, and integrating AI tools into workflows. Candidates should have a Bachelor's degree in... 

    Ayar Labs

    San Jose, CA
    4 days ago
  • $156k - $316.8k

     ...Software Engineer - AI Agent Memory Infrastructure Location: San Jose Team: Technology Employment Type: Regular Job Code: A238905B Responsibilities Join ByteDance's AI Agent Memory Infrastructure team, where we build the core memory systems that power... 
    Temporary work
    Local area

    ByteDance

    San Jose, CA
    3 days ago
  • A technology company in Cupertino is seeking a Software Engineer for Infrastructure Performance. This role involves designing and writing software for new model-specific ASICs, ensuring CI tests run efficiently, and assisting with server provisioning. Candidates should... 
    Relocation package

    OpenReq

    Cupertino, CA
    1 day ago
  • $75k - $300k

     ...A cutting-edge AI company located in San Jose, California is looking for an experienced DevOps Engineer to join their infra team. The role involves overseeing Kubernetes environments and...  ...tools for autonomous driving software. Candidates should have proficiency in... 

    Tensor

    San Jose, CA
    4 days ago
  • $218.8k - $335.3k

     ...About the team: The AV ML Infra team at GM builds end-to-end ML...  ...to meet the unique demands of AI and ML innovation, supporting...  ...enhance the productivity of ML engineers, and drive the adoption of cutting...  ...design and build end-to-end software products , owning everything... 
    Local area
    Work from home
    Flexible hours

    General Motors

    Sunnyvale, CA
    1 day ago
  • $174k - $252k

    Senior Software Engineer, Infrastructure, Infra Spanner corporate_fare Google place Sunnyvale, CA, USA Bachelor’s degree or equivalent practical experience. 5 years of experience with software development in C++. 5 years of experience in performance analysis, debugging... 
    Full time

    Google Inc.

    Sunnyvale, CA
    4 days ago
  • $170.5k - $315.49k

     ..., our journey is to transform AI into something safer, more trustworthy...  ...The model is only half an agent; the harness is the other half...  ...itself. This is core product engineering on an agent framework...  ...or related STEM field 5+ years software development background Strong... 
    Full time
    Internship
    Local area
    Immediate start
    Shift work

    Intel Corporation

    Santa Clara, CA
    9 hours ago
  •  ...About the team The AV ML Infra team builds end‑to‑end ML platforms and developer...  ...‑facing products to support AI and ML innovation across teams such...  ...As a Staff AI/ML Full‑Stack Engineer, you will design and build end‑to‑end software products, owning user‑facing interfaces... 

    Israelvcforum

    Sunnyvale, CA
    3 days ago
  •  ...vehicle intelligence initiatives through next-generation AI Research. Responsibilities include building tools and...  ...for large-scale research and collaborating with AI engineering teams to enhance self-driving software. The ideal applicant has strong software skills and analytical... 

    Decisive Point

    Sunnyvale, CA
    3 days ago
  • $207k - $307k

    A leading tech company in Sunnyvale, CA is seeking a Software Engineer to lead the design and architecture of customer-facing systems. Applicants...  ...in software development, focusing on distributed systems and AI/ML applications. You will drive project outcomes, implement... 
    Full time

    Google Inc.

    Sunnyvale, CA
    2 days ago
  • $174k - $255k

    Senior Software Engineer, Networking Switch Infra corporate_fare Google place Sunnyvale, CA, USA Apply Bachelor’s degree or equivalent practical experience. 5 years of experience with software development in one or more programming languages. 5 years of experience... 
    Full time

    Google Inc.

    Sunnyvale, CA
    2 days ago
  • $147.4k - $272.1k

    Software Engineer - AI Agents & Automation, Maps Data Tooling Cupertino, California, United States Software and Services Apple Maps is built on a continuously maintained data asset of extraordinary scale. As part of the Maps Data organization, we build the internal tools... 
    Relocation

    Apple Inc.

    Cupertino, CA
    1 day ago
  • A leading technology company in California is looking for a Senior Software Engineer to develop cutting-edge AI and ML solutions. Responsibilities include writing and testing code, collaborating through design and code reviews, and contributing to documentation. Candidates... 
    Full time

    Google Inc.

    Sunnyvale, CA
    3 days ago
  • $275.8k - $340.5k

     ...vehicles, join us. About the team: The AV ML Infra team at GM builds ML infrastructure designed to meet the unique demands of AI and ML innovation, supporting a wide range...  ..., enhance the productivity of ML engineers, and drive the adoption of cutting-edge ML techniques... 
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    8 days ago
  • $156k - $387.6k

     ...Software Engineer/Researcher, AI-Native Database Systems Location: San Jose Team: Infrastructure...  ...platforms, and real-time memory for AI agents. As a Senior Software Engineer or Researcher...  ...search, and ANN indexing / AI infra or model-serving infrastructure (especially... 
    Temporary work
    Local area

    ByteDance

    San Jose, CA
    3 days ago
  •  ...NVIDIA Gruppe is seeking a Principal AI and ML Infra Software Engineer to join our Hardware Infrastructure team in Santa Clara, CA. In this role, you'll work closely with AI research teams to enhance efficiency by addressing infrastructure deficiencies for GPU Clusters... 

    NVIDIA Gruppe

    Santa Clara, CA
    4 days ago
  • $272k - $431.25k

    NVIDIA Corporation seeks a Principal AI and ML Infra Software Engineer in Santa Clara, California, to enhance the efficiency of AI/ML research on GPU Clusters. The role involves collaboration with various teams, monitoring infrastructure performance, and implementing improvements... 

    NVIDIA Corporation

    Santa Clara, CA
    2 days ago
  • $147k - $237.5k

     ...Integrity, and Inclusion. We weave AI into the fabric of everything...  .... Job Summary The ADEM engineering team is the engine of...  ...Principal Engineer focused on the Agent, you will be at the center of...  ...group is seeking a Principal Software Engineer to serve as a primary... 
    Permanent employment
    Full time
    Work at office
    Local area

    Palo Alto Networks

    Santa Clara, CA
    6 days ago
  •  ...A cybersecurity technology firm in California seeks an Applied AI Engineer to architect and enhance AI-driven systems. Responsibilities include end-to-end feature ownership, collaborating with AI/ML teams, and integrating advanced AI solutions into operational workflows... 
    Remote work

    Fortinet

    Sunnyvale, CA
    3 days ago
  • $140k - $215k

     ...security with the world's most advanced AI-native platform. We work on large scale...  ...a Senior-to-Principal (Level 7) backend software Engineer to build out platform products which provide...  ...or similar open source serverless infra-building framework(s) Contributed to the... 
    Full time
    Work experience placement
    Work at office
    Local area

    Koitecc Solutions

    Sunnyvale, CA
    3 days ago
  • $153k - $222k

     ...the global adoption of safe, AI‑driven machines. Founded in 20...  ...at Applied, we encourage all engineers to take ownership over technical...  ...next generation self‑driving software Help scale end‑to‑end training...  ...managed services at scale) ML infra fluency - has used and/or contributed... 
    Full time
    For contractors
    For subcontractor
    Casual work
    Work at office
    Remote work
    Day shift

    Decisive Point

    Sunnyvale, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software engineer - AI Agent Infra. Be the first to apply!