Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software engineer - AI Agent Infra

$212.8k

ByteDance

Software Engineer - AI Agent Infra

Location: San Jose

Team: Technology

Employment Type: Regular

Job Code: A154953A

Responsibilities

Team Introduction We are building the dedicated AI Agent infrastructure and product platform for the Security organization, enabling different business teams to rapidly build, deploy, and scale AI Agents for real-world security use cases. Our mission is to turn the latest advances in LLMs, AI Agents, and applied AI systems into production-ready capabilities that power security workflows end to end — from intelligent assistance and automated analysis to workflow execution and decision support. We focus on building a platform that is not only powerful, but also secure, controllable, auditable, and scalable. You will work at the intersection of AI application engineering, agent infrastructure, and security productization, partnering closely with security experts and product teams to bring high-impact AI capabilities into complex business scenarios.

Responsibilities - Build the foundational AI Agent infrastructure for the Security organization, including agent runtime/frameworks, tool and plugin ecosystems, workflow orchestration, memory and knowledge/RAG systems, evaluation pipelines, observability, and cost governance.

- Design and develop the platform capabilities that enable multiple business teams to build and operate AI Agents efficiently, with strong guarantees around access control, auditing, isolation, governance, and reliability.

- Drive the implementation and iteration of AI Agent products and solutions for security scenarios, such as security operations assistance, investigation and triage, risk analysis, policy understanding and generation, automated Q&A, and intelligent workflow automation.

- Build robust backend services and APIs that support the full lifecycle of AI Agent applications, including integration with internal tools, data systems, and business workflows.

- Improve the quality and production readiness of AI applications through systematic work on evaluation, online experimentation, canary release, monitoring, fallback mechanisms, and performance optimization.

- Stay current with frontier AI technologies and apply them pragmatically in high-value security scenarios, working closely with domain experts to turn emerging capabilities into measurable business impact.

Qualifications

Minimum Qualifications - Bachelor's degree or above in Computer Science or a related field. - Proficiency in at least one programming language such as Go, Java, Python, C, C++, C#, or JavaScript, with strong backend engineering skills. - Strong computer science fundamentals, including data structures, algorithms, operating systems, networking, and databases. - Solid system design and engineering experience, with hands-on understanding of distributed systems, service architecture, caching, messaging, and high-availability backend services. - Strong problem-solving and execution skills, with the ability to collaborate effectively across engineering, product, and domain teams.

Preferred Qualifications - Experience in AI Agent systems, LLM applications, RAG, tool use, workflow orchestration, or AI application infrastructure. - Experience productionizing AI/ML applications, including areas such as evaluation, prompt/system optimization, online quality improvement, and reliability engineering. - Interest in applying advanced AI technologies to high-impact security and enterprise scenarios.

Job Information

For Pay TransparencyCompensation Description (Annually) The base salary range for this position in the selected city is $212800 - $450000 annually. Compensation may vary outside of this range depending on a number of factors, including a candidate's qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units. Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure). The Company reserves the right to modify or change these benefits programs at any time, with or without notice. For Los Angeles County (unincorporated) Candidates: Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment: 1. Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues; 2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems; and 3. Exercising sound judgment.

About Us

Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

Why Join ByteDance

Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day. As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Diversity & Inclusion

ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

Reasonable Accommodation

ByteDance is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Software engineer - AI Agent Infra in San Jose, CA vacancy
  • $262k - $365k

    Senior Staff Software Engineer, Infrastructure, Agents Infra Advanced Experience owning outcomes and decision making, solving ambiguous problems and influencing...  ...as we continue to push technology forward. Applied AI builds conversational agents deployed at a large scale... 
    Suggested
    Full time

    Google Inc.

    Sunnyvale, CA
    5 days ago
  • $212.8k - $387.6k

     .... 3 years experience as a senior development engineer. 3. 3 years experience of building large-scale...  ...understanding of cloud infrastructure or AI infrastructure. 6. Familiar with at least one of the areas below: GPU Infra (GPU cluster management, job scheduling, collective... 
    Suggested
    Temporary work
    Local area

    ByteDance

    San Jose, CA
    1 day ago
  • $272k - $431.25k

     ...Principal Ai And Ml Infra Software Engineer, Gpu Clusters We are seeking a Principal AI and ML Infra Software Engineer, GPU Clusters at NVIDIA to join our Hardware Infrastructure team. As an Engineer, you will have a pivotal role in enhancing efficiency for our researchers... 
    Suggested

    NVIDIA

    Santa Clara, CA
    4 days ago
  • $174k - $252k

    Senior Software Engineer, ML Infrastructure, Core Infra corporate_fare Google place Sunnyvale, CA, USA Apply Qualifications...  ...product teams including agent assist, dialogflow, and insights to...  ...market, and scaling. The Cloud Applied AI (AAI) powers business growth with Gemini... 
    Suggested
    Full time
    Temporary work

    Google Inc.

    Sunnyvale, CA
    5 days ago
  • $156k - $316.8k

     ...Responsibilities We are building the next generation of AI-native creation tools powered by intelligent AI agents. Our mission is to transform how people create by...  ...at the intersection of AI research, systems engineering, and creative product development, translating... 
    Suggested
    Temporary work
    Local area

    Tik Tok

    San Jose, CA
    1 day ago
  • $156k - $387.6k

     ...Join us in pushing the boundaries of AI technology and creating the next generation...  ...seeking a highly skilled and innovative Software Engineer to join our cutting-edge Agentic Engine...  ...Retrieval-Augmented Generation (RAG), and AI agents - Develop expertise in data development... 
    Temporary work
    Local area

    Tik Tok

    San Jose, CA
    5 days ago
  • $156k - $387.6k

     ...-generation backend systems powered by AI and Agents, collaborating with product managers, data...  ...creators worldwide. As a core backend engineer, you will go beyond routine coding to...  ...analyze and solve problems; - Good grasp of software engineering and how to build a system... 
    Temporary work
    Local area
    Worldwide

    Tik Tok

    San Jose, CA
    5 days ago
  • $181.1k - $318.4k

     ...Software Engineer (GenAi - AI Agents), AI & Data Platforms (AiDP) We are looking for a passionate and experienced Software Engineer to help build the foundation of Apple's next-generation Generative AI platform. This role blends deep systems thinking, scalable backend... 
    Relocation

    Apple

    Sunnyvale, CA
    12 hours ago
  • $224k - $356.5k

     ...into the unlimited potential of AI to define the next era of...  ...develop the future of AI-powered software development! Our team works...  ...to harness always-on agents in secure, efficient environments...  ...the quality and velocity of AI engineering practices. If you thrive on solving... 

    NVIDIA

    Santa Clara, CA
    5 days ago
  • $126k - $250k

    Applied Intuition, Inc. in Sunnyvale, California is looking for a Software Engineer to join a high-impact team focused on AI capabilities and frameworks. You will design and ship AI infrastructure, partner with product teams, and serve as a GenAI expert. Candidates should... 
    Remote job
    Casual work

    jobs.frontdoordefense.com - Jobboard

    Sunnyvale, CA
    5 days ago
  • $170k - $192k

    Ayar Labs in San Jose, CA is seeking a Sr. Engineer for Research Software & Modeling Infrastructure. The role involves designing and maintaining data schemas, building data pipelines, and integrating AI tools into workflows. Candidates should have a Bachelor's degree in... 

    Ayar Labs

    San Jose, CA
    4 days ago
  • $156k - $316.8k

     ...Responsibilitie About the Team Join ByteDance's AI Agent Memory Infrastructure team, where we build the core memory systems that...  ...Working at the intersection of LLMs, data systems, and context engineering, we tackle challenges in memory representation, retrieval, and... 
    Temporary work
    Local area

    ByteDance

    San Jose, CA
    3 days ago
  • $170.9k - $231.2k

     ...Overview: We are looking for a motivated engineer to join Arm’s Developer and Platform...  ...SDKs and MCP registries. Our team works on software development methodologies, educational content...  ...this context, you will help shape how AI agents interact with Arm platforms by improving... 

    Arm Limited

    San Jose, CA
    5 days ago
  •  ...cutting-edge technology company in San Jose is looking for a software engineer to lead infrastructure tooling for next-generation ASICs. The...  ...competitive benefits and the chance to contribute significantly to the evolving landscape of AI technology. #J-18808-Ljbffr Etched

    Etched

    San Jose, CA
    5 days ago
  • A technology company in Cupertino is seeking a Software Engineer for Infrastructure Performance. This role involves designing and writing software for new model-specific ASICs, ensuring CI tests run efficiently, and assisting with server provisioning. Candidates should... 
    Relocation package

    OpenReq

    Cupertino, CA
    1 day ago
  • $170.6k - $261.3k

     ...About the team: The AV ML Infra team at GM builds end-to-end ML...  ...to meet the unique demands of AI and ML innovation, supporting...  ...enhance the productivity of ML engineers, and drive the adoption of cutting...  ...design and build end-to-end software products , owning everything... 
    Local area
    Work from home
    Flexible hours

    General Motors

    Sunnyvale, CA
    1 day ago
  • $218.8k - $335.3k

     ...About the team: The AV ML Infra team at GM builds end-to-end ML...  ...to meet the unique demands of AI and ML innovation, supporting...  ...enhance the productivity of ML engineers, and drive the adoption of cutting...  ...design and build end-to-end software products , owning everything... 
    Local area
    Work from home
    Flexible hours

    General Motors

    Sunnyvale, CA
    1 day ago
  • $75k - $300k

    A cutting-edge AI company located in San Jose, California is looking for an experienced DevOps Engineer to join their infra team. The role involves overseeing Kubernetes environments and...  ...tools for autonomous driving software. Candidates should have proficiency in... 

    Tensor

    San Jose, CA
    5 days ago
  •  ...how the map gets maintained. We're looking for a software engineer to lead the development of intelligent agent systems within this macOS-based platform. Think...  ...Demonstrated experience building agentic systems, AI-driven automation, or autonomous workflows (tool-use... 

    Apple

    Cupertino, CA
    3 days ago
  • $156k - $387.6k

     ...Cloud Acceleration Engineer – DPU & AI Infra Location: San Jose Team: Infrastructure Employment Type: Regular Job Code: A56612...  ...architecture, development, and research of next-generation software-hardware technologies across compute, networking, and storage... 
    Temporary work
    Local area

    ByteDance

    San Jose, CA
    4 days ago
  • $207k - $307k

    A leading tech company in Sunnyvale, CA is seeking a Software Engineer to lead the design and architecture of customer-facing systems. Applicants...  ...in software development, focusing on distributed systems and AI/ML applications. You will drive project outcomes, implement... 
    Full time

    Google Inc.

    Sunnyvale, CA
    2 days ago
  • $174k - $255k

    Senior Software Engineer, Networking Switch Infra corporate_fare Google place Sunnyvale, CA, USA Apply Bachelor’s degree or equivalent practical experience. 5 years of experience with software development in one or more programming languages. 5 years of experience... 
    Full time

    Google Inc.

    Sunnyvale, CA
    2 days ago
  • $170k - $240k

     ...safely and reliably. We employ modern AI techniques to organize vast amounts...  ...(CTO): Previously led the Stripe engineering team that launched Banking-as-a-Service...  ...looking for our Founding Platform / Infra Engineer – a strong software engineer first. You can design,... 
    Contract work
    Work at office
    Remote work

    GrabJobs

    San Jose, CA
    2 days ago
  • $156k - $387.6k

     ...Software Engineer/Researcher, AI-Native Database Systems Location: San Jose Team: Infrastructure...  ...platforms, and real-time memory for AI agents. As a Senior Software Engineer or Researcher...  ...search, and ANN indexing / AI infra or model-serving infrastructure (especially... 
    Temporary work
    Local area

    ByteDance

    San Jose, CA
    3 days ago
  • $275.8k - $340.5k

     ...vehicles, join us. About the team: The AV ML Infra team at GM builds ML infrastructure designed to meet the unique demands of AI and ML innovation, supporting a wide range...  ..., enhance the productivity of ML engineers, and drive the adoption of cutting-edge ML techniques... 
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    2 days ago
  •  ...vehicle intelligence initiatives through next-generation AI Research. Responsibilities include building tools and...  ...for large-scale research and collaborating with AI engineering teams to enhance self-driving software. The ideal applicant has strong software skills and analytical... 

    Decisive Point

    Sunnyvale, CA
    5 days ago
  • A leading technology company in California is looking for a Senior Software Engineer to develop cutting-edge AI and ML solutions. Responsibilities include writing and testing code, collaborating through design and code reviews, and contributing to documentation. Candidates... 
    Full time

    Google Inc.

    Sunnyvale, CA
    3 days ago
  • $153k - $222k

     ...Software Engineer - E2E Autonomy Sunnyvale, California, United States About Applied Intuition...  ...Inc. is powering the future of physical AI. Founded in 2017 and now valued at $15...  ...cloud-managed services at scale) ML infra fluency - has used and/or contributed to... 
    Full time
    For contractors
    For subcontractor
    Casual work
    Work at office
    Remote work
    Day shift

    Applied Intuition

    Sunnyvale, CA
    1 day ago
  • **Staff AI/ML Engineer, AV ML Infra**As a **Staff AI/ML Engineer**, you will be a technical expert within the AV ML Infra team, driving the design and implementation of scalable ML infrastructure solutions. You will influence the direction of our technical projects, provide... 

    General Motors

    Sunnyvale, CA
    5 days ago
  • $272k - $431.25k

    NVIDIA Corporation seeks a Principal AI and ML Infra Software Engineer in Santa Clara, California, to enhance the efficiency of AI/ML research on GPU Clusters. The role involves collaboration with various teams, monitoring infrastructure performance, and implementing improvements... 

    NVIDIA Corporation

    Santa Clara, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software engineer - AI Agent Infra. Be the first to apply!