Software engineer - AI Agent Infra
$212.8kByteDance
Software Engineer - AI Agent Infra
Location: San Jose
Team: Technology
Employment Type: Regular
Job Code: A154953A
Responsibilities
Team Introduction We are building the dedicated AI Agent infrastructure and product platform for the Security organization, enabling different business teams to rapidly build, deploy, and scale AI Agents for real-world security use cases. Our mission is to turn the latest advances in LLMs, AI Agents, and applied AI systems into production-ready capabilities that power security workflows end to end — from intelligent assistance and automated analysis to workflow execution and decision support. We focus on building a platform that is not only powerful, but also secure, controllable, auditable, and scalable. You will work at the intersection of AI application engineering, agent infrastructure, and security productization, partnering closely with security experts and product teams to bring high-impact AI capabilities into complex business scenarios.
Responsibilities - Build the foundational AI Agent infrastructure for the Security organization, including agent runtime/frameworks, tool and plugin ecosystems, workflow orchestration, memory and knowledge/RAG systems, evaluation pipelines, observability, and cost governance.
- Design and develop the platform capabilities that enable multiple business teams to build and operate AI Agents efficiently, with strong guarantees around access control, auditing, isolation, governance, and reliability.
- Drive the implementation and iteration of AI Agent products and solutions for security scenarios, such as security operations assistance, investigation and triage, risk analysis, policy understanding and generation, automated Q&A, and intelligent workflow automation.
- Build robust backend services and APIs that support the full lifecycle of AI Agent applications, including integration with internal tools, data systems, and business workflows.
- Improve the quality and production readiness of AI applications through systematic work on evaluation, online experimentation, canary release, monitoring, fallback mechanisms, and performance optimization.
- Stay current with frontier AI technologies and apply them pragmatically in high-value security scenarios, working closely with domain experts to turn emerging capabilities into measurable business impact.
Qualifications
Minimum Qualifications - Bachelor's degree or above in Computer Science or a related field. - Proficiency in at least one programming language such as Go, Java, Python, C, C++, C#, or JavaScript, with strong backend engineering skills. - Strong computer science fundamentals, including data structures, algorithms, operating systems, networking, and databases. - Solid system design and engineering experience, with hands-on understanding of distributed systems, service architecture, caching, messaging, and high-availability backend services. - Strong problem-solving and execution skills, with the ability to collaborate effectively across engineering, product, and domain teams.
Preferred Qualifications - Experience in AI Agent systems, LLM applications, RAG, tool use, workflow orchestration, or AI application infrastructure. - Experience productionizing AI/ML applications, including areas such as evaluation, prompt/system optimization, online quality improvement, and reliability engineering. - Interest in applying advanced AI technologies to high-impact security and enterprise scenarios.
Job Information
For Pay TransparencyCompensation Description (Annually) The base salary range for this position in the selected city is $212800 - $450000 annually. Compensation may vary outside of this range depending on a number of factors, including a candidate's qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units. Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure). The Company reserves the right to modify or change these benefits programs at any time, with or without notice. For Los Angeles County (unincorporated) Candidates: Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment: 1. Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues; 2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems; and 3. Exercising sound judgment.
About Us
Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.
Why Join ByteDance
Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day. As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.
Diversity & Inclusion
ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.
Reasonable Accommodation
ByteDance is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at
$262k - $365k
Senior Staff Software Engineer, Infrastructure, Agents Infra Advanced Experience owning outcomes and decision making, solving ambiguous problems and influencing... ...as we continue to push technology forward. Applied AI builds conversational agents deployed at a large scale...SuggestedFull time$212.8k - $387.6k
.... 3 years experience as a senior development engineer. 3. 3 years experience of building large-scale... ...understanding of cloud infrastructure or AI infrastructure. 6. Familiar with at least one of the areas below: GPU Infra (GPU cluster management, job scheduling, collective...SuggestedTemporary workLocal area$272k - $431.25k
...Principal Ai And Ml Infra Software Engineer, Gpu Clusters We are seeking a Principal AI and ML Infra Software Engineer, GPU Clusters at NVIDIA to join our Hardware Infrastructure team. As an Engineer, you will have a pivotal role in enhancing efficiency for our researchers...Suggested$174k - $252k
Senior Software Engineer, ML Infrastructure, Core Infra corporate_fare Google place Sunnyvale, CA, USA Apply Qualifications... ...product teams including agent assist, dialogflow, and insights to... ...market, and scaling. The Cloud Applied AI (AAI) powers business growth with Gemini...SuggestedFull timeTemporary work$156k - $316.8k
...Responsibilities We are building the next generation of AI-native creation tools powered by intelligent AI agents. Our mission is to transform how people create by... ...at the intersection of AI research, systems engineering, and creative product development, translating...SuggestedTemporary workLocal area$156k - $387.6k
...Join us in pushing the boundaries of AI technology and creating the next generation... ...seeking a highly skilled and innovative Software Engineer to join our cutting-edge Agentic Engine... ...Retrieval-Augmented Generation (RAG), and AI agents - Develop expertise in data development...Temporary workLocal area$156k - $387.6k
...-generation backend systems powered by AI and Agents, collaborating with product managers, data... ...creators worldwide. As a core backend engineer, you will go beyond routine coding to... ...analyze and solve problems; - Good grasp of software engineering and how to build a system...Temporary workLocal areaWorldwide$181.1k - $318.4k
...Software Engineer (GenAi - AI Agents), AI & Data Platforms (AiDP) We are looking for a passionate and experienced Software Engineer to help build the foundation of Apple's next-generation Generative AI platform. This role blends deep systems thinking, scalable backend...Relocation$224k - $356.5k
...into the unlimited potential of AI to define the next era of... ...develop the future of AI-powered software development! Our team works... ...to harness always-on agents in secure, efficient environments... ...the quality and velocity of AI engineering practices. If you thrive on solving...$126k - $250k
Applied Intuition, Inc. in Sunnyvale, California is looking for a Software Engineer to join a high-impact team focused on AI capabilities and frameworks. You will design and ship AI infrastructure, partner with product teams, and serve as a GenAI expert. Candidates should...Remote jobCasual work$170k - $192k
Ayar Labs in San Jose, CA is seeking a Sr. Engineer for Research Software & Modeling Infrastructure. The role involves designing and maintaining data schemas, building data pipelines, and integrating AI tools into workflows. Candidates should have a Bachelor's degree in...$156k - $316.8k
...Responsibilitie About the Team Join ByteDance's AI Agent Memory Infrastructure team, where we build the core memory systems that... ...Working at the intersection of LLMs, data systems, and context engineering, we tackle challenges in memory representation, retrieval, and...Temporary workLocal area$170.9k - $231.2k
...Overview: We are looking for a motivated engineer to join Arm’s Developer and Platform... ...SDKs and MCP registries. Our team works on software development methodologies, educational content... ...this context, you will help shape how AI agents interact with Arm platforms by improving...- ...cutting-edge technology company in San Jose is looking for a software engineer to lead infrastructure tooling for next-generation ASICs. The... ...competitive benefits and the chance to contribute significantly to the evolving landscape of AI technology. #J-18808-Ljbffr Etched
- A technology company in Cupertino is seeking a Software Engineer for Infrastructure Performance. This role involves designing and writing software for new model-specific ASICs, ensuring CI tests run efficiently, and assisting with server provisioning. Candidates should...Relocation package
$170.6k - $261.3k
...About the team: The AV ML Infra team at GM builds end-to-end ML... ...to meet the unique demands of AI and ML innovation, supporting... ...enhance the productivity of ML engineers, and drive the adoption of cutting... ...design and build end-to-end software products , owning everything...Local areaWork from homeFlexible hours$218.8k - $335.3k
...About the team: The AV ML Infra team at GM builds end-to-end ML... ...to meet the unique demands of AI and ML innovation, supporting... ...enhance the productivity of ML engineers, and drive the adoption of cutting... ...design and build end-to-end software products , owning everything...Local areaWork from homeFlexible hours$75k - $300k
A cutting-edge AI company located in San Jose, California is looking for an experienced DevOps Engineer to join their infra team. The role involves overseeing Kubernetes environments and... ...tools for autonomous driving software. Candidates should have proficiency in...- ...how the map gets maintained. We're looking for a software engineer to lead the development of intelligent agent systems within this macOS-based platform. Think... ...Demonstrated experience building agentic systems, AI-driven automation, or autonomous workflows (tool-use...
$156k - $387.6k
...Cloud Acceleration Engineer – DPU & AI Infra Location: San Jose Team: Infrastructure Employment Type: Regular Job Code: A56612... ...architecture, development, and research of next-generation software-hardware technologies across compute, networking, and storage...Temporary workLocal area$207k - $307k
A leading tech company in Sunnyvale, CA is seeking a Software Engineer to lead the design and architecture of customer-facing systems. Applicants... ...in software development, focusing on distributed systems and AI/ML applications. You will drive project outcomes, implement...Full time$174k - $255k
Senior Software Engineer, Networking Switch Infra corporate_fare Google place Sunnyvale, CA, USA Apply Bachelor’s degree or equivalent practical experience. 5 years of experience with software development in one or more programming languages. 5 years of experience...Full time$170k - $240k
...safely and reliably. We employ modern AI techniques to organize vast amounts... ...(CTO): Previously led the Stripe engineering team that launched Banking-as-a-Service... ...looking for our Founding Platform / Infra Engineer – a strong software engineer first. You can design,...Contract workWork at officeRemote work$156k - $387.6k
...Software Engineer/Researcher, AI-Native Database Systems Location: San Jose Team: Infrastructure... ...platforms, and real-time memory for AI agents. As a Senior Software Engineer or Researcher... ...search, and ANN indexing / AI infra or model-serving infrastructure (especially...Temporary workLocal area$275.8k - $340.5k
...vehicles, join us. About the team: The AV ML Infra team at GM builds ML infrastructure designed to meet the unique demands of AI and ML innovation, supporting a wide range... ..., enhance the productivity of ML engineers, and drive the adoption of cutting-edge ML techniques...Local areaRemote workWork from homeRelocationRelocation packageFlexible hours- ...vehicle intelligence initiatives through next-generation AI Research. Responsibilities include building tools and... ...for large-scale research and collaborating with AI engineering teams to enhance self-driving software. The ideal applicant has strong software skills and analytical...
- A leading technology company in California is looking for a Senior Software Engineer to develop cutting-edge AI and ML solutions. Responsibilities include writing and testing code, collaborating through design and code reviews, and contributing to documentation. Candidates...Full time
$153k - $222k
...Software Engineer - E2E Autonomy Sunnyvale, California, United States About Applied Intuition... ...Inc. is powering the future of physical AI. Founded in 2017 and now valued at $15... ...cloud-managed services at scale) ML infra fluency - has used and/or contributed to...Full timeFor contractorsFor subcontractorCasual workWork at officeRemote workDay shift- **Staff AI/ML Engineer, AV ML Infra**As a **Staff AI/ML Engineer**, you will be a technical expert within the AV ML Infra team, driving the design and implementation of scalable ML infrastructure solutions. You will influence the direction of our technical projects, provide...
$272k - $431.25k
NVIDIA Corporation seeks a Principal AI and ML Infra Software Engineer in Santa Clara, California, to enhance the efficiency of AI/ML research on GPU Clusters. The role involves collaboration with various teams, monitoring infrastructure performance, and implementing improvements...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software engineer - AI Agent Infra. Be the first to apply!
- graduate software developer San Jose, CA
- rust software engineer San Jose, CA
- senior software design engineer San Jose, CA
- software engineer student San Jose, CA
- software engineer amazon San Jose, CA
- software developer positions San Jose, CA
- software engineer full time San Jose, CA
- software qa engineer San Jose, CA
- new graduate software engineer San Jose, CA
- junior software developer San Jose, CA

