AI Systems Architect
Software Technology Inc
AI Systems Architect
Location: SFO, CA & San Leandro, CA (Hybrid)
Duration: Contract for 12 + Months
Job Description
We are seeking an experienced AI Systems Architect to design, build, and scale high-performance distributed AI systems. The ideal candidate will have deep expertise in GenAI, LLMs, and cloud-native architectures, along with hands-on experience in building enterprise-scale AI/ML platforms and agent-based systems.
Must-Have Skills
- Strong experience in designing and implementing high-performance, large-scale distributed systems
- Proven experience in implementing and deploying AI/ML platforms at scale
- Expertise in building agent-based architectures, evaluation frameworks, and prompt/context engineering
- Knowledge of MCP (Model Context Protocol) servers
- Hands-on experience in LLM inference optimization, including batching and caching strategies
- Strong experience with Kubernetes and cloud infrastructure (AWS/Azure/GCP)
- Proficiency in at least one programming language (Python, Java, Go, etc.)
- Expertise in designing agent data stacks & retrieval systems, including:
- Vector databases
- Hybrid search
- Data freshness strategies
- Memory systems
- Graph reasoning
- BM25 and advanced retrieval techniques
Key Responsibilities
- Architect and deliver scalable, high-performance distributed systems
- Design and deploy AI/ML and GenAI platforms at enterprise scale
- Build and manage agent-based architectures, including:
- Prompt and context engineering
- MCP servers
- Evaluation frameworks
- Optimize LLM inference pipelines for latency, throughput, and efficiency
- Design and implement agent data & retrieval systems (vector DBs, hybrid search, memory, graph-based reasoning)
- Lead Kubernetes-based, cloud-native deployments
- Provide technical leadership, architecture governance, and hands-on mentoring to engineering teams
Nice to Have
- Experience with RAG (Retrieval-Augmented Generation) frameworks
- Familiarity with multi-agent systems and orchestration frameworks
- Exposure to real-time data pipelines and streaming architectures
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Systems Architect in San Francisco, CA vacancy
- ...the expectation that it will only accelerate - our ability to architect scalable systems for support readiness, userfeedback, and broader program... ...systems will be required. About OpenAI OpenAI is an AI research and deployment company dedicated to ensuring that general...SuggestedWork at officeRelocation packageShift work
OpenAI
San Francisco, CA2 days ago - ...Systems Engineer (Contract) Overview EVONA Space is seeking an experienced Systems Engineer to lead technical delivery across... ...intersection of spacecraft systems engineering and next-generation AI-enabled mission integration. Key Responsibilities Own...SuggestedContract work
EVONA
San Francisco, CA3 days ago $120.28k - $163.23k
...IT Systems Architect Employment Type: Full Time, Mid level Department: Information Technology As an IT Lead System Architect for CGS... ...1 - $163,230.78 a year We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing...SuggestedFull timeFlexible hoursContact Government Services, LLC
San Francisco, CA2 days ago- ...Systems Architect 4 – AI / Distributed Systems Locations: Dallas Charlotte San Francisco Bay Area (Onsite) Must-Have Skills Experience in designing and implementing high-performance, large-scale distributed systems Experience implementing...Suggested
Argyle Infotech
San Francisco, CA4 days ago $100k - $180k
...traditional testing approaches miss. Antithesis runs your entire system in a deterministic simulation, breaks it in every way imaginable,... ...teams to debug faster and ship with greater confidence. The rise of AI-generated code has made what we do more important than ever....Suggested- A revolutionary AI infrastructure company in San Francisco seeks Forward Deployed Engineers to transform AI capabilities. The role emphasizes technical authority, prototype building, and simplifying complex integrations. Ideal candidates must have deep integration experience...
- Suger.io in San Francisco seeks a dynamic individual to enhance revenue operations by leveraging AI and developing systems for sales, customer success, and finance. Your role will involve collaborating with the CEO on high-priority initiatives that aim to transform the...
- A leading AI research company in San Francisco is looking for an experienced User Operations professional to design and automate systems that enhance customer support. The role requires expertise in project management, data science, and automation, with a strong focus...
- A leading AI infrastructure company in San Francisco is seeking a Senior Enterprise Technology Administrator to optimize their financial... ...managing Procure-to-Pay and Order-to-Cash workflows, ensuring system reliability, and enhancing financial integrations. Candidates should...
$246.5k - $290k
...Staff Level Device System Architect Tools for Humanity (TFH) designs and builds technology behind World. World is building a real human network designed to accelerate people in the age of AI. As bots and autonomous agents reshape the internet, people, institutions,...Contract workFlexible hoursShift workTools for Humanity
San Francisco, CA3 days ago$289.1k - $408.5k
Dolby is seeking a leader for their Advanced Technology Group to define strategic research vision and advance initiatives in scalable AI/ML. The role requires a PhD and 15+ years of experience in high-impact research and technical leadership. The position offers a...- ...Francisco is seeking an experienced software engineer to own core AI infrastructure and design agent architectures. The role requires... ...architectural skills, along with a track record of owning systems end-to-end. The ideal candidate should have 3-6 years of experience...Work at office
- Noon is hiring a Frontend Systems Architect to anchor our frontend team in San Francisco. This role involves driving architectural excellence,... ...optimization, and mentoring engineers amid a rapidly evolving AI landscape. The ideal candidate has 6-10 years of experience, with...
- Sierracorp in San Francisco is seeking a Machine Learning Architect to define the ML strategy and build scalable systems. The role involves architecting end-to-end ML... ...is highly valued. Join a forward-thinking team shaping the future of AI. #J-18808-Ljbffr Sierracorp
$250k - $300k
NOON is looking for a Frontend Systems Architect to enhance their cutting-edge AI design tool. This high-leverage, hands-on role requires 6-10 years of web application experience, mastery of React and TypeScript, plus expertise in state management and optimization techniques...- ...transformational leader to build and lead Global Growth Systems - a new organization focused on reimagining customer growth through AI and automation. This role requires redefining... ...changing landscape. The ideal candidate will architect modern engagement systems and ensure...
$850 - $1,000 per unit
...experience in government or a federal agency to build task scenarios for AI research. This role involves collaboration with experts,... ...challenges, and contributes to the development of next-gen AI systems. Competitive task completion pay of $850–$1000 per task, with potential...Hourly payRemote workMercor Inc
San Francisco, CA1 day ago$130k - $170k
...Warehouse Engineer San Francisco About the Role Together AI is building high-performance inference compute and the software... ...intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society,...Full timeInternshipTogether AI
San Francisco, CA3 days ago- ...We are seeking a Strategic Data Solutions Architect to help enterprise organizations modernize their data ecosystems and build AI-ready solutions within the Salesforce platform... ...(CTA) Salesforce Application or System Architect Certifications CDMP or other Data...Work at office2 days per week1 day per week
Stott and May
San Francisco, CA3 days ago - About Brain Co. Brain Co. is an applied AI startup co-founded by Elad Gil, and backed by leading Silicon Valley builders including... ...delivering impact on real-world problems across governments, healthcare systems, and critical industries. Our progress so far: Automated...
$240k - $275k
Overview Together AI is building high-performance inference compute and the software... ...governance across the org. Responsibilities Architect and operate a medallion/curated data... ...company. We believe open and transparent AI systems will drive innovation and create the best...Full time$161.3k - $225.8k
A leading data and AI company is seeking a pre-sales professional to help enterprises adopt data-driven strategies. You will be the technical voice for Databricks, guiding clients on their transformational journey while leveraging your strong background in big data and...Remote job- ...Together AI is seeking a Staff Data Warehouse Engineer to design and operate a medallion data warehouse stack (bronze, silver, gold) supporting product, usage, billing, and operational data. This role involves building Airflow‑orchestrated pipelines, maintaining dbt transformation...
aijoblist
San Francisco, CA1 day ago - ...for a groundbreaking product. Ideal candidates will have a proven track record in product design, with a deep understanding of complex systems. This role offers a unique opportunity to shape the future of a rapidly growing visual AI platform. #J-18808-Ljbffr comfy-org
$75k - $135k
...Consulting Associate in Metis Strategy’s Data & AI Practice plays a key role in supporting... ...and platforms under guidance from senior architects. Contribute to the design of data flows,... ...patterns, and pipelines across systems and cloud environments. Collaborate with...Work experience placement$180.66k - $248.36k
A leading data and AI company is seeking a Big Data Solutions Architect to work in San Francisco. The successful candidate will manage customer engagements, provide technical solutions, and work on impactful projects using the Databricks platform. Key qualifications include...- A leading tech firm is seeking a Big Data Solutions Architect to engage with clients and tackle big data challenges using the Databricks platform. The ideal candidate should possess over 6 years of experience in data engineering and analytics, be proficient in Python or...
- SAP is looking for a skilled professional to engage fully with account teams and partners, becoming a trusted advisor in our data and AI solutions. The ideal candidate will have over 7 years of relevant experience, especially in crafting tailored solutions to meet...
- A leading data and AI company based in San Francisco is seeking a Big Data Solutions Architect. In this role, you will engage with clients on their big data challenges using the platform. Responsibilities include consulting on architecture, guiding project delivery, and...
- ...and processes. • Explore and prototype the use of generative AI and large language models (LLMs) to drive product innovation.... ...designs adhering to architectural best practices. • Consider system performance, scalability, and reliability when defining technical...
E-Solutions
San Francisco, CA5 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Systems Architect. Be the first to apply!
Related searches
- technical architect San Francisco, CA
- salesforce technical architect San Francisco, CA
- system architect San Francisco, CA
- pega system architect San Francisco, CA
- technical architect
- salesforce technical architect
- system architect
- junior system architect
- information systems architect
- servicenow technical architect