AI Systems Architect
Software Technology Inc
AI Systems Architect
Location: SFO, CA & San Leandro, CA (Hybrid)
Duration: Contract for 12 + Months
Job Description
We are seeking an experienced AI Systems Architect to design, build, and scale high-performance distributed AI systems. The ideal candidate will have deep expertise in GenAI, LLMs, and cloud-native architectures, along with hands-on experience in building enterprise-scale AI/ML platforms and agent-based systems.
Must-Have Skills
- Strong experience in designing and implementing high-performance, large-scale distributed systems
- Proven experience in implementing and deploying AI/ML platforms at scale
- Expertise in building agent-based architectures, evaluation frameworks, and prompt/context engineering
- Knowledge of MCP (Model Context Protocol) servers
- Hands-on experience in LLM inference optimization, including batching and caching strategies
- Strong experience with Kubernetes and cloud infrastructure (AWS/Azure/GCP)
- Proficiency in at least one programming language (Python, Java, Go, etc.)
- Expertise in designing agent data stacks & retrieval systems, including:
- Vector databases
- Hybrid search
- Data freshness strategies
- Memory systems
- Graph reasoning
- BM25 and advanced retrieval techniques
Key Responsibilities
- Architect and deliver scalable, high-performance distributed systems
- Design and deploy AI/ML and GenAI platforms at enterprise scale
- Build and manage agent-based architectures, including:
- Prompt and context engineering
- MCP servers
- Evaluation frameworks
- Optimize LLM inference pipelines for latency, throughput, and efficiency
- Design and implement agent data & retrieval systems (vector DBs, hybrid search, memory, graph-based reasoning)
- Lead Kubernetes-based, cloud-native deployments
- Provide technical leadership, architecture governance, and hands-on mentoring to engineering teams
Nice to Have
- Experience with RAG (Retrieval-Augmented Generation) frameworks
- Familiarity with multi-agent systems and orchestration frameworks
- Exposure to real-time data pipelines and streaming architectures
Vacancy posted 18 hours ago
Similar jobs that could be interesting for youBased on the AI Systems Architect in San Leandro, CA vacancy
- ...Systems Engineer (Contract) Overview EVONA Space is seeking an experienced Systems Engineer to lead technical delivery across... ...intersection of spacecraft systems engineering and next-generation AI-enabled mission integration. Key Responsibilities Own...SuggestedContract work
EVONA
Hayward, CA2 days ago - ...We are seeking a Strategic Data Solutions Architect to help enterprise organizations modernize their data ecosystems and build AI-ready solutions within the Salesforce platform... ...(CTA) Salesforce Application or System Architect Certifications CDMP or other Data...SuggestedWork at office2 days per week1 day per week
Stott and May
Hayward, CA2 days ago - ...more about our people and team. Job Specs The Solution Architect's primary responsibility will be to ensure customer success and... ...services to implement customer solutions. Leverage AI along with Skedulo and Customer Branding Assets to design and build...SuggestedWork experience placementWork from homeHome officeWork visa
Skedulo
San Lorenzo, CA2 days ago - ...across 10+ business lines, driving fraud reduction, operational efficiency, and customer insights. Leverage AutoML tools (e.g., Vertex AI AutoML, H2O Driverless AI) for low-code/no-code model development, documentation automation, and rapid deployment Develop and...Suggested
Omni Inclusive
San Leandro, CA1 day ago - ...Job Title : Data Solution Architect Location : Contract - Long Term Location : Dublin, CA Type : Hybrid - 3 days in... ...already, this person is higher level, part of the design, road mapping, etc. Future - chatbot queries, AI use cases for future...SuggestedContract workFor contractors
Perfict Global, Inc.
Dublin, CA2 days ago $165k - $190k
...Role: We are seeking a highly experienced Senior Data & AI Solution Architect to lead the design and implementation of scalable data... ...technologies such as Spark, Databricks or similar. Optimize system performance, scalability, security, and cost. AI & Machine...Grocery Outlet
Emeryville, CA2 days ago$92.33k - $124.91k
...and functional requirement; business process mapping. Must have system implementation skills, to include: conceptual and detailed design... ...worldwide, offering leading capabilities in digital modernization, AI/ML, Cloud, Cyber and application development. Together with our...Contract workTemporary workFor contractorsWork at officeImmediate startRemote workWorldwideRelocation packageFlexible hoursGeneral Dynamics Information Technology
Hayward, CA4 days ago- ...Job Title: M365 Technical Architect Location: Emeryville, CA (Onsite)... ...the hot, growing market of Cloud and Data/AI related IT services leveraging Microsoft... ...M365 services, policies, procedures, and system configurations. * Keep up to date with...Full timeContract work
Sparktek
Emeryville, CA11 hours ago - ...Senior Technical Architect Job No: PCGJP00003598 Location: 300 Lakeside Dr, Oakland, CA 94612 United States Duration: 18... ...implementation experience, including: § Experience building systems that use AI, including agents or similar AI-powered tools § Experience rapidly...Work at officeRemote work
Kasmo Global
Oakland, CA4 days ago - ...-stage startup developing the autonomy software and operating systems powering many of the leading automotive, trucking, defense, robotics... ...programs globally. They're looking to hire strong Systems Architects at a senior to principal level to help build and own the...
Lumicity
Hayward, CA2 days ago $90k - $145k
Veev Group seeks a BIM Systems Specialist in Hayward, CA, focusing on the integrity and standards of the BIM environment throughout the product lifecycle. The successful candidate will have a degree in Architecture or Engineering, along with over five years of experience...- ...Digital Health Solutions Architect We are seeking an experienced Digital Health Solutions... ...will focus on leveraging Epic and other EHR systems, with a strong emphasis on... ...Preferred Skills Familiarity with AI and machine learning applications in healthcare...Remote work
Omni Inclusive
Oakland, CA1 day ago $140k
...Solutions Architect As a Solutions Architect on Everlaw's commercial team, you will partner closely with Account Executives and Customer... ...your expertise across our platform, including our generative AI capabilities (Deep Dive, Storybuilder, Writing Assistant, Review...Work at officeWork from homeFlexible hoursdisABLEDperson Inc
Oakland, CA19 hours ago$170k - $190k
...Overview We are seeking an elite Solutions Architect to lead the end-to-end design, sizing, and deployment of NVIDIA AI Factory-aligned infrastructure. In this highly... ...architectures using NVIDIA DGX, HGX, and MGX systems with B200, B300, and GB300 Blackwell SXM and...Contract workLocal areaePlus Technology, inc.
San Ramon, CA2 days ago$200k - $230k
...Solutions Architect Beverly Hills, California, United States Mindful movement. It's at... ...initiatives, and cost-benefit analyses for retail systems Design deployment architectures for... ...on web/mobile/app platforms. ~ Use of AI/data centric approaches to scale customer...Work at officeALO Yoga
San Ramon, CA11 hours ago- An innovative aerospace startup is seeking a Systems Engineer to lead aircraft architecture and ensure compliance with airworthiness standards. This role involves developing top-level requirements and collaborating with hardware and software teams. Ideal candidates have...
$123.62k - $267.75k
...Job Description The Principal Data Architect is a leadership position responsible for developing the vision for AI-enabled data ecosystems, defining the Enterprise... ...alignment of data across operational and analytical systems, enabling consistency from transaction...Local areaDelta Dental Plans Association
Oakland, CA3 days ago- ...Data Architect (SAP Data exp) Emeryville, CA Data Architect (SAP Data exp) Emeryville, CA Terms: Contract(Only on w2) Job Details: Experience... ..., or data governance roles ~5+ years leading data science, AI, or enterprise analytics functions at a senior level ~ Proven...Contract work
ESR Healthcare
Emeryville, CA1 day ago $1,000 per month
...impact beyond academic research, we are laying the groundwork for ML systems that are systematic, transparent, and unbounded when reasoning... ...software made possible by language models Are excited to use AI tools as part of your daily engineering workflow, while still...Work at officeRemote workHome officeRelocation packageFlexible hoursElicit
Oakland, CA4 days ago- ...primary infrastructure-as-a-service for servicing future vehicles with our robotic repair centers, powered by our proprietary software and AI. We are a strong team of experienced robotics + automotive + shared mobility enthusiasts who have worked in self-driving, mapping,...
Kinetic Corporation
Oakland, CA3 days ago $202.5k - $274k
...is driven to stay current with the fast moving ML & AI landscape and integrate innovations into our platforms... ...scenarios ~ Deep understanding and ability to architect and develop next-generation ML systems, staying ahead of industry trends and integrating latest...Local areaIntuit
Oakland, CA1 day ago- ...Abbott Laboratories is seeking a Staff Machine Learning Engineer to lead the design, development, and deployment of scalable AI/ML solutions, particularly in the medical imaging and computer vision domain. Key Responsibilities: Build and scale...Full time
Procyon TS
Alameda, CA2 days ago $114.3k - $220.9k
...The Data Architect provides high-level technical leadership and strategic design for the University... ...ITS) division, mainly for analytical and AI purposes. Operating at the intersection... ...software development and analytical systems, the Data Architect ensures that all data...Local areaRemote workWork visaUniversity of California , Riverside
Oakland, CA2 days ago$170.76 - $175.76 per hour
...Enterprise Ai And Data Strategy Leader Pay Range: $170.76hr - $175.76hr Requirement/Must Have: Minimum 15 years of leadership experience across data, analytics, AI, or enterprise technology required. Proven experience delivering enterprise-scale AI and...Cynet Systems
Oakland, CA11 hours ago$150 - $187 per hour
...Job Title: Chief AI & Data Architect Job ID: 26-02458 Location: Oakland, CA (Hybrid) Duration: 05 months on W2 contract **LOCAL CANDIDATES ONLY. Hybrid. The team needs this role in OGO at least 2 days a week on Tuesday and Wed. Other locations days...Hourly payContract workLocal area2 days per weekSunrise Systems
Oakland, CA11 hours ago- ...We are seeking an Enterprise Data Architect to lead client-facing consulting engagements that define enterprise-wide data architecture... ...guide the delivery of modern data platforms that enable analytics, AI/ML, and digital products at scale. The ideal candidate blends...
Brillio
San Ramon, CA3 days ago $146k - $167k
...a highly skilled Salesforce Solution Architect to design, develop, and implement scalable... ...support Mizuho OSI's internal Quality System policies, procedures and work instructions... ...middleware platforms . Knowledge of AI-powered Salesforce solutions (Einstein,...Local areaFlexible hoursMizuho OSI
Union City, CA3 days ago$133.3k - $208.9k
Armanino LLP is looking for a Data Analytics & AI Pre-Sales Engineer based in San Ramon, California. The role involves partnering with sales teams to shape AI-driven transformation initiatives, leading discovery sessions, and designing end-to-end solutions using Microsoft...$250k
...businesses can own. We’re seeking a Solutions Architect Leader to serve as a senior technical... ...while leading executive workshops around AI infrastructure, hybrid cloud, and data... ...in enterprise infrastructure, cloud, or systems leadership roles; prior experience as CTO...Remote workFlexible hoursShift work- ...foundations, digitize formulation and testing workflows, and apply AI to innovate faster, smarter, and at scale. About the... ...As our Backend & Infrastructure Engineer, you will architect and build the core systems that power everything our AI/ML team delivers-the APIs,...Remote workWork from home
Albert Invent
Oakland, CA11 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Systems Architect. Be the first to apply!
