Remote AI Architect for Enterprise Systems & LLMs

Introduction At IBM Software, we transform client challenges into solutions. Building the world's leading AI-powered, cloud-native products that shape the future of business and society. Our legacy of innovation creates endless opportunities for IBMers to learn, grow, and make an impact on a global scale. Working in Software means joining a team fueled by curiosity and collaboration. You'll work with diverse technologies, partners, and industries to design, develop, and deliver solutions that power digital transformation. With a culture that values innovation, growth, and continuous learning, IBM Software places you at the heart of IBM's product and technology landscape. Here, you'll have the tools and opportunities to advance your career while creating software that changes the world. With Confluent, data doesn't sit still. We put information in motion, streaming in near real time so organizations can react faster, build smarter, and deliver experiences as dynamic as the world around them. Your role and responsibilities Overview: The Business Systems team manages the backbone of our company’s operations. We oversee the core platforms that drive our business: Salesforce, NetSuite, and Zendesk. Our goal is to modernize this stack by integrating practical AI solutions that automate manual workflows and improve data accessibility for our internal teams. We are looking for a hands‑on AI Architect to deliver technical designs and implementations of internal AI tools. This is a hybrid role where you will act as a software architect, a lead engineer, and a technical partner to the business. You will be responsible for taking vague business problems and turning them into reliable, secure AI software solutions. You will be instrumental in defining the architecture and writing the code that runs in production. What you will do: System Architecture & Integration Design for Action: Build AI integrations that do more than just summarize text. Design systems that can securely read from and write back to our core platforms (e.g., updating a record in Salesforce or drafting a response in Zendesk). Secure Data Flow: Architect the integration layer between external LLM providers (Google, Anthropic, OpenAI) and internal data. Ensure all data retrieval is governed by strict permissions so users are only able to access data they are authorized to see. Scalability: Design a model‑agnostic inference layer that allows us to switch between models based on performance and cost requirements. Hands‑On Development Backend Engineering: Write production‑ready code using modern agent frameworks (ADK, LangChain). This is a technical role that requires coding. Retrieval Augmented Generation (RAG): Implement robust RAG pipelines to ground AI responses in company data. This includes managing vector databases and optimizing search strategies (hybrid search, reranking) to ensure accuracy. Deployment: Set up the CI/CD pipelines and infrastructure required to deploy and maintain these services in a cloud environment. Quality & Governance Evaluation: Move beyond “eye‑balling” results. Implement automated testing frameworks to measure response accuracy, latency, and costs before deploying changes. Data Privacy: Ensure strict handling of PII and adherence to enterprise security standards. You will be the gatekeeper for how sensitive data is exposed to LLMs. Stakeholder Partnership Requirements Gathering: Partner with leaders in Sales, Marketing, and Support to identify high‑impact automation opportunities. Translate business needs into technical specifications. This job can be performed from anywhere in the US Required technical and professional expertise Technical Experience: Software Engineering: 8+ years of experience in software development with strong proficiency in Python and API design (REST). Applied AI: 2+ years of experience building LLM‑powered applications or agents (using libraries like LangChain or ADK). Data Engineering: Experience with Vector Databases (e.g., Pinecone, pgvector) and building pipelines to process unstructured text. Cloud Infrastructure: Hands‑on experience deploying services on AWS, Azure, or GCP. Integration & Business Skills: Enterprise Platforms: Proven experience integrating custom applications with SaaS platforms like Salesforce, NetSuite, or Zendesk. You understand their data models and API constraints. Preferred technical and professional experience Hands‑on experience with GCP Vertex AI features and technologies (Agent Engine, RAG Engine etc) IBM is committed to creating a diverse environment and is proud to be an equal‑opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status. #J-18808-Ljbffr IBM Computing