Software Engineer, AI Foundation (Mid-Senior level)

Software Engineer

As a Software Engineer on the AI Foundations team, you will own the platform that powers every AI-driven product at Zip. This is not a feature team — you are building the shared infrastructure that multiplies the effectiveness of every engineer and product at the company. Your work spans agentic orchestration, document processing pipelines, retrieval and memory systems, and the eval infrastructure that makes it all reliable. You will operate with significant technical autonomy, regularly defining the right approach from scratch in a field where established answers are still being written. If you find that energizing rather than uncomfortable, this role is built for you.

You Will

• Design and build the core agentic platform powering Zip's AI products, including orchestration, memory, retrieval, and document processing infrastructure.
• Own end-to-end delivery of platform capabilities — from architecture decisions through production — with real influence over how the broader engineering organization builds AI.
• Partner closely with every product team at Zip to understand their needs, surface shared patterns, and ship reusable infrastructure that raises quality across Intake AI, Chatbot, IP Agent, Contract Orchestration, and Payments simultaneously.
• Push the frontier of applied AI engineering: LLM orchestration with LangGraph, RAG pipelines, agentic document parsing, and self-correcting memory systems.
• Build and evolve eval frameworks and observability tooling that make AI systems measurably more reliable over time.
• Translate ambiguous, open-ended problems into well-scoped technical solutions, without waiting for a playbook that may not yet exist.

Qualifications

• We are hiring software engineers across all levels. Most of our open roles are targeting individuals with at least 3 years experience if past work is highly relevant.
• BS or higher, in Computer Science or related technical field involving coding (e.g. physics or math)
• 3+ years of backend or full-stack software engineering experience in a production environment.
• Strong Python proficiency; experience with async frameworks and distributed systems is a plus.
• Hands-on experience building or operating LLM-based applications — RAG pipelines, tool use, agents, or eval systems.
• Experience with data pipelines, job scheduling (Airflow or equivalent), and vector databases or embedding-based search.
• Comfort with observability tooling: tracing, logging, metrics, and alerting in production AI systems.
• A track record of owning problems end-to-end — you care whether things work in production, not just whether they shipped.
• Ability to drive ambiguous, open-ended problems to a conclusion without a lot of hand-holding.
• A platform mindset: you think about who else will use what you build and design for reuse, not just the immediate use case.
• Exposure to AI-driven automation or interest in working with AI/ML teams to build intelligent workflows.

Nice to Have

• Familiarity with LangChain, LangGraph, or similar agent orchestration frameworks.
• Experience with document parsing or OCR pipelines (PDF, DOCX, XLSX extraction).
• Background in ML platform, developer tooling, or internal platform engineering.
• Prior work on evaluation frameworks for AI/ML systems.
• Experience at a fast-moving startup with broad, cross-functional responsibilities.
• Exposure to procurement, finance, or enterprise SaaS domains.

The salary range for this role is $160,000 - $260,000. The salary for this position is determined based on a variety of job-related factors that may include location, relevant experience, education, or particular skills and expertise.

Perks & Benefits

• Start-up equity
• 100% health, vision & dental coverage options
• Catered breakfast, lunch, & dinner
• Flexible PTO
• ClassPass membership
• Monthly commuter benefit
• Team building events & happy hours
• Home office stipend
• Phone/internet reimbursement
• Paid parental leave
• Fertility stipend
• 401k plan
• Unlimited AI token usage

We're looking to hire Zipsters and that means hiring people who take ownership, communicate openly, have an underdog mindset, and are excited to increase the pace of innovation for every business in the world. We encourage all candidates to apply even if your experience doesn't exactly match up to our job description. We are committed to building a diverse and inclusive workspace where everyone (regardless of age, religion, ethnicity, gender, sexual orientation, and more) feels like they belong. We look forward to hearing from you!