Sr Forward Deployment Engineer

Senior Forward Deployed GenAI Engineer

Hybrid Opportunity- Chicago (3 days a week at clients office)

Re-location provided.

About Avanta

Avanta helps ambitious small and mid-market companies build AI intelligence that changes how work gets done—in weeks, not quarters. We design and deliver practical AI systems from model selection through production deployment, and we build them so the customer can understand, operate, and own the outcome.

Our work spans agentic solutions, AI enablement, AI-native software delivery, business transformation, small language models, strategy, governance, adoption, measurement, and executive advisory.

Role Summary

You will independently design and deliver production generative AI applications while balancing customer value, technical quality, security, cost, adoption, and operational ownership. You will mentor associate engineers and serve as a trusted technical partner to customer teams.

What You Will Do

• Lead the design and implementation of production-grade generative AI applications and customer workstreams.
• Build RAG systems across structured, semi-structured, and unstructured data, including authorization-aware retrieval and citations.
• Design agentic workflows coordinating multiple tools, services, business rules, and human approval boundaries.
• Evaluate proprietary, open-weight, multimodal, embedding, reranking, and specialized models for specific business needs.
• Benchmark quality, accuracy, latency, throughput, cost, safety, and operational complexity before recommending a model or architecture.
• Create golden datasets, scoring rubrics, regression tests, and repeatable evaluation pipelines.
• Diagnose failures across ingestion, parsing, chunking, embeddings, retrieval, reranking, prompts, tool execution, orchestration, and output generation.
• Implement human review, approval, escalation, and rollback mechanisms for higher-impact actions.
• Design for multitenancy, resiliency, availability, graceful degradation, and defined service-level objectives.
• Integrate AI applications with enterprise systems, data platforms, workflow tools, identity services, and security controls.
• Build production monitoring for model quality, retrieval effectiveness, tool execution, latency, token usage, cost, errors, and user behavior.
• Improve systems through caching, batching, context reduction, prompt optimization, model routing, provider abstraction, and architectural changes.
• Build deployment pipelines, infrastructure automation, automated testing, and release-management practices.
• Support production incidents, lead root-cause analysis for owned workstreams, and implement durable corrective actions.
• Convert customer implementations into templates, connectors, evaluation packs, runbooks, accelerators, and reference architectures.
• Mentor associate engineers and provide code, design, and customer-communication feedback.

Customer-Facing Responsibilities

• You will lead technical discovery with customer engineers, business owners, security teams, operators, and data stakeholders.
• You'll translate business problems into measurable AI use cases and technical requirements, facilitate design workshops, create implementation plans, coordinate across customer teams, communicate risks, and help customer engineers understand and operate the delivered solution.
• You may also support pre-sales technical discovery when needed, while remaining accountable for hands-on delivery .

Technical Responsibilities

• Design cloud-native services using API, distributed-system, asynchronous, and event-driven patterns.
• Apply hybrid retrieval, metadata filtering, query rewriting, reranking, retrieval evaluation, and graph-based retrieval where appropriate.
• Design agent state, memory, tool contracts, authorization, failure recovery, and deterministic controls.
• Establish prompt/configuration versioning, automated regression testing, experiment tracking, and release gates.
• Implement identity-aware retrieval and least-privilege access.
• Protect systems from prompt injection, data leakage, unsafe tool use, malicious input, and invalid structured output.
• Apply containers, Kubernetes or serverless patterns, infrastructure as code, and automated CI/CD.
• Trace and observe the complete application path across models, retrieval, agents, tools, data, and infrastructure.
• Optimize model and application cost, latency, throughput, and reliability.
• Define runbooks, incident procedures, support boundaries, SLOs, and ownership before go-live.

Required Qualifications

• Approximately 4–7 years of relevant engineering experience , including meaningful ownership of production software, enterprise AI, ML, search, data, or automation systems.
• Strong production software-engineering ability in Python , plus competence in at least one additional enterprise language or framework.
• Experience designing and operating APIs, cloud services, data pipelines, integrations, automated tests, observability, and release pipelines.
• Hands-on experience taking a GenAI or ML solution beyond prototype into production .
• Practical expertise in RAG, model evaluation, agent tools, security controls, cost management, and production troubleshooting .
• Ability to lead technical discovery and explain trade-offs to business leaders, customer engineers, and security stakeholders.
• Evidence of independent ownership, sound judgment, mentorship, and disciplined delivery in ambiguous environments.

Representative Technology Stack

Languages: Advanced Python, TypeScript/JavaScript, Java, C#, Go, SQL, FastAPI, Node.js, React.

AI/Models: Amazon Bedrock, SageMaker, Azure OpenAI, AI Foundry, Google Vertex AI, OpenAI, Anthropic, Hugging Face, open-weight models.

Agents: LangGraph, LangChain, LlamaIndex, Semantic Kernel, AutoGen, CrewAI, Haystack.

Retrieval/Data: PostgreSQL/pgvector, OpenSearch/Elasticsearch, Pinecone, Weaviate, Milvus, Qdrant, Redis, Neo4j, warehouses, lakehouses and streaming platforms.

Evaluation/Observability: MLflow, Weights & Biases, LangSmith, Arize Phoenix, OpenTelemetry, Prometheus, Grafana.

Infrastructure: Docker, Kubernetes, Terraform, CI/CD, Argo CD, serverless, API gateways and model gateways.

Security: IAM, RBAC/ABAC, encryption, DLP, audit logging, policy engines, guardrails, lineage and governance tooling.

What Success Looks Like

You'll independently own customer workstreams from discovery through production, improve AI system quality, reliability, latency and cost using evidence, establish repeatable evaluation and observability practices, turn prototypes into maintainable production systems, mentor engineers, and convert successful implementations into reusable Avanta capabilities.

Important note: This is not a presentation-only Sales Engineer role. It remains a hands-on delivery role.