Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior AI Engineer

Compunnel

Job Summary
We are seeking a Senior AI Engineer to design, build, deploy, and operate enterprise-grade Large Language Model (LLM) applications that support business processes in regulated financial services environments. The role requires hands-on experience delivering Generative AI solutions from design through production deployment, including ongoing production support. The ideal candidate will have strong expertise in Agentic AI, Generative AI, LLM orchestration, Retrieval-Augmented Generation (RAG), AI evaluation, Python, cloud services, observability, and production-grade AI engineering.

Key Responsibilities
• Design and implement multi-step LLM pipelines, including LLM orchestration, structured output generation, tool/function calling, error handling, retries, and fallback logic.
• Develop and maintain RAG solutions, including indexing strategies, embedding model selection, and retrieval quality optimization.
• Build and maintain LLM evaluation frameworks and golden datasets to measure accuracy, consistency, and regression risk before production releases.
• Establish and enforce quality gates for model, prompt, and configuration changes.
• Implement observability for non-deterministic AI applications, including tracing, structured logging, quality monitoring, and cost monitoring.
• Manage the cost and latency of production AI workloads against defined budgets.
• Collaborate with Product, Business, Risk, Compliance, and Security teams to translate business requirements into technical solutions and support review and approval processes.
• Participate in code reviews, architectural decisions, and technical documentation.
• Provide ongoing production support for deployed AI applications, including incident response, root cause analysis, regression management, and remediation.
• Mentor junior engineers and contribute to engineering standards and best practices.
• Design and operate enterprise-grade AI applications that meet availability, latency, cost management, access control, data handling, and auditability requirements.
• Support security and compliance reviews and manage changes deployed against live production traffic.

Required Qualifications
• Bachelor's degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.
• Minimum 5 years of professional software engineering experience.
• Minimum 2 years of experience developing LLM or Generative AI applications.
• Demonstrated experience deploying at least one enterprise-grade AI application into production and providing post-launch support. Proof-of-concept-only experience does not meet this requirement.
• Experience delivering AI solutions that serve real users or business processes rather than only internal pilots.
• Hands-on experience with Agentic AI, Generative AI, LLMs, and LangChain.
• Experience with at least one LLM agent or orchestration framework, such as LangGraph, LangChain, LlamaIndex, Semantic Kernel, AutoGen, or Amazon Bedrock Agents.
• Strong experience with LLM evaluation methodologies, including golden dataset curation, metric selection, evaluation of non-deterministic outputs, LLM-as-judge techniques, and established evaluation frameworks or custom evaluation harnesses.
• Strong proficiency in Python 3.11+, including type annotations, automated testing, and asynchronous programming.
• Experience building and operating cloud-based services, including REST APIs, data pipelines, and event-driven workers.
• Experience working with codebases governed by automated quality gates and formal code reviews.
• Experience completing security and compliance reviews in regulated or enterprise environments.
• Post-production ownership involving incident response, regression management, and deployment of changes against live traffic.
• Experience managing non-functional requirements, including availability, latency, cost, access control, data handling, and auditability.

Preferred Qualifications
• Experience with Document AI or Intelligent Document Processing, including OCR, structured field extraction, scanned documents, photographed documents, and handwritten source material.
• Experience designing human-in-the-loop workflows, including confidence scoring, selective automation, escalation, and review processes.
• Experience implementing business rules or policies as versioned and reviewable artifacts.
• Experience with event-driven architecture, particularly Apache Kafka.
• Experience with Kubernetes, Helm, and CI/CD pipeline ownership.
• Experience with Infrastructure as Code (IaC), particularly Terraform.
• Experience with model selection, model benchmarking, fine-tuning, distillation, and cost and quality optimization.
• Experience with financial services, insurance, healthcare, or other regulated industries.

Technical Skills
• AI and Generative AI: LLMs, Agentic AI, LLM orchestration frameworks, RAG, LLM evaluation, and observability tooling.
• Programming and Application Development: Python 3.11+, FastAPI, and Pydantic.
• Data and Databases: PostgreSQL with vector extensions and Aurora PostgreSQL.
• Cloud and AI Platforms: AgentCore and cloud-based AI services.
• Infrastructure and DevOps: Kubernetes, Helm, Terraform, and CI/CD.
• Event-Driven Architecture: Apache Kafka.
• Observability: Datadog and OpenTelemetry.

Notes:

Mandatory Areas Agentic AI; Generative AI; LLMs; LangChain

Must Have Skill 1 Agentic AI / LLM orchestration with hands-on LangChain, LangGraph, LlamaIndex, Semantic Kernel, AutoGen, or Amazon Bedrock Agents

Must Have Skill 2 Generative AI / LLM application development, with minimum 2 years developing LLM/GenAI applications

Must Have Skill 3 RAG including embeddings, indexing strategies, vector retrieval, and retrieval-quality optimization

Must Have Skill 4 Python 3.11+, including type annotations, automated testing, asynchronous programming, APIs/FastAPI

Must Have Skill 5 LLM Evaluation, including golden datasets, metrics, non-deterministic output evaluation, and LLM-as-judge/evaluation frameworks

Must Have Skill 6 Enterprise production AI deployment & post-production support including incident response, regression management, latency/cost management, and live production changes

Must Have Skill 7 AI Observability & Cloud Services including tracing, structured logging, quality/cost monitoring, REST APIs/data pipelines/event-driven services

Must Have Skill 8 Enterprise Security & Compliance, including security/compliance reviews, access control, data handling, and auditability

Domain Experience Regulated industry strongly preferred, particularly Financial Services. Insurance and Healthcare are also acceptable preferred backgrounds.

Experience Minimum 5 years software engineering + minimum 2 years LLM/GenAI application development

Must Have Certifications None specified

Location Remote.

Onsite Requirement No

Number of days onsite Remote
Vacancy posted 10 hours ago
Similar jobs that could be interesting for youBased on the Senior AI Engineer in Aliso Viejo, CA vacancy
  •  ...Job Description Job Description Job Title: Senior AI Engineer Work Location: Irvine, CA 92618 Contract duration: 6 months Interview Mode- In-person Interview Job Details: Must Have Skills AI Engineer SDLC.ai AWS, Claude Detailed Job Description... 
    Senior
    Contract work

    eTeam Inc.

    Irvine, CA
    23 days ago
  •  ...sponsorship, and C2C arrangements are not accepted. This role is hybrid in Tustin, CA or Plano, TX. Position Summary The Senior AI Engineer serves as a technical leader responsible for driving the design, development, and deployment of advanced artificial... 
    Senior

    Veritas Search Group

    Tustin, CA
    3 days ago
  • $153.84k - $246.15k

     ...on-demand professional development resources that allow you to hone existing skills and learn new ones “I can succeed as a Senior AI AppSec Engineer at Capital Group”As a Senior AI AppSec Engineer, you will work with application teams to ensure the security of custom and... 
    Senior
    Full time
    Temporary work
    Local area
    Flexible hours

    Capital Group

    Irvine, CA
    2 days ago
  • $87.5k - $140k

     ...customers experience continuous intelligence during design and engineering and into operations and maintenance using a unified electrical...  ...is proud to be an Equal Opportunity Employer. Job Title: Senior Electrical Engineer - R & D Engineering Location: Irvine,... 
    Senior
    Full time
    Local area

    ETAP

    Irvine, CA
    1 day ago
  • $112.2k - $190.7k

     ...to drive innovation and efficiency across the IT ecosystem. Our AI Center of Excellence (CoE) is a dynamic and strategic group dedicated...  ....Your role:We are seeking a talented and motivated Agentic AI Engineer to join our AI CoE. In this hands-on role, you will be... 
    Senior
    Full time
    Temporary work
    Worldwide

    Ingram Micro

    Irvine, CA
    2 days ago
  • $124k - $280k

     ...InnovationManagement LevelSenior ManagerJob Description & SummaryThe OpportunityAs a Senior Manager, Agentic Engineering Lead, you will guide the design and delivery of agentic and generative AI solutions for clients within our Advisory practice. In this role, you will bring... 
    Senior
    Full time
    H1b

    PwC

    Irvine, CA
    2 days ago
  • Masimo, a Danaher operating company in Irvine, CA, seeks a Sr Engineer to advance AI/ML for medical devices. You will integrate measurement technologies and analyze physiological data to develop models for disease detection and prediction of critical events, working with... 
    Senior

    Radiometer

    Irvine, CA
    2 days ago
  • EY is seeking a Forward‑Deployed Engineer Senior Manager to lead interdisciplinary teams delivering AI and data solutions for clients. You will translate AI strategy into production-grade systems, guiding MLOps and agentic tooling while collaborating with data scientists... 
    Senior
    Remote work

    EY

    Irvine, CA
    2 days ago
  •  ...Power Apps.ResponsibilitiesThe candidate should be able to develop AI-powered agents and business-process automations, integrate them...  ...policies, security roles, and access controls.Production-Grade Engineering: Ability to build reliable automations with error handling,... 
    Senior

    Luxoft

    Irvine, CA
    4 days ago
  • $132.5k - $366.3k

     ...technology and intelligence. Visit us at: About the RoleWe are building out practitioners within our Song - Sales practice: AI Forward Deployed Engineers who embed directly with clients to design, prototype, and deploy Agentic AI solutions that transform how our clients... 
    Senior
    Live in
    Work at office
    Local area

    Accenture

    Irvine, CA
    3 days ago
  • $77k - $202k

     ...ApplicableSpecialismProduct InnovationManagement LevelSenior AssociateJob Description & SummaryThe OpportunityAs a Senior Associate - Azure AI Engineer you will design and develop generative AI solutions for clients within our Advisory practice, applying Azure-based engineering... 
    Senior
    Full time
    H1b

    PwC

    Irvine, CA
    2 days ago
  • $202.9k - $300.26k

     ...infrastructure that connects our world. Across enterprise, cloud and AI, and carrier architectures, our innovative technology is...  ...ecosystem at the intersection of machine learning and hardware engineering — systems that learn from how engineering actually plays out in... 
    Senior
    Permanent employment
    Full time
    Internship
    Work from home

    Marvell

    Irvine, CA
    1 day ago
  •  ...staffingfuture.comHM’s Top Needs:1.Sustaining/Released product engineering experience2.Technical Investigation and problem solving3....  ...the treatment of stroke related diseases.A Day in the LifeThe Senior R&D Engineer is a technical contributor to the Research & Engineering... 
    Senior
    Full time
    Part time
    For contractors
    Work at office
    Local area
    Worldwide

    Planet Pharma

    Irvine, CA
    4 days ago
  •  ...synonymous with entertainment excellence and creativity.Agentic & AI EngineeringDesign, build, and operate production-quality agentic...  ...safe, reliable access to backend systems and enterprise data.Engineer prompts for reliable structured output (JSON schemas, few-shot examples... 
    Senior
    For contractors

    Sony Interactive Entertainment America

    Aliso Viejo, CA
    2 days ago
  • $177.3k - $265.9k

     ...nurture the experiences under the PlayStation brand, a name synonymous with entertainment excellence and creativity.Senior Software Engineer - Applied AI & StreamingAliso Viejo, CAThe vision We think AI will change what cloud gaming can be. It can make streamed play faster... 
    Senior

    Sony Interactive Entertainment America

    Aliso Viejo, CA
    5 days ago
  •  ...Job Overview We are seeking an experienced AI Security Engineer with strong expertise in cybersecurity, AI-driven automation, and programming to develop and implement intelligent security solutions. The ideal candidate will leverage AI and automation technologies to... 
    Contract work

    2T Consulting

    Irvine, CA
    8 days ago
  • $140k - $180k

     ...Job Summary The Senior Data & AI Analytics Engineer’s key objective is to own NC America’s data from raw table to finished insight. They will turn raw game, player, and business data into clean, well-modeled summary tables, write the analysis themselves, and build the... 
    Senior
    Work at office
    Local area

    NC America

    Irvine, CA
    2 days ago
  •  ...name synonymous with entertainment excellence and creativity.Senior Software Engineer Cloud Engineering (Contractor)We are seeking a Senior...  ...systemsInfrastructure-as-code experience (CDK, Terraform)Familiarity with AI-assisted development tools and modern cloud-native... 
    Senior
    For contractors

    Sony Interactive Entertainment America

    Aliso Viejo, CA
    5 days ago
  •  ...name synonymous with entertainment excellence and creativity.Senior Software Engineer - Cloud Streaming Game Services (Contractor)Aliso Viejo,...  ...project status, risks, estimates, and dependenciesLeverage modern AI-assisted development tools (e.g. Codex, Claude, etc) to... 
    Senior
    For contractors

    Sony Interactive Entertainment America

    Aliso Viejo, CA
    3 days ago
  •  ...and enhance data pipelines and integration frameworks supporting AI, analytics, and business applications.Improve data quality,...  ...solutionsCollaborate closely with business stakeholders, product managers, and engineering teams to translate business objectives into technical solutions... 

    Luxoft

    Irvine, CA
    3 days ago
  •  ...Job Description Job Description Job Title: R-D Engineer II Job ID: 28617 Location:5290 California Ave Irvine California 92617 Duration: 06 months Pay Rate: $45.00 - $50.00/hr. on W2 Required Qualifications: Bachelor's degree with 2+ years of relevant... 
    Internship
    Local area

    Artech LLC

    Irvine, CA
    23 days ago
  •  ...Job Description Job Description Join our team as a Principal R&D Development Engineer and play a pivotal role in designing and developing life-saving medical device products. Based in the vibrant city of Irvine, CA, you'll have the opportunity to work in a dynamic... 

    LanceSoft Inc

    Irvine, CA
    23 days ago
  •  ...Job Description Job Description Job Title: Prin R-D Engineer Job ID: 28172 Location: Irvine California 92617 Duration:06 months Pay Rate: $60.00 - $65.00/hr on W2 Top 3 Must-Haves # Catheter design & manufacturing experience # Design Controls,... 

    Artech LLC

    Irvine, CA
    23 days ago
  •  ...innovative team in Irvine, CA, a vibrant hub for medical device development and research. We are seeking a motivated and skilled R&D Engineer to contribute to groundbreaking projects in the medical device field. This is an exciting opportunity to work onsite at our Irvine... 
    Internship

    LanceSoft Inc

    Irvine, CA
    23 days ago
  •  ...Type: 1099, C2C, W-2Company: SRI Tech SolutionsJob Title: Senior python developer with AI/ML knowledgeLocation - Atlanta, Dallas, NJ or Irvine (CA)...  ...along with related services like GCS, GKE, Compute Engine, IAM, Dataproc)Strong experience with relational database... 
    Senior

    SRI Tech

    Irvine, CA
    2 days ago
  •  ...development skills and hands-on experience with LLM or Generative AI applications. Practical knowledge of agentic patterns:...  ...workflow execution. Experience with Google ADK, Vertex AI, Agent Engine and Gemini, or comparable agent frameworks with ability to transition... 
    Temporary work
    Local area

    Valiant Technologies LLC

    Irvine, CA
    11 hours ago
  •  ...Job Description Job Description Job Title : Senior Salesforce Developer – Technical Architect Position Overview Drive the technical...  ...healthcare domain. This role combines senior-level Salesforce engineering with technical architecture, enterprise integrations, platform... 
    Senior
    Local area

    HTC Global Services Inc

    Aliso Viejo, CA
    2 days ago
  • $132.5k - $366.3k

     ...technology and intelligence. Visit us at: About the Role We are building out practitioners within our Song – Sales practice: AI Forward Deployed Engineers who embed directly with clients to design, prototype, and deploy Agentic AI solutions that transform how our clients... 
    Senior
    Full time
    Live in
    Work at office
    Local area

    Accenture Global

    Irvine, CA
    6 days ago
  • Irvine, California • Job Type: Direct Hire • Posted: 2 weeks agoAI Software EngineerOur client is seeking an experienced AI Software Engineer to develop and support modern business applications while helping teams safely adopt AI-powered development tools. This is a hands... 
    Local area
    Visa sponsorship
    Free visa

    Irvine Technology

    Irvine, CA
    1 day ago
  • $80k - $140k

     ...members to contribute in a larger capacity than is possible in typical positions.Position DescriptionWe are seeking a highly skilled AI Engineer with deep expertise in Large Language Models (LLMs), AI agent frameworks, and Model Context Protocols (MCP). The ideal candidate... 
    Local area

    Applied Medical Resources Corporation

    Rancho Santa Margarita, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior AI Engineer. Be the first to apply!