Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior AI/LLM Engineer

VDart Inc

Title: Senior AI/LLM Engineer

Location: Pittsburgh, Pennsylvania (Remote)

Type: Contract

Project Overview

  • We are seeking an experienced [strong style="font-weight: bolder;Senior AI/LLM Engineer to design, develop, and deploy enterprise-grade Generative AI solutions that leverage Large Language Models (LLMs) to solve complex business challenges.
  • The ideal candidate will have strong expertise in Python development, Retrieval-Augmented Generation (RAG), AI orchestration frameworks, and cloud-native AI architectures.
  • This role will work closely with product owners, solution architects, data engineers, and business stakeholders to build scalable, secure, and production-ready AI applications powered by OpenAI and other leading foundation models.

Key Responsibilities:

AI Solution Design & Development

  • Design, develop, and deploy enterprise-scale Generative AI applications using modern LLM technologies.
  • Build production-grade backend services using Python and modern software engineering practices.
  • Develop scalable AI architectures utilizing OpenAI, Anthropic Claude, Gemini, Llama, or similar foundation models.
  • Design and implement Retrieval-Augmented Generation (RAG) pipelines using vector databases and semantic search capabilities.
  • Develop intelligent multi-agent AI systems capable of orchestrating complex business workflows.
  • AI Architecture & Integration
  • Design AI solution architectures that are scalable, secure, maintainable, and aligned with enterprise standards.
  • Integrate AI capabilities into existing enterprise applications, APIs, and business workflows.
  • Develop and consume REST APIs, microservices, and event-driven services for AI applications.
  • Implement AI orchestration frameworks such as LangChain and related agent frameworks.
  • Prompt Engineering & Model Optimization
  • Develop and optimize prompts for improved accuracy, reasoning, and business outcomes.
  • Evaluate LLM performance and implement techniques to improve response quality.
  • Establish AI governance, model evaluation, and responsible AI best practices.
  • Monitor AI application performance and continuously optimize latency, cost, and quality.
  • Cloud & Enterprise AI
  • Build cloud-native AI solutions using Azure or AWS AI services.
  • Implement Azure AI Search and vector search capabilities.
  • Design secure enterprise AI applications following cloud security and governance standards.
  • Collaborate with DevOps teams to deploy AI solutions using CI/CD pipelines.
  • Stakeholder Collaboration
  • Partner with business stakeholders to understand AI use cases and translate them into scalable technical solutions.
  • Present architecture decisions, solution approaches, and AI strategies to both technical and non-technical audiences.
  • Mentor junior engineers and contribute to AI engineering best practices across the organization.

Required Qualifications

  • Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Software Engineering, or a related field.
  • 6+ years of software engineering or machine learning engineering experience.
  • Minimum 3+ years of hands-on experience building Artificial Intelligence and Generative AI solutions.
  • 3 to 5 years of strong hands-on experience developing production applications using Python.
  • 1 to 3 years of experience building applications using OpenAI (preferred), Anthropic Claude, Gemini, Llama, or similar LLM platforms.
  • 3+ years of strong experience implementing Retrieval-Augmented Generation (RAG) architectures.
  • 1 to 3 years of experience integrating vector databases and semantic search solutions.
  • 1 to 3 years of strong understanding of LangChain and AI orchestration frameworks.
  • Experience designing multi-agent AI architectures.
  • Strong knowledge of prompt engineering, model evaluation, AI governance, and Responsible AI principles.
  • Experience building REST APIs, microservices, and event-driven architectures.
  • Experience with Azure or AWS cloud platforms.
  • Strong understanding of scalable enterprise application architecture.
  • Excellent analytical, problem-solving, and communication skills.
  • Required Technical Skills
  • Python
  • JavaScript
  • Generative AI
  • Large Language Models (LLMs)
  • OpenAI (Preferred)
  • Retrieval-Augmented Generation (RAG)
  • Multi-Agent AI Orchestration
  • LangChain
  • Langfuse
  • AI Solution Architecture
  • Azure AI Search
  • Vector Databases
  • Prompt Engineering
  • REST APIs
  • Microservices
  • Event-Driven Architecture
  • Azure or AWS Cloud Services
  • Preferred Qualifications
  • Experience with LangGraph, AutoGen, CrewAI, Semantic Kernel, or similar AI agent frameworks.
  • Experience with vector databases such as Pinecone, Weaviate, ChromaDB, Qdrant, Milvus, or Azure AI Search.
  • Experience with containerization technologies such as Docker and Kubernetes.
  • Knowledge of CI/CD pipelines and MLOps practices.
  • Experience with AI observability and monitoring platforms.
  • Familiarity with enterprise security, compliance, and Responsible AI frameworks.
  • Experience working in Agile/Scrum environments.
  • Nice to Have
  • Experience developing enterprise copilots or AI assistants.
  • Experience integrating AI into enterprise SaaS platforms.
  • Knowledge of AI governance, security, and compliance standards.
  • Experience optimizing LLM inference performance and AI operational costs.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior AI/LLM Engineer in Remote vacancy
  • $229.9k - $262.4k

    Senior Lead AI Engineer (LLM Customization and Finetuning) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to... 
    Senior
    Full time
    Part time
    Local area

    Capital One Financial Corporation

    Remote
    9 hours ago
  •  ...focuses on designing and scaling reusable AI-driven workflows, particularly those...  ...platform components used broadly across engineering teams. Key Responsibilities Design...  ...and implement orchestration patterns for LLM-powered agents. Evaluate and select models... 
    Senior
    Full time

    Calliere

    Remote
    9 hours ago
  • $225.4k - $257.2k

    Senior Lead AI Engineer (AI Foundations, LLM Core and Agentic AI) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning... 
    Senior
    Full time
    Part time
    Local area

    Capital One Financial Corporation

    Remote
    9 hours ago
  • $148k - $201k

    Role Description Censys is seeking a Senior Software Engineer to join our SOC/TH team focused on AI and LLMs . The SOC-TH team builds intelligence-driven investigation...  ..., LangSmith) and designing regression testing for LLM pipelines. ~Ability to rapidly prototype,... 
    Senior
    Full time

    Censys

    Remote
    7 days ago
  •  ...AMC Health is seeking a Senior Software Engineer for Applied AI to build and operate real-time voice AI systems and ML pipelines in production. You will work across voice, LLM engineering, and traditional ML, shaping scalable cloud infrastructure in a regulated healthcare... 
    Senior
    Remote work

    amchealth

    Tallahassee, FL
    1 day ago
  •  ...AMC Health is seeking a Senior Software Engineer: Applied AI to work on voice agents and ML systems in a remote US setting. You will bridge real-time voice processing, LLM engineering, and traditional ML pipelines within a production healthcare environment. The role... 
    Senior
    Remote work

    amchealth

    Nashville, TN
    1 day ago
  •  ...AMC Health in the US is seeking a Senior Software Engineer to build and operate production AI voice agents that hold real phone conversations in a regulated healthcare...  ...setting. You will own real-time voice pipelines, LLM evaluation, and ML workflows, with heavy emphasis... 
    Senior
    Remote work

    amchealth

    Charleston, WV
    1 day ago
  •  ...AMC Health in the United States (remote) seeks a Senior Software Engineer for Applied AI focusing on Voice Agents and ML Systems. You'll work across real-time voice AI, LLM engineering, traditional ML, and cloud infrastructure to build production-grade AI that interacts... 
    Senior
    Remote work

    amchealth

    Trenton, NJ
    1 day ago
  •  ...AMC Health is seeking a Senior Software Engineer for Applied AI focused on voice agents and ML systems. You will work across real-time voice AI, LLM engineering, traditional ML, and cloud infrastructure in production, with high-stakes outcomes. You will ship and debug... 
    Senior
    Remote work

    amchealth

    Annapolis, MD
    1 day ago
  •  ...cutting-edge team building next-generation AI systems in a U.S.-based hybrid/remote environment as a full-time Senior AI Engineer II. You’ll work with modern technologies including...  ...experience with production-level ML/LLM systems Programming experience in Python, Go... 
    Senior
    Full time
    Remote work
    Flexible hours

    Motion Recruitment

    Phoenix, AZ
    1 day ago
  • $114.4k - $128.96k

     ...Artificial Intelligence, Software Engineering, or a closely related...  ...Artificial Intelligence and Generative AI solutions. We need 3 to 5...  ...Gemini, Llama, or comparable LLM platforms. We require 3+...  ...0 countries. This is a remote Senior AI/LLM Engineer role supporting... 
    Senior
    Hourly pay
    Full time
    Remote work
    Worldwide
    Flexible hours

    NTT DATA, Inc.

    Raleigh, NC
    5 days ago
  •  ...AMC Health is seeking a Senior Software Engineer for Applied AI (Voice Agents & ML Systems) to join a remote US team. You will work across real-time voice AI, LLM engineering, and traditional ML, delivering production-grade pipelines and instrumentation for healthcare... 
    Senior
    Remote work

    amchealth

    Columbia, SC
    1 day ago
  •  ...AMC Health is seeking a Senior Software Engineer: Applied AI (Voice Agents & ML Systems) to build real-time voice AI systems and end-to-end ML pipelines...  ...setting. You will work across real-time voice, LLM engineering, traditional ML, and cloud infrastructure, shipping... 
    Senior
    Remote work

    amchealth

    Oklahoma City, OK
    1 day ago
  •  ...AMC Health seeks a Senior Software Engineer: Applied AI to build real-time voice agents and ML pipelines in a regulated healthcare setting. You will own end-to-end backend systems, LLM integration, and cloud infrastructure, balancing latency, reliability, and safety.... 
    Senior
    Remote work

    amchealth

    Lansing, MI
    1 day ago
  •  ...Coinbase is seeking a Senior Software Engineer for the AI Platform team to build and operate LLM and agent infrastructure used company-wide. You will own multi-quarter initiatives spanning gateway, runtime, knowledge bases, and governance, shaping how Coinbase scales... 
    Senior
    Remote work

    Coinbase

    Oklahoma City, OK
    1 day ago
  •  ...Coinbase seeks a Senior Software Engineer for the AI Platform to build and operate the LLM and agent infrastructure used across the company. You will own core platform systems, from the LLM Gateway to runtime sandboxes, and guide multi-quarter technical initiatives that... 
    Senior
    Remote work

    Coinbase

    Richmond, VA
    1 day ago
  •  ...Coinbase is hiring a Senior Software Engineer for the AI Platform team. You will build and operate LLM and agent infrastructure used company-wide, shaping how Coinbase scales AI. You’ll lead end-to-end platform initiatives, from gateway and runtimes to knowledge bases... 

    Coinbase

    Denver, CO
    14 hours ago
  •  ...Coinbase, a remote-first company, seeks a Senior Software Engineer for the AI Platform team. You will build and operate the LLM and agent infrastructure used across Coinbase, enabling teams to scale AI responsibly and effectively. You’ll own core platform systems, design... 
    Senior
    Remote work

    Coinbase

    Columbia, SC
    14 hours ago
  •  ...Coinbase is seeking a Senior Software Engineer for the AI Platform team. You will build and operate the LLM and agent infrastructure powering Coinbase's AI initiatives, shaping how AI scales across the organization. You will lead multi-quarter projects across gateway... 
    Senior
    Remote work

    Coinbase

    Salt Lake City, UT
    14 hours ago
  • $140k - $215k

    Role Description CrowdStrike is looking for a Senior AI Infrastructure Engineer with expertise in Large Language Models (LLMs) Infrastructure and data...  ...security products. This role requires hands-on experience in LLM infrastructure to support multiple large scale training... 
    Senior
    Full time
    Work at office

    CrowdStrike

    Remote
    7 days ago
  •  ...Coinbase is seeking a Senior Software Engineer on the AI Platform team to build and operate LLM and agent infrastructure that powers the company. You will lead multi-quarter initiatives across gateway systems, knowledge bases, and production AI agents to scale AI across... 
    Senior
    Remote work

    Coinbase

    Atlanta, GA
    14 hours ago
  •  ...Coinbase is seeking a Senior Software Engineer for the AI Platform to own and scale the LLM and agent infrastructure used across the company. The role focuses on building, deploying, and operating large-scale AI systems with governance and cost awareness. You will partner... 
    Senior
    Remote work

    Coinbase

    Santa Fe, NM
    1 day ago
  •  ...Coinbase is seeking a Senior Software Engineer to join the AI Platform team. You will own the architecture of core platform systems, including the LLM Gateway and AI Hub, and lead initiatives across the full AI stack to scale the company's use of large language models... 
    Senior
    Remote work

    Coinbase

    Olympia, WA
    14 hours ago
  • $175k - $225k

     ...AI/LLM Systems Software Engineer Location: San Francisco, CA Work Type: In-person Employment: Full-time Experience Required: 2+ years Salary Range: $175,000 - $225,000 per year Visa Sponsorship: Not available The... 
    Full time

    A5 Talent Finders

    Remote
    9 hours ago
  • ICON is seeking a pragmatic AI Software Engineer to design and ship AI-powered tools, workflows, and autonomous agents for its Government Technology team. The role is remote with periodic travel to ICON HQ in Austin, TX. You will own end-to-end AI feature development,... 
    Senior
    Remote job

    ICON Technology

    Austin, TX
    1 day ago
  • $104k - $124.8k

     ...with large language models, including API integration, prompt engineering, fine-tuning or adaptation, and building applications with RAG...  ...CloudFormation. Responsibilities: We design and implement agentic AI systems, including tool-calling agents that combine retrieval,... 
    Senior
    Hourly pay
    Full time
    Remote work

    NTT DATA, Inc.

    New York, NY
    7 days ago
  •  ...Job Title AI-focused Senior Software Engineer (path to Staff Engineer) Job Description The Tight Embedded Accounting HQ is in Washington, DC...  ...recently revamped (and debt-free) architecture focused on LLM use cases for the future of Agentic Accounting. We’re... 
    Senior
    Full time
    Work at office

    Tight

    Remote
    9 hours ago
  •  ...Senior AI Engineer, Ares Platform Team: Ares AI Engineering Reports to: Ilir Osmanaj, VP of AI Engineering Location: Boston, MA (hybrid...  ...systems, with at least 2 years working directly on LLMs or LLM-powered agents. ~ Deep Python; strong, production-grade... 
    Senior
    Full time
    Remote work

    Assail

    Boston, MA
    9 hours ago
  •  ...accelerate justice in communities around the world. Cellebrite’s AI-powered Digital Investigation Platform enables customers to lawfully...  .... Experience with GenAI infrastructure, semantic caching, and LLM integration. Knowledge of observability tools like Datadog and... 
    Senior
    Full time

    Cellebrite

    Remote
    9 hours ago
  • $160k - $195k

     ...SaaS company building practical AI-powered solutions that improve...  .... We are expanding our engineering team to build the next generation...  ...Role We are looking for a Senior Applied AI Engineer to help...  ...infrastructure and frameworks for LLM-powered applications, enabling... 
    Senior
    Remote job
    Full time
    Local area

    Brightplan

    United States
    9 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior AI/LLM Engineer. Be the first to apply!