Senior AI/LLM Engineer
VDart Inc
Title: Senior AI/LLM Engineer
Location: Pittsburgh, Pennsylvania (Remote)
Type: Contract
Project Overview
- We are seeking an experienced [strong style="font-weight: bolder;Senior AI/LLM Engineer to design, develop, and deploy enterprise-grade Generative AI solutions that leverage Large Language Models (LLMs) to solve complex business challenges.
- The ideal candidate will have strong expertise in Python development, Retrieval-Augmented Generation (RAG), AI orchestration frameworks, and cloud-native AI architectures.
- This role will work closely with product owners, solution architects, data engineers, and business stakeholders to build scalable, secure, and production-ready AI applications powered by OpenAI and other leading foundation models.
Key Responsibilities:
AI Solution Design & Development
- Design, develop, and deploy enterprise-scale Generative AI applications using modern LLM technologies.
- Build production-grade backend services using Python and modern software engineering practices.
- Develop scalable AI architectures utilizing OpenAI, Anthropic Claude, Gemini, Llama, or similar foundation models.
- Design and implement Retrieval-Augmented Generation (RAG) pipelines using vector databases and semantic search capabilities.
- Develop intelligent multi-agent AI systems capable of orchestrating complex business workflows.
- AI Architecture & Integration
- Design AI solution architectures that are scalable, secure, maintainable, and aligned with enterprise standards.
- Integrate AI capabilities into existing enterprise applications, APIs, and business workflows.
- Develop and consume REST APIs, microservices, and event-driven services for AI applications.
- Implement AI orchestration frameworks such as LangChain and related agent frameworks.
- Prompt Engineering & Model Optimization
- Develop and optimize prompts for improved accuracy, reasoning, and business outcomes.
- Evaluate LLM performance and implement techniques to improve response quality.
- Establish AI governance, model evaluation, and responsible AI best practices.
- Monitor AI application performance and continuously optimize latency, cost, and quality.
- Cloud & Enterprise AI
- Build cloud-native AI solutions using Azure or AWS AI services.
- Implement Azure AI Search and vector search capabilities.
- Design secure enterprise AI applications following cloud security and governance standards.
- Collaborate with DevOps teams to deploy AI solutions using CI/CD pipelines.
- Stakeholder Collaboration
- Partner with business stakeholders to understand AI use cases and translate them into scalable technical solutions.
- Present architecture decisions, solution approaches, and AI strategies to both technical and non-technical audiences.
- Mentor junior engineers and contribute to AI engineering best practices across the organization.
Required Qualifications
- Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Software Engineering, or a related field.
- 6+ years of software engineering or machine learning engineering experience.
- Minimum 3+ years of hands-on experience building Artificial Intelligence and Generative AI solutions.
- 3 to 5 years of strong hands-on experience developing production applications using Python.
- 1 to 3 years of experience building applications using OpenAI (preferred), Anthropic Claude, Gemini, Llama, or similar LLM platforms.
- 3+ years of strong experience implementing Retrieval-Augmented Generation (RAG) architectures.
- 1 to 3 years of experience integrating vector databases and semantic search solutions.
- 1 to 3 years of strong understanding of LangChain and AI orchestration frameworks.
- Experience designing multi-agent AI architectures.
- Strong knowledge of prompt engineering, model evaluation, AI governance, and Responsible AI principles.
- Experience building REST APIs, microservices, and event-driven architectures.
- Experience with Azure or AWS cloud platforms.
- Strong understanding of scalable enterprise application architecture.
- Excellent analytical, problem-solving, and communication skills.
- Required Technical Skills
- Python
- JavaScript
- Generative AI
- Large Language Models (LLMs)
- OpenAI (Preferred)
- Retrieval-Augmented Generation (RAG)
- Multi-Agent AI Orchestration
- LangChain
- Langfuse
- AI Solution Architecture
- Azure AI Search
- Vector Databases
- Prompt Engineering
- REST APIs
- Microservices
- Event-Driven Architecture
- Azure or AWS Cloud Services
- Preferred Qualifications
- Experience with LangGraph, AutoGen, CrewAI, Semantic Kernel, or similar AI agent frameworks.
- Experience with vector databases such as Pinecone, Weaviate, ChromaDB, Qdrant, Milvus, or Azure AI Search.
- Experience with containerization technologies such as Docker and Kubernetes.
- Knowledge of CI/CD pipelines and MLOps practices.
- Experience with AI observability and monitoring platforms.
- Familiarity with enterprise security, compliance, and Responsible AI frameworks.
- Experience working in Agile/Scrum environments.
- Nice to Have
- Experience developing enterprise copilots or AI assistants.
- Experience integrating AI into enterprise SaaS platforms.
- Knowledge of AI governance, security, and compliance standards.
- Experience optimizing LLM inference performance and AI operational costs.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior AI/LLM Engineer in Remote vacancy
$229.9k - $262.4k
Senior Lead AI Engineer (LLM Customization and Finetuning) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to...SeniorFull timePart timeLocal area- ...focuses on designing and scaling reusable AI-driven workflows, particularly those... ...platform components used broadly across engineering teams. Key Responsibilities Design... ...and implement orchestration patterns for LLM-powered agents. Evaluate and select models...SeniorFull time
$225.4k - $257.2k
Senior Lead AI Engineer (AI Foundations, LLM Core and Agentic AI) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning...SeniorFull timePart timeLocal area$148k - $201k
Role Description Censys is seeking a Senior Software Engineer to join our SOC/TH team focused on AI and LLMs . The SOC-TH team builds intelligence-driven investigation... ..., LangSmith) and designing regression testing for LLM pipelines. ~Ability to rapidly prototype,...SeniorFull time- ...AMC Health is seeking a Senior Software Engineer for Applied AI to build and operate real-time voice AI systems and ML pipelines in production. You will work across voice, LLM engineering, and traditional ML, shaping scalable cloud infrastructure in a regulated healthcare...SeniorRemote work
- ...AMC Health is seeking a Senior Software Engineer: Applied AI to work on voice agents and ML systems in a remote US setting. You will bridge real-time voice processing, LLM engineering, and traditional ML pipelines within a production healthcare environment. The role...SeniorRemote work
- ...AMC Health in the US is seeking a Senior Software Engineer to build and operate production AI voice agents that hold real phone conversations in a regulated healthcare... ...setting. You will own real-time voice pipelines, LLM evaluation, and ML workflows, with heavy emphasis...SeniorRemote work
- ...AMC Health in the United States (remote) seeks a Senior Software Engineer for Applied AI focusing on Voice Agents and ML Systems. You'll work across real-time voice AI, LLM engineering, traditional ML, and cloud infrastructure to build production-grade AI that interacts...SeniorRemote work
- ...AMC Health is seeking a Senior Software Engineer for Applied AI focused on voice agents and ML systems. You will work across real-time voice AI, LLM engineering, traditional ML, and cloud infrastructure in production, with high-stakes outcomes. You will ship and debug...SeniorRemote work
- ...cutting-edge team building next-generation AI systems in a U.S.-based hybrid/remote environment as a full-time Senior AI Engineer II. You’ll work with modern technologies including... ...experience with production-level ML/LLM systems Programming experience in Python, Go...SeniorFull timeRemote workFlexible hours
$114.4k - $128.96k
...Artificial Intelligence, Software Engineering, or a closely related... ...Artificial Intelligence and Generative AI solutions. We need 3 to 5... ...Gemini, Llama, or comparable LLM platforms. We require 3+... ...0 countries. This is a remote Senior AI/LLM Engineer role supporting...SeniorHourly payFull timeRemote workWorldwideFlexible hours- ...AMC Health is seeking a Senior Software Engineer for Applied AI (Voice Agents & ML Systems) to join a remote US team. You will work across real-time voice AI, LLM engineering, and traditional ML, delivering production-grade pipelines and instrumentation for healthcare...SeniorRemote work
- ...AMC Health is seeking a Senior Software Engineer: Applied AI (Voice Agents & ML Systems) to build real-time voice AI systems and end-to-end ML pipelines... ...setting. You will work across real-time voice, LLM engineering, traditional ML, and cloud infrastructure, shipping...SeniorRemote work
- ...AMC Health seeks a Senior Software Engineer: Applied AI to build real-time voice agents and ML pipelines in a regulated healthcare setting. You will own end-to-end backend systems, LLM integration, and cloud infrastructure, balancing latency, reliability, and safety....SeniorRemote work
- ...Coinbase is seeking a Senior Software Engineer for the AI Platform team to build and operate LLM and agent infrastructure used company-wide. You will own multi-quarter initiatives spanning gateway, runtime, knowledge bases, and governance, shaping how Coinbase scales...SeniorRemote work
- ...Coinbase seeks a Senior Software Engineer for the AI Platform to build and operate the LLM and agent infrastructure used across the company. You will own core platform systems, from the LLM Gateway to runtime sandboxes, and guide multi-quarter technical initiatives that...SeniorRemote work
- ...Coinbase is hiring a Senior Software Engineer for the AI Platform team. You will build and operate LLM and agent infrastructure used company-wide, shaping how Coinbase scales AI. You’ll lead end-to-end platform initiatives, from gateway and runtimes to knowledge bases...
- ...Coinbase, a remote-first company, seeks a Senior Software Engineer for the AI Platform team. You will build and operate the LLM and agent infrastructure used across Coinbase, enabling teams to scale AI responsibly and effectively. You’ll own core platform systems, design...SeniorRemote work
- ...Coinbase is seeking a Senior Software Engineer for the AI Platform team. You will build and operate the LLM and agent infrastructure powering Coinbase's AI initiatives, shaping how AI scales across the organization. You will lead multi-quarter projects across gateway...SeniorRemote work
$140k - $215k
Role Description CrowdStrike is looking for a Senior AI Infrastructure Engineer with expertise in Large Language Models (LLMs) Infrastructure and data... ...security products. This role requires hands-on experience in LLM infrastructure to support multiple large scale training...SeniorFull timeWork at office- ...Coinbase is seeking a Senior Software Engineer on the AI Platform team to build and operate LLM and agent infrastructure that powers the company. You will lead multi-quarter initiatives across gateway systems, knowledge bases, and production AI agents to scale AI across...SeniorRemote work
- ...Coinbase is seeking a Senior Software Engineer for the AI Platform to own and scale the LLM and agent infrastructure used across the company. The role focuses on building, deploying, and operating large-scale AI systems with governance and cost awareness. You will partner...SeniorRemote work
- ...Coinbase is seeking a Senior Software Engineer to join the AI Platform team. You will own the architecture of core platform systems, including the LLM Gateway and AI Hub, and lead initiatives across the full AI stack to scale the company's use of large language models...SeniorRemote work
$175k - $225k
...AI/LLM Systems Software Engineer Location: San Francisco, CA Work Type: In-person Employment: Full-time Experience Required: 2+ years Salary Range: $175,000 - $225,000 per year Visa Sponsorship: Not available The...Full time- ICON is seeking a pragmatic AI Software Engineer to design and ship AI-powered tools, workflows, and autonomous agents for its Government Technology team. The role is remote with periodic travel to ICON HQ in Austin, TX. You will own end-to-end AI feature development,...SeniorRemote job
$104k - $124.8k
...with large language models, including API integration, prompt engineering, fine-tuning or adaptation, and building applications with RAG... ...CloudFormation. Responsibilities: We design and implement agentic AI systems, including tool-calling agents that combine retrieval,...SeniorHourly payFull timeRemote work- ...Job Title AI-focused Senior Software Engineer (path to Staff Engineer) Job Description The Tight Embedded Accounting HQ is in Washington, DC... ...recently revamped (and debt-free) architecture focused on LLM use cases for the future of Agentic Accounting. We’re...SeniorFull timeWork at office
- ...Senior AI Engineer, Ares Platform Team: Ares AI Engineering Reports to: Ilir Osmanaj, VP of AI Engineering Location: Boston, MA (hybrid... ...systems, with at least 2 years working directly on LLMs or LLM-powered agents. ~ Deep Python; strong, production-grade...SeniorFull timeRemote work
- ...accelerate justice in communities around the world. Cellebrite’s AI-powered Digital Investigation Platform enables customers to lawfully... .... Experience with GenAI infrastructure, semantic caching, and LLM integration. Knowledge of observability tools like Datadog and...SeniorFull time
$160k - $195k
...SaaS company building practical AI-powered solutions that improve... .... We are expanding our engineering team to build the next generation... ...Role We are looking for a Senior Applied AI Engineer to help... ...infrastructure and frameworks for LLM-powered applications, enabling...SeniorRemote jobFull timeLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI/LLM Engineer. Be the first to apply!





