Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

LLM Engineer

Ova Technologies

Job Title:


LLM Engineer (Large Language Model Engineer)


Job Summary:


We are seeking a highly skilled LLM Engineer to design, develop, fine-tune, and deploy Large Language Model (LLM) based applications and AI-powered solutions. The ideal candidate will have expertise in Generative AI, Natural Language Processing (NLP), Prompt Engineering, Retrieval-Augmented Generation (RAG), and AI system architecture. This role involves building intelligent assistants, AI copilots, enterprise search platforms, and automation solutions using cutting-edge LLM technologies.


Key Responsibilities:

  • Design, develop, and deploy applications powered by Large Language Models (LLMs).
  • Build AI assistants, chatbots, knowledge management systems, and AI copilots.
  • Develop and optimize Prompt Engineering strategies to improve model responses.
  • Implement Retrieval-Augmented Generation (RAG) pipelines using vector databases.
  • Fine-tune open-source and proprietary LLMs for domain-specific use cases.
  • Integrate AI models with enterprise systems, APIs, databases, and cloud services.
  • Develop evaluation frameworks to measure model performance, accuracy, and reliability.
  • Implement guardrails, safety mechanisms, and hallucination mitigation techniques.
  • Collaborate with Data Scientists, AI Engineers, Product Managers, and MLOps teams.
  • Monitor, optimize, and maintain AI systems in production environments.
  • Research and evaluate emerging AI models, frameworks, and architectures.
  • Ensure compliance with Responsible AI, security, and governance standards.
Required Skills:
  • Strong understanding of Large Language Models (LLMs) and Generative AI concepts.
  • Experience with NLP, Transformer architectures, and AI model deployment.
  • Expertise in Prompt Engineering and Retrieval-Augmented Generation (RAG).
  • Knowledge of AI evaluation, model optimization, and inference strategies.
  • Strong problem-solving and system design skills.
  • Excellent communication and collaboration abilities.
Technical Skills:
  • Programming Languages: Python, SQL, JavaScript
  • LLM Platforms: OpenAI GPT, Claude, Gemini, Llama, Mistral, Cohere
  • AI Frameworks: LangChain, LlamaIndex, LangGraph, Haystack
  • Machine Learning Frameworks: PyTorch, TensorFlow, Hugging Face Transformers
  • Vector Databases: Pinecone, ChromaDB, Weaviate, Milvus, FAISS
  • Cloud Platforms: AWS, Azure, Google Cloud Platform (GCP)
  • APIs: REST APIs, GraphQL
  • MLOps Tools: MLflow, Kubeflow, Airflow
  • Containerization: Docker, Kubernetes
  • Version Control: Git, GitHub, GitLab
Qualifications:
  • Bachelor's degree in Computer Science, Artificial Intelligence, Machine Learning, Data Science, or a related field.
  • Master's degree in AI, Data Science, or Machine Learning is a plus.
  • Relevant AI and cloud certifications are preferred.
Experience:
  • 3-8 years of experience in AI Engineering, Machine Learning Engineering, NLP, or Software Development.
  • Hands-on experience building and deploying LLM-powered applications.
  • Experience with RAG architectures, vector databases, and AI orchestration frameworks.
  • Experience integrating AI services into enterprise applications.
Preferred Qualifications:
  • Experience with fine-tuning techniques such as LoRA, PEFT, RLHF, and QLoRA.
  • Knowledge of Agentic AI, Multi-Agent Systems, and Autonomous AI Workflows.
  • Experience with LangGraph, CrewAI, AutoGen, or Semantic Kernel.
  • Understanding of AI Security, Responsible AI, and Model Governance.
  • Experience deploying AI applications in cloud-native environments.
Preferred Qualities:
  • Strong innovation and research mindset.
  • Passion for AI, NLP, and emerging technologies.
  • Excellent troubleshooting and analytical skills.
  • Ability to rapidly learn and adapt to new AI frameworks.
  • Strong ownership and accountability for AI solution quality.
Employment Type:


Full-Time


Location:


Remote / Hybrid / On-site


Nice to Have:
  • Experience building AI copilots, enterprise search systems, and knowledge assistants.
  • Knowledge of multimodal AI models (text, image, audio, video).
  • Experience with AI observability and evaluation platforms such as LangSmith, Arize AI, or Weights & Biases.
  • Familiarity with enterprise SaaS, HR Tech, Healthcare, FinTech, E-commerce, or Customer Support AI solutions.
  • Contributions to open-source AI projects, research papers, AI communities, or hackathons.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the LLM Engineer in New York, NY vacancy
  • $500 per month

     ...Angelo , Larry Summers , and Jack Dorsey . Position: Agent Engineer Type: Contract Compensation: $100–$500 per task...  ...Location: Remote Role Responsibilities Build and operate LLM agents in production environments. Evaluate agent... 
    Suggested
    Remote job
    Contract work
    Summer work

    Mercor

    New York, NY
    23 days ago
  •  ...Confluence pages, and turns them into insights and coaching for Sales Engineers. Its users are experts who will check its work, and its output...  .... What we are looking for You have shipped LLM-backed features to production and kept them working after launch... 
    Suggested

    seRevel

    New York, NY
    1 day ago
  • $152k - $241.5k

    We are looking for a passionate and energized engineer to accelerate the integration of APIs across the CUDA-X math library software stack into modern LLM and agentic AI workflows. Leading organizations globally are using GPU-powered data centers for AI, data analytics... 
    Suggested
    Full time
    Remote work

    Nvidia

    New York, NY
    16 hours ago
  • Entendre is looking for a Member of Technical Staff - Applied AI based in New York to design and ship user-facing products that merge cutting-edge AI capabilities with dependable workflows. You will work across the stack to deliver solutions that are robust and intuitive...
    Suggested

    Entendre

    New York, NY
    2 days ago
  •  ...Capital One is seeking an AI Engineer to join the IFX team in New York, building responsible and scalable AI systems that power real-time customer experiences. You will partner with engineers, researchers, PMs, and data scientists to design and deliver foundation-model... 
    Suggested

    Jobleads-US

    New York, NY
    2 days ago
  • $100k - $130k

     ...Partner with business stakeholders, application teams, and quality engineering organizations to define migration strategies and automation...  ...Retrieval-Augmented Generation (RAG) Large Language Model (LLM) Integrations Preferred Qualifications Experience migrating... 
    Full time
    Local area
    Immediate start

    Capgemini

    New York, NY
    3 days ago
  •  ...We are looking for an experienced Senior QA Engineer to own quality for our AI voice virtual agent. This role is for someone who is equally...  ...may be accented or noisy, interprets intent, reasons over an LLM, generates a spoken reply, and decides whether to resolve the... 
    Remote work

    Lever

    New York, NY
    3 days ago
  • $116k - $182k

     ...you. WHAT YOU'LL DO We're looking for a Senior Lead Systems Engineer who's passionate about building the next generation of...  ...Bonus: Experience implementing AI agents, MCP integrations, LLM-powered workflows, or enterprise AI platforms Experience with... 
    Work at office
    Local area
    Flexible hours

    Braze

    New York, NY
    3 days ago
  • $135k - $150k

     ...which makes everything possible.The Senior Data Platform Automation Engineer engineers the automation, developer experience, and reliability...  ...GitHub Actions or GitLab; strong Python skills. Hands-on with LLM/agent applications using Azure AI Foundry (Azure OpenAI, Prompt... 
    Full time
    Remote work
    Flexible hours

    Danaher Corporation

    New York, NY
    4 days ago
  • $170k - $230k

     ...Job Description Job Description Description: Applied AI Engineer | Production AI & LLM Systems | $170K-$230K + Equity Full-Time | Hybrid - Approximately 3 Days/Week In Office | New York, NY Dana Gudermuth Senior Recruiter | Heartline Staffing Call or... 
    Permanent employment
    Full time
    Work at office
    Relocation package
    3 days per week

    Purple Cow Recruiting

    New York, NY
    13 days ago
  • $172.5k - $313.7k

     ...systems and use cases.Making computer use dependable raises hard engineering questions. How does an agent know it succeeded? When should it...  ...or teams.You have hands-on experience shipping and operating LLM-powered systems, and can explain how evaluations and production... 
    Full time

    Salesforce

    New York, NY
    2 days ago
  •  ...The RoleWe're hiring a GTM Systems Engineer to build and own the systems layer behind Rogo's revenue engine. This is not a conventional...  ...HaveExperience building or extending MCP servers, agent frameworks, or LLM orchestration tooling.Production experience with iPaaS or... 
    Contract work
    Shift work

    Rogo AI

    New York, NY
    1 day ago
  • $150k - $170k

     ...authority on architecture decisions, integration patterns, and engineering best practices within the ORCA program. LOCATION This role is 1...  ...design (schema evolution, partitioning, storage optimization) AI/LLM integration (agent architectures, tool-calling patterns, multi-... 
    Remote work
    Relocation

    TRSS

    New York, NY
    3 days ago
  •  ...United States with Middlesex Paving earning an equally solid regional presence and reputation.  Position Summary: The Field Engineer in heavy civil construction plays a vital role in supporting project execution by managing on-site engineering functions, ensuring... 
    Contract work
    Temporary work
    For subcontractor
    Interim role

    The Middlesex Corporation

    New York, NY
    4 days ago
  • $125k - $140k

     ...A licensed Master Plumber and General Contractor serving NYC and Westchester is hiring a Commissioning Engineer to own startup and commissioning on its new mechanical installations, from pre-startup readiness through first fire and verified operation. Because the company... 
    For contractors
    Local area
    Remote work

    Cobalt Recruitment

    New York, NY
    16 hours ago
  • Software Engineer We are hiring a Software Engineer with a 'You Build It, You Run It' mentality to expand automation across the business...  ...one of the tools you'll reach for when it fits: RAG pipelines, LLM integrations, and prompt engineering where the problem genuinely... 
    Full time
    Local area
    Remote work
    Flexible hours

    Brook + Whittle

    New York, NY
    2 days ago
  • $170k - $180k

     ...Datavations delivers to our customers. We are looking for a senior engineer to own this domain end-to-end—driving both the data systems that...  .... WHAT YOU'LL OWN The attribute extraction engine — LLM-based extraction at production scale, its configuration model, its... 
    Work at office

    Datavations

    New York, NY
    2 days ago
  •  ...Job Description Job Description The Construction Project Engineer/Junior Project Manager plays a key role in managing mid-size commercial construction projects, supporting the Project Manager to ensure projects are completed on time, within budget, and to quality... 
    For contractors
    For subcontractor
    Work at office

    JCC Construction Corp.

    New York, NY
    13 days ago
  •  ...AI Automation Engineer - Job Description (JD) Job Title AI Automation Engineer Job Summary We are seeking an innovative AI Automation...  ...traditional machine learning models?How would you integrate an LLM into an existing web application?Explain REST API integration with... 

    Ova Technologies

    New York, NY
    4 days ago
  • $144k - $207k

     ...applying. We’re looking for an AI Automation and Integration Engineer to join our rapidly evolving IT & AI Workspace Technology team....  ...across Slack, Jira, Salesforce, GitHub, AWS‑based infrastructure, LLM providers (e.g., Claude), and internal APIs. Design agentic... 
    Work experience placement
    Summer holiday
    Live out
    Work at office
    Local area
    Flexible hours
    2 days per week

    SupportFinity

    New York, NY
    1 day ago
  • $160k - $300k

     ...Lead to own quality across our AI platform. This is a hands-on engineering role focused on building testing infrastructure, evaluation systems...  ...output quality. You’ll be responsible for everything from LLM evaluations and agent testing to Playwright automation, CI/CD... 
    Visa sponsorship
    Relocation package

    Storm3

    New York, NY
    1 day ago
  • $184k - $230k

     ...LinkedIn. The Role Ironclad is looking for a Director, GTM Engineering & Systems Architecture to build the agentic systems that will...  ...stacks. ~ A proven track record shipping production AI agents or LLM‑powered systems. Comfortable with agent frameworks and building... 
    Full time
    Contract work

    Jobleads-US

    New York, NY
    2 days ago
  •  ...seRevel is seeking an engineer to own the AI worker end to end, building prompts, tooling, and retrieval over POC notes, Slack, Jira, and Confluence. You will design evaluation harnesses and guardrails to ensure grounded, fast insights for Sales Engineers and leadership... 

    Jobleads-US

    New York, NY
    2 days ago
  • $85k - $105k

    OverviewAre you looking for a rewarding opportunity with significant career growth potential? Gilbane is seeking a Field Engineer I to join our team. In this role, you will gain hands-on experience across all aspects of project delivery, learning the responsibilities of... 
    Contract work
    For contractors
    Internship
    Work at office
    Flexible hours

    Gilbane Building Company

    New York, NY
    2 days ago
  • $140k - $180k

     ...secure data shares.  Within the Data Collaboration Group, our Engineering & Operations team builds the automation and platform...  ...libraries, services, testing, CI/CD, and code reviews   AI / LLM Engineering  Hands-on experience building applications using... 
    Full time
    Local area
    Remote work

    NBCUniversal

    New York, NY
    26 days ago
  •  ...service digital partner that combines Strategy, Experience & Design, Engineering and Managed Services. We build digital solutions that deliver...  ...audiences.PREFERRED QUALIFICATIONSExperience monitoring LLM or agent-based applications, including token usage, latency and... 

    Appnovation

    New York, NY
    4 days ago
  •  ...Back to jobs Director, AI Automation Engineering New York, NY, Atlanta, GA, or Remote, USA Apply Job Title: Director, AI Automation Engineer...  ...Frameworks - Create automated evaluation frameworks for LLM outputs: accuracy, safety, bias, and regression. - Implement RAG... 
    Full time
    Remote work

    Impiricus

    New York, NY
    14 days ago
  •  ...Job Description Job Description Employment Opportunity: Junior Project Engineer - Heavy Construction/ Demolition Location: New York City Company: Titan Industrial, General Contractor Position Type: Full-Time, On Site   About Us: Titan Industrial... 
    Full time
    For contractors
    For subcontractor
    Internship
    Work at office

    TItan Industrial Services

    New York, NY
    2 days ago
  • $175k - $300k

     ...multimodal agents that turn creative direction into edits, rendering engines that composite multiple layers of video and graphics, and...  ...agentic pipelines Deep understanding of transformers and modern LLM techniques Experience with fine-tuning, alignment, or post-... 
    Full time
    Local area
    Night shift

    Mirage

    New York, NY
    8 days ago
  • $100k - $125k

     ...Construction Office Engineer US-NY-New York Job ID: 2026-3411 # of Openings: 1 Category: REI LiRo-Hill Overview We are seeking a qualified Construction Office Engineer for MTA Projects (NICET Level III or IV) located in Manhattan, NY .... 
    For contractors
    Work at office

    The LiRo Group

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to LLM Engineer. Be the first to apply!