Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

LLM Engineer

Ova Technologies

LLM Engineer (Large Language Model Engineer)

We are seeking a highly skilled LLM Engineer to design, develop, fine-tune, and deploy Large Language Model (LLM) based applications and AI-powered solutions. The ideal candidate will have expertise in Generative AI, Natural Language Processing (NLP), Prompt Engineering, Retrieval-Augmented Generation (RAG), and AI system architecture. This role involves building intelligent assistants, AI copilots, enterprise search platforms, and automation solutions using cutting-edge LLM technologies.

Key Responsibilities:

  • Design, develop, and deploy applications powered by Large Language Models (LLMs).
  • Build AI assistants, chatbots, knowledge management systems, and AI copilots.
  • Develop and optimize Prompt Engineering strategies to improve model responses.
  • Implement Retrieval-Augmented Generation (RAG) pipelines using vector databases.
  • Fine-tune open-source and proprietary LLMs for domain-specific use cases.
  • Integrate AI models with enterprise systems, APIs, databases, and cloud services.
  • Develop evaluation frameworks to measure model performance, accuracy, and reliability.
  • Implement guardrails, safety mechanisms, and hallucination mitigation techniques.
  • Collaborate with Data Scientists, AI Engineers, Product Managers, and MLOps teams.
  • Monitor, optimize, and maintain AI systems in production environments.
  • Research and evaluate emerging AI models, frameworks, and architectures.
  • Ensure compliance with Responsible AI, security, and governance standards.

Required Skills:

  • Strong understanding of Large Language Models (LLMs) and Generative AI concepts.
  • Experience with NLP, Transformer architectures, and AI model deployment.
  • Expertise in Prompt Engineering and Retrieval-Augmented Generation (RAG).
  • Knowledge of AI evaluation, model optimization, and inference strategies.
  • Strong problem-solving and system design skills.
  • Excellent communication and collaboration abilities.

Technical Skills:

  • Programming Languages: Python, SQL, JavaScript
  • LLM Platforms: OpenAI GPT, Claude, Gemini, Llama, Mistral, Cohere
  • AI Frameworks: LangChain, llamaIndex, LangGraph, Haystack
  • Machine Learning Frameworks: PyTorch, TensorFlow, Hugging Face Transformers
  • Vector Databases: Pinecone, ChromaDB, Weaviate, Milvus, FAISS
  • Cloud Platforms: AWS, Azure, Google Cloud Platform (GCP)
  • APIs: REST APIs, GraphQL
  • MLOps Tools: MLflow, Kubeflow, Airflow
  • Containerization: Docker, Kubernetes
  • Version Control: Git, GitHub, GitLab

Qualifications:

  • Bachelor's degree in Computer Science, Artificial Intelligence, Machine Learning, Data Science, or a related field.
  • Master's degree in AI, Data Science, or Machine Learning is a plus.
  • Relevant AI and cloud certifications are preferred.

Experience:

  • 3–8 years of experience in AI Engineering, Machine Learning Engineering, NLP, or Software Development.
  • Hands-on experience building and deploying LLM-powered applications.
  • Experience with RAG architectures, vector databases, and AI orchestration frameworks.
  • Experience integrating AI services into enterprise applications.

Preferred Qualifications:

  • Experience with fine-tuning techniques such as LoRA, PEFT, RLHF, and QLoRA.
  • Knowledge of Agentic AI, Multi-Agent Systems, and Autonomous AI Workflows.
  • Experience with LangGraph, CrewAI, AutoGen, or Semantic Kernel.
  • Understanding of AI Security, Responsible AI, and Model Governance.
  • Experience deploying AI applications in cloud-native environments.

Preferred Qualities:

  • Strong innovation and research mindset.
  • Passion for AI, NLP, and emerging technologies.
  • Excellent troubleshooting and analytical skills.
  • Ability to rapidly learn and adapt to new AI frameworks.
  • Strong ownership and accountability for AI solution quality.

Employment Type:

Full-Time

Location:

Remote / Hybrid / On-site

Nice to Have:

  • Experience building AI copilots, enterprise search systems, and knowledge assistants.
  • Knowledge of multimodal AI models (text, image, audio, video).
  • Experience with AI observability and evaluation platforms such as LangSmith, Arize AI, or Weights & Biases.
  • Familiarity with enterprise SaaS, HR Tech, Healthcare, FinTech, E-commerce, or Customer Support AI solutions.
  • Contributions to open-source AI projects, research papers, AI communities, or hackathons.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the LLM Engineer in New York, NY vacancy
  • $180k - $220k

     ...and Citi Ventures. The Role In this role, you'll own the core LLM infrastructure powering two products redefining B2B research: Hub...  ...user needs into technical solutions while maintaining engineering best practices Nice to Have RAG systems, embeddings, semantic search... 
    Suggested
    Immediate start
    Remote work
    Flexible hours

    NewtonX

    New York, NY
    4 days ago
  •  ...prioritizes human value. About the Role We’re seeking Software Engineers to develop scalable systems that integrate large language models...  ...JSON schemas, function calling, etc.) to ensure robust, correct LLM outputs Collaborate with Ops and R&D to identify high‑impact automation... 
    Suggested
    Full time
    Part time
    For contractors
    Flexible hours

    Basis Research Institute

    New York, NY
    2 days ago
  • $65 - $80 per hour

    A renowned AI collaboration firm is seeking LLM Mechanical Engineers for a short-term remote project. The role involves using mechanical design expertise to improve AI models, with responsibilities including solving manufacturing scenarios and collaborating with AI researchers... 
    Suggested
    Remote job
    Hourly pay
    Contract work
    Temporary work
    Flexible hours

    Crossing Hurdles

    New York, NY
    2 days ago
  • A leading AI consulting firm is seeking a Software Engineer to build, deploy, and operate production LLM-powered applications. This role requires strong software engineering skills with a focus on AI-driven features. Ideal candidates should have 3+ years of experience,... 
    Suggested
    Remote job
    Full time

    Click2.ai

    New York, NY
    2 days ago
  • A tech solutions company in New York seeks an Associate Data & AI Engineer to build and scale data and AI infrastructure. This role focuses on deploying LLM-powered agents to automate workflows. The ideal candidate has a Bachelor's degree and 0-2 years of experience in... 
    Suggested

    Career Techniques

    New York, NY
    2 days ago
  • $100k - $200k

    Blockchain Capital is looking for a Senior LLM Systems Engineer to enhance its LLM-driven oracle automation stack. This role emphasizes accuracy, performance, and operational quality of production systems using LLMs for various prediction market rules. The successful candidate... 
    Remote job

    blockchaincapital.com

    New York, NY
    4 days ago
  • The Consensus is seeking early-career Software Engineers to innovate in performance benchmarking and LLM engineering. This role provides the chance to work at the intersection of hardware and software, focusing on systems that drive AI capabilities. Ideal candidates are... 

    The Consensus

    New York, NY
    4 days ago
  • $100k - $200k

    MoneyLion is seeking a Senior LLM Systems Engineer to enhance LLM-driven components for oracle automation. This production role focuses on improving accuracy and resilience of systems that manage prediction market rules. Required experience includes 3+ years in Python... 
    Remote job

    MoneyLion

    New York, NY
    1 day ago
  • A leading staffing agency is seeking an AI Engineer to join a rapidly growing AI team. The role focuses on building and deploying generative...  ...applications. Ideal candidates will have strong experience with LLM frameworks and prompt engineering, along with excellent... 
    Remote job
    Full time

    Prestige Staffing

    New York, NY
    2 days ago
  • $175k - $200k

    Iovance Biotherapeutics seeks a senior engineer to design and deploy AI systems focused on operational productivity. Ideal candidates will...  ...of experience in software/AI engineering, including designing LLM-based applications. The role involves working with cross-disciplinary... 

    Iovance Biotherapeutics

    New York, NY
    3 days ago
  •  ...focuses on building AI systems, production ML, and collaborating with engineering teams. Ideal candidates have over 5 years of experience in software development, especially with Python, and knowledge of LLM capabilities. This position offers a competitive salary reflecting... 
    Remote job

    NTT DATA North America

    New York, NY
    2 days ago
  • Role Overview NeuralCraft AI is building the next generation of enterprise AI products and we need a Prompt Engineer & LLM Systems Designer who can sit at the intersection of language, logic, and product. You won't be training models; you'll be crafting the instruction... 

    ti Steps

    New York, NY
    4 days ago
  • Theadvertisingclub is seeking an LLM Developer to design, build, and optimize large language model systems that power innovative AI interview tools. You will work on production-grade features that enhance user performance in high-pressure interviews and meetings. Join a... 
    Remote job
    Flexible hours

    Theadvertisingclub

    New York, NY
    3 days ago
  • Tata Consultancy Services Limited is looking for a skilled AI/LLM Engineer in New York, NY to design and build intelligent agent-based systems. The candidate will develop systems that reason, plan, and act autonomously using frameworks like LangChain. Key responsibilities... 

    Tata Consultancy Services Limited

    New York, NY
    3 days ago
  • $100k - $150k

    Bright Vision Technologies is seeking an LLM Fine-Tuning Engineer to design and execute fine-tuning workflows for large language models. This remote position requires 6+ years of experience and strong proficiency in Python and ML frameworks, especially PyTorch. The role... 
    Remote job

    Bright Vision Technologies

    New York, NY
    4 days ago
  • $180k - $240k

    A leading AI company seeks a Senior Software Engineer to join their LLM team. This person will build and maintain the LLM gateway service that connects customers to multiple LLM providers. Responsibilities include working closely with the customer success team to understand... 
    Remote job

    AssemblyAI

    New York, NY
    1 day ago
  • A nonprofit applied AI research organization is seeking Software Engineers to develop scalable systems that integrate large language models with operational workflows. The role involves designing and deploying automated pipelines and collaborating with teams to streamline... 
    Part time
    For contractors
    Flexible hours

    Basis Research Institute

    New York, NY
    2 days ago
  • Nutrient GmbH is seeking a Workflow Automation Engineer to transform customer processes into elegant solutions. In this role, you'll combine technical skills with customer interaction to deliver workflow automation solutions on the Nutrient platform. Your responsibilities... 
    Remote job

    Nutrient GmbH

    New York, NY
    2 days ago
  • Basis-Research-Institute in New York is seeking Software Engineers to develop scalable systems that integrate large language models with various operational workflows. In this role, you will design and deploy automated pipelines for tasks involving technology such as GPT... 
    Full time
    Part time

    Basis-Research-Institute

    New York, NY
    3 days ago
  • Propio is seeking an AI/LLM Safety Engineer to ensure that AI models operate safely in production. The role involves designing safety evaluations, leading red-teaming exercises, and building guardrails. Ideal candidates will have a degree in a relevant field and 4+ years... 

    Propio

    New York, NY
    2 days ago
  • $140k - $145k

     ...developing, designing, and presenting analytics Knowledge of software engineering leading practice, including version control and testing...  ...Collaborate with cross-functional teams to integrate fine-tuned LLM solutions into products and services Stay up-to-date with the latest... 
    Full time
    For contractors
    Work experience placement
    Work at office
    Remote work

    GlobalLogic

    New York, NY
    2 days ago
  • Hello. We are Nagarro, a digital product engineering company scaling in a big way. We build products, services, and experiences that inspire...  ...You will join an existing development team to build and ship LLM‑powered features in a complex, large‑scale production application... 
    Worldwide

    Nagarro

    New York, NY
    2 days ago
  •  ...and information integrity. Our team comes from high‑performing engineering cultures, including Meta, Perplexity, AWS, Affim, and leading...  ...create societal impact Qualifications 3+ YOE in Python 1+ YOE in LLM framework like Langchain or LlamaIndex 1+ YOE with agentic or... 

    GPTZero

    New York, NY
    2 days ago
  • Covasant Technologies is seeking an AI Engineer I to join our team in Hyderabad. This full-time role involves supporting the development and maintenance of AI-powered solutions while collaborating with various teams to enhance workflow automation initiatives. The ideal... 
    Full time

    Covasant Technologies

    New York, NY
    4 days ago
  •  ...working collaboratively with development teams, and ensuring effective integration of AI tools. The role requires strong programming skills in Python and at least 3 years of QA engineering experience. This is a W2 contract position. #J-18808-Ljbffr Accord Technologies Inc
    Contract work

    Accord Technologies Inc

    New York, NY
    3 days ago
  •  ...expert to design and implement advanced AI QA agents. This position calls for someone with extensive experience in AI/ML and QA engineering. The ideal candidate will be involved in automating QA processes and improving efficiency, working at a leading firm in digital transformation... 

    Synechron

    New York, NY
    2 days ago
  • $100k - $140k

    CFC- Chatham Financial Corporation is looking for a Full Stack Engineer to join their Technology Engagements team in New York. This role...  ...for both external clients and internal applications, utilizing LLM-powered tools daily. The ideal candidate should possess over 5 years... 

    CFC- Chatham Financial Corporation

    New York, NY
    2 days ago
  • $95k - $149k

     ...Field Engineer New York, NY Who We Are Addepar is a global data and AI platform empowering investment professionals to turn complex...  ...Familiarity with AI/ML tools and experience implementing LLM-driven automation solutions Strong understanding of financial... 
    H1b
    Remote work
    Worldwide
    Visa sponsorship
    Work visa
    Flexible hours

    Addepar

    New York, NY
    2 days ago
  • Nagarro is seeking a full-stack engineer to join their development team, focusing on building LLM-powered features in a complex production application. This role is hands-on and involves leveraging AI coding tools to optimize workflows and deliver solutions across various... 

    Nagarro

    New York, NY
    2 days ago
  •  ...candidate will have a strong background in system optimization and experience with distributed ML systems, along with excellent software engineering skills. Scale offers competitive salaries along with comprehensive benefits including health, dental, and retirement plans. #J-1... 

    Scale AI, Inc.

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to LLM Engineer. Be the first to apply!