Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

LLM Engineer

Ova Technologies

Job Title:


LLM Engineer (Large Language Model Engineer)


Job Summary:


We are seeking a highly skilled LLM Engineer to design, develop, fine-tune, and deploy Large Language Model (LLM) based applications and AI-powered solutions. The ideal candidate will have expertise in Generative AI, Natural Language Processing (NLP), Prompt Engineering, Retrieval-Augmented Generation (RAG), and AI system architecture. This role involves building intelligent assistants, AI copilots, enterprise search platforms, and automation solutions using cutting-edge LLM technologies.


Key Responsibilities:

  • Design, develop, and deploy applications powered by Large Language Models (LLMs).
  • Build AI assistants, chatbots, knowledge management systems, and AI copilots.
  • Develop and optimize Prompt Engineering strategies to improve model responses.
  • Implement Retrieval-Augmented Generation (RAG) pipelines using vector databases.
  • Fine-tune open-source and proprietary LLMs for domain-specific use cases.
  • Integrate AI models with enterprise systems, APIs, databases, and cloud services.
  • Develop evaluation frameworks to measure model performance, accuracy, and reliability.
  • Implement guardrails, safety mechanisms, and hallucination mitigation techniques.
  • Collaborate with Data Scientists, AI Engineers, Product Managers, and MLOps teams.
  • Monitor, optimize, and maintain AI systems in production environments.
  • Research and evaluate emerging AI models, frameworks, and architectures.
  • Ensure compliance with Responsible AI, security, and governance standards.
Required Skills:
  • Strong understanding of Large Language Models (LLMs) and Generative AI concepts.
  • Experience with NLP, Transformer architectures, and AI model deployment.
  • Expertise in Prompt Engineering and Retrieval-Augmented Generation (RAG).
  • Knowledge of AI evaluation, model optimization, and inference strategies.
  • Strong problem-solving and system design skills.
  • Excellent communication and collaboration abilities.
Technical Skills:
  • Programming Languages: Python, SQL, JavaScript
  • LLM Platforms: OpenAI GPT, Claude, Gemini, Llama, Mistral, Cohere
  • AI Frameworks: LangChain, LlamaIndex, LangGraph, Haystack
  • Machine Learning Frameworks: PyTorch, TensorFlow, Hugging Face Transformers
  • Vector Databases: Pinecone, ChromaDB, Weaviate, Milvus, FAISS
  • Cloud Platforms: AWS, Azure, Google Cloud Platform (GCP)
  • APIs: REST APIs, GraphQL
  • MLOps Tools: MLflow, Kubeflow, Airflow
  • Containerization: Docker, Kubernetes
  • Version Control: Git, GitHub, GitLab
Qualifications:
  • Bachelor's degree in Computer Science, Artificial Intelligence, Machine Learning, Data Science, or a related field.
  • Master's degree in AI, Data Science, or Machine Learning is a plus.
  • Relevant AI and cloud certifications are preferred.
Experience:
  • 3-8 years of experience in AI Engineering, Machine Learning Engineering, NLP, or Software Development.
  • Hands-on experience building and deploying LLM-powered applications.
  • Experience with RAG architectures, vector databases, and AI orchestration frameworks.
  • Experience integrating AI services into enterprise applications.
Preferred Qualifications:
  • Experience with fine-tuning techniques such as LoRA, PEFT, RLHF, and QLoRA.
  • Knowledge of Agentic AI, Multi-Agent Systems, and Autonomous AI Workflows.
  • Experience with LangGraph, CrewAI, AutoGen, or Semantic Kernel.
  • Understanding of AI Security, Responsible AI, and Model Governance.
  • Experience deploying AI applications in cloud-native environments.
Preferred Qualities:
  • Strong innovation and research mindset.
  • Passion for AI, NLP, and emerging technologies.
  • Excellent troubleshooting and analytical skills.
  • Ability to rapidly learn and adapt to new AI frameworks.
  • Strong ownership and accountability for AI solution quality.
Employment Type:


Full-Time


Location:


Remote / Hybrid / On-site


Nice to Have:
  • Experience building AI copilots, enterprise search systems, and knowledge assistants.
  • Knowledge of multimodal AI models (text, image, audio, video).
  • Experience with AI observability and evaluation platforms such as LangSmith, Arize AI, or Weights & Biases.
  • Familiarity with enterprise SaaS, HR Tech, Healthcare, FinTech, E-commerce, or Customer Support AI solutions.
  • Contributions to open-source AI projects, research papers, AI communities, or hackathons.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the LLM Engineer in New York, NY vacancy
  • BNB Chain is looking for an AI Operator to build LLM-driven tools and workflows. You will design AI workflows that automate complex...  ...of features. The ideal candidate has 1-2+ years in software engineering, with expertise in AI/LLM applications and a solid understanding... 
    Suggested
    Remote job

    BNB Chain

    New York, NY
    3 days ago
  •  ...Tradeweb Markets seeks an experienced AI/LLM Product Engineer to design and build intelligent, language-driven systems that translate user intent into structured execution workflows. This role sits at the intersection of large language models, data science, and electronic... 
    Suggested

    Tradeweb Markets

    New York, NY
    1 day ago
  •  ...focuses on building AI systems, production ML, and collaborating with engineering teams. Ideal candidates have over 5 years of experience in software development, especially with Python, and knowledge of LLM capabilities. This position offers a competitive salary reflecting... 
    Suggested
    Remote work

    NTT DATA North America

    New York, NY
    4 days ago
  •  ...information integrity. Our team comes from high-performing engineering cultures, including Meta, Perplexity, AWS, Affirm, and leading...  ...impact Qualifications ~3+ YOE in Python ~1+ YOE in LLM framework like Langchain or LlamaIndex ~1+ YOE with agentic or... 
    Suggested

    GPTZero

    New York, NY
    4 days ago
  • Entendre is looking for a Member of Technical Staff - Applied AI based in New York to design and ship user-facing products that merge cutting-edge AI capabilities with dependable workflows. You will work across the stack to deliver solutions that are robust and intuitive...
    Suggested

    Entendre

    New York, NY
    1 day ago
  •  ...Decagon Systems Engineer Decagon is the leading conversational AI platform empowering every brand to deliver concierge customer experiences...  ...replacing every repetitive touchpoint with scripts, agents, or LLM-powered flows. Your Background Looks Something Like This... 
    Full time
    Work at office
    Local area

    Decagon

    New York, NY
    2 days ago
  • $170k - $190k

     ...impact. Role Overview We are looking for a Senior QA Automation Engineer to establish and scale quality engineering across Duetti. This is...  ...testing is a plus. Experience with AI‑powered applications, LLM evaluation frameworks, or agent‑based systems is a plus. Communication... 
    Immediate start
    Flexible hours

    Duetti

    New York, NY
    20 hours ago
  •  ...Job Description Job Description HVAC Specialist / Building Engineer (Commercial – Non-Union) We are seeking a highly skilled HVAC Specialist / Building Engineer to join the operations team at a premier Class A commercial office property. This is a non-union position... 
    Work at office

    Trandon Associates, Inc

    New York, NY
    a month ago
  • $240k

     ...defense layer for the AI age and are looking for an exceptional ML engineer to stabilize the system that turns raw signal into decisions —...  ...across APIs, pipelines, and data storage ~ Deployed ML / LLM systems in production and improved them via feedback loops ~ Strong... 
    Full time
    Flexible hours

    Sweep360

    New York, NY
    19 hours ago
  • $281.2k - $401.71k

     ...and systems. As part of this shift, we’re creating a shared Agent Engine that powers agent-based experiences across Spotify. You’ll join...  ...You have experience with areas such as agent orchestration, LLM infrastructure, evaluation systems, or data pipelines for machine... 
    Remote job
    Full time
    Flexible hours
    Shift work

    Spotify

    New York, NY
    19 hours ago
  • $120k - $160k

     ...their feedback and needs. ABOUT THE JOB Radar is hiring a Systems Engineer who will take end-to-end ownership of system-level inventory...  ...potential, not lack of weakness. Use of artificial intelligence or a LLM such as ChatGPT during the interview process will be grounds for... 
    Flexible hours

    RADAR

    New York, NY
    4 days ago
  •  ...Job Description Job Description Employment Opportunity: Junior Project Engineer - Heavy Construction/ Demolition Location: New York City Company: Titan Industrial, General Contractor Position Type: Full-Time, On Site   About Us: Titan Industrial... 
    Full time
    For contractors
    For subcontractor
    Internship
    Work at office

    TItan Industrial Services

    New York, NY
    21 days ago
  •  ...mission to democratize AI. Leveraging proprietary AI Studio and AI Engines, the company helps drive the clients’ AI Enterprise...  ...using Python, automation tools (n8n/Make/Zapier or similar), and LLM platforms/APIs (e.g., OpenAI, IBM watsonx.ai, Amazon Bedrock), plus... 
    Full time
    Local area
    Worldwide

    Fusemachines

    New York, NY
    19 hours ago
  • $203k - $305k

     ...leave a positive mark on culture. Summary The Principal Production Engineer is the senior technical authority for the Integration Team’s...  ...interface improvements. Preferred Production experience with AI/ML or LLM‑based tools, including eval/quality loops and safety... 
    Contract work

    Paramount

    New York, NY
    1 day ago
  • $125k - $145k

     ...Resource Groups (ERGs) About the Role We’re hiring an AI Automation Engineer to grow into one of the most interesting roles in our technology...  ...hackathons, or coursework. You’ve built something that uses an LLM and learned why it’s harder than it looks. Practical AWS... 
    Internship

    OUTFRONT Media

    New York, NY
    1 day ago
  •  ...commercial, residential, institutional, and infrastructure projects. We are seeking an organized, motivated, and driven Project Engineer to join our growing operations team. This position offers an excellent opportunity to gain hands on experience in construction... 
    For contractors
    For subcontractor
    Work at office

    Exterior Wall & Building Consultants

    New York, NY
    27 days ago
  •  ...TEC Systems seeks a Building Automation, Control System Design Engineer to support HVAC and BAS/BMS projects from our LIC or Central NJ offices. You will review plans, develop delivery schedules, design DDC/BAS control panels, and specify components. You will document... 

    TEC Systems, Inc.

    New York, NY
    1 day ago
  •  ...and backend data pipelines. We are looking for a QA Automation Engineer with strong API and UI automation skills, data testing aptitude,...  ...for writing and refactoring test code Hands‑on familiarity with LLM‑based tools (ChatGPT, Claude, Gemini) for test case generation,... 
    Part time
    Work at office
    Remote work
    Work from home
    Flexible hours
    Shift work

    Curinos

    New York, NY
    1 day ago
  • $75k - $90k

     ..., installed, and functionally tested to meet the clients requirements and design intent. For this position of Commissioning Field Engineer II an excellent salary and benefits package is offered. About the Job A Field Engineer II reports directly to his or her Team Leader... 
    Work at office

    ROLE

    New York, NY
    1 day ago
  • $140k - $160k

     ...architecture, and CI/CD infrastructure, and scale a lean team of QA engineers to deliver quality across multiple products and platforms (...  ...Evaluate, implement, and scale AI‑driven testing platforms and LLM‑assisted workflows (e.g., autonomous API testing, self‑healing UI... 
    Remote work
    Home office

    Reveal Technology LLC

    New York, NY
    1 day ago
  • $240k - $280k

     ...'strike team' that delivers the changes. This is a role for an engineer who is equally comfortable in a high-level design session as they...  ...group leading the charge in architecting the agentic workflows and LLM-assisted systems that will allow us to deliver features at 10x... 
    Full time
    Work at office
    Work from home
    Worldwide
    Flexible hours

    Soundcloud

    New York, NY
    19 hours ago
  • $130k - $175k

     ...Thank you for your interest in Uncountable Engineering! Description Uncountable is seeking experienced engineers to lead the transformation...  ...companies to accelerate discovery through Generative AI. As an LLM Applications Engineer, you will be the architect of our LLM... 

    Uncountable Inc

    New York, NY
    4 days ago
  • $164k - $205k

     ...intelligent alerting and observability systems Collaborate with engineering teams to embed reliability into the development lifecycle,...  ...about AI tooling: you're already using copilots, AI assistants, or LLM-based tools in your workflow and are excited to push your skillset... 
    Work experience placement
    Summer holiday
    Work at office
    Local area
    Flexible hours
    Shift work
    2 days per week

    BetterUp

    New York, NY
    1 day ago
  • $197.3k - $225.1k

    Lead AI Engineer (AI Foundations, LLM Customization and Finetuning) Overview At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning... 
    Full time
    Part time
    Local area

    Capital One Financial Corporation

    New York, NY
    19 hours ago
  •  ...Job Description Job Description The Lead Electrical Designer (or Engineer*) is a senior member & manager of the project team, working under the direct supervision of the Trade Design Manager (or Senior Engineer*) to lead and manage project teams & design initiatives... 
    Work at office

    MG Engineering D.P.C.

    New York, NY
    8 days ago
  • $229.9k - $262.4k

     ...Senior Manager, AI Engineering (People Leader) (Gen AI Platform Services) Overview At Capital One, we are creating responsible and reliable...  ..., PyTorch, and more. Invent and introduce state‑of‑the‑art LLM optimization techniques to improve the performance — scalability... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    2 days ago
  •  ...to moderately complex aspects of a project. May provide guidance and/or share knowledge of all aspects of the role with Controls Engineer I. All other duties as assigned by Supervisor. Knowledge, Skills and Abilities Preferred Associate’s degree and/or technical school... 
    Work experience placement
    Work at office
    Night shift

    Hy-Tek Intralogistics

    New York, NY
    2 days ago
  •  ...as the platform evolves. We’re looking for a Developer Relations Engineer to join our Developer Success team and lead high-quality video...  ...emphasize your thought leadership when the author is an AI agent or LLM. You'll learn about our team and we'll learn about you to see... 
    Permanent employment
    Work at office
    Flexible hours

    EXPO

    New York, NY
    2 days ago
  • $120k - $130k

     ...Job Description Must Have Technical/Functional Skills. We are looking for a highly skilled AI/LLM Engineer to design and build intelligent agent-based systems that can reason, plan, and act autonomously. The role requires strong Python engineering expertise and hands‑... 

    Tata Consultancy Services

    New York, NY
    2 days ago
  • $80.7k - $103.2k

     ...improves existing procedures and documents · Analyzes data and reports results with management and staff · Collaborates with design engineers, operation engineers, purchasers, and other internal staff · Provides technical/troubleshooting support for both mechanical and... 

    Advanced Technology Services

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to LLM Engineer. Be the first to apply!