Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

LLM Engineer

Ova Technologies

Job Title:


LLM Engineer (Large Language Model Engineer)


Job Summary:


We are seeking a highly skilled LLM Engineer to design, develop, fine-tune, and deploy Large Language Model (LLM) based applications and AI-powered solutions. The ideal candidate will have expertise in Generative AI, Natural Language Processing (NLP), Prompt Engineering, Retrieval-Augmented Generation (RAG), and AI system architecture. This role involves building intelligent assistants, AI copilots, enterprise search platforms, and automation solutions using cutting-edge LLM technologies.


Key Responsibilities:

  • Design, develop, and deploy applications powered by Large Language Models (LLMs).
  • Build AI assistants, chatbots, knowledge management systems, and AI copilots.
  • Develop and optimize Prompt Engineering strategies to improve model responses.
  • Implement Retrieval-Augmented Generation (RAG) pipelines using vector databases.
  • Fine-tune open-source and proprietary LLMs for domain-specific use cases.
  • Integrate AI models with enterprise systems, APIs, databases, and cloud services.
  • Develop evaluation frameworks to measure model performance, accuracy, and reliability.
  • Implement guardrails, safety mechanisms, and hallucination mitigation techniques.
  • Collaborate with Data Scientists, AI Engineers, Product Managers, and MLOps teams.
  • Monitor, optimize, and maintain AI systems in production environments.
  • Research and evaluate emerging AI models, frameworks, and architectures.
  • Ensure compliance with Responsible AI, security, and governance standards.
Required Skills:
  • Strong understanding of Large Language Models (LLMs) and Generative AI concepts.
  • Experience with NLP, Transformer architectures, and AI model deployment.
  • Expertise in Prompt Engineering and Retrieval-Augmented Generation (RAG).
  • Knowledge of AI evaluation, model optimization, and inference strategies.
  • Strong problem-solving and system design skills.
  • Excellent communication and collaboration abilities.
Technical Skills:
  • Programming Languages: Python, SQL, JavaScript
  • LLM Platforms: OpenAI GPT, Claude, Gemini, Llama, Mistral, Cohere
  • AI Frameworks: LangChain, LlamaIndex, LangGraph, Haystack
  • Machine Learning Frameworks: PyTorch, TensorFlow, Hugging Face Transformers
  • Vector Databases: Pinecone, ChromaDB, Weaviate, Milvus, FAISS
  • Cloud Platforms: AWS, Azure, Google Cloud Platform (GCP)
  • APIs: REST APIs, GraphQL
  • MLOps Tools: MLflow, Kubeflow, Airflow
  • Containerization: Docker, Kubernetes
  • Version Control: Git, GitHub, GitLab
Qualifications:
  • Bachelor's degree in Computer Science, Artificial Intelligence, Machine Learning, Data Science, or a related field.
  • Master's degree in AI, Data Science, or Machine Learning is a plus.
  • Relevant AI and cloud certifications are preferred.
Experience:
  • 3-8 years of experience in AI Engineering, Machine Learning Engineering, NLP, or Software Development.
  • Hands-on experience building and deploying LLM-powered applications.
  • Experience with RAG architectures, vector databases, and AI orchestration frameworks.
  • Experience integrating AI services into enterprise applications.
Preferred Qualifications:
  • Experience with fine-tuning techniques such as LoRA, PEFT, RLHF, and QLoRA.
  • Knowledge of Agentic AI, Multi-Agent Systems, and Autonomous AI Workflows.
  • Experience with LangGraph, CrewAI, AutoGen, or Semantic Kernel.
  • Understanding of AI Security, Responsible AI, and Model Governance.
  • Experience deploying AI applications in cloud-native environments.
Preferred Qualities:
  • Strong innovation and research mindset.
  • Passion for AI, NLP, and emerging technologies.
  • Excellent troubleshooting and analytical skills.
  • Ability to rapidly learn and adapt to new AI frameworks.
  • Strong ownership and accountability for AI solution quality.
Employment Type:


Full-Time


Location:


Remote / Hybrid / On-site


Nice to Have:
  • Experience building AI copilots, enterprise search systems, and knowledge assistants.
  • Knowledge of multimodal AI models (text, image, audio, video).
  • Experience with AI observability and evaluation platforms such as LangSmith, Arize AI, or Weights & Biases.
  • Familiarity with enterprise SaaS, HR Tech, Healthcare, FinTech, E-commerce, or Customer Support AI solutions.
  • Contributions to open-source AI projects, research papers, AI communities, or hackathons.
Vacancy posted 19 hours ago
Similar jobs that could be interesting for youBased on the LLM Engineer in New York, NY vacancy
  • General Information Job Title ML Staff Engineer - LLM & Production Systems Job ID 107242 Work Areas Technology & Engineering Employment Type Permanent Full-Time Location(s) Boston, Chicago, Dallas, New York Description & Requirements... 
    Suggested
    Permanent employment
    Full time
    Work at office
    Local area
    1 day per week

    Bain & Company

    New York, NY
    2 days ago
  • Modal is building a comprehensive LLM serving platform with a focus on end-to-end inference research. You will work with the research...  ...scale. You will collaborate with customers and Forward Deployed Engineers to deploy and tune models, and you will push frontier techniques... 
    Suggested

    modal

    New York, NY
    4 days ago
  • $500 per month

     ...Angelo , Larry Summers , and Jack Dorsey . Position: Agent Engineer Type: Contract Compensation: $100–$500/hour Location: Remote Role Responsibilities Build and operate LLM agents in production environments. Evaluate agent performance... 
    Suggested
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    3 days ago
  • thecompany.com is seeking engineers to build and productionize AI systems that go beyond demos, including live traffic and real users. You...  ...Bedrock and Azure OpenAI. You'll design and deploy production-grade LLM apps, orchestrate agent frameworks like LangChain, LangGraph, or... 
    Suggested
    Remote job

    United States Digital Space LLC

    New York, NY
    2 days ago
  • $119k - $149k

     ...Pune, Dubai, Geneva, Singapore and São Paulo. The RoleAs a Field Engineer you will embed directly with clients to architect and build...  ...transformationsFamiliarity with AI/ML tools and experience implementing LLM-driven automation solutionsStrong understanding of financial... 
    Suggested
    H1b
    Remote work
    Worldwide
    Visa sponsorship
    Work visa
    Flexible hours

    Addepar

    New York, NY
    4 days ago
  • About the Role You'll be building an AI Supply Chain Manager from the ground up at a Y Combinator-backed AI/supply chain startup, owning LLM systems end-to-end-from early prototypes to production. This is a high-autonomy role where your work directly powers real-world... 
    Visa sponsorship

    Clera

    New York, NY
    3 days ago
  • Be an LLM Rockstar! Responsible AI Development at Dynamo AI (US) Do you dream of building safe and ethical AI for the real world? Join...  ...models (LLMs). (Learn more atdynamo.ai) Our team of Ph.D.s and engineers pushes the boundaries of AI research, with real-world impact.... 

    Stackruit Ltd.

    New York, NY
    19 hours ago
  • Bright Vision Technologies is seeking an LLM Engineer for a 100% remote role in the United States. You will design and operationalize fine-tuning workflows for large language models, collaborating with product, design, and engineering teams to deliver production-grade... 
    Remote job

    United States Digital Space LLC

    New York, NY
    1 day ago
  • Mercury in New York is seeking an experienced software engineer to evolve Command, Mercury's LLM-powered financial assistant. You will design and ship new skills for workflows like sending payments, managing invoices, and understanding cash flow, and own end-to-end capabilities... 

    Jobzhr

    New York, NY
    19 hours ago
  • TALENDICA, New York, US, is seeking MS Dynamics 365 Functional Resources with a focus on large language model (LLM) development and optimization for a remote contract role lasting 2-3 months. This opportunity targets professionals who can adapt quickly to evolving NLP workloads... 
    Remote job
    Contract work

    AIToolboard

    New York, NY
    1 day ago
  •  ...working collaboratively with development teams, and ensuring effective integration of AI tools. The role requires strong programming skills in Python and at least 3 years of QA engineering experience. This is a W2 contract position. #J-18808-Ljbffr Accord Technologies Inc
    Contract work

    Accord Technologies Inc

    New York, NY
    1 day ago
  • Modal Labs is building a platform that covers the entire life of an LLM—from training to deployment and observation. We seek a research‑leaning engineer with a systems background to own inference bets, optimize autoscaling, and ship ideas back into production. Work in... 

    Modal Labs

    New York, NY
    19 hours ago
  • Cohere is seeking a Senior Research Engineer, Model Evaluation, to create next‑generation evaluation methods and scalable infrastructure....  ...frontier model capabilities, and you will push the state‑of‑the‑art in LLM evaluation methods while building tools used across technical... 

    cohere

    New York, NY
    2 days ago
  • Clera is building an AI Supply Chain Manager from scratch, owning end-to-end LLM systems from prototypes to production. The role focuses on shipping production-grade LLM-powered agents that decide what to produce, where to make it, and how to move goods through factories... 

    Clera

    New York, NY
    3 days ago
  • Entendre is looking for a Member of Technical Staff - Applied AI based in New York to design and ship user-facing products that merge cutting-edge AI capabilities with dependable workflows. You will work across the stack to deliver solutions that are robust and intuitive...

    Entendre

    New York, NY
    4 days ago
  •  ...OPENINGS!Head of GTM Systems and EngineeringThe Head of GTM Systems & Engineering is the lead architect of the Revenue Operating System. Your...  ...required is automatically populated, formatted, and validated.LLM-Powered Data Synthesis: Engineer automated pipelines that use... 

    Three Pillars Recruiting

    New York, NY
    3 days ago
  •  ...healthcare startup in New York to build end-to-end ML systems for medical coding and revenue cycle workflows. We’re seeking a Founding AI Engineer to own core AI systems from data ingestion to production deployment. This hands-on role offers meaningful equity upside and a... 
    Work at office

    Recruiting from Scratch

    New York, NY
    19 hours ago
  • $165k - $260k

    Senior LLM Research Engineer - Artificial Intelligence Location New York Business Area Engineering and CTO Ref # 10049309 Description & Requirements Bloomberg’s Engineering AI department has 400+ AI practitioners building highly sought after products... 
    Temporary work
    For contractors
    Work experience placement

    Bloomberg

    New York, NY
    19 hours ago
  • $115k - $135k

     ...Innovation) Team. This position is a hands-on cloud and platform engineering role with a strong focus on AI-enabled platforms, GitHub-based...  ...improvement of AI-enabled platforms and large language model (LLM) services using Azure-native capabilities.Participate in the engineering... 
    Full time
    Work at office
    Remote work
    Relocation package
    Monday to Friday

    AlixPartners

    New York, NY
    3 days ago
  • $102.75k - $195.25k

     ...career by building integrations and knowledge bases that other engineering teams will depend on every day? Are you ready to work alongside...  ...databases, using embeddings and evaluation techniques to keep the LLM Wiki and AWS Bedrock-managed knowledge bases accurate and... 
    Work at office
    Local area
    Remote work
    Visa sponsorship

    Deloitte

    New York, NY
    2 days ago
  • Volga Partners is seeking a skilled Software Development Engineer to work on AI-powered applications in a fully remote capacity. You will develop production-grade systems, integrating large language models and backend services. In this role, you will be involved in API... 
    Remote job

    Volga Partners

    New York, NY
    19 hours ago
  • $116k - $182k

     ...WHAT YOU'LL DO We're looking for a Senior Lead Systems Engineer who's passionate about building the next generation of enterprise...  ...Bonus: Experience implementing AI agents, MCP integrations, LLM-powered workflows, or enterprise AI platforms Experience with... 
    Work at office
    Local area
    Flexible hours

    Braze

    New York, NY
    4 days ago
  • $200.8k - $251k

     ...a machine learning framework for large language models. Candidates should have system optimization experience and solid software engineering skills, particularly in tools like CUDA and Pytorch. This full-time position offers a competitive salary range of $200,800 - $251... 
    Full time

    Scale AI

    New York, NY
    1 day ago
  • $125k - $145k

     ...Resource Groups (ERGs)About the RoleWe're hiring an AI Automation Engineer to grow into one of the most interesting roles in our technology...  ...hackathons, or coursework. You've built something that uses an LLM and learned why it's harder than it looks.Practical AWS... 
    Full time
    Internship

    OUTFRONT Media

    New York, NY
    4 days ago
  •  ...Rippling will depend on. The team recently transitioned from Talent Engineering into the AI Cloud org under Laks Srini, and is now laser-...  ...evolves as the technology evolvesStrong curiosity around AI agents, LLM infrastructure, agentic workflows, automation systems, or... 
    Work at office
    3 days per week

    Rippling

    New York, NY
    1 day ago
  • $165k - $210k

     ...secure data shares. Within the Data Collaboration Group, our Engineering & Operations team builds the automation and platform...  ...libraries, services, testing, CI/CD, and code reviews  AI / LLM Engineering  ~ Hands-on experience building applications using... 
    Local area
    Remote work

    NBCUniversal

    New York, NY
    9 days ago
  • $140k - $215k

     ...alerts, and preventions on the platform.About the Role:As a sensor engineer within the Windows Content Development team, you will focus on...  ...and big data systems.Experience leveraging frontier AI/LLM technologies to accelerate developer velocity, increase feature... 
    Full time
    Work experience placement
    Work at office
    Local area
    2 days per week

    CrowdStrike

    New York, NY
    19 hours ago
  •  ...Fluidstack Production Engineering Team Examples of key exciting problems the team is working on: Make tens of thousands of GPUs...  ...systemic cause, and move on. You're fluent with AI tooling. LLM APIs, MCP servers, and agentic frameworks, and you drive Claude... 
    Local area

    Fluidstack

    New York, NY
    2 days ago
  • Ripple is seeking a Senior Staff Security Engineer focused on AI Security in New York. You will be the deepest technical expert at the intersection...  ...and AI-powered security tooling. You will design controls for LLM-integrated systems, own the AI security across the SDLC, and... 

    P2P

    New York, NY
    3 days ago
  • $120k - $160k

     ...their feedback and needs. ABOUT THE JOB Radar is hiring a Systems Engineer who will take end-to-end ownership of system-level inventory...  ...potential, not lack of weakness. Use of artificial intelligence or a LLM such as ChatGPT during the interview process will be grounds for... 
    Flexible hours

    RADAR

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to LLM Engineer. Be the first to apply!