LLM Engineer
Ova Technologies
Job Title:
LLM Engineer (Large Language Model Engineer)
Job Summary:
We are seeking a highly skilled LLM Engineer to design, develop, fine-tune, and deploy Large Language Model (LLM) based applications and AI-powered solutions. The ideal candidate will have expertise in Generative AI, Natural Language Processing (NLP), Prompt Engineering, Retrieval-Augmented Generation (RAG), and AI system architecture. This role involves building intelligent assistants, AI copilots, enterprise search platforms, and automation solutions using cutting-edge LLM technologies.
Key Responsibilities:
Full-Time
Location:
Remote / Hybrid / On-site
Nice to Have:
LLM Engineer (Large Language Model Engineer)
Job Summary:
We are seeking a highly skilled LLM Engineer to design, develop, fine-tune, and deploy Large Language Model (LLM) based applications and AI-powered solutions. The ideal candidate will have expertise in Generative AI, Natural Language Processing (NLP), Prompt Engineering, Retrieval-Augmented Generation (RAG), and AI system architecture. This role involves building intelligent assistants, AI copilots, enterprise search platforms, and automation solutions using cutting-edge LLM technologies.
Key Responsibilities:
- Design, develop, and deploy applications powered by Large Language Models (LLMs).
- Build AI assistants, chatbots, knowledge management systems, and AI copilots.
- Develop and optimize Prompt Engineering strategies to improve model responses.
- Implement Retrieval-Augmented Generation (RAG) pipelines using vector databases.
- Fine-tune open-source and proprietary LLMs for domain-specific use cases.
- Integrate AI models with enterprise systems, APIs, databases, and cloud services.
- Develop evaluation frameworks to measure model performance, accuracy, and reliability.
- Implement guardrails, safety mechanisms, and hallucination mitigation techniques.
- Collaborate with Data Scientists, AI Engineers, Product Managers, and MLOps teams.
- Monitor, optimize, and maintain AI systems in production environments.
- Research and evaluate emerging AI models, frameworks, and architectures.
- Ensure compliance with Responsible AI, security, and governance standards.
- Strong understanding of Large Language Models (LLMs) and Generative AI concepts.
- Experience with NLP, Transformer architectures, and AI model deployment.
- Expertise in Prompt Engineering and Retrieval-Augmented Generation (RAG).
- Knowledge of AI evaluation, model optimization, and inference strategies.
- Strong problem-solving and system design skills.
- Excellent communication and collaboration abilities.
- Programming Languages: Python, SQL, JavaScript
- LLM Platforms: OpenAI GPT, Claude, Gemini, Llama, Mistral, Cohere
- AI Frameworks: LangChain, LlamaIndex, LangGraph, Haystack
- Machine Learning Frameworks: PyTorch, TensorFlow, Hugging Face Transformers
- Vector Databases: Pinecone, ChromaDB, Weaviate, Milvus, FAISS
- Cloud Platforms: AWS, Azure, Google Cloud Platform (GCP)
- APIs: REST APIs, GraphQL
- MLOps Tools: MLflow, Kubeflow, Airflow
- Containerization: Docker, Kubernetes
- Version Control: Git, GitHub, GitLab
- Bachelor's degree in Computer Science, Artificial Intelligence, Machine Learning, Data Science, or a related field.
- Master's degree in AI, Data Science, or Machine Learning is a plus.
- Relevant AI and cloud certifications are preferred.
- 3-8 years of experience in AI Engineering, Machine Learning Engineering, NLP, or Software Development.
- Hands-on experience building and deploying LLM-powered applications.
- Experience with RAG architectures, vector databases, and AI orchestration frameworks.
- Experience integrating AI services into enterprise applications.
- Experience with fine-tuning techniques such as LoRA, PEFT, RLHF, and QLoRA.
- Knowledge of Agentic AI, Multi-Agent Systems, and Autonomous AI Workflows.
- Experience with LangGraph, CrewAI, AutoGen, or Semantic Kernel.
- Understanding of AI Security, Responsible AI, and Model Governance.
- Experience deploying AI applications in cloud-native environments.
- Strong innovation and research mindset.
- Passion for AI, NLP, and emerging technologies.
- Excellent troubleshooting and analytical skills.
- Ability to rapidly learn and adapt to new AI frameworks.
- Strong ownership and accountability for AI solution quality.
Full-Time
Location:
Remote / Hybrid / On-site
Nice to Have:
- Experience building AI copilots, enterprise search systems, and knowledge assistants.
- Knowledge of multimodal AI models (text, image, audio, video).
- Experience with AI observability and evaluation platforms such as LangSmith, Arize AI, or Weights & Biases.
- Familiarity with enterprise SaaS, HR Tech, Healthcare, FinTech, E-commerce, or Customer Support AI solutions.
- Contributions to open-source AI projects, research papers, AI communities, or hackathons.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the LLM Engineer in New York, NY vacancy
$500 per month
...Angelo , Larry Summers , and Jack Dorsey . Position: Agent Engineer Type: Contract Compensation: $100–$500 per task... ...Location: Remote Role Responsibilities Build and operate LLM agents in production environments. Evaluate agent...SuggestedRemote jobContract workSummer work- ...Confluence pages, and turns them into insights and coaching for Sales Engineers. Its users are experts who will check its work, and its output... .... What we are looking for You have shipped LLM-backed features to production and kept them working after launch...Suggested
$152k - $241.5k
We are looking for a passionate and energized engineer to accelerate the integration of APIs across the CUDA-X math library software stack into modern LLM and agentic AI workflows. Leading organizations globally are using GPU-powered data centers for AI, data analytics...SuggestedFull timeRemote work- Entendre is looking for a Member of Technical Staff - Applied AI based in New York to design and ship user-facing products that merge cutting-edge AI capabilities with dependable workflows. You will work across the stack to deliver solutions that are robust and intuitive...Suggested
- ...Capital One is seeking an AI Engineer to join the IFX team in New York, building responsible and scalable AI systems that power real-time customer experiences. You will partner with engineers, researchers, PMs, and data scientists to design and deliver foundation-model...Suggested
$100k - $130k
...Partner with business stakeholders, application teams, and quality engineering organizations to define migration strategies and automation... ...Retrieval-Augmented Generation (RAG) Large Language Model (LLM) Integrations Preferred Qualifications Experience migrating...Full timeLocal areaImmediate start- ...We are looking for an experienced Senior QA Engineer to own quality for our AI voice virtual agent. This role is for someone who is equally... ...may be accented or noisy, interprets intent, reasons over an LLM, generates a spoken reply, and decides whether to resolve the...Remote work
$116k - $182k
...you. WHAT YOU'LL DO We're looking for a Senior Lead Systems Engineer who's passionate about building the next generation of... ...Bonus: Experience implementing AI agents, MCP integrations, LLM-powered workflows, or enterprise AI platforms Experience with...Work at officeLocal areaFlexible hours$135k - $150k
...which makes everything possible.The Senior Data Platform Automation Engineer engineers the automation, developer experience, and reliability... ...GitHub Actions or GitLab; strong Python skills. Hands-on with LLM/agent applications using Azure AI Foundry (Azure OpenAI, Prompt...Full timeRemote workFlexible hours$170k - $230k
...Job Description Job Description Description: Applied AI Engineer | Production AI & LLM Systems | $170K-$230K + Equity Full-Time | Hybrid - Approximately 3 Days/Week In Office | New York, NY Dana Gudermuth Senior Recruiter | Heartline Staffing Call or...Permanent employmentFull timeWork at officeRelocation package3 days per week$172.5k - $313.7k
...systems and use cases.Making computer use dependable raises hard engineering questions. How does an agent know it succeeded? When should it... ...or teams.You have hands-on experience shipping and operating LLM-powered systems, and can explain how evaluations and production...Full time- ...The RoleWe're hiring a GTM Systems Engineer to build and own the systems layer behind Rogo's revenue engine. This is not a conventional... ...HaveExperience building or extending MCP servers, agent frameworks, or LLM orchestration tooling.Production experience with iPaaS or...Contract workShift work
$150k - $170k
...authority on architecture decisions, integration patterns, and engineering best practices within the ORCA program. LOCATION This role is 1... ...design (schema evolution, partitioning, storage optimization) AI/LLM integration (agent architectures, tool-calling patterns, multi-...Remote workRelocation- ...United States with Middlesex Paving earning an equally solid regional presence and reputation. Position Summary: The Field Engineer in heavy civil construction plays a vital role in supporting project execution by managing on-site engineering functions, ensuring...Contract workTemporary workFor subcontractorInterim role
$125k - $140k
...A licensed Master Plumber and General Contractor serving NYC and Westchester is hiring a Commissioning Engineer to own startup and commissioning on its new mechanical installations, from pre-startup readiness through first fire and verified operation. Because the company...For contractorsLocal areaRemote work- Software Engineer We are hiring a Software Engineer with a 'You Build It, You Run It' mentality to expand automation across the business... ...one of the tools you'll reach for when it fits: RAG pipelines, LLM integrations, and prompt engineering where the problem genuinely...Full timeLocal areaRemote workFlexible hours
$170k - $180k
...Datavations delivers to our customers. We are looking for a senior engineer to own this domain end-to-end—driving both the data systems that... .... WHAT YOU'LL OWN The attribute extraction engine — LLM-based extraction at production scale, its configuration model, its...Work at office- ...Job Description Job Description The Construction Project Engineer/Junior Project Manager plays a key role in managing mid-size commercial construction projects, supporting the Project Manager to ensure projects are completed on time, within budget, and to quality...For contractorsFor subcontractorWork at office
- ...AI Automation Engineer - Job Description (JD) Job Title AI Automation Engineer Job Summary We are seeking an innovative AI Automation... ...traditional machine learning models?How would you integrate an LLM into an existing web application?Explain REST API integration with...
$144k - $207k
...applying. We’re looking for an AI Automation and Integration Engineer to join our rapidly evolving IT & AI Workspace Technology team.... ...across Slack, Jira, Salesforce, GitHub, AWS‑based infrastructure, LLM providers (e.g., Claude), and internal APIs. Design agentic...Work experience placementSummer holidayLive outWork at officeLocal areaFlexible hours2 days per week$160k - $300k
...Lead to own quality across our AI platform. This is a hands-on engineering role focused on building testing infrastructure, evaluation systems... ...output quality. You’ll be responsible for everything from LLM evaluations and agent testing to Playwright automation, CI/CD...Visa sponsorshipRelocation package$184k - $230k
...LinkedIn. The Role Ironclad is looking for a Director, GTM Engineering & Systems Architecture to build the agentic systems that will... ...stacks. ~ A proven track record shipping production AI agents or LLM‑powered systems. Comfortable with agent frameworks and building...Full timeContract work- ...seRevel is seeking an engineer to own the AI worker end to end, building prompts, tooling, and retrieval over POC notes, Slack, Jira, and Confluence. You will design evaluation harnesses and guardrails to ensure grounded, fast insights for Sales Engineers and leadership...
$85k - $105k
OverviewAre you looking for a rewarding opportunity with significant career growth potential? Gilbane is seeking a Field Engineer I to join our team. In this role, you will gain hands-on experience across all aspects of project delivery, learning the responsibilities of...Contract workFor contractorsInternshipWork at officeFlexible hours$140k - $180k
...secure data shares. Within the Data Collaboration Group, our Engineering & Operations team builds the automation and platform... ...libraries, services, testing, CI/CD, and code reviews AI / LLM Engineering Hands-on experience building applications using...Full timeLocal areaRemote work- ...service digital partner that combines Strategy, Experience & Design, Engineering and Managed Services. We build digital solutions that deliver... ...audiences.PREFERRED QUALIFICATIONSExperience monitoring LLM or agent-based applications, including token usage, latency and...
- ...Back to jobs Director, AI Automation Engineering New York, NY, Atlanta, GA, or Remote, USA Apply Job Title: Director, AI Automation Engineer... ...Frameworks - Create automated evaluation frameworks for LLM outputs: accuracy, safety, bias, and regression. - Implement RAG...Full timeRemote work
- ...Job Description Job Description Employment Opportunity: Junior Project Engineer - Heavy Construction/ Demolition Location: New York City Company: Titan Industrial, General Contractor Position Type: Full-Time, On Site About Us: Titan Industrial...Full timeFor contractorsFor subcontractorInternshipWork at office
$175k - $300k
...multimodal agents that turn creative direction into edits, rendering engines that composite multiple layers of video and graphics, and... ...agentic pipelines Deep understanding of transformers and modern LLM techniques Experience with fine-tuning, alignment, or post-...Full timeLocal areaNight shift$100k - $125k
...Construction Office Engineer US-NY-New York Job ID: 2026-3411 # of Openings: 1 Category: REI LiRo-Hill Overview We are seeking a qualified Construction Office Engineer for MTA Projects (NICET Level III or IV) located in Manhattan, NY ....For contractorsWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to LLM Engineer. Be the first to apply!





