LLM Engineer
Ova Technologies
LLM Engineer (Large Language Model Engineer)
We are seeking a highly skilled LLM Engineer to design, develop, fine-tune, and deploy Large Language Model (LLM) based applications and AI-powered solutions. The ideal candidate will have expertise in Generative AI, Natural Language Processing (NLP), Prompt Engineering, Retrieval-Augmented Generation (RAG), and AI system architecture. This role involves building intelligent assistants, AI copilots, enterprise search platforms, and automation solutions using cutting-edge LLM technologies.
Key Responsibilities:
- Design, develop, and deploy applications powered by Large Language Models (LLMs).
- Build AI assistants, chatbots, knowledge management systems, and AI copilots.
- Develop and optimize Prompt Engineering strategies to improve model responses.
- Implement Retrieval-Augmented Generation (RAG) pipelines using vector databases.
- Fine-tune open-source and proprietary LLMs for domain-specific use cases.
- Integrate AI models with enterprise systems, APIs, databases, and cloud services.
- Develop evaluation frameworks to measure model performance, accuracy, and reliability.
- Implement guardrails, safety mechanisms, and hallucination mitigation techniques.
- Collaborate with Data Scientists, AI Engineers, Product Managers, and MLOps teams.
- Monitor, optimize, and maintain AI systems in production environments.
- Research and evaluate emerging AI models, frameworks, and architectures.
- Ensure compliance with Responsible AI, security, and governance standards.
Required Skills:
- Strong understanding of Large Language Models (LLMs) and Generative AI concepts.
- Experience with NLP, Transformer architectures, and AI model deployment.
- Expertise in Prompt Engineering and Retrieval-Augmented Generation (RAG).
- Knowledge of AI evaluation, model optimization, and inference strategies.
- Strong problem-solving and system design skills.
- Excellent communication and collaboration abilities.
Technical Skills:
- Programming Languages: Python, SQL, JavaScript
- LLM Platforms: OpenAI GPT, Claude, Gemini, Llama, Mistral, Cohere
- AI Frameworks: LangChain, llamaIndex, LangGraph, Haystack
- Machine Learning Frameworks: PyTorch, TensorFlow, Hugging Face Transformers
- Vector Databases: Pinecone, ChromaDB, Weaviate, Milvus, FAISS
- Cloud Platforms: AWS, Azure, Google Cloud Platform (GCP)
- APIs: REST APIs, GraphQL
- MLOps Tools: MLflow, Kubeflow, Airflow
- Containerization: Docker, Kubernetes
- Version Control: Git, GitHub, GitLab
Qualifications:
- Bachelor's degree in Computer Science, Artificial Intelligence, Machine Learning, Data Science, or a related field.
- Master's degree in AI, Data Science, or Machine Learning is a plus.
- Relevant AI and cloud certifications are preferred.
Experience:
- 3–8 years of experience in AI Engineering, Machine Learning Engineering, NLP, or Software Development.
- Hands-on experience building and deploying LLM-powered applications.
- Experience with RAG architectures, vector databases, and AI orchestration frameworks.
- Experience integrating AI services into enterprise applications.
Preferred Qualifications:
- Experience with fine-tuning techniques such as LoRA, PEFT, RLHF, and QLoRA.
- Knowledge of Agentic AI, Multi-Agent Systems, and Autonomous AI Workflows.
- Experience with LangGraph, CrewAI, AutoGen, or Semantic Kernel.
- Understanding of AI Security, Responsible AI, and Model Governance.
- Experience deploying AI applications in cloud-native environments.
Preferred Qualities:
- Strong innovation and research mindset.
- Passion for AI, NLP, and emerging technologies.
- Excellent troubleshooting and analytical skills.
- Ability to rapidly learn and adapt to new AI frameworks.
- Strong ownership and accountability for AI solution quality.
Employment Type:
Full-Time
Location:
Remote / Hybrid / On-site
Nice to Have:
- Experience building AI copilots, enterprise search systems, and knowledge assistants.
- Knowledge of multimodal AI models (text, image, audio, video).
- Experience with AI observability and evaluation platforms such as LangSmith, Arize AI, or Weights & Biases.
- Familiarity with enterprise SaaS, HR Tech, Healthcare, FinTech, E-commerce, or Customer Support AI solutions.
- Contributions to open-source AI projects, research papers, AI communities, or hackathons.
$180k - $220k
...and Citi Ventures. The Role In this role, you'll own the core LLM infrastructure powering two products redefining B2B research: Hub... ...user needs into technical solutions while maintaining engineering best practices Nice to Have RAG systems, embeddings, semantic search...SuggestedImmediate startRemote workFlexible hours- ...prioritizes human value. About the Role We’re seeking Software Engineers to develop scalable systems that integrate large language models... ...JSON schemas, function calling, etc.) to ensure robust, correct LLM outputs Collaborate with Ops and R&D to identify high‑impact automation...SuggestedFull timePart timeFor contractorsFlexible hours
$65 - $80 per hour
A renowned AI collaboration firm is seeking LLM Mechanical Engineers for a short-term remote project. The role involves using mechanical design expertise to improve AI models, with responsibilities including solving manufacturing scenarios and collaborating with AI researchers...SuggestedRemote jobHourly payContract workTemporary workFlexible hours- A leading AI consulting firm is seeking a Software Engineer to build, deploy, and operate production LLM-powered applications. This role requires strong software engineering skills with a focus on AI-driven features. Ideal candidates should have 3+ years of experience,...SuggestedRemote jobFull time
- A tech solutions company in New York seeks an Associate Data & AI Engineer to build and scale data and AI infrastructure. This role focuses on deploying LLM-powered agents to automate workflows. The ideal candidate has a Bachelor's degree and 0-2 years of experience in...Suggested
$100k - $200k
Blockchain Capital is looking for a Senior LLM Systems Engineer to enhance its LLM-driven oracle automation stack. This role emphasizes accuracy, performance, and operational quality of production systems using LLMs for various prediction market rules. The successful candidate...Remote job- The Consensus is seeking early-career Software Engineers to innovate in performance benchmarking and LLM engineering. This role provides the chance to work at the intersection of hardware and software, focusing on systems that drive AI capabilities. Ideal candidates are...
$100k - $200k
MoneyLion is seeking a Senior LLM Systems Engineer to enhance LLM-driven components for oracle automation. This production role focuses on improving accuracy and resilience of systems that manage prediction market rules. Required experience includes 3+ years in Python...Remote job- A leading staffing agency is seeking an AI Engineer to join a rapidly growing AI team. The role focuses on building and deploying generative... ...applications. Ideal candidates will have strong experience with LLM frameworks and prompt engineering, along with excellent...Remote jobFull time
$175k - $200k
Iovance Biotherapeutics seeks a senior engineer to design and deploy AI systems focused on operational productivity. Ideal candidates will... ...of experience in software/AI engineering, including designing LLM-based applications. The role involves working with cross-disciplinary...- ...focuses on building AI systems, production ML, and collaborating with engineering teams. Ideal candidates have over 5 years of experience in software development, especially with Python, and knowledge of LLM capabilities. This position offers a competitive salary reflecting...Remote job
- Role Overview NeuralCraft AI is building the next generation of enterprise AI products and we need a Prompt Engineer & LLM Systems Designer who can sit at the intersection of language, logic, and product. You won't be training models; you'll be crafting the instruction...
- Theadvertisingclub is seeking an LLM Developer to design, build, and optimize large language model systems that power innovative AI interview tools. You will work on production-grade features that enhance user performance in high-pressure interviews and meetings. Join a...Remote jobFlexible hours
- Tata Consultancy Services Limited is looking for a skilled AI/LLM Engineer in New York, NY to design and build intelligent agent-based systems. The candidate will develop systems that reason, plan, and act autonomously using frameworks like LangChain. Key responsibilities...
$100k - $150k
Bright Vision Technologies is seeking an LLM Fine-Tuning Engineer to design and execute fine-tuning workflows for large language models. This remote position requires 6+ years of experience and strong proficiency in Python and ML frameworks, especially PyTorch. The role...Remote job$180k - $240k
A leading AI company seeks a Senior Software Engineer to join their LLM team. This person will build and maintain the LLM gateway service that connects customers to multiple LLM providers. Responsibilities include working closely with the customer success team to understand...Remote job- A nonprofit applied AI research organization is seeking Software Engineers to develop scalable systems that integrate large language models with operational workflows. The role involves designing and deploying automated pipelines and collaborating with teams to streamline...Part timeFor contractorsFlexible hours
- Nutrient GmbH is seeking a Workflow Automation Engineer to transform customer processes into elegant solutions. In this role, you'll combine technical skills with customer interaction to deliver workflow automation solutions on the Nutrient platform. Your responsibilities...Remote job
- Basis-Research-Institute in New York is seeking Software Engineers to develop scalable systems that integrate large language models with various operational workflows. In this role, you will design and deploy automated pipelines for tasks involving technology such as GPT...Full timePart time
- Propio is seeking an AI/LLM Safety Engineer to ensure that AI models operate safely in production. The role involves designing safety evaluations, leading red-teaming exercises, and building guardrails. Ideal candidates will have a degree in a relevant field and 4+ years...
$140k - $145k
...developing, designing, and presenting analytics Knowledge of software engineering leading practice, including version control and testing... ...Collaborate with cross-functional teams to integrate fine-tuned LLM solutions into products and services Stay up-to-date with the latest...Full timeFor contractorsWork experience placementWork at officeRemote work- Hello. We are Nagarro, a digital product engineering company scaling in a big way. We build products, services, and experiences that inspire... ...You will join an existing development team to build and ship LLM‑powered features in a complex, large‑scale production application...Worldwide
- ...and information integrity. Our team comes from high‑performing engineering cultures, including Meta, Perplexity, AWS, Affim, and leading... ...create societal impact Qualifications 3+ YOE in Python 1+ YOE in LLM framework like Langchain or LlamaIndex 1+ YOE with agentic or...
- Covasant Technologies is seeking an AI Engineer I to join our team in Hyderabad. This full-time role involves supporting the development and maintenance of AI-powered solutions while collaborating with various teams to enhance workflow automation initiatives. The ideal...Full time
- ...working collaboratively with development teams, and ensuring effective integration of AI tools. The role requires strong programming skills in Python and at least 3 years of QA engineering experience. This is a W2 contract position. #J-18808-Ljbffr Accord Technologies IncContract work
- ...expert to design and implement advanced AI QA agents. This position calls for someone with extensive experience in AI/ML and QA engineering. The ideal candidate will be involved in automating QA processes and improving efficiency, working at a leading firm in digital transformation...
$100k - $140k
CFC- Chatham Financial Corporation is looking for a Full Stack Engineer to join their Technology Engagements team in New York. This role... ...for both external clients and internal applications, utilizing LLM-powered tools daily. The ideal candidate should possess over 5 years...$95k - $149k
...Field Engineer New York, NY Who We Are Addepar is a global data and AI platform empowering investment professionals to turn complex... ...Familiarity with AI/ML tools and experience implementing LLM-driven automation solutions Strong understanding of financial...H1bRemote workWorldwideVisa sponsorshipWork visaFlexible hours- Nagarro is seeking a full-stack engineer to join their development team, focusing on building LLM-powered features in a complex production application. This role is hands-on and involves leveraging AI coding tools to optimize workflows and deliver solutions across various...
- ...candidate will have a strong background in system optimization and experience with distributed ML systems, along with excellent software engineering skills. Scale offers competitive salaries along with comprehensive benefits including health, dental, and retirement plans. #J-1...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to LLM Engineer. Be the first to apply!

