Machine Learning Engineer

Seeking a highly skilled Machine Learning Engineer specializing in Large Language Models (LLMs) for automated evaluation and quality assessment, this full-time remote position will design and implement systems to measure and improve model output accuracy, relevance, and consistency while collaborating with cross-functional teams. Key responsibilities Design and implement automated systems and pipelines for evaluating LLM outputs Develop metrics and KPIs to measure output quality, accuracy, and consistency Collaborate with Engineering teams to create automated logic checks and validation tools Required qualifications 5+ years of experience in ML engineering, NLP, or AI/ML automation Hands-on experience in prompt engineering and designing LLM-based evaluation systems Strong understanding of machine learning principles with a focus on NLP and advanced LLM capabilities Expertise in building automated evaluation or QA pipelines Bachelor's/Master's degree in Computer Science/Engineering or a related field