Python Engineering Manager, LLM Training & Evaluation
Turing
Freelance · Remote · LATAM
About Turing
Turing is one of the world’s leading AGI infrastructure companies, working with frontier AI labs to accelerate model development through high-quality training data, evaluations, and engineering talent.
About the Role
As a Python Engineering Manager in our LLM Training business, you will lead large teams of software engineers and data scientists supporting the development of high-quality foundational Large Language Models (LLMs). You will oversee Supervised Fine-Tuning (SFT), Reinforcement Learning from Human Feedback (RLHF), and related technical data-generation and evaluation workflows.
This role combines engineering leadership, delivery ownership, quality management, and client collaboration. You will ensure that projects achieve the expected standards of quality, throughput, cost efficiency, and stakeholder satisfaction.
What You’ll Do
- Lead and manage large teams of Python engineers and developers working on LLM training and evaluation tasks.
- Oversee the execution of SFT, RLHF, and other technical data-generation workflows.
- Own project delivery from initiation through ramp-up, stabilization, and ongoing execution.
- Collaborate closely with research clients and internal stakeholders to understand requirements and ensure successful delivery.
- Establish rigorous review processes to maintain the quality and consistency of datasets and technical outputs.
- Identify and resolve issues related to task clarity, methodology, result communication, code quality, and implementation bugs.
- Conduct hands-on technical reviews and guide teams in improving Python code quality and engineering practices.
- Implement processes to improve project quality, productivity, scalability, and cost efficiency.
- Mentor engineering leads and team members while fostering a collaborative and high-performance culture.
- Track delivery metrics, identify risks, and implement corrective actions to meet project goals.
What We’re Looking For
- 5+ years of experience in software engineering, with strong hands-on proficiency in Python.
- Proven experience managing large technical teams in a delivery-oriented environment.
- Strong understanding of software development, code review, debugging, testing, and quality assurance practices.
- Demonstrated ability to engage in hands-on technical work and identify and resolve quality issues.
- Excellent leadership and people management skills, including mentoring and team motivation.
- Strong communication and stakeholder management skills, with the ability to collaborate effectively with clients and internal teams.
- Strong ownership of project outcomes, delivery timelines, quality, and operational performance.
- Ability to manage multiple priorities in a fast-paced, client-facing environment.
Engagement Details
Compensation: Market rate; please provide a specific hourly rate expectation
Availability: 40 hours/week preferred, with at least 6 hours of Pacific Time overlap per day
Type: Independent contractor
Duration: Approximately 2 months
Start: As soon as possible
Location: LATAM
Evaluation Process
Hiring Manager interview (~30 minutes)
- ...working with frontier AI labs to accelerate model development through high-quality training data, evaluations, and engineering talent. About the Role As a Python Engineering Manager in our LLM Training business, you will lead large teams of software engineers and data...TrainingHourly payTemporary workFor contractorsFreelanceImmediate startRemote work
- ...Role Overview We are looking for an Engineering Manager to lead teams creating high-quality conversational data for training and evaluating advanced Large Language Models (LLMs). The... ...for creating and evaluating multi-turn LLM conversations. ~Define workflows, priorities...TrainingContract workTemporary workFreelanceRemote work
- ...feedback, and rigorous evaluation frameworks. Our... ...agentic workflows, software engineering, and multimodal AI,... ...programming experience in Python (mandatory) along with... ...Secrets management issues Input validation... ...projects with leading LLM companies. Offer Details...SuggestedContract workTemporary workFor contractorsFreelanceRemote workWorldwide
$292k - $365k
...and tools including LLM fine-tuning,... ..., RAG/Search, LLM evaluation and testing automation... ...machine learning engineer, you will be responsible... ...with product managers, software engineers... ...experience in Python and hands-on experience... ...Proven record of training, fine tuning,...TrainingFull timeWork experience placementCasual workLive inWork at officeRemote work$150k - $230k
...looking for a hands-on Machine Learning Engineer to drive the post-training of our large language models, with a... ...and stability.Build and maintain evaluation and reward/verifier pipelines to... ...production-ready code.RequirementsHands-on LLM post-training experience. You have...TrainingFull timeLocal areaWork from home- ...and validate verifiable software engineering tasks and evaluation datasets derived from public repository... ...realistic code tasks that inform LLM evaluation and training. Key Responsibilities... ...at least one of these languages: Python, JavaScript, Java, Go, Rust, C/C++...TrainingFor contractorsLocal areaRemote work
$201.3k - $352.3k
...DescriptionIt all started when engineer Fred Luddy wrote code... ..., and product managers with a dual mission. We... ...Benchmarking and Evaluations to establish and lead... ...ROUGE, BLEU, G-Eval, LLM-as-a-judge patterns, and... ...scale.Proficiency in Python and familiarity with data...Work experience placementWork at officeImmediate startRemote workFlexible hoursShift work$302k - $355k
...are hiring a Senior Engineering Manager to lead the Machine Learning... ...infrastructure: evaluation systems,... ...evaluation, golden sets, training-data provenance, model... ....Fluency with modern LLM systems, including structured... ..., or security.Python, AWS/SageMaker or similar...TrainingWork at officeLocal areaRemote workRelocation3 days per week- ...Engineering Manager Anywhere Type: Permanent Category: Development... ...retrieval over organization data, evaluation and monitoring, PHI-safe... ...reports including hiring, training, supervising, mentoring, and... ...tools and practices, including LLM-based tooling, code...TrainingHourly payPermanent employmentFull timeLocal areaRemote work
- ...Machine Learning Engineer to join our Search... ...systems, models, evaluation frameworks, and data... ...collaborate with product managers, software... ...production.Strong Python skills and experience... ...evaluation, or LLM-as-a-judge.Experience... ...fine-tuning, post-training, evaluating, or...TrainingWork at officeLocal area
- ...partner company, who manages all applications and next... ...is looking for an Engineering Manager AI based in United... ...processes, including training, evaluation, monitoring, and retraining. - Oversee LLM-powered workflows such... ...such as Go, Python, gRPC, REST APIs, event...TrainingFull time
- ...partner company, who manages all applications and next... ...is looking for an Engineering Manager AI based in United... ...processes, including training, evaluation, monitoring, and retraining. Oversee LLM-powered workflows such... ...such as Go, Python, gRPC, REST APIs, event...TrainingFull timeRemote work
- ...DEUNA is looking for an Engineering Manager to lead our AI/ML... ...backend services, and AI/LLM workflows to make... ...AI/ML systems: model training and serving, LLM-powered... ...work (training, evaluation, monitoring, retraining... ...Backend / Platform: Go, Python, gRPC & REST APIs,...TrainingFull timeRemote workShift work
- ...high-quality data, advanced training pipelines, plus top AI researchers... ...who specialize in software engineering, logical reasoning, STEM,... ...Does a Typical Day Look Like? Evaluate and refine AI-generated code... ...automated verification tools in Python that can verify the quality...TrainingFor contractorsRemote workFlexible hours
- ...Senior Machine Learning Engineer**, you will build and... ...large language model (LLM) systems that extract... ...has **personally built, trained, evaluated, and deployed machine... ...search**.* **Advanced Python** programming skills... ...policies designed to help manage personal and...TrainingWork at officeRemote workFlexible hours
$185.2k - $210.6k
...guidance, infrastructure, training, and custom solutions... ...skills to AI agents, evaluation frameworks, and usage analytics. The Engineering Manager will lead the AI... ...on agentic workflows, LLM integration, and MCP-based... ...in TypeScript and/or Python ~ Track record of...TrainingFull timeRemote work$127k - $235k
...Senior Machine Learning Engineer, you will build and... ...large language model (LLM) systems that extract... ...has personally built, trained, evaluated, and deployed machine... ...search. ~ Advanced Python programming skills and... ...policies designed to help manage personal and professional...TrainingWork at officeRemote workFlexible hours$127k - $235k
...Senior Machine Learning Engineer , you will build and... ...large language model (LLM) systems that extract... ...has personally built, trained, evaluated, and deployed machine... ..., or search .Advanced Python programming skills and... ...policies designed to help manage personal and...TrainingWork at officeLocal areaRemote workFlexible hours- ...Role Overview Design and evaluate high-quality datasets and evaluations... ...across the software engineering lifecycle. Key Responsibilities... ..., and corrections in Python, JavaScript including ReactJS... ...Java, Rust, and Go for model training and benchmarking. Evaluate...TrainingFor contractorsRemote work10 hours per weekFlexible hours
- ...of high-quality datasets and evaluation pipelines that improve and... ...code generation and software engineering tasks. You will curate and author... ...high-quality data, advanced training pipelines, and expert... ...solutions, and correct code in Python, JavaScript including...TrainingFull timeFor contractorsRemote work10 hours per weekFlexible hours
$192.5k - $302.5k
...build.You will define evaluation standards that other teams... ...labels, validated LLM judges, and release gates... ..., mentor senior engineers, shape hiring, and represent... ...decisions for model training and serving, including... ...-on in production Python and strong SQL with distributed...TrainingRemote workWorldwide$240k - $290k
...an experienced Senior Engineering Manager to build and lead our... ...responsible for how we test, evaluate, and govern the AI... ...our cloud-only AI and LLM-based products. You... ...data pipelines and model training through cloud services... ....Proficiency in Python, Linux, shell scripting...TrainingWork at officeWorldwideFlexible hoursShift work$192.5k - $357.5k
...Machine Learning Engineer to join our Foundation... ...rigorous evaluation harnesses that check... ...architectures and context management for long-horizon... ...scale distributed training and inference... ...Own the production Python/PyTorch codebases... ...Deep expertise in LLM serving, test-time...TrainingFull timeLocal areaWorldwideRelocation package$197.3k - $225.1k
AI Engineer 4 (AI Foundations: LLM Customization, Finetuning, Reinforcement... ..., technical program managers, and product... ...including foundation model training, large language... ..., guardrails, model evaluation, experimentation, governance... ...programming with Python, Go, Scala, CUDA, or...TrainingFull timePart timeLocal area- ...Principal Machine Learning Engineer, you will drive the... ...learning algorithms, training sophisticated models,... ...experimentation and model evaluations, and providing... ..., ranking, retrieval, LLM-based systems) to optimize... ...closely with product managers, designers, and engineering...TrainingLocal areaRemote work
$220k - $292k
...military in months, not years.The Test & Evaluation Engineering Team at Anduril works across the... ...all flight operations and test range management. Our team conducts full system-level... ...to) work experience, education and/or training, critical skills, and/or business considerations...TrainingFull timeWork experience placementImmediate startRemote work- ...large language model (LLM) capabilities, and... .... Own how models, evaluation pipelines, data... ...leadership across engineering teams, guiding... ...programming expertise in Python; additional... ...technical leadership managing teams of 10+ engineers... ..., including training, fine‑tuning, inference...TrainingRemote workWork from homeFlexible hours
- ...experts. We’re one of the largest engineering and system integration firms... ...We are seeking an Engineering Manager I who will support multiple... ...program growth.Perform performance evaluations on a yearly basisDevelop and execute focused training plans to enhance individual...TrainingLocal areaRemote work
$224k - $356.5k
...are looking for an experienced Software Engineering Manager to lead the development of our core... ...velocity and agent quality—backed by evaluations, benchmarking, and feedback loops.Providing... ..., vector databases, and GPU-optimized training and inference workflows to deliver...TrainingFull timeRemote work$142.4k - $213.6k
Schneider Electric is looking for an On-Site Engineering Manager in the Las Vegas area!This Las Vegas based Engineering Manager who... ...fulfill specific customer requirements. Interview, hire, train, mentor, evaluate, and when necessary, performance manage team members.Responsibilities...TrainingFull timeTemporary workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Python Engineering Manager, LLM Training & Evaluation. Be the first to apply!
- python programmer Remote
- python developer remote Remote
- python developer Remote
- full stack / python developer (remote) Remote
- entry level python developer Remote
- python developer data analytics Remote
- python engineer Remote
- senior python developer Remote
- python data scientist Remote
- python data scientist (contract) Remote




