Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Python Engineering Manager, LLM Training & Evaluation

Temporary

Turing

Freelance · Remote · LATAM

About Turing

Turing is one of the world’s leading AGI infrastructure companies, working with frontier AI labs to accelerate model development through high-quality training data, evaluations, and engineering talent.

About the Role

As a Python Engineering Manager in our LLM Training business, you will lead large teams of software engineers and data scientists supporting the development of high-quality foundational Large Language Models (LLMs). You will oversee Supervised Fine-Tuning (SFT), Reinforcement Learning from Human Feedback (RLHF), and related technical data-generation and evaluation workflows.

This role combines engineering leadership, delivery ownership, quality management, and client collaboration. You will ensure that projects achieve the expected standards of quality, throughput, cost efficiency, and stakeholder satisfaction.

What You’ll Do

  • Lead and manage large teams of Python engineers and developers working on LLM training and evaluation tasks.
  • Oversee the execution of SFT, RLHF, and other technical data-generation workflows.
  • Own project delivery from initiation through ramp-up, stabilization, and ongoing execution.
  • Collaborate closely with research clients and internal stakeholders to understand requirements and ensure successful delivery.
  • Establish rigorous review processes to maintain the quality and consistency of datasets and technical outputs.
  • Identify and resolve issues related to task clarity, methodology, result communication, code quality, and implementation bugs.
  • Conduct hands-on technical reviews and guide teams in improving Python code quality and engineering practices.
  • Implement processes to improve project quality, productivity, scalability, and cost efficiency.
  • Mentor engineering leads and team members while fostering a collaborative and high-performance culture.
  • Track delivery metrics, identify risks, and implement corrective actions to meet project goals.

What We’re Looking For

  • 5+ years of experience in software engineering, with strong hands-on proficiency in Python.
  • Proven experience managing large technical teams in a delivery-oriented environment.
  • Strong understanding of software development, code review, debugging, testing, and quality assurance practices.
  • Demonstrated ability to engage in hands-on technical work and identify and resolve quality issues.
  • Excellent leadership and people management skills, including mentoring and team motivation.
  • Strong communication and stakeholder management skills, with the ability to collaborate effectively with clients and internal teams.
  • Strong ownership of project outcomes, delivery timelines, quality, and operational performance.
  • Ability to manage multiple priorities in a fast-paced, client-facing environment.

Engagement Details

  • Compensation: Market rate; please provide a specific hourly rate expectation

  • Availability: 40 hours/week preferred, with at least 6 hours of Pacific Time overlap per day

  • Type: Independent contractor

  • Duration: Approximately 2 months

  • Start: As soon as possible

  • Location: LATAM

Evaluation Process

  • Hiring Manager interview (~30 minutes)

Vacancy posted 17 days ago
Similar jobs that could be interesting for youBased on the Python Engineering Manager, LLM Training & Evaluation in Remote vacancy
  •  ...working with frontier AI labs to accelerate model development through high-quality training data, evaluations, and engineering talent. About the Role As a Python Engineering Manager in our LLM Training business, you will lead large teams of software engineers and data... 
    Training
    Hourly pay
    Temporary work
    For contractors
    Freelance
    Immediate start
    Remote work

    Turing

    Remote
    18 days ago
  •  ...Role Overview We are looking for an Engineering Manager to lead teams creating high-quality conversational data for training and evaluating advanced Large Language Models (LLMs). The...  ...for creating and evaluating multi-turn LLM conversations. ~Define workflows, priorities... 
    Training
    Contract work
    Temporary work
    Freelance
    Remote work

    Turing

    Remote
    18 days ago
  •  ...feedback, and rigorous evaluation frameworks. Our...  ...agentic workflows, software engineering, and multimodal AI,...  ...programming experience in Python (mandatory) along with...  ...Secrets management issues Input validation...  ...projects with leading LLM companies. Offer Details... 
    Suggested
    Contract work
    Temporary work
    For contractors
    Freelance
    Remote work
    Worldwide

    Turing

    Remote
    26 days ago
  • $292k - $365k

     ...and tools including LLM fine-tuning,...  ..., RAG/Search, LLM evaluation and testing automation...  ...machine learning engineer, you will be responsible...  ...with product managers, software engineers...  ...experience in Python and hands-on experience...  ...Proven record of training, fine tuning,... 
    Training
    Full time
    Work experience placement
    Casual work
    Live in
    Work at office
    Remote work

    Airbnb

    Remote
    7 days ago
  • $150k - $230k

     ...looking for a hands-on Machine Learning Engineer to drive the post-training of our large language models, with a...  ...and stability.Build and maintain evaluation and reward/verifier pipelines to...  ...production-ready code.RequirementsHands-on LLM post-training experience. You have... 
    Training
    Full time
    Local area
    Work from home

    News Break

    Mountain View, CA
    4 days ago
  •  ...and validate verifiable software engineering tasks and evaluation datasets derived from public repository...  ...realistic code tasks that inform LLM evaluation and training. Key Responsibilities...  ...at least one of these languages: Python, JavaScript, Java, Go, Rust, C/C++... 
    Training
    For contractors
    Local area
    Remote work

    SaidGig

    United States
    more than 2 months ago
  • $201.3k - $352.3k

     ...DescriptionIt all started when engineer Fred Luddy wrote code...  ..., and product managers with a dual mission. We...  ...Benchmarking and Evaluations to establish and lead...  ...ROUGE, BLEU, G-Eval, LLM-as-a-judge patterns, and...  ...scale.Proficiency in Python and familiarity with data... 
    Work experience placement
    Work at office
    Immediate start
    Remote work
    Flexible hours
    Shift work

    ServiceNow

    Santa Clara, CA
    5 days ago
  • $302k - $355k

     ...are hiring a Senior Engineering Manager to lead the Machine Learning...  ...infrastructure: evaluation systems,...  ...evaluation, golden sets, training-data provenance, model...  ....Fluency with modern LLM systems, including structured...  ..., or security.Python, AWS/SageMaker or similar... 
    Training
    Work at office
    Local area
    Remote work
    Relocation
    3 days per week

    Checkr

    San Francisco, CA
    3 days ago
  •  ...Engineering Manager Anywhere Type: Permanent Category: Development...  ...retrieval over organization data, evaluation and monitoring, PHI-safe...  ...reports including hiring, training, supervising, mentoring, and...  ...tools and practices, including LLM-based tooling, code... 
    Training
    Hourly pay
    Permanent employment
    Full time
    Local area
    Remote work

    Eliassen Group

    Lansing, MI
    19 hours ago
  •  ...Machine Learning Engineer to join our Search...  ...systems, models, evaluation frameworks, and data...  ...collaborate with product managers, software...  ...production.Strong Python skills and experience...  ...evaluation, or LLM-as-a-judge.Experience...  ...fine-tuning, post-training, evaluating, or... 
    Training
    Work at office
    Local area

    Atlassian

    Mountain View, CA
    2 days ago
  •  ...partner company, who manages all applications and next...  ...is looking for an Engineering Manager AI based in United...  ...processes, including training, evaluation, monitoring, and retraining. - Oversee LLM-powered workflows such...  ...such as Go, Python, gRPC, REST APIs, event... 
    Training
    Full time

    Jobgether

    Remote
    6 days ago
  •  ...partner company, who manages all applications and next...  ...is looking for an Engineering Manager AI based in United...  ...processes, including training, evaluation, monitoring, and retraining. Oversee LLM-powered workflows such...  ...such as Go, Python, gRPC, REST APIs, event... 
    Training
    Full time
    Remote work

    jobgether

    United States
    6 days ago
  •  ...DEUNA is looking for an Engineering Manager to lead our AI/ML...  ...backend services, and AI/LLM workflows to make...  ...AI/ML systems: model training and serving, LLM-powered...  ...work (training, evaluation, monitoring, retraining...  ...Backend / Platform: Go, Python, gRPC & REST APIs,... 
    Training
    Full time
    Remote work
    Shift work

    DEUNA

    Remote
    9 days ago
  •  ...high-quality data, advanced training pipelines, plus top AI researchers...  ...who specialize in software engineering, logical reasoning, STEM,...  ...Does a Typical Day Look Like? Evaluate and refine AI-generated code...  ...automated verification tools in Python that can verify the quality... 
    Training
    For contractors
    Remote work
    Flexible hours

    Turing

    United States
    3 days ago
  •  ...Senior Machine Learning Engineer**, you will build and...  ...large language model (LLM) systems that extract...  ...has **personally built, trained, evaluated, and deployed machine...  ...search**.* **Advanced Python** programming skills...  ...policies designed to help manage personal and... 
    Training
    Work at office
    Remote work
    Flexible hours

    Jobleads-US

    New York, NY
    2 days ago
  • $185.2k - $210.6k

     ...guidance, infrastructure, training, and custom solutions...  ...skills to AI agents, evaluation frameworks, and usage analytics. The Engineering Manager will lead the AI...  ...on agentic workflows, LLM integration, and MCP-based...  ...in TypeScript and/or Python ~ Track record of... 
    Training
    Full time
    Remote work

    Goodleap

    Remote
    21 days ago
  • $127k - $235k

     ...Senior Machine Learning Engineer, you will build and...  ...large language model (LLM) systems that extract...  ...has personally built, trained, evaluated, and deployed machine...  ...search. ~ Advanced Python programming skills and...  ...policies designed to help manage personal and professional... 
    Training
    Work at office
    Remote work
    Flexible hours

    Jobleads-US

    New York, NY
    2 days ago
  • $127k - $235k

     ...Senior Machine Learning Engineer , you will build and...  ...large language model (LLM) systems that extract...  ...has personally built, trained, evaluated, and deployed machine...  ..., or search .Advanced Python programming skills and...  ...policies designed to help manage personal and... 
    Training
    Work at office
    Local area
    Remote work
    Flexible hours

    Jobleads-US

    New York, NY
    2 days ago
  •  ...Role Overview Design and evaluate high-quality datasets and evaluations...  ...across the software engineering lifecycle. Key Responsibilities...  ..., and corrections in Python, JavaScript including ReactJS...  ...Java, Rust, and Go for model training and benchmarking. Evaluate... 
    Training
    For contractors
    Remote work
    10 hours per week
    Flexible hours

    SaidGig

    Canada
    more than 2 months ago
  •  ...of high-quality datasets and evaluation pipelines that improve and...  ...code generation and software engineering tasks. You will curate and author...  ...high-quality data, advanced training pipelines, and expert...  ...solutions, and correct code in Python, JavaScript including... 
    Training
    Full time
    For contractors
    Remote work
    10 hours per week
    Flexible hours

    SaidGig

    United States
    more than 2 months ago
  • $192.5k - $302.5k

     ...build.You will define evaluation standards that other teams...  ...labels, validated LLM judges, and release gates...  ..., mentor senior engineers, shape hiring, and represent...  ...decisions for model training and serving, including...  ...-on in production Python and strong SQL with distributed... 
    Training
    Remote work
    Worldwide

    ZoomInfo

    Waltham, MA
    2 days ago
  • $240k - $290k

     ...an experienced Senior Engineering Manager to build and lead our...  ...responsible for how we test, evaluate, and govern the AI...  ...our cloud-only AI and LLM-based products. You...  ...data pipelines and model training through cloud services...  ....Proficiency in Python, Linux, shell scripting... 
    Training
    Work at office
    Worldwide
    Flexible hours
    Shift work

    Sonatus

    Sunnyvale, CA
    1 day ago
  • $192.5k - $357.5k

     ...Machine Learning Engineer to join our Foundation...  ...rigorous evaluation harnesses that check...  ...architectures and context management for long-horizon...  ...scale distributed training and inference...  ...Own the production Python/PyTorch codebases...  ...Deep expertise in LLM serving, test-time... 
    Training
    Full time
    Local area
    Worldwide
    Relocation package

    Genentech

    New York, NY
    2 days ago
  • $197.3k - $225.1k

    AI Engineer 4 (AI Foundations: LLM Customization, Finetuning, Reinforcement...  ..., technical program managers, and product...  ...including foundation model training, large language...  ..., guardrails, model evaluation, experimentation, governance...  ...programming with Python, Go, Scala, CUDA, or... 
    Training
    Full time
    Part time
    Local area

    Capital One

    McLean, VA
    1 day ago
  •  ...Principal Machine Learning Engineer, you will drive the...  ...learning algorithms, training sophisticated models,...  ...experimentation and model evaluations, and providing...  ..., ranking, retrieval, LLM-based systems) to optimize...  ...closely with product managers, designers, and engineering... 
    Training
    Local area
    Remote work

    Atlassian

    Mountain View, CA
    5 days ago
  • $220k - $292k

     ...military in months, not years.The Test & Evaluation Engineering Team at Anduril works across the...  ...all flight operations and test range management. Our team conducts full system-level...  ...to) work experience, education and/or training, critical skills, and/or business considerations... 
    Training
    Full time
    Work experience placement
    Immediate start
    Remote work

    Anduril Industries

    Costa Mesa, CA
    2 days ago
  •  ...large language model (LLM) capabilities, and...  .... Own how models, evaluation pipelines, data...  ...leadership across engineering teams, guiding...  ...programming expertise in Python; additional...  ...technical leadership managing teams of 10+ engineers...  ..., including training, fine‑tuning, inference... 
    Training
    Remote work
    Work from home
    Flexible hours

    your Jared

    San Diego, CA
    3 days ago
  •  ...experts. We’re one of the largest engineering and system integration firms...  ...We are seeking an Engineering Manager I who will support multiple...  ...program growth.Perform performance evaluations on a yearly basisDevelop and execute focused training plans to enhance individual... 
    Training
    Local area
    Remote work

    E Tech Group

    Chicago, IL
    1 day ago
  • $224k - $356.5k

     ...are looking for an experienced Software Engineering Manager to lead the development of our core...  ...velocity and agent quality—backed by evaluations, benchmarking, and feedback loops.Providing...  ..., vector databases, and GPU-optimized training and inference workflows to deliver... 
    Training
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    3 days ago
  • $142.4k - $213.6k

    Schneider Electric is looking for an On-Site Engineering Manager in the Las Vegas area!This Las Vegas based Engineering Manager who...  ...fulfill specific customer requirements. Interview, hire, train, mentor, evaluate, and when necessary, performance manage team members.Responsibilities... 
    Training
    Full time
    Temporary work
    Flexible hours

    Schneider Electric

    Las Vegas, NV
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Python Engineering Manager, LLM Training & Evaluation. Be the first to apply!