Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

MLE Bench - Data Analyst

Part-time

Turing

Analyze ML datasets to evaluate and improve system performance.

About Turing

Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L

Role Overview

We are looking for experienced Data Analysts (MLE Bench) to contribute to benchmark-driven evaluation projects focused on real-world machine learning systems. This role involves hands-on analytical work with production-like datasets, metrics, and ML outputs to help evaluate, diagnose, and improve the performance of advanced AI systems.

The ideal candidate is comfortable working at the intersection of data analysis and machine learning, with strong analytical rigor and the ability to work with real datasets and ML evaluation workflows.

What does day-to-day life look like?

  • Analyze structured and unstructured datasets generated from ML training, inference, and evaluation pipelines .
  • Define, compute, and validate metrics used to evaluate model performance and behavior.
  • Investigate data distributions, model outputs, failure modes, and edge cases relevant to benchmark tasks.
  • Write and run Python and SQL code to analyze data, create reports, and support evaluation workflows.
  • Validate data quality, consistency, and correctness across datasets and experiments.
  • Create clear, well-documented analytical artifacts and reproducible analysis workflows.
  • Collaborate with ML engineers and researchers to design challenging, real-world evaluation scenarios for MLE Bench.

Requirements

  • Minimum 3+ years of experience as a Data Analyst or Analytics-focused Engineer .
  • Strong proficiency in Python for data analysis.
  • Solid experience with SQL and relational datasets.
  • Experience analyzing ML outputs and evaluation metrics .
  • Strong understanding of statistics and analytical reasoning.
  • Ability to work with large, complex datasets and draw reliable insights.
  • Experience writing clean, readable, and well-documented analytical code .
  • Excellent spoken and written English communication skills .

Perks of Freelancing With Turing

  • Work in a fully remote environment.
  • Opportunity to work on cutting-edge AI projects with leading LLM companies.

Offer Details

  • Commitments Required: At least 4 hours per day and minimum 20 hours per week with overlap of 4 hours with PST.
  • Engagement Type: Contractor assignment (no medical/paid leave)
  • Duration of Contract: 3 months (adjustable based on engagement)
  • Location: India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey, Brazil, Mexico

Evaluation Process

  • Technical Interview with live coding challege (60 mins)

Skills: Machine Learning, Python, Data Analysis

Vacancy posted 13 days ago
Similar jobs that could be interesting for youBased on the MLE Bench - Data Analyst in San Francisco, CA vacancy
  •  ...Machine Learning Model SpecialistThe ideal candidate will have a foundational understanding of machine learning, data annotation, quality assurance, and natural language processing. They will play a pivotal role in updating our machine learning models and ensuring their... 
    Suggested
    Full time

    Welocalize

    San Francisco, CA
    2 days ago
  • $115k - $135k

    About CheckrCheckr is building the data platform to power safe and fair decisions. Over 140,000 companies and millions of people rely...  ...Combinator 2024 Breakthrough Company.About the team/roleAs a Product Analyst II, you will work hand-in-hand with multiple business... 
    Suggested
    Work at office
    Local area
    Remote work
    Relocation
    3 days per week

    Checkr

    San Francisco, CA
    4 days ago
  •  ...Business Data AnalystLocation: San Francisco, CADuration: Long TermPharma Domain MandatoryBusiness Data Analyst in terms of Data Standards and Data Migration:Translating business requirements, process documentation, system/report specifications, integrated data flows... 
    Suggested

    Keylent Inc

    San Francisco, CA
    5 days ago
  •  ...Business Data AnalystLocation: San Francisco, CARate: DOE $/hr. on w2 only Position Type: contract Interview Process: Phone Followed...  ...Green Card and GC EADJob DescriptionThe Production Support Systems Analyst will work with minimal supervision to support iHub Project... 
    Suggested
    Permanent employment
    Contract work

    Staffing the Universe

    San Francisco, CA
    1 day ago
  • DescriptionKforce has a client in San Francisco, CA that is seeking a Data Analyst.Responsibilities:* The Data Analyst will design business analysis, create and maintain dashboards to track business trends on a weekly and monthly basis* Create necessary data pipeline to... 
    Suggested
    Work experience placement
    Immediate start

    KForce

    San Francisco, CA
    3 days ago
  • $93.6k - $117k

     ...the tools, resources, and support you need to grow your career.Data at BrexThe Data organization develops insights, models, and data...  ...Marketing, Product, Engineering, and Operations. Our Data Scientists, Analysts, and Engineers work together to make data—and insights derived... 
    Work at office
    Remote work
    Work from home

    Brex

    San Francisco, CA
    5 days ago
  • $114.2k - $142.7k

     ...environmental, and humanitarian sectors. We are both a space company and data company all rolled into one.Customers and users across the globe...  ..., and The Netherlands.About the Role:We are seeking a Data Analyst to join our Data Team. The ideal candidate is curious,... 
    Full time
    Temporary work
    Work at office
    Local area
    Remote work
    Home office
    3 days per week

    Planet Labs

    San Francisco, CA
    4 days ago
  • $135k - $180k

    The RoleAt Candid Health, we’re searching for a Data Analyst to help us enhance efficiency, product scalability and operational decision making. You will perform critical analysis and implement data driven solutions that enable our engineering, product and leadership teams... 

    Candid Health

    San Francisco, CA
    4 days ago
  • Job-ID16730413Reference21-04570 Duties: The ideal candidate has experience applying data science to impact business outcomes, and enjoys pushing the boundaries to innovate. You will conduct analyses utilizing a variety of statistical methods, and build automated reports... 
    Local area

    Intelliswift

    San Francisco, CA
    7 days ago
  •  ...Data Analyst Position at Air Apps At Air Apps, we believe in thinking bigger—and moving faster. We're a family-founded company on a mission to create the world's first AI-powered Personal & Entrepreneurial Resource Planner (PRP), and we need your passion and ambition... 
    Temporary work
    Worldwide

    Air Apps

    San Francisco, CA
    4 days ago
  • Airbnb Client Qualifications Professional industry experience in a quantitative analysis role Good product/business analytics skills Strong SQL and programming skills using Python or R Ability to communicate clearly and effectively to cross functional partners...

    Omega Solutions Inc

    San Francisco, CA
    1 day ago
  •  ...Data Analyst 511 Operator plays a pivotal role in collecting and disseminating traffic and transit emergency and non-emergency information assisting in congestion management in the San Francisco Bay Area along with Santa Cruz and San Joaquin county. The timeliness and... 
    Shift work

    TransSight, LLC

    San Francisco, CA
    1 day ago
  • $130k - $200k

     ...Cardless is looking for a Data Analyst / Senior Data Analyst to join our team and help shape the insights, processes, and decisions behind our co-branded credit card platform. In this role, you'll work across domains including applications, accounts, transactions, fraud... 
    Work at office
    Relocation package
    Flexible hours

    Cardless, Inc

    San Francisco, CA
    4 days ago
  •  ...50 years later, it continues to build upon its legacy of enriching the lives of older adults. What You’ll Do as the Clinical Data Analyst: Essential Functions: Use data analysis to identify areas for improvement in various areas: staffing, patient care, or... 
    Full time
    Temporary work
    Part time
    Work at office
    Flexible hours
    Weekday work

    San Francisco Campus for Jewish Living

    San Francisco, CA
    5 days ago
  •  ...About the job Data Analyst Junior and Mid Job Description ~ Expertise in SQL skills to profile the data. ~ Analyse, Profile and systematically present the data for Business and management team understanding. ~ ETL development and Data... 

    AllJobs

    San Francisco, CA
    3 days ago
  •  ...Bench Scientist II Integrated Resources, Inc., is led by a seasoned team with combined decades in the industry. We deliver strategic...  ...responses to Regulatory questions as appropriate. Present data/ strategy to scientists (and management) in internal venues (technical... 

    Integrated Resources

    San Francisco, CA
    4 days ago
  • $38 per hour

     ...Data Quality Analyst Welo Data is looking for experienced, detail-oriented professionals to join our team as Data Quality Analysts. This role sits at the center of execution and quality — bridging Data Labeling Associates (DLAs) and Team Leads to ensure work is not... 
    Full time
    Contract work
    Remote work
    Visa sponsorship

    Welocalize

    San Francisco, CA
    1 day ago
  •  ...Data Analytics What You'll Be Doing: Help create financial models and advanced analysis for budgeting and forecasting of our compensation investments. Expertise in visualization and using data insights to make recommendations and achieve goals. Experience using... 
    Work experience placement

    Omni Inclusive

    San Francisco, CA
    4 days ago
  •  ...Data Analyst Location: San Francisco, New York, Seattle, or Little Rock Duration: 12 + Months Contract Rate: DOE Client is the data collaboration platform of choice for the world's most innovative companies. A groundbreaking leader in consumer privacy, data ethics... 
    Contract work

    Staffing the Universe

    San Francisco, CA
    4 days ago
  • $135k - $200k

     ...healthcare technology company. The role Raydar is recruiting for this role on behalf of our client. Analyze business and operational data and maintain the reporting tools that help cross-functional groups make informed decisions. Pair hands-on analysis with data... 
    Full time
    Work at office

    Raydar Inc

    San Francisco, CA
    5 days ago
  •  ...Data Analyst Recology provides organics, recycling, and solid waste collection and processing services to over 130 communities in California, Oregon, and Washington. Recology owns and operates composting facilities, transfer stations, materials recovery facilities,... 
    Contract work

    Samprasoft

    San Francisco, CA
    3 days ago
  • $88k - $95.5k

     ...jobs. Building on decades of experience and success, JVS is a data-driven organization that takes a whole systems approach to...  ...quality employment and economic mobility. The Role    The Data Analyst is a core member of JVS's Evaluation and Impact team, responsible... 
    Work at office
    Work from home
    Relocation

    Jewish Vocational Service (San Francisco)

    San Francisco, CA
    4 days ago
  • $140k - $180k

     ...Data Analyst Harper is an AI-native commercial insurance company in San Francisco. We're not bolting AI onto insurance — we're rebuilding the entire business as software, on a simple bet: turning expert human judgment into compute is one of the largest transitions... 
    Relocation
    Monday to Friday
    Day shift

    Harper Group

    San Francisco, CA
    3 days ago
  • $123k - $165k

    Job Posting Title:Sr Data AnalystReq ID:10157869Job Description:The Product & Tech Analytics team is seeking a Sr. Data Analyst who will be a key player in driving personalization strategy on Disney+ and Hulu. We partner across the business to turn raw data into meaningful... 
    Full time

    Hulu

    San Francisco, CA
    3 days ago
  •  ...communication will only be sent from @Rippling.com addresses.About the roleRippling's Payments Data & Analytics team is seeking an experienced and highly skilled Senior Data Analyst - Payments (Internal title: Data Scientist) to join our rapidly expanding team. In this... 
    Work at office
    3 days per week

    Rippling

    San Francisco, CA
    3 days ago
  • $60k - $85k

     ...globally in our San Francisco, Seattle, and Delhi offices. Please reach out if you are interested in joining the future of AI! Data Operations Analyst We are looking for an eager and motivated Data Operations Analyst to join our Data Operations team. At Hive, our... 
    Work experience placement

    Hive

    San Francisco, CA
    1 day ago
  • $100k

     ...Cloud World/Oracle Java one (Las Vegas) -2023/2022 and at Gartner Data Analytics Summit (Florida)-2023 All Positions are open for all...  ..., Java full-stack developers, Python/Java developers, Data analysts/ Data Scientists, and Machine Learning engineers for full-time positions... 
    Full time
    H1b

    SynergisticIT

    San Francisco, CA
    1 day ago
  •  ...Description Involves gathering analyzing and interpreting a wide variety of research data. Designs and conducts research including selecting data samples developing research instruments analyzing collected information according to established statistical methods and... 
    Full time

    University of California, San Francisco

    San Francisco, CA
    14 days ago
  •  ...Build and validate data pipelines for AI performance evaluation projects. About Turing Based in San Francisco, California, Turing...  ...We are looking for experienced Software Engineers (SWE Bench – Data Engineer / Data Science) to contribute to benchmark-driven... 
    Contract work
    Part time
    For contractors
    Freelance
    Remote work

    Turing

    San Francisco, CA
    13 days ago
  •  ...DescriptionAt least 2 years of experience with Information Technology and Test Delivery in which at least 2 years of experience in Test Data ManagementAt least 2 years of experience in FACET application or Healthcare IT systemsExcellent understanding of the Healthcare... 
    Permanent employment
    Full time
    H1b

    Sonsoft

    San Francisco, CA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to MLE Bench - Data Analyst. Be the first to apply!