Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

MLE Bench - Data Analyst

Part-time

Turing

Analyze ML datasets to evaluate and improve system performance.

About Turing

Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L

Role Overview

We are looking for experienced Data Analysts (MLE Bench) to contribute to benchmark-driven evaluation projects focused on real-world machine learning systems. This role involves hands-on analytical work with production-like datasets, metrics, and ML outputs to help evaluate, diagnose, and improve the performance of advanced AI systems.

The ideal candidate is comfortable working at the intersection of data analysis and machine learning, with strong analytical rigor and the ability to work with real datasets and ML evaluation workflows.

What does day-to-day life look like?

  • Analyze structured and unstructured datasets generated from ML training, inference, and evaluation pipelines .
  • Define, compute, and validate metrics used to evaluate model performance and behavior.
  • Investigate data distributions, model outputs, failure modes, and edge cases relevant to benchmark tasks.
  • Write and run Python and SQL code to analyze data, create reports, and support evaluation workflows.
  • Validate data quality, consistency, and correctness across datasets and experiments.
  • Create clear, well-documented analytical artifacts and reproducible analysis workflows.
  • Collaborate with ML engineers and researchers to design challenging, real-world evaluation scenarios for MLE Bench.

Requirements

  • Minimum 3+ years of experience as a Data Analyst or Analytics-focused Engineer .
  • Strong proficiency in Python for data analysis.
  • Solid experience with SQL and relational datasets.
  • Experience analyzing ML outputs and evaluation metrics .
  • Strong understanding of statistics and analytical reasoning.
  • Ability to work with large, complex datasets and draw reliable insights.
  • Experience writing clean, readable, and well-documented analytical code .
  • Excellent spoken and written English communication skills .

Perks of Freelancing With Turing

  • Work in a fully remote environment.
  • Opportunity to work on cutting-edge AI projects with leading LLM companies.

Offer Details

  • Commitments Required: At least 4 hours per day and minimum 20 hours per week with overlap of 4 hours with PST.
  • Engagement Type: Contractor assignment (no medical/paid leave)
  • Duration of Contract: 3 months (adjustable based on engagement)
  • Location: India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey, Brazil, Mexico

Evaluation Process

  • Technical Interview with live coding challege (60 mins)

Skills: Machine Learning, Python, Data Analysis

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the MLE Bench - Data Analyst in San Francisco, CA vacancy
  •  ...Machine Learning Model SpecialistThe ideal candidate will have a foundational understanding of machine learning, data annotation, quality assurance, and natural language processing. They will play a pivotal role in updating our machine learning models and ensuring their... 
    Suggested
    Full time

    Welocalize

    San Francisco, CA
    2 days ago
  • $115k - $135k

    About CheckrCheckr is building the data platform to power safe and fair decisions. Over 140,000 companies and millions of people rely...  ...Combinator 2024 Breakthrough Company.About the team/roleAs a Product Analyst II, you will work hand-in-hand with multiple business... 
    Suggested
    Work at office
    Local area
    Remote work
    Relocation
    3 days per week

    Checkr

    San Francisco, CA
    4 days ago
  • DescriptionKforce has a client in San Francisco, CA that is seeking a Data Analyst.Responsibilities:* The Data Analyst will design business analysis, create and maintain dashboards to track business trends on a weekly and monthly basis* Create necessary data pipeline to... 
    Suggested
    Work experience placement
    Immediate start

    KForce

    San Francisco, CA
    3 days ago
  • $114.2k - $142.7k

     ...environmental, and humanitarian sectors. We are both a space company and data company all rolled into one.Customers and users across the globe...  ..., and The Netherlands.About the Role:We are seeking a Data Analyst to join our Data Team. The ideal candidate is curious,... 
    Suggested
    Full time
    Temporary work
    Work at office
    Local area
    Remote work
    Home office
    3 days per week

    Planet Labs

    San Francisco, CA
    4 days ago
  • $135k - $180k

    The RoleAt Candid Health, we’re searching for a Data Analyst to help us enhance efficiency, product scalability and operational decision making. You will perform critical analysis and implement data driven solutions that enable our engineering, product and leadership teams... 
    Suggested

    Candid Health

    San Francisco, CA
    4 days ago
  • $93.6k - $117k

     ...the tools, resources, and support you need to grow your career.Data at BrexThe Data organization develops insights, models, and data...  ...Marketing, Product, Engineering, and Operations. Our Data Scientists, Analysts, and Engineers work together to make data—and insights derived... 
    Work at office
    Remote work
    Work from home

    Brex

    San Francisco, CA
    5 days ago
  • Job-ID16730413Reference21-04570 Duties: The ideal candidate has experience applying data science to impact business outcomes, and enjoys pushing the boundaries to innovate. You will conduct analyses utilizing a variety of statistical methods, and build automated reports... 
    Local area

    Intelliswift

    San Francisco, CA
    7 days ago
  •  ...50 years later, it continues to build upon its legacy of enriching the lives of older adults. What You’ll Do as the Clinical Data Analyst: Essential Functions: Use data analysis to identify areas for improvement in various areas: staffing, patient care, or... 
    Full time
    Temporary work
    Part time
    Work at office
    Flexible hours
    Weekday work

    San Francisco Campus for Jewish Living

    San Francisco, CA
    20 hours ago
  •  ...Bench Scientist II Integrated Resources, Inc., is led by a seasoned team with combined decades in the industry. We deliver strategic...  ...responses to Regulatory questions as appropriate. Present data/ strategy to scientists (and management) in internal venues (technical... 

    Integrated Resources

    San Francisco, CA
    4 days ago
  •  ...Data Analytics What You'll Be Doing: Help create financial models and advanced analysis for budgeting and forecasting of our compensation investments. Expertise in visualization and using data insights to make recommendations and achieve goals. Experience using... 
    Work experience placement

    Omni Inclusive

    San Francisco, CA
    4 days ago
  •  ...Data Analyst Location: San Francisco, New York, Seattle, or Little Rock Duration: 12 + Months Contract Rate: DOE Client is the data collaboration platform of choice for the world's most innovative companies. A groundbreaking leader in consumer privacy, data ethics... 
    Contract work

    Staffing the Universe

    San Francisco, CA
    4 days ago
  • $135k - $200k

     ...healthcare technology company. The role Raydar is recruiting for this role on behalf of our client. Analyze business and operational data and maintain the reporting tools that help cross-functional groups make informed decisions. Pair hands-on analysis with data... 
    Full time
    Work at office

    Raydar Inc

    San Francisco, CA
    19 hours ago
  •  ...Data AnalystSan Francisco, California, United StatesAt Emendata, we help bridge the gap between data and the real world. We partner with organizations that have a social mission and help them tackle their problems using analytics. Our role in these partnerships goes end... 
    Full time
    Live in
    Visa sponsorship

    Emendata, LLC

    San Francisco, CA
    2 days ago
  •  ...DutiesHelpConducts complex data analysis to evaluate program effectiveness, inform policy decision, and assess the impact of legislation or regulations.Oversees contract and project performance by monitoring progress, evaluating contractor achievement of goals, and assessing... 
    Contract work
    For contractors

    U.S. Department of State

    San Francisco, CA
    4 days ago
  • $140k - $180k

     ...Data Analyst Harper is an AI-native commercial insurance company in San Francisco. We're not bolting AI onto insurance — we're rebuilding the entire business as software, on a simple bet: turning expert human judgment into compute is one of the largest transitions... 
    Relocation
    Monday to Friday
    Day shift

    Harper Group

    San Francisco, CA
    3 days ago
  • $88k - $95.5k

     ...jobs. Building on decades of experience and success, JVS is a data-driven organization that takes a whole systems approach to...  ...quality employment and economic mobility. The Role    The Data Analyst is a core member of JVS's Evaluation and Impact team, responsible... 
    Work at office
    Work from home
    Relocation

    Jewish Vocational Service (San Francisco)

    San Francisco, CA
    4 days ago
  • Title: Data Analyst III (HR/ Workday/ People Analytics) Location: San Francisco, CA or Seattle, WA (3 days/ week) Duration: 4+ months 179298 Pay rate: $65/hr to $68/hr Job Description: Role Overview: Client is seeking a detail-oriented Data Analyst to support a temporary... 
    Full time
    Temporary work
    For contractors
    Immediate start
    3 days per week

    Pinnacle Group

    San Francisco, CA
    2 hours ago
  •  ...Data Analyst Position at Air AppsAt Air Apps, we believe in thinking bigger—and moving faster. We're a family-founded company on a mission to create the world's first AI-powered Personal & Entrepreneurial Resource Planner (PRP), and we need your passion and ambition to... 
    Temporary work
    Worldwide

    Air Apps

    San Francisco, CA
    3 days ago
  •  ...Senior Program Analyst And Subject Matter Expert In Data AnalyticsThis position is located in Bureau of Consular Affairs (CA), Passport Services (PPT), Management Analysis and Coordination (MAC), Management and Process Analysis Division (MP). Serves as a senior program... 
    Work at office

    US Government Jobs

    San Francisco, CA
    4 days ago
  •  ...Data Analyst Recology provides organics, recycling, and solid waste collection and processing services to over 130 communities in California, Oregon, and Washington. Recology owns and operates composting facilities, transfer stations, materials recovery facilities,... 
    Contract work

    Samprasoft

    San Francisco, CA
    3 days ago
  • $190k - $270k

     ...multi-site deployments, and a partner ecosystem. Right now, the data that runs the business is scattered across a dozen systems that...  ...for analytical rigor at Meter; the bar that the next five analysts we hire will be measured against. What a typical week looks like... 
    Day shift

    Meter Service

    San Francisco, CA
    4 days ago
  •  ...The ideal candidate will use their passion for big data and analytics to provide insights to the business covering a range of topics. They will be responsible for conducting both recurring and ad hoc analysis for business users. Responsibilities Understand the day... 

    ShrinQ Consulting Group Inc

    San Francisco, CA
    4 days ago
  •  ...Job Title: Data Analyst Location: Brookline, MA (Remote within the United States) Employment Type: Full-time About Daice Labs Daice Labs is an AI research and product company founded by MIT CSAIL scientists, headquartered in Brookline, MA. The company develops... 
    Full time
    Local area
    Remote work

    Daice Labs

    San Francisco, CA
    3 days ago
  • $38 per hour

     ...Excellence Are you an experienced QA professional who knows how to mentor others and maintain a high bar for data integrity? Welo Data is seeking Data Quality Analysts for Project Perseus. This isn't just about labeling; you are the Quality Gatekeeper. You will bridge... 
    Hourly pay
    Full time
    Work at office
    Shift work

    Welo Data

    San Francisco, CA
    2 days ago
  • $123k - $165k

    Job Posting Title:Sr Data AnalystReq ID:10157869Job Description:The Product & Tech Analytics team is seeking a Sr. Data Analyst who will be a key player in driving personalization strategy on Disney+ and Hulu. We partner across the business to turn raw data into meaningful... 
    Full time

    Hulu

    San Francisco, CA
    3 days ago
  •  ...communication will only be sent from @Rippling.com addresses.About the roleRippling's Payments Data & Analytics team is seeking an experienced and highly skilled Senior Data Analyst - Payments (Internal title: Data Scientist) to join our rapidly expanding team. In this... 
    Work at office
    3 days per week

    Rippling

    San Francisco, CA
    3 days ago
  • $38 per hour

     ...Data Quality AnalystWelo Data is looking for experienced, detail-oriented professionals to join our team as Data Quality Analysts. This role sits at the center of execution and quality — bridging Data Labeling Associates (DLAs) and Team Leads to ensure work is not only... 
    Full time
    Contract work
    Remote work
    Visa sponsorship

    Welocalize

    San Francisco, CA
    4 days ago
  • $60k - $85k

     ...globally in our San Francisco, Seattle, and Delhi offices. Please reach out if you are interested in joining the future of AI! Data Operations Analyst We are looking for an eager and motivated Data Operations Analyst to join our Data Operations team. At Hive, our... 
    Work experience placement

    Hive

    San Francisco, CA
    1 day ago
  •  ...DescriptionAt least 2 years of experience with Information Technology and Test Delivery in which at least 2 years of experience in Test Data ManagementAt least 2 years of experience in FACET application or Healthcare IT systemsExcellent understanding of the Healthcare... 
    Permanent employment
    Full time
    H1b

    Sonsoft

    San Francisco, CA
    5 days ago
  • $127k - $150k

    Position Summary Healthcare Data Engineer Sr. Consultant Deloitte Consulting's technology professionals help clients identify and solve their most critical information and technological challenges. We provide advisory through end-to-end implementation services as... 
    Local area
    Visa sponsorship

    Deloitte

    San Francisco, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to MLE Bench - Data Analyst. Be the first to apply!