Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI-Driven Data Engineer - Frontier Pipeline Evaluator

Obsidian

Obsidian is seeking contributors to support a Frontier Code Agents project focused on evaluating and improving frontier AI coding models within realistic data engineering workflows. You will assess complex ETL pipelines, data warehouses, and distributed systems, using leading AI coding agents to drive rigorous testing and analysis.

The role emphasizes critical thinking, bug detection, and comparison across multiple frontier models to gauge strengths, weaknesses, and scalability under real-world

#J-18808-Ljbffr
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI-Driven Data Engineer - Frontier Pipeline Evaluator in New York, NY vacancy
  • Scan.com is looking for a data-driven professional to own end-to-end data workflows, from raw sources to decision-ready assets. You will transform data with dbt, build reliable pipelines in Snowflake, and deliver Tableau dashboards used across operations and product teams... 
    Pipeline
    Remote job

    Doist

    New York, NY
    3 days ago
  •  ...hiring a Product Analytics Engineer to join the Product...  ...responsible for analytics data systems powering the Falcon...  ...Console. You will design data pipelines, deliver insights, and enable data-driven product decisions at...  ...teams, with exposure to AI-enabled tooling and modern... 
    Pipeline

    CrowdStrike

    New York, NY
    3 days ago
  • EvolutionIQ is hiring a Senior Analytics Engineer to lead the design, development, and scale of its analytical data platform. You will build robust ETL/ELT pipelines, optimize data models, and partner...  ...and engineers to deliver data-driven insights. You will establish data... 
    Pipeline

    EvolutionIQ

    New York, NY
    4 days ago
  •  ...a Senior Analyst, Analytics engineering to empower our analytics community...  ...maintaining, and governing a data warehouse of operational and...  ...develop a semantic layer and AI-driven self-service analytics,...  ...contribute to scalable data pipelines and governance. #J-18808-Ljbffr... 
    Pipeline

    3M HEALTHCARE

    New York, NY
    3 days ago
  • $200k - $225k

    Data Engineer, Data Products Location: New York...  ...Minerva builds AI for marketing leaders...  ...and transformation pipelines without creating a...  ...quests: identify and evaluate new sources,...  ...facing systems - Frontier and open-source models...  ...and SQL. - Driven by first-principles... 
    Pipeline
    Full time
    Work at office
    Immediate start
    Relocation package

    Minerva

    New York, NY
    2 days ago
  • $175k - $250k

    Millennium is seeking a Commodities Content Engineer based in New York to develop robust ETL workflows on their commodities data platform. The role involves using Python and SQL for data processing and analytics collaboration with various teams. Candidates should have... 
    Pipeline

    Millennium

    New York, NY
    15 hours ago
  • Regard, located in New York City, is seeking an experienced Data Engineer to build and maintain data pipelines for analytics and machine learning. Candidates should have at least 3 years of experience in data engineering, proficient in Python and SQL, and familiar with... 
    Pipeline
    Work at office

    Regard

    New York, NY
    5 days ago
  •  ...operates at the frontier of predictive...  ...intelligence, using AI to simulate and...  ..., mission-driven team and we intend...  ...THE ROLE As a Data Integration...  ...intersection of data engineering and...  ...maintain scalable pipelines to ingest, clean...  ...pipelines Help evaluate new data sources... 
    Pipeline
    Work at office
    Relocation
    Visa sponsorship
    Relocation package

    Aaru

    New York, NY
    3 days ago
  • DoorDash is seeking a senior BI/Data Engineer to own critical parts of our data infrastructure...  ...to key stakeholders, and architect AI-driven flows across our stack including DBT, Looker...  ...and drive governance standards across pipelines. You will collaborate with GTM, Finance... 
    Pipeline

    Doordashusa

    New York, NY
    15 hours ago
  •  ...Corporate Functions Data Office is part of the...  ...head into our New Frontier strategy! The Lead Data Engineer plays a critical role...  ...commitment to data‑driven decision‑making and...  ...reliable, and maintainable pipelines in Azure Data Bricks...  ...leveraging AI and ML capabilities... 
    Pipeline
    Work at office

    MetLife

    New York, NY
    1 day ago
  •  ...une entreprise innovante dans le secteur de la technologie cloud, recherche un Data Engineer talentueux pour rejoindre son équipe dynamique. Le poste implique le développement de pipelines de données, la mise en œuvre de solutions de Big Data et la collaboration à des... 
    Pipeline
    Remote job

    Cloudacio

    New York, NY
    2 days ago
  • $175k - $250k

    Data Engineer - CommoditiesThe Commodities Technology team builds and operates...  ..., implement and maintain pipelines that ingest, clean, transform...  ..., and consistency. Leverage AI to automate schema inference...  ...ingestion pipelines. Apply AI-driven data quality, observability,... 
    Pipeline

    Millennium Management

    New York, NY
    4 days ago
  •  ...advanced hardware, software, and AI technology to make it...  ...of sleep into a personalized, data-driven recovery experience. We are trusted...  ...we need a world-class Data Engineer to power our next phase of...  ...by architecting the analytics pipelines that power individualized sleep... 
    Pipeline
    Full time
    Work at office
    Immediate start
    Worldwide
    Sleeping nights
    Night shift

    Eight Sleep

    New York, NY
    1 day ago
  • $106k - $151k

    Build data pipelines, reports, best practices and frameworks that enable analysts and...  ...the organization.Use feature engineering to support data needs for ML/AI model development and subsequent scaling...  ...you will use an analytical, data-driven approach to drive a deep... 
    Pipeline

    Google

    New York, NY
    3 days ago
  • $100k - $140k

     ...bonusesResponsibilitiesWe are hiring a hands-on senior level Data Engineer to build trustworthy, well governed...  ...develop, and maintain scalable ELT/ETL pipelines and lakehouse structures in Microsoft...  ...of data products, BI solutions, and AI-driven use cases across business areas.... 
    Pipeline
    Work at office
    Remote work
    Weekend work
    3 days per week

    GUARD Insurance Group

    New York, NY
    5 days ago
  •  ...management firm seeking a Senior Data Engineer to help transform and...  ...build, and maintain scalable ELT pipelines using Python, SQL Server, Snowflake...  ....Familiarity with event-driven architectures, CDC, streaming...  ...building semantic layers and AI-ready data platforms.If you... 
    Pipeline
    Work at office
    Immediate start
    Work from home

    Solomon Page

    New York, NY
    1 day ago
  •  ...enterprises. We’re on the frontier of an entirely new...  ...category: Agentic AI. We enable...  ...a time. Senior Data Engineer (AI‑First) Mission...  ...focused solely on pipelines and dashboards. You...  ..., and agent‑driven decision support....  ...business data safely Evaluate emerging AI technologies... 
    Pipeline
    Remote work

    Smartcat

    New York, NY
    2 days ago
  • $182k - $242k

    CoreWeave is The Essential Cloud for AI. Built for pioneers by...  ...more at .What You’ll Do:The Data Engineering Team builds and operates the...  ...CoreWeave. We design resilient data pipelines, scalable lakehouse systems,...  ...:Experience operating event-driven architectures using Kafka,... 
    Pipeline
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    5 days ago
  • $97.17k - $126.32k

     ...mindset.About the Role:The Data Engineer designs, develops, and...  ...high-performing data pipelines, data warehouses,...  ...initiatives, and data-driven decision-making. The position...  ...standards.• Evaluate emerging technologies...  ...Intelligence, analytics, and AI initiatives through... 
    Pipeline
    Full time
    Local area
    Visa sponsorship

    New York State Technology Enterprise Corporation (NYSTEC)

    New York, NY
    2 days ago
  • $110k - $190k

    Senior Data Management Professional - Data Engineering - Commodities Data Location New York...  ...quality is built directly into pipelines, systems and architecture...  ...technologies including AI and machine learning to...  ...analysis to support data-driven decision making and... 
    Pipeline
    Temporary work
    For contractors
    Work experience placement

    Bloomberg

    New York, NY
    2 days ago
  • $137.4k - $161.7k

     ...Monroe is seeking a Senior Data Engineer to join our Data & AI practice. In this role,...  ...ecosystems, develop scalable data pipelines, and establish trusted...  ..., and support data-driven recommendations for clients...  ...sound judgment in evaluating outputs.Apply AI technologies... 
    Pipeline
    Local area
    Immediate start
    Flexible hours

    West Monroe Partners

    New York, NY
    1 day ago
  • $148.5k - $260.1k

     ...SalesforceSalesforce is the #1 AI CRM, where humans...  ...to power AI-driven experiences,...  ...search, enterprise data discovery, and...  ...Knowledge Graph and AI Engineering team.The SMTS will...  ..., semantic pipeline workflows, and AI-...  ...infrastructure standards.)Evaluate & Innovate (LMTS):... 
    Pipeline
    Full time
    Contract work

    Salesforce

    New York, NY
    1 day ago
  • Millennium in New York seeks a seasoned software engineer to join the Fixed Income RAD team,...  ..., production-grade analytics and AI-enabled solutions for portfolio managers...  ...empower investment decisions. You’ll develop data pipelines, dashboards and web UIs using React/... 
    Pipeline

    Millennium

    New York, NY
    2 days ago
  • $90k - $135.29k

     ...Surgical Intelligence is seeking a Data Engineer to support the development and deployment of data-driven tools in surgical care. This...  ...building and maintaining data pipelines, managing surgical datasets (including...  ...of research and clinical AI projects across the Department... 
    Pipeline
    Traineeship
    Local area
    Immediate start
    Flexible hours

    Mount Sinai Health System

    New York, NY
    5 days ago
  • $176k - $210k

    Komodo Health Inc is seeking a Senior Data Engineer based in San Francisco to develop and maintain AWS cloud infrastructure and enhance...  ...expert knowledge of AWS services, along with experience in CI/CD pipelines and big-data tools. This role offers a salary range of $176,0... 
    Pipeline

    Komodo Health

    New York, NY
    15 hours ago
  •  ...technologies like Generative AI to increase...  ...join a team of analytics engineers focused on delivering clean...  ...structured, and reliable data to power various...  ...and maintain dbt data pipelines to deliver clean, reliable...  ...problem-solving, and purpose-driven innovation. Here, you’... 
    Pipeline
    Local area
    3 days per week

    New York Life Insurance Company

    New York, NY
    1 day ago
  •  ...and passionate Senior Data Engineer to design and execute...  ...Azure cloud, APIs, and AI. You will be responsible...  ...of optimal data pipelines taking advantage of leading...  ...responsible for the evaluation of existing data pipeline...  ...-solving, and purpose-driven innovation. Here, you’... 
    Pipeline
    Local area
    3 days per week

    New York Life Insurance Company

    New York, NY
    3 days ago
  • $207k - $275k

     ...The Essential Cloud for AI. Built for pioneers by...  ....What You'll Do:The Data Engineering Team builds and operates...  ...design resilient data pipelines, scalable lakehouse...  ...broader platform strategy.Evaluate and standardize core...  ...operating event-driven architectures using Kafka... 
    Pipeline
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    5 days ago
  • $140k - $215k

     ...world’s most advanced AI-native platform. We work...  ...to work for a mission-driven company leveraging AI to...  ...hiring a Product Analytics Engineer for CrowdStrike's...  ...maintains the analytics data systems that power the...  ...about trade-offsBuild data pipelines that process large... 
    Pipeline
    Full time
    Work experience placement
    Work at office
    Local area
    Worldwide

    CrowdStrike

    New York, NY
    3 days ago
  • $110k - $169k

     ...Pricing Data Engineer Build and maintain data infrastructure and tools for consistent, data‑driven pricing across the firm. Collaborate with cross...  ...workflows, integrate AI, and improve pricing analysis...  ...models Develop and manage data pipelines and queries to support... 
    Pipeline
    Full time
    Work at office

    McDermott Will & Schulte LLP

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI-Driven Data Engineer - Frontier Pipeline Evaluator. Be the first to apply!