Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI-Driven Data Engineer - Frontier Pipeline Evaluator

Obsidian

Obsidian is seeking contributors to support a Frontier Code Agents project focused on evaluating and improving frontier AI coding models within realistic data engineering workflows. You will assess complex ETL pipelines, data warehouses, and distributed systems, using leading AI coding agents to drive rigorous testing and analysis. The role emphasizes critical thinking, bug detection, and comparison across multiple frontier models to gauge strengths, weaknesses, and scalability under real-world #J-18808-Ljbffr Obsidian

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AI-Driven Data Engineer - Frontier Pipeline Evaluator in New York, NY vacancy
  • BlackLine, a leading cloud software provider, seeks a Lead Data Engineer in New York to design, build, and optimize data pipelines powering AI-driven accounting agents. You will lead scalable data infrastructure and collaborate across teams to deliver high-quality data... 
    Pipeline
    Work at office

    BlackLine

    New York, NY
    2 days ago
  •  ...drives us to explore new frontiers, create unforgettable...  ...INDUSTRIES Senior Data Engineer Primary: Bay Area (...  ...We're doing an AI-first engineering rebuild...  ...of untangling years of pipelines. You're here to build...  ...Quality Focused: You've driven real improvements in pipeline... 
    Pipeline
    Work at office
    Relocation package
    Flexible hours
    2 days per week

    MrBeast

    New York, NY
    2 days ago
  •  ...Systems is seeking a founding analytics engineer in Finance to shape data infrastructure and analytics...  ...analytical features, building ETL/ELT pipelines, data modeling, ensuring data quality...  ...adopting modern data practices with AI as a core enabler. #J-18808-Ljbffr Mews... 
    Pipeline

    Mews Systems

    New York, NY
    2 days ago
  • $314.8k - $359.3k

    Senior Director, Data EngineerAs a...  ...Director, Data Engineer at Capital One,...  ...scalable, data-driven solutions. Our...  ...responsible and reliable AI systems,...  ...or a streaming pipeline in the...  ...testing, guardrails, evaluation, deployment, and...  ...risk** posed by frontier AI models and agentic... 
    Pipeline
    Full time
    Part time
    Local area
    Day shift

    Capital One

    New York, NY
    1 day ago
  • $220k - $250k

     ...Senior AI Data Engineer Cooley AI is seeking a Senior AI...  ...subsidiary of Cooley LLP. The frontier development arm of...  ...application: the RAG pipelines, embedding...  ...feature improvement. Evaluate and integrate Databricks...  ...package design, test-driven development, and production... 
    Pipeline
    Full time
    Temporary work
    Work at office
    Flexible hours
    Weekend work

    Cooley LLP

    New York, NY
    1 day ago
  • $200k - $300k

     ...pharma brands. Frontiers of technology: we...  ...the frontiers of AI to expand what is...  ...difficult, consequential data problem. About...  ...our first data engineer to build the data...  ...and transformation pipelines, identity and attribution...  ...batch and event-driven pipelines with... 
    Pipeline
    H1b
    Visa sponsorship

    OfferGenie

    New York, NY
    1 day ago
  •  ...drives us to explore new frontiers, create unforgettable...  ...generations. We're doing an AI-first engineering rebuild for a company...  ...someone else's pipelines. You're here to build the data infrastructure that powers...  ...data pipelines, event-driven architectures, and at least... 
    Pipeline
    Work at office
    Relocation package
    Flexible hours
    3 days per week

    Mrbeast

    New York, NY
    3 days ago
  • $150k - $250k

     ...Data Engineer - $150k - $250k Base ($200k - $400k TC) – NYC/ Chicago/ London (Hybrid) – Prop...  ...develop and maintain scalable data ingestion pipelines and core trading datasets. Onboard,...  ...data structures and APIs. Support AI-driven initiatives through the annotation and... 
    Pipeline

    Intec Select

    New York, NY
    2 days ago
  •  ...PATTERNIQ PatternIQ is an AI-powered consumer world...  ...consumers. Our ML-driven programmatic ad network...  ...recommendation engine. We're seed-stage...  ...open and direct. We let data settle arguments....  ...the parity between them. Pipeline health is your problem,... 
    Pipeline

    PatternIQ

    New York, NY
    3 days ago
  •  ...ServicesSelling Points Lead impactful data engineering projects in a fast-paced...  ...and optimize advanced data pipelines. Enhance skills with cutting-...  ...standards.Contribute to AI agent operations, supporting...  ...deployment and maintenance of AI-driven data workflows.Participate in... 
    Pipeline

    Green Key Resources

    New York, NY
    2 days ago
  •  ...EquitySelling Points Lead cutting-edge AI and data engineering initiatives in a dynamic environment....  ...enterprise systems. Shape the future of AI-driven analytics and automation.Job...  ...focuses on implementing advanced data pipelines and AI systems to support enterprise-wide... 
    Pipeline

    Green Key Resources

    New York, NY
    3 days ago
  •  ...rapidly growing Health-Tech company modernizing PBM with a data-driven platform. The Data Engineering team transforms streams into insights, enabling...  ...Snowflake, using Python heavily to implement scalable data pipelines, ensure data quality, and support executive decision-... 
    Pipeline

    SmithRx

    New York, NY
    2 days ago
  • $150k - $190k

     ...verticals, supplemented with Data & AI, Cybersecurity, Risk &...  ...years of professional software engineering experience to design, architect...  ...driving architecture, data pipelines, server-side services, integration...  ...or supporting messaging-driven or event-driven reference... 
    Pipeline
    Full time
    Temporary work
    Remote work
    Worldwide

    BIP US

    New York, NY
    18 hours ago
  • $100k - $140k

     ...bonusesResponsibilitiesWe are hiring a hands-on senior level Data Engineer to build trustworthy, well governed...  ...develop, and maintain scalable ELT/ETL pipelines and lakehouse structures in Microsoft...  ...of data products, BI solutions, and AI-driven use cases across business areas.... 
    Pipeline
    Work at office
    Remote work
    3 days per week

    GUARD Insurance Group

    New York, NY
    4 days ago
  •  ...the foundational data infrastructure that...  ...powers cutting-edge AI applications...  ...maintain scalable data pipelines, manage secure...  ...prepare data for AI-driven systems while collaborating...  ...hypotheses into engineered features, manage...  ..., automated agent evaluation (LangSmith, Opik,... 
    Pipeline
    Apprenticeship
    Work at office
    Local area
    Easy work

    McKinsey & Company

    New York, NY
    3 days ago
  • $148.5k - $260.1k

     ...SalesforceSalesforce is the #1 AI CRM, where humans...  ...effort is Master Data Management (MDM):...  ...seeking talented engineers at the Senior...  ...layers, event-driven architectures, Change...  ..., ETL/ELT pipelines, and large-scale data...  ...recruiters assess and evaluate candidates’... 
    Pipeline
    Full time

    Salesforce

    New York, NY
    5 days ago
  • $182k - $242k

    CoreWeave is The Essential Cloud for AI. Built for pioneers by...  ...more at .What You’ll Do:The Data Engineering Team builds and operates the...  ...CoreWeave. We design resilient data pipelines, scalable lakehouse systems,...  ...:Experience operating event-driven architectures using Kafka,... 
    Pipeline
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    4 days ago
  • $137.4k - $161.7k

     ...Monroe is seeking a Senior Data Engineer to join our Data & AI practice. In this role,...  ...ecosystems, develop scalable data pipelines, and establish trusted...  ..., and support data-driven recommendations for clients...  ...sound judgment in evaluating outputs.Apply AI technologies... 
    Pipeline
    Local area
    Immediate start
    Flexible hours

    West Monroe Partners

    New York, NY
    5 days ago
  • $91.1k - $179.5k

     ...6. Work you'll do The Data Engineer Consultant will support...  ...intelligence (AI), machine learning (ML...  ...design and deliver data-driven workforce and human capital...  ...into production-ready pipelines and platforms with strong...  ..., including evaluation, monitoring, governance... 
    Pipeline
    Local area

    Deloitte

    New York, NY
    1 day ago
  • $90k - $135.29k

     ...Surgical Intelligence is seeking a Data Engineer to support the development and deployment of data-driven tools in surgical care. This...  ...building and maintaining data pipelines, managing surgical datasets (including...  ...of research and clinical AI projects across the Department... 
    Pipeline
    Traineeship
    Local area
    Immediate start
    Flexible hours

    Mount Sinai Health System

    New York, NY
    4 days ago
  •  ...Role Overview The Lead Data Engineer will own the design, development,...  ...robust data architecture and pipelines leveraging cloud-based technologies...  ...strategic analytics, AI/ML initiatives, and data governance...  ..., Excel files, and event-driven systems. Develop ingestion... 
    Pipeline
    Full time

    The Phoenix Group

    New York, NY
    4 days ago
  • $320k - $405k

     ...Back to jobs New Data Engineer, Billing & Payments San Francisco...  ...interpretable, and steerable AI systems. We want AI to be...  ...insights that help teams make data-driven decisions....  ...and maintain data models and pipelines in dbt that transform raw billing... 
    Pipeline
    Work at office
    Visa sponsorship
    Flexible hours

    Royper Royco LLC

    New York, NY
    4 days ago
  • $220k - $245k

     ...healthcare in the U.S. — and using AI to scale that impact further...  ...an exceptional Senior Data Engineer with a high sense of ownership...  ...and implementations of data pipelines using Python and SQL in AWS....  ...development, medallion and event-driven architectures. ~... 
    Pipeline
    Work at office
    Flexible hours
    3 days per week

    Garner Health

    New York, NY
    1 day ago
  • $320k - $405k

     ...interpretable, and steerable AI systems. We want AI to...  ...committed researchers, engineers, policy experts, and...  ...About the role As a Data Engineer on the Data...  ...so teams can make data-driven decisions. Responsibilities...  ...and manage key dbt pipelines that turn raw logs into... 
    Pipeline
    For contractors
    Work at office
    Visa sponsorship
    Flexible hours

    anthropic

    New York, NY
    1 day ago
  •  ...Data Engineer May sit hybrid onsite in Wilmington, DE, McLean, VA, Richmond...  ...and optimize AWS-based data pipelines using Java, Scala, and Spark,...  ...will emphasize event-driven patterns, data quality, and operational...  ...integration in pipelines and AI automation exposure. Prior... 
    Pipeline

    Eliassen Group

    New York, NY
    2 days ago
  • $110k - $169k

     ...Job Description The Pricing Data Engineer builds and maintains the data...  ...that enable consistent, data-driven pricing across the firm while...  ...and the integration of AI-driven capabilities to enhance...  ...models Develop and manage data pipelines and queries to support... 
    Pipeline
    Full time
    Work at office

    McDermott Will & Schulte

    New York, NY
    1 day ago
  •  ...behalf of our client. Own the end-to-end data engineering work behind a large analytics and...  ...extending its attributes and improving the pipelines behind it. Expand connections to...  ...quality. Create interfaces that let AI-driven applications query and consume data... 
    Pipeline
    Full time
    Work at office

    Fast-growing software company

    New York, NY
    1 day ago
  • $197.3k - $225.1k

     ...Data Engineer 4 - ERM Transformation Do you love building and pioneering...  ...technology. We build data-driven tools that use machine learning...  ...powered by state-of-the-art AI technology. Our products,...  ...reusability across data platforms and pipelines Serve as an ambassador for... 
    Pipeline
    Full time
    Part time
    Internship
    H1b
    Local area

    Capital One

    New York, NY
    1 day ago
  •  ...Job Title: Data Engineer Location: NJ/NYC or Chicago - 3-4 days...  ...classification GCP NLP and AI exposure Specialist Data...  ...frameworks, and data-driven solutions. Your work will empower...  ...ETL tasks and optimizing data pipelines for speed and efficiency.... 
    Pipeline
    3 days per week

    3B Staffing LLC

    New York, NY
    4 days ago
  •  ...About the Role BDIPlus is looking for Senior Data Engineers who thrive on solving complex data challenges. You'll build highly scalable, event-driven data pipelines powering next-generation analytics and AI capabilities for an enterprise financial services platform... 
    Pipeline
    Visa sponsorship

    BDIPlus

    New York, NY
    18 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI-Driven Data Engineer - Frontier Pipeline Evaluator. Be the first to apply!