Senior Data Engineer: Scalable AI Pipelines & Governance
Dairy Challenge
Dairy Challenge is seeking an experienced Data Engineer to design, build, and optimize scalable ETL/ELT pipelines supporting AI/ML model training and inference. You will ensure data accuracy, security, and reliability through cleansing, validation, and continuous updates, while troubleshooting complex integration issues and promoting best practices. Ideal candidates will have 8+ years in data engineering, strong Python/SQL/PySpark skills, and experience with Azure Data Factory, Kafka, Snowflake, #J-18808-Ljbffr Dairy Challenge
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer: Scalable AI Pipelines & Governance in Brooklyn, NY vacancy
- Crexi, a leader in AI-powered commercial real estate technology, is seeking a Senior Data Engineer to own scalable data pipelines, models, and infrastructure powering Crexi Intelligence and related analytics. You will drive data quality, reliability, and observability...PipelineSenior
- ...Logistics in Chicago is seeking a Senior Data Engineer to own the data ecosystem... ...science. You will design and manage pipelines, data warehouses, and governance, partnering with data scientists... ...vision, mentor engineers, and drive scalable cloud infrastructure using...PipelineSenior
- COFCU is actively seeking a Data Engineer to design, build, and maintain scalable data infrastructure, pipelines, and production-grade data flows. You... ..., analytics, and future AI use cases while ensuring data quality and governance. The role sits at the intersection...Pipeline
- WhiteWaterExpress is seeking a Senior Data Engineer to design and build scalable data solutions turning complex business data into actionable insights. You will own critical data infrastructure, pipelines, integrations, and warehouse solutions that support operations, analytics...PipelineSenior
- ...Mandatory - GCP BigQuery, Dataflow, Python, Cloud Composer, Data Governance & Validation The Senior Data Engineer will be responsible for designing, developing, and maintaining scalable data pipelines and solutions on Google Cloud Platform (GCP). The role focuses...PipelineSenior
Omni Inclusive
Secaucus, NJ2 days ago - Tesla in Fremont, California is seeking a Sr Data Engineer to design and maintain scalable data architectures, pipelines, and analytics supporting executive decision-making. You will collaborate with the Information and Examination group, ensure data quality, implement...PipelineSenior
- Warner Bros. Discovery is seeking a Senior Staff Data Engineer to design and deliver data pipelines processing billions of ad events daily, and to modernize... .... You will drive observability, data governance, and scalable data platforms across global teams. The role...PipelineSenior
$175k - $205k
...Cortex Cortex is the Engineering Operations Platform -... ...mission control for the AI software factory. As AI... ...the visibility, governance, and golden paths to move... ...here. Role Summary As a Senior Data Engineer , you’ll own... ...internal data systems and pipelines. You will be...PipelineSeniorWork experience placementRemote workFlexible hoursCortex
Brooklyn, NY2 days ago- ...technology company in North America, seeks a Senior Data Engineer to own the data ecosystem powering... ...and data science. You’ll design data pipelines, maintain data warehouses, ensure... ...cloud infrastructure with a focus on governance and automation. You will collaborate with...PipelineSenior
- Ycotek is seeking a Data Engineer to design, build, and optimize data pipelines and data lakes. You will collaborate with analysts... ...scientists to translate business needs into scalable technical solutions and ensure data quality and governance. The role involves working with SQL...Pipeline
- Tru Staffing Inc. seeks a Senior Data Engineer to design, build, and operate enterprise data platforms... ...supporting reporting, analytics, and AI/ML initiatives. You will work on data lakes, warehouses, ETL/ELT pipelines, and data governance, ensuring high availability and model...PipelineSeniorRemote jobWork at office
- Senior Data Engineer at American Airlines is seeking a seasoned data professional to advance data management, governance, and analytics across the enterprise. The role emphasizes building scalable data pipelines, enabling data access, and driving insights with modern tooling...PipelineSeniorRemote job
$90k - $165k
...alternative application process. Senior Data Engineer (On Site, Washington, DC)... ...complex data migration and pipeline engineering initiatives... ...legacy ETL artifacts into scalable Python/PySpark code, migrates... ...and implements robust data governance and automated...PipelineSeniorFull timeWork at officeImmediate startMonday to FridayDay shift- ...seeking a Microsoft Fabric Data Architect to scale... ...for BI, ML, and AI initiatives and to communicate... ...effectively with senior leadership. You will... ..., review Spark pipelines, and enable ML/AI capabilities... ..., while advising on governance and scalability. #J-18808-Ljbffr...PipelineSenior
- Dairy Farmers of America, Inc. is seeking an experienced data engineer to design and optimize scalable ETL/ELT pipelines for AI/ML model training and inference. You will ensure data accuracy, security, and governance while collaborating with software engineers, data...PipelineSenior
$160k - $200k
...not just IOCs, from various data sources. Nebulock acts like a teammate: a 24/7 AI threat hunter that investigates... ...to detect anomalies. As a Senior Data Engineer on this team, you will own... ...Design, build, and maintain scalable data pipelines that ingest and process large...PipelineSeniorFull timeRemote workNebulock Inc.
Brooklyn, NY4 days ago- ...consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics... ...are seeking an experienced Data Engineer to join our data team. In this role... ...designing, building, and maintaining scalable data pipelines, data integration processes, and...PipelineSeniorLocal area
Tiger Analytics
Brooklyn, NY2 days ago $140.5k - $205k
...Artificial Intelligence (AI) Sr. Data Engineer will design, build,... ..., cyber/risk, model governance, data science, and... ...technology needs into secure, scalable, measurable... ...reusable models, data pipelines, APIs, feature workflows... ...engineering teams, senior stakeholders, governance...PipelineSeniorFull timeWork at officeFlexible hoursDay shift- Humana, Inc. seeks a Senior Data Engineer to build and evolve the data foundation... .../Silver/Gold lakehouse pipelines, develop Gold feature... ...will ensure data quality, governance, and scalable models while collaborating with Data Science, AI Engineering, and Platform Engineering...PipelineSeniorRemote job
- Celigo, Inc. is seeking a Senior Data Engineer to own the design and delivery of scalable Snowflake-based ELT pipelines and data models. You will collaborate... ...will enforce data quality, governance, and cost-aware optimization, while leveraging AI-assisted tooling to...PipelineSeniorRemote job
- ...like application development and AI/ML, and our people-first culture has... ...THE ROLE We are looking for a Senior Data Engineer to design and build scalable data lakes, warehouses, and lakehouse... ...will implement Python-based ETL/ELT pipelines, orchestrate workflows with...PipelineSeniorWork at officeRemote workVisa sponsorshipWork visaFlexible hours
AgileEngine
Jersey City, NJ1 day ago - ...seeking a Sr Full-Stack Software Engineer for AIML Data Operations. You will work on data pipelines, web services, and front-end... ...collaborate with teams across Apple’s AI initiatives and user-facing... ...production-grade software and scalable solutions across platforms. #J...PipelineSenior
- ...growing platform and a strong data-driven backend. As a Senior Backend Engineer, you will own Ad Factory's infrastructure, data pipelines, and APIs, shaping how... ...analyzed. You will build scalable Postgres schemas, GraphQL... ..., while embracing AI-enabled productivity. Join...PipelineSeniorRemote job
- 540 is seeking a Senior Data Engineer to support a mission-critical federal... ...federal systems to build scalable data pipelines, APIs, and data products... ...thinking company that the government turns to in order to get shit... ...data Experience using AI/ML to accelerate work, including...PipelineSeniorTemporary workLocal areaRemote workFlexible hours
540
Brooklyn, NY2 days ago $200k - $250k
...re building the AI intelligence... ...Ambience runs on data: which clinicians... ...is a hard data engineering problem, and it... ...'ll own. As a Senior Data Engineer,... ...build and run the pipelines that ingest... ...model it into governed metrics, and put... ...outcomes. Support Scalable Infrastructure:...PipelineSeniorWork at officeRemote workFlexible hoursAmbience Healthcare, Inc.
Brooklyn, NY1 day ago- UnitedHealth Group is seeking a Senior Data Engineer to join the UHC Core Data KTLO team in Eden Prairie, MN or remotely within the U.S. The role focuses on building AI-powered data platforms, scalable pipelines, and modern data architectures to empower healthcare outcomes...PipelineSeniorRemote job
- ...E-commerce, and Data Analytics. Our industry... ...a full-time Senior Data Engineer who will support... ...data integration pipelines that enable our team... ...will also build scalable tools and work... ...data Use modern AI tools like Claude... ...state and local laws governing nondiscrimination...PipelineSeniorFull timeWork at officeLocal areaRemote workVisa sponsorship
Digital Envoy
Brooklyn, NY2 days ago - ...environment. Who We Want As a Senior Data Engineer at Arrive Logistics,... ...as well as own the pipelines that ingest and... ...and optimize robust, scalable, and reliable data pipelines... ...model to ensure data governance throughout all data... ..., and evaluates AI agents and reusable skill...PipelineSeniorWork experience placementCasual workWork at officeLocal areaRelocationRelocation package
Arrive Logistics
Brooklyn, NY5 days ago $77.5k - $176k
...and unstructured data available today... ...As aseniorData Engineer, you know that... ...deployment of pipelines and platforms that... ...maintenance of scalable platforms for... ...Generative AI, including RAG,... ...enterprise data governance Knowledge of Agile... ...Data Engineer, Senior The Opportunity...PipelineSeniorFull timeContract workPart timeWork at officeLocal areaRemote workBooz Allen Hamilton
Brooklyn, NY15 hours ago$126k - $210k
...harness cutting-edge AI and breakthrough technologies... ...batch/streaming data pipelines and transformations that... ...ensure high‑quality, governed data flows into AI and... ...platforms.Develop scalable transformation frameworks... ...dependencies using modern data engineering tools.Partner with...PipelineSeniorTemporary workWorldwideFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer: Scalable AI Pipelines & Governance. Be the first to apply!
Related searches
- data center engineer Brooklyn, NY
- senior cloud data engineer Brooklyn, NY
- data infrastructure engineer Brooklyn, NY
- sr information security engineer Brooklyn, NY
- data visualization developer Brooklyn, NY
- remote data engineer Brooklyn, NY
- etl data engineer Brooklyn, NY
- data engineer analytics Brooklyn, NY
- sr data engineer Brooklyn, NY
- junior big data engineer Brooklyn, NY