Data Engineer: Build Scalable AI-Driven Data Pipelines
Vericence
About Vericence Vericence is a digital engineering and technology consulting firm helping enterprises build AI-driven platforms, modernize legacy systems, and scale innovation through cloud, data, and intelligent engineering. We partner with global organizations to deliver high-impact technology solutions and build world‑class engineering teams. Core Skills & Experience Strong hand‑on experience with Python and PySpark, including deep understanding of Spark concepts, performance tuning, and scalable data processing Experience with modern data platforms such as Snowflake, Databricks, or similar cloud‑based solutions Solid understanding of data pipeline design, development, orchestration, and monitoring for batch and streaming workloads Familiarity with Medallion Architecture (bronze, silver, gold layers) and best practices for data transformation Strong knowledge of autoscaling, cluster optimization, and cost‑efficient data processing in distributed/cloud environments Experience with CI/CD, DevOps practices, and version control; exposure to Terraform or Infrastructure‑as‑Code tools is preferred Ability to collaborate effectively with business, analytics, and engineering teams to deliver scalable and reusable data solutions #J-18808-Ljbffr Vericence
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Data Engineer: Build Scalable AI-Driven Data Pipelines in New York, NY vacancy
- ...technology company based in the United States is seeking a Data Engineer to build scalable pipelines and deliver reliable data models. The role requires... ...compensation, benefits, and the chance to work in a mission-driven environment dedicated to improving healthcare outcomes....PipelineRemote job
- A leading AI-native revenue platform is seeking its first Data Engineer to design and implement a scalable data infrastructure. This role involves building reliable data pipelines, maintaining data quality, and translating business metrics into actionable models. Ideal...Pipeline
- A leading technology research organization is seeking an AI Data Engineer to build scalable data pipelines and collaborate with data scientists on impactful AI initiatives. This is a fully remote role ideal for someone with at least 4 years of Data Engineering experience...PipelineRemote job
$138k - $181.65k
A leading sports technology company is searching for a Senior Data Engineer in New York, NY, to design and build scalable data solutions that drive analytics and business operations. The role requires at least 5 years of data engineering experience and proficiency in SQL...Pipeline- ...healthcare advocacy marketplace is seeking a skilled Python Data Engineer to design and build data pipelines that enhance healthcare outcomes. This fully remote... ...patient health decisions. Solace Health is a mission-driven company founded in 2022, looking for passionate...PipelineRemote job
- ...forward-thinking technology company is seeking a Data Engineer to join their team. In this role, you will design, build, and maintain data infrastructures and... .... Key responsibilities include developing scalable data pipelines and collaborating with teams on data requirements...Pipeline
- A tech-driven storage solutions provider is seeking a Data Engineer to enhance data operations. This role involves designing scalable data pipelines, ensuring data quality across the organization, and collaborating with teams to make data accessible. The ideal candidate...PipelineFull time
- ...structures based in New York is seeking a Junior Data Engineer to develop scalable data processing pipelines. The successful candidate will collaborate with a... ...Knowledge of Informatica is a plus. This position requires US citizenship. #J-18808-Ljbffr Unrivaled Metal BuildingsPipeline
$180k - $260k
Whatnot is seeking a Data Engineer to build and scale systems that drive data-driven decisions across the company. The role involves defining data architecture, building pipelines, and implementing data models that ensure data quality and efficiency. With a salary range...Pipeline- CLEAR is seeking a Data Engineer II in New York City to enhance their secure identity platform. The role involves building scalable data systems, developing data pipelines, and collaborating with stakeholders. The ideal candidate has at least 4 years of experience in data...Pipeline
- McKinsey & Company in New York seeks a Data Engineer II to design and optimize data platforms that power advanced analytics. You will build secure data pipelines and collaborate with cross-functional teams to ensure data accuracy and production readiness. The ideal candidate...Pipeline
- A leading staffing company is seeking a Senior Data Engineer in New York, NY to design and build scalable data solutions utilizing various Microsoft Azure tools and technologies. The ideal candidate will have significant experience in data modeling, big data environments...Pipeline
- Comcast is seeking an AI Data Engineer (Level 5) to drive best... ...supporting Global Audit by building and maintaining a... ...capabilities in designing scalable solutions and resilient data pipelines. This role offers significant... ...through data-driven insights. #J-18808-Ljbffr...Pipeline
- Arhaus, LLC. is seeking a Data Engineer in Kentucky to design, build, and optimize scalable data platforms and AI-driven solutions. You will work on a modern data architecture with... ...a focus on AI implementation and data pipeline automation, collaborating with cross-functional...Pipeline
- Senior Data Engineer - Modern Engineering Team Apply... ...is central to building and evolving our next... ...generation, event-driven data platform,... ...effectively with AI coding agents and... ...production-grade data pipelines built on Java, Spring... ...documentation of scalable, highly available,...PipelineFull timeWork experience placement
- Happy Scribe is seeking a Data Engineer in New York City, responsible for building and managing the data foundation of Glidepath. The ideal... ...in data engineering, focusing on creating scalable data pipelines and powering AI-driven insights. This position offers a unique...PipelineLocal area
- ...Talent is seeking a Founding Senior Data Engineer in New York, NY. This role... ...the data platform to create a scalable data stack that powers analytics... ...and reporting. With a focus on building intuitive data models and optimizing data pipelines, you'll collaborate with teams...Pipeline
- ...is seeking a talented and experienced Data Engineer to build a robust data platform on Azure Cloud.... ...experience in designing and managing data pipelines, ensuring data quality, and leveraging... ...the Data Engineer will contribute to scalable data ingestion, transformation, and...Pipeline
- A technology solutions company in the United States is seeking a Data Engineer to develop and maintain data models and scalable data pipelines using Snowflake and DBT. The ideal candidate has proven experience with data warehousing concepts, CI/CD pipelines, and excellent...Pipeline
- Peraton is seeking a Senior Data Engineer to design and build scalable data foundations that support advanced AI-enabled capabilities. This role requires combining data engineering... ...should have extensive experience in data pipelines, natural language processing, and graph...Pipeline
- The State of Oklahoma is looking for a skilled Data Engineer to enhance its data services team in Oklahoma City. This role involves building robust data pipelines and maintaining data platforms, contributing to analytics initiatives. Candidates should have at least 4 years...Pipeline
- A healthcare advocacy startup is looking for a Data Engineer to build and optimize data pipelines. The ideal candidate should be proficient in Python and SQL, with experience using Airflow, Terraform, and Snowflake. You will play a key role in ensuring data reliability...PipelineRemote job
$64.89k - $173.04k
Hispanic Alliance for Career Enhancement is seeking a Data Engineer in Delaware to design and implement data pipelines. This full-time role involves building ETL/ELT pipelines, optimizing data models, and collaborating with data scientists. The ideal candidate will have...PipelineFull time- An innovative InsurTech MGA is seeking a Data Engineer to design scalable data systems that facilitate analytics and underwriting... ...collaborate with cross-functional teams to build robust infrastructure and drive data-driven decisions. The ideal candidate has 3+ years of...PipelineRemote job
- A cutting-edge technology firm based in New York is seeking a Data Engineer to join their team. The role requires someone to architect and build data pipelines, manage data quality and governance, and develop solutions to protect sensitive information. The ideal candidate...PipelineWork at office
- Jobgether is looking for a Senior Data Engineer to work remotely and transform data into actionable insights, enhancing data infrastructure... ...and programming in Python. The Senior Data Engineer will build data pipelines, collaborate with teams, and develop analytical tools to...PipelineRemote job
$110k - $130k
The New York Times in New York, NY, is seeking a Data Engineer for the Partner Revenue team. This hybrid position requires 3 days in the office and involves developing scalable data and ETL solutions to enhance data-informed decision-making. Candidates should have 2+ years...PipelineWork at office- ...in the United States is seeking a Senior Data Engineer to join their team. This role focuses on designing and maintaining scalable data infrastructures, ensuring high-quality... ...successful candidate will implement data pipelines, optimize performance, and support advanced...Pipeline
- IDT Corporation is seeking a skilled Data/ML Engineer to join their BI team. This remote opportunity... ...designing and maintaining data pipelines, collaborating with data stakeholders, and implementing scalable infrastructure for LLM-driven applications. Candidates should have...PipelineRemote job
- Citta Solutions Private Limited is seeking a Data Engineer to design and implement data solutions that enhance OLAP and OLTP processes. This... .... The ideal candidate will collaborate with team members to build ETL processes and ensure data quality through automation. A Bachelor...Pipeline
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer: Build Scalable AI-Driven Data Pipelines. Be the first to apply!
Related searches
- senior data center engineer New York, NY
- bi data engineer New York, NY
- data engineer manager New York, NY
- data science developer New York, NY
- junior data developer New York, NY
- etl data engineer New York, NY
- entry level big data engineer New York, NY
- data engineer New York, NY
- big data cloud engineer New York, NY
- junior big data engineer New York, NY