Data Engineer: Build Scalable AI-Driven Data Pipelines
Vericence
About Vericence Vericence is a digital engineering and technology consulting firm helping enterprises build AI-driven platforms, modernize legacy systems, and scale innovation through cloud, data, and intelligent engineering. We partner with global organizations to deliver high-impact technology solutions and build world‑class engineering teams. Core Skills & Experience Strong hand‑on experience with Python and PySpark, including deep understanding of Spark concepts, performance tuning, and scalable data processing Experience with modern data platforms such as Snowflake, Databricks, or similar cloud‑based solutions Solid understanding of data pipeline design, development, orchestration, and monitoring for batch and streaming workloads Familiarity with Medallion Architecture (bronze, silver, gold layers) and best practices for data transformation Strong knowledge of autoscaling, cluster optimization, and cost‑efficient data processing in distributed/cloud environments Experience with CI/CD, DevOps practices, and version control; exposure to Terraform or Infrastructure‑as‑Code tools is preferred Ability to collaborate effectively with business, analytics, and engineering teams to deliver scalable and reusable data solutions #J-18808-Ljbffr
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Data Engineer: Build Scalable AI-Driven Data Pipelines in New York, NY vacancy
$85k - $107k
...technology company is seeking an Intermediate Data Engineer to transform raw data into useful data systems. You will build scalable data pipelines for batch and stream processing in a... ...with business teams to enhance data-driven decision making. The position requires a...PipelineFrontdoor
New York, NY4 days ago- ...technology company based in the United States is seeking a Data Engineer to build scalable pipelines and deliver reliable data models. The role requires... ...compensation, benefits, and the chance to work in a mission-driven environment dedicated to improving healthcare outcomes....PipelineRemote work
Empassion Health
New York, NY2 days ago - ...A leading technology research organization is seeking an AI Data Engineer to build scalable data pipelines and collaborate with data scientists on impactful AI initiatives. This is a fully remote role ideal for someone with at least 4 years of Data Engineering experience...PipelineRemote work
Pro Search
New York, NY2 days ago - ...forward-thinking technology company is seeking a Data Engineer to join their team. In this role, you will design, build, and maintain data infrastructures and... .... Key responsibilities include developing scalable data pipelines and collaborating with teams on data requirements...Pipeline
Ira Commerce
New York, NY2 days ago - ...A leading identity verification firm is seeking a Senior Data Engineer to join their Data Automation team. You will be responsible for designing and building scalable data platforms and pipelines crucial to their identity verification products. The ideal candidate has...Pipeline
Socure Inc
New York, NY2 days ago - ...A tech-driven storage solutions provider is seeking a Data Engineer to enhance data operations. This role involves designing scalable data pipelines, ensuring data quality across the organization, and collaborating with teams to make data accessible. The ideal candidate...PipelineFull time
Storable
New York, NY2 days ago - ...A technology and services company is seeking a Data Engineer to design, build, and optimize scalable data systems that drive business insights and workflows. The role involves developing ETL pipelines, optimizing data models, and enhancing data quality and integrity. Candidates...PipelineRemote work
Safe Ride Services
New York, NY2 days ago - ...A dynamic educational data management company in the United States is seeking a Data Engineer to build scalable data pipelines and enhance backend database systems. The ideal candidate will have a strong proficiency in SQL, experience with AWS Glue and Microsoft SQL Server...Pipeline
Munetrix
New York, NY2 days ago - ...A data analytics firm is seeking a Data Engineer to help clients build scalable, reliable data infrastructure. The role is fully remote but candidates must reside in the United States. The engineer will design pipelines, optimize cloud solutions, and work with modern data...PipelineRemote work
NuView Analytics
New York, NY2 days ago $138k - $181.65k
A leading sports technology company is searching for a Senior Data Engineer in New York, NY, to design and build scalable data solutions that drive analytics and business operations. The role requires at least 5 years of data engineering experience and proficiency in SQL...Pipeline- Brightcrew Ltd in New York is looking for a Data Engineer to develop the data infrastructure for a healthcare AI platform. This full-time hybrid role involves building and maintaining data pipelines, ensuring clean data integration, and modeling complex workflows. Candidates...PipelineFull time
- A leading staffing company is seeking a Senior Data Engineer in New York, NY to design and build scalable data solutions utilizing various Microsoft Azure tools and technologies. The ideal candidate will have significant experience in data modeling, big data environments...Pipeline
- ...Talent is seeking a Founding Senior Data Engineer in New York, NY. This role... ...the data platform to create a scalable data stack that powers analytics... ...and reporting. With a focus on building intuitive data models and optimizing data pipelines, you'll collaborate with teams...Pipeline
- ...A technology solutions company in the United States is seeking a Data Engineer to develop and maintain data models and scalable data pipelines using Snowflake and DBT. The ideal candidate has proven experience with data warehousing concepts, CI/CD pipelines, and excellent...Pipeline
TechDigital Group
New York, NY2 days ago - ...A leading network technology company is seeking a Data Engineer to design, build, and maintain scalable data pipelines. The role involves collaboration with data scientists, ensuring the data infrastructure is reliable and cost-effective. Ideal candidates should have...PipelineRemote work
Versa Networks
New York, NY2 days ago - ...A healthcare advocacy startup is looking for a Data Engineer to build and optimize data pipelines. The ideal candidate should be proficient in Python and SQL, with experience using Airflow, Terraform, and Snowflake. You will play a key role in ensuring data reliability...PipelineRemote work
SOLACE HEALTH LLC
New York, NY2 days ago - ...An innovative InsurTech MGA is seeking a Data Engineer to design scalable data systems that facilitate analytics and underwriting... ...collaborate with cross-functional teams to build robust infrastructure and drive data-driven decisions. The ideal candidate has 3+ years of...PipelineRemote work
Conscia Talent
New York, NY2 days ago - ...Jobgether is looking for a Senior Data Engineer to work remotely and transform data into actionable insights, enhancing data infrastructure... ...and programming in Python. The Senior Data Engineer will build data pipelines, collaborate with teams, and develop analytical tools to...PipelineRemote work
Jobgether
New York, NY2 days ago - ...A technology-driven data solutions firm is seeking a Mid-Senior level Data Engineer to design and optimize scalable data pipelines and manage cloud infrastructure. The ideal candidate has a Bachelor's degree in Computer Science and extensive experience with database systems...PipelineRemote work
Wynd Labs
New York, NY2 days ago $111.6k - $139.5k
...World Wide Technology is seeking a Senior Data Engineer to lead the development and maintenance of data pipelines and ETL processes. This position involves working closely... ...architects and data teams to deliver data-driven solutions across business areas. Candidates should...PipelineRemote workWorld Wide Technology
New York, NY2 days ago$160k - $200k
...A forward-thinking energy solutions provider is seeking a Data Engineer to architect and deploy scalable data pipelines for millions of connected devices. The ideal candidate will have over 5 years of experience, proficiency in Python and SQL, and familiarity with data...PipelineFull timeRemote workRenew Home Services
New York, NY2 days ago- ...company in the United States is seeking a Software Engineer to join their data ingestion team. The successful candidate will work on... ...greenfield project as part of a data platform, developing scalable data ingestion pipelines for location-based analytics. With responsibilities...Pipeline
Digital Map Products
New York, NY2 days ago - ...unpaid remote internship for students interested in data engineering. Interns will build data pipelines, manage databases, and create ETL processes with mentorship... ...strong resume and LinkedIn profile, and exposure to AI-driven tools for data workflows. Perfect for those looking...PipelineTemporary workInternshipRemote work
Go Offer
New York, NY2 days ago - ...A dynamic AI-focused company is seeking a Senior Data Engineer to architect and own their data platform. This role involves creating robust ETL/ELT pipelines and developing customer-facing data products. Candidates should have over 4 years of experience in data engineering...PipelineRemote work
CloudDevs
New York, NY2 days ago - ...Cloudera is seeking a Senior Data Engineer to lead AI-orchestrated development. This role focuses on building scalable, high-performance data pipelines and modernizing workflows for data management. The ideal candidate will have at least 5 years of experience in data...PipelineFlexible hours
Cloudera
New York, NY2 days ago - ...in the United States is seeking a Senior Data Engineer to join their team. This role focuses on designing and maintaining scalable data infrastructures, ensuring high-quality... ...successful candidate will implement data pipelines, optimize performance, and support advanced...Pipeline
TopDog Law LLC
New York, NY2 days ago - ...A mission-driven tech startup is seeking an experienced Senior Data Engineer to enhance its data initiatives in healthcare. The role requires building and maintaining data pipelines and transformations crucial to decision-making. Responsibilities involve designing complex...PipelineRemote workFlexible hours
Launch TN
New York, NY2 days ago - ...IDT Corporation is seeking a skilled Data/ML Engineer to join their BI team. This remote opportunity... ...designing and maintaining data pipelines, collaborating with data stakeholders, and implementing scalable infrastructure for LLM-driven applications. Candidates should have...PipelineRemote work
IDT
New York, NY2 days ago - ...Citta Solutions Private Limited is seeking a Data Engineer to design and implement data solutions that enhance OLAP and OLTP processes. This... .... The ideal candidate will collaborate with team members to build ETL processes and ensure data quality through automation. A Bachelor...Pipeline
Citta Solutions Private Limited
New York, NY2 days ago - ...Empassion Health, Inc. in the United States is looking for a Data Engineer to build and maintain data pipelines and workflows. The ideal candidate will have 2+ years of experience in data engineering, proficiency in SQL and Python, and expertise in cloud technologies...PipelineRemote work
Empassion Health, Inc.
New York, NY2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer: Build Scalable AI-Driven Data Pipelines. Be the first to apply!
Related searches
- junior data developer New York, NY
- director data engineering New York, NY
- junior big data engineer New York, NY
- data engineer graduate New York, NY
- senior data engineer New York, NY
- data platform engineer New York, NY
- sr information security engineer New York, NY
- senior data integration developer New York, NY
- data developer New York, NY
- data engineer New York, NY