Data Engineer - Airflow, dbt, Kubernetes/OpenShift
Conch Technologies Inc
Job Title: Data Engineer Airflow, dbt, Kubernetes/OpenShift
Experience: 10+ Years
Duration: 12 months Contract on W2
Location : Jersey City , NJ ( Hybrid , Onsite )
Job DescriptionWe are seeking a highly skilled Data Engineer with strong enterprise data engineering experience and deep expertise in Apache Airflow, dbt Core, Python, Kubernetes/OpenShift, and SQL . The role will focus on building, operating, and optimizing scalable data pipelines supporting financial, accounting, migration, and high-volume data processing workloads.
Key Responsibilities- Design, develop, and maintain complex Apache Airflow DAGs for batch and event-driven pipelines.
- Optimize Airflow scheduling, executors, workers, dependencies, retries, SLAs, and alerting.
- Lead dbt Core implementation, including data modeling, testing, documentation, macros, incremental models, and CI/CD.
- Develop staging, intermediate, and mart data models following analytics engineering best practices.
- Deploy and manage data workloads on Kubernetes/OpenShift .
- Implement workload distribution, horizontal scaling, resource optimization, and autoscaling.
- Monitor and tune pipeline performance across Airflow, dbt, data platforms, and infrastructure.
- Implement observability through logs, metrics, alerts, and proactive monitoring.
- Ensure high availability, fault tolerance, security, and resiliency.
- Collaborate with data architects, platform engineers, and business stakeholders.
- Support financial reporting, accounting, regulatory data, and enterprise migration initiatives.
- 10+ years of Data Engineering, Analytics Engineering, or Platform Engineering experience.
- Expert-level Apache Airflow DAG development, orchestration, scheduling, and performance tuning.
- Expert-level dbt Core modeling, testing, macros, implementation, and optimization.
- Strong Python and advanced SQL skills.
- Deep production experience with Kubernetes and/or OpenShift .
- Strong understanding of distributed workload management and performance optimization.
- Experience with cloud data platforms, containerized deployments, CI/CD, Git , and enterprise production environments.
- Financial services or accounting platform experience.
- Enterprise system migration experience.
- Experience with Oracle data warehouses .
- Experience supporting high-volume data processing and regulatory reporting.
- Expert Apache Airflow / DAG development and performance tuning .
- Expert dbt Core / data modeling / testing / implementation .
- Strong Python + SQL .
- Production Kubernetes/OpenShift experience.
- Enterprise-scale data engineering and distributed workload optimization experience.
With Regards,
Prem Chand Kolli | US IT Recruiter
View email address on us.fitly.work View phone number on us.fitly.work *825
Conch Technologies, Inc |
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Data Engineer - Airflow, dbt, Kubernetes/OpenShift in Jersey City, NJ vacancy
- ...seeking a highly skilled Senior Data Engineer with 8+ years of hands-on experience... ...deep expertise in Apache Airflow DAG development, dbt Core modeling and implementation,... ...cloud-native container platforms (Kubernetes / OpenShift). This role is critical to building...Suggested
Blue Ribbon Global Technologies
Jersey City, NJ2 days ago - ...Senior Data Engineer Airflow, dbt, Kubernetes/OpenShift Location: Jersey City, NJ - onsite Duration: 6 months Interview: Virtual round and final in-person Note: Must be local with DL copy LinkedIn with location (before 2022)...SuggestedLocal area
Akaasa Technologies
Jersey City, NJ2 days ago $80 - $85 per hour
...Seeking a highly skilled Senior Data Engineer with 8+ years of hands-on experience... ...including deep expertise in Apache Airflow DAG development, dbt Core modeling and implementation,... ...cloud-native container platforms (Kubernetes / OpenShift). location: Jersey City, New...SuggestedHourly payContract workTemporary workWork experience placementJersey City, NJ3 days ago- ...Description Job Description Job Title: Senior Data Engineer. Location: Jersey City, NJ (On-site).... ...platforms. This role requires expert-level Apache Airflow , dbt Core , and production Kubernetes / OpenShift . General ETL or warehouse-only engineers...SuggestedContract work
ZipStaff Inc.
Jersey City, NJ3 days ago $80 - $85 per hour
Senior Data Engineer Seeking a highly skilled Senior Data Engineer with 8+ years of... ...deep expertise in Apache Airflow DAG development, dbt Core modeling and implementation,... ...cloud-native container platforms (Kubernetes / OpenShift). location: Jersey City, New Jersey...SuggestedHourly payContract work- Sr Data Engineer Location: Jersey City, NJ Duration: Long Term Must Have Skills 10+ years of professional... ...role requires hands-on experience with DBT and Apache Airflow deployed on Kubernetes, specifically within an on-prem OpenShift environment. This position involves closer...
- Job Title: Data Engineer Job Summary: We are seeking a skilled and motivated Data Engineer... ...orchestration tools (e.g., Apache Airflow, Prefect, dbt). Proficiency in at least one... ...and orchestration tools (e.g., Docker, Kubernetes). What We Offer: Competitive salary and...Remote workFlexible hours
- Job Title: Sr. Data Engineer Location: Jersey City, NJ Hybrid (3-4 days... ...services, API design, etc. Kubernetes CI/CD (preferably GitLab) Job Orchestration (preferably Airflow) Familiarity with Snowflake... ...expert) Nice to have Azure DBT AI automation experience Financial...
$70 per hour
...676 ****@*****.*** Python Oracle Linux Airflow Developer - Onsite Final Interview **USC and GC only** DBT needed Location: Jersey City, NJ - 3 days onsite... ...the automation and orchestration of complex data workflows. The ideal candidate will have hands-on...- ...you! ABOUT THE ROLE We are looking for a Senior Data Engineer to design and maintain data pipelines and automation systems... ...will build scalable ELT/ETL workflows using Python, SQL, dbt, and Airflow across AWS services including Glue, Athena, and Aurora alongside...Work at officeWork from homeVisa sponsorshipWork visa
AgileEngine
Jersey City, NJ3 days ago - Title: Data Engineer with Financial Services, Databricks and MDM Experience - NJ ": Employment... ...PySpark, or Snowpark. • Experience with dbt (Data Build Tool) for: o Data... ...orchestration and workflow tools (e.g., Airflow, Databricks Workflows, Snowflake Tasks)...Contract work
- Hi, Title- Lead AWS Data Engineer Location- Jersey City, NJ Contract: Job Summary: We are seeking an experienced Lead Data Engineer... ...modernization programs Familiarity with tools such as dbt, Apache Airflow, AWS Glue, or similar orchestration frameworks Solid Python...Contract work
$126k - $210k
...bachelors degree in Computer Science, Engineering, or a related discipline, or equivalent... ...experience in software development and data engineering; experience in financial services... ..., SQL, and orchestration tools such as Airflow and/or dbt. We need a strong understanding of...Full timeTemporary workWorldwideFlexible hoursBNY
Jersey City, NJ11 days ago- ...Data Engineer Design and develop technology solutions that meet the business requirements for Pershing X's Cloud data platform. Design... ...ETL and ELT tools. Hands-on experience with Snowflake, DBT and Airflow is highly preferred. Experience in building cloud native solutions...
Keylent Inc
Jersey City, NJ4 days ago - ...possible.As a Lead Software Engineer at JPMorgan Chase,... ...& Investment Banking - Data Analytics - Payments Technology... ...using Spark, Airflow, Kafka, and FlinkDevelops... ...grade data platforms on Kubernetes with open catalog... ...BI platforms (Tableau, dbt Metrics) JPMorganChase...
$90k - $125k
...Annually A Day in the Life of a Data Analytics Engineer at MetLife Legal Plans:... ...analytics solutions using DBT Cloud, AWS, Python, and SQL... ...management tools such as Airflow, Prefect, or Dagster. Familiarity... ...Terraform or other IaaC, Kubernetes Cluster, IBM I DB2, AWS CLI...Full timeContract workTemporary workLocal areaRemote work- ...As a Lead Software Engineer at JPMorgan Chase, within... ...& Investment Banking – Data Analytics – Payments Technology... ...using Spark, Airflow, Kafka, and Flink Develops... ...data platforms on Kubernetes with open catalog integration... ...BI platforms (Tableau, dbt Metrics) About Us...
JPMorgan Chase & Co.
Jersey City, NJ6 days ago $61k - $101k
...certification in software engineering concepts, plus 5+ years... ...engineering or data platform development.... ...orchestration tools such as Apache Airflow. We need proficiency... ...data platforms on Kubernetes with open catalog integration... ...such as Tableau and dbt Metrics....Full timeJ.P. Morgan
Jersey City, NJ16 days ago- ...brighter future and make a meaningful difference. As a Lead Data Engineer at JPMorganChase within the Corporate Sector, you are an... ...observability Develop and operate workflow orchestration (e.g., Apache Airflow) to schedule, monitor, and manage data movement and...Jersey City, NJ3 days ago
- Jump is seeking a Senior Data Engineer to own the data platform, focusing on reliability and performance of a Snowflake/dbt stack. You will build and maintain pipelines, tests, and governance to deliver trustworthy data for internal dashboards and client products. You...Remote job
$88.59 - $96.59 per hour
...Data Engineering Architect Genesis10 is currently seeking a Data Engineering Architect for a contract position with a Global Financial... ...architectures Experience with APIs and data services Knowledge of Kubernetes or containerized environments Familiarity with Terraform...Hourly payPermanent employmentContract workGenesis10
Jersey City, NJ3 days ago- Job Description We are searching for a seasoned Data Engineer with a specialty in the workings of DBT. In this position you will be joining a small team (3-4 people) and helping across a variety of data projects (storage, ingestion, data cleaning, transformation) specifically...Full timeRemote work
$142.32k - $213.48k
...come join us. We’ll enable growth and progress together.The Sr Data Engineer, AVP is an intermediate level position responsible for... ...experience requiredHands on experience with AWS Glue, AWS Athena, AIRFLOW, SNOWFLAKEDatabase expertise on Database systems - MongoDB, Oracle...Full timeCitigroup
Jersey City, NJa month ago$10.45k - $15.16k
...this time, including CPT/OPT. The Lead Data Engineer will provide technical leadership in the... ...Flink, Spark Streaming, Kafka Streams, or dbt-mesh architectures to enrich, filter,... ...or BigQuery. Solid foundation in Docker, Kubernetes, Terraform, and CI/CD automation for event...16 hoursContract workTemporary workCasual workWork at officeLocal areaRemote workWork from homeWork visaFlexible hours- ...Position: Senior Data Engineer Location: Jersey city, NJ***Onsite*** Duration: 1 Years Job Description We are seeking an... ...Required Skills and Experience: Technical: Snowflake, Oracle Pl/SQL, DBT, Python, any BI reporting tool Strong hands-on experience with...
Inherent Technologies
Jersey City, NJ2 days ago $99.4k - $150.3k
Job Category Data About Salesforce Salesforce is the #1 AI CRM, where humans with agents... ...of Salesforce. We are seeking a Data Engineer to join the Finance Data Office team at... ...with hands‑on experience in Snowflake, Airflow, and dbt, and a desire to grow in a business-...Work at office- Snowflake Data Engineer About the Role We're looking for a Snowflake Data Engineer with solid... ...scripts Implement transformation logic using dbt (data build tool) or similar frameworks... ...Familiarity with orchestration tools (Airflow, Dagster, or Snowflake Tasks) Exposure...
$142.32k - $213.48k
Job Overview: The Sr. Data Engineer, AVP is an intermediate level position responsible for participation in the establishment and implementation... ...required. Hands‑on experience with AWS Glue, AWS Athena, Airflow, Snowflake. Database expertise on MongoDB, Oracle, PostgreSQL...$320k - $405k
...group of committed researchers, engineers, policy experts, and business... ...systems. About the Role As a Data Engineer on the Data Science &... ...data models through tooling like dbt; proficiency with workflow management platforms like Airflow and version control management...Contract workWork at officeVisa sponsorshipFlexible hours$8.75k - $11.67k
...operations, and get more value from their data. Our products combine practical business... ...for everyday use. You will join the engineering team behind our new mid-market analytics... ...NICE TO HAVE Experience with AWS or GCP dbt, Airflow, Dagster, or similar data tooling Experience...Remote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer - Airflow, dbt, Kubernetes/OpenShift. Be the first to apply!
Related searches
- aws data engineer Jersey City, NJ
- director data engineering Jersey City, NJ
- data platform engineer Jersey City, NJ
- data engineer machine learning Jersey City, NJ
- data science developer Jersey City, NJ
- senior data engineer Jersey City, NJ
- finance data engineer Jersey City, NJ
- big data devops engineer Jersey City, NJ
- data engineer analytics Jersey City, NJ
- senior data integration developer Jersey City, NJ