Data Engineer - Airflow, dbt, Kubernetes/OpenShift
Conch Technologies Inc
Job Title: Data Engineer Airflow, dbt, Kubernetes/OpenShift
Experience: 10+ Years
Duration: 12 months Contract on W2
Location : Jersey City , NJ ( Hybrid , Onsite )
Job DescriptionWe are seeking a highly skilled Data Engineer with strong enterprise data engineering experience and deep expertise in Apache Airflow, dbt Core, Python, Kubernetes/OpenShift, and SQL . The role will focus on building, operating, and optimizing scalable data pipelines supporting financial, accounting, migration, and high-volume data processing workloads.
Key Responsibilities- Design, develop, and maintain complex Apache Airflow DAGs for batch and event-driven pipelines.
- Optimize Airflow scheduling, executors, workers, dependencies, retries, SLAs, and alerting.
- Lead dbt Core implementation, including data modeling, testing, documentation, macros, incremental models, and CI/CD.
- Develop staging, intermediate, and mart data models following analytics engineering best practices.
- Deploy and manage data workloads on Kubernetes/OpenShift .
- Implement workload distribution, horizontal scaling, resource optimization, and autoscaling.
- Monitor and tune pipeline performance across Airflow, dbt, data platforms, and infrastructure.
- Implement observability through logs, metrics, alerts, and proactive monitoring.
- Ensure high availability, fault tolerance, security, and resiliency.
- Collaborate with data architects, platform engineers, and business stakeholders.
- Support financial reporting, accounting, regulatory data, and enterprise migration initiatives.
- 10+ years of Data Engineering, Analytics Engineering, or Platform Engineering experience.
- Expert-level Apache Airflow DAG development, orchestration, scheduling, and performance tuning.
- Expert-level dbt Core modeling, testing, macros, implementation, and optimization.
- Strong Python and advanced SQL skills.
- Deep production experience with Kubernetes and/or OpenShift .
- Strong understanding of distributed workload management and performance optimization.
- Experience with cloud data platforms, containerized deployments, CI/CD, Git , and enterprise production environments.
- Financial services or accounting platform experience.
- Enterprise system migration experience.
- Experience with Oracle data warehouses .
- Experience supporting high-volume data processing and regulatory reporting.
- Expert Apache Airflow / DAG development and performance tuning .
- Expert dbt Core / data modeling / testing / implementation .
- Strong Python + SQL .
- Production Kubernetes/OpenShift experience.
- Enterprise-scale data engineering and distributed workload optimization experience.
With Regards,
Prem Chand Kolli | US IT Recruiter
View email address on us.fitly.work View phone number on us.fitly.work *825
Conch Technologies, Inc |
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Data Engineer - Airflow, dbt, Kubernetes/OpenShift in Jersey City, NJ vacancy
- ...Job Summary (Senior Data Engineer): - Lead the design, development, and maintenance... ...complex data pipelines using Apache Airflow and dbt Core for enterprise-scale financial... ...cloud-native container platforms (Kubernetes/OpenShift), ensuring efficient resource...Suggested
Expert Technology Services
Jersey City, NJ2 days ago - ...Senior Data Engineer Airflow, dbt, Kubernetes/OpenShift Location: Jersey City, NJ - onsite Duration: 6 months Interview: Virtual round and final in-person Note: Must be local with DL copy LinkedIn with location (before 2022)...SuggestedLocal area
Akaasa Technologies
Jersey City, NJ2 days ago - ...are seeking a highly skilled Senior Data Engineer with 8+ years of hands-on... ...including deep expertise in Apache Airflow DAG development, dbt Core modeling and implementation,... ...cloud-native container platforms (Kubernetes / OpenShift). This role is critical to building...Suggested
Connvertex Technologies Inc.
Jersey City, NJ2 days ago - ...in Phoenix, United States is seeking a data engineer to design and implement data pipelines... ...tooling. You will work with ELK stack, NiFi, Airflow, and cloud services to ensure reliable... ...role requires hands-on experience with Kubernetes and Docker, SQL databases, and CI/CD...Suggested
$80 - $85 per hour
...Senior Data EngineerSeeking a highly skilled Senior Data Engineer with 8+ years of hands-on experience in enterprise... ...deep expertise in Apache Airflow DAG development, dbt Core modeling and... ...native container platforms (Kubernetes / OpenShift). location: Jersey City, New...SuggestedHourly payContract workRandstad
Jersey City, NJ2 days ago- ...Sr Data Engineer Location: Jersey City, NJ Duration: Long Term Must Have Skills ~10... ...The role requires hands-on experience with DBT and Apache Airflow deployed on Kubernetes, specifically within an on-prem OpenShift environment. ~ This position involves closer...
GlobalPoint
Jersey City, NJ2 days ago $80 - $85 per hour
...Seeking a highly skilled Senior Data Engineer with 8+ years of hands-on experience... ...including deep expertise in Apache Airflow DAG development, dbt Core modeling and implementation,... ...cloud-native container platforms (Kubernetes / OpenShift). location: Jersey City, New...Hourly payContract workTemporary workWork experience placementJersey City, NJ7 days ago- Job Title: Senior Data Engineer. Location: Jersey City, NJ (On-site). Employment Type: Contract (W2 through ZipStaff... .... This role requires expert-level Apache Airflow , dbt Core , and production Kubernetes / OpenShift . General ETL or warehouse-only engineers without...Contract work
- ...Job Title: Data Engineer Job Summary: We are seeking a skilled and motivated Data... ...orchestration tools (e.g., Apache Airflow, Prefect, dbt). ~ Proficiency in at least one programming... ...orchestration tools (e.g., Docker, Kubernetes). What We Offer: Competitive...Remote workFlexible hours
Adidev Technologies Inc
Jersey City, NJ17 hours ago - ...possible.As a Lead Software Engineer at JPMorgan Chase,... ...& Investment Banking - Data Analytics - Payments Technology... ...using Spark, Airflow, Kafka, and FlinkDevelops... ...grade data platforms on Kubernetes with open catalog... ...BI platforms (Tableau, dbt Metrics) JPMorganChase...
- Job Title: Sr. Data Engineer Location: Jersey City, NJ Hybrid (3-4 days... ...services, API design, etc. Kubernetes CI/CD (preferably GitLab) Job Orchestration (preferably Airflow) Familiarity with Snowflake... ...expert) Nice to have Azure DBT AI automation experience Financial...
$70 per hour
...676 ****@*****.*** Python Oracle Linux Airflow Developer - Onsite Final Interview **USC and GC only** DBT needed Location: Jersey City, NJ - 3 days onsite... ...the automation and orchestration of complex data workflows. The ideal candidate will have hands-on...- ...Title: Data Engineer with Financial Services, Databricks and MDM Experience - NJ ":... ...PySpark, or Snowpark. • Experience with dbt (Data Build Tool) for: o Data transformation... ...orchestration and workflow tools (e.g., Airflow, Databricks Workflows, Snowflake Tasks)...Contract work
3B Staffing LLC
Jersey City, NJ4 days ago - ...Hi, Title- Lead AWS Data Engineer Location- Jersey City, NJ Contract: Job Summary: We are seeking... ...modernization programs Familiarity with tools such as dbt, Apache Airflow, AWS Glue, or similar orchestration frameworks Solid...Contract work
Centraprise
Jersey City, NJ1 day ago $76.8k - $121k
...brighter, healthier future for all. As a Data Engineer , you will focus on developing data... ...stack that includes Snowflake, dbt, Python, and SQL, you will assemble... ...utilizing Git, containerization (Docker/Kubernetes), Terraform, Airflow, and Snowflake/dbt. Preferred...Hourly payLocal areaWorldwideRelocation- Job Title: ETL Data Engineer Job location : Jeresy,NJ (Onsite|) Job Type: Fulltime Job Description • Design and develop technology... ...various ETL and ELT tools • Hands-on experience with Snowflake, DBT and Airflow is highly preferred • Experience in building cloud native...Full time
$126k - $210k
...you will Build robust batch/streaming data pipelines and transformations that ensure... ...and dependencies using modern data engineering tools.Partner with analytics, AI, business... ..., SQL, and orchestration tools such as Airflow and/or dbt.Strong understanding of cloud and lakehouse...Temporary workWorldwideFlexible hours- Gravity IT Resources is seeking a Sr Data Engineer to design, build, and optimize data pipelines and analytics solutions using Snowflake and dbt. You will collaborate with Data Engineering, Analytics, Product, and business stakeholders to deliver scalable, well-governed...Remote job
- ...possible.As a Lead Software Engineer at JPMorgan Chase,... ...& Investment Banking - Data Analytics - Payments Technology... ...using Spark, Airflow, Kafka, and FlinkDevelops... ...grade data platforms on Kubernetes with open catalog... ...BI platforms (Tableau, dbt Metrics) JPMorganChase...
- ...a brighter future and make a meaningful difference.As a Lead Data Engineer at JPMorganChase within the Corporate Sector, you are an integral... ...and operate workflow orchestration (e.g., Apache Airflow) to schedule, monitor, and manage data movement and transformationsModel...
$126k - $210k
...bachelors degree in Computer Science, Engineering, or a related discipline, or equivalent... ...experience in software development and data engineering; experience in financial services... ..., SQL, and orchestration tools such as Airflow and/or dbt. We need a strong understanding of...Full timeTemporary workWorldwideFlexible hoursBNY
Jersey City, NJ15 days ago$90k - $125k
...Annually A Day in the Life of a Data Analytics Engineer at MetLife Legal Plans:... ...analytics solutions using DBT Cloud, AWS, Python, and SQL... ...management tools such as Airflow, Prefect, or Dagster. Familiarity... ...Terraform or other IaaC, Kubernetes Cluster, IBM I DB2, AWS CLI...Full timeContract workTemporary workLocal areaRemote work- Irvine Company is seeking an Analytics Engineer to design dimensional models on Snowflake, build dbt pipelines, and orchestrate with Dagster. You will develop Python... ...ingestion for non-standard sources and ensure data quality for analytics. You will collaborate with analysts...Contract workTemporary work
$82.42k - $126.6k
...specialize in leveraging advanced technologies such as AI, cloud, and data-led innovation to help our clients accelerate growth and unlock... ...shell scripting. Experience in orchestration tool like Autosys, Airflow. Sound knowledge of relational databases (SQL) and experience...Full timeTemporary workRelocation- We are seeking a seasoned Data Engineer with 3-7 years of experience in data engineering, cloud platforms and distributed systems, along... ...pipelines and container orchestration tools like Docker and Kubernetes.• Experience working in agile environments delivering complex...Work experience placement
$142.32k - $213.48k
...come join us. We’ll enable growth and progress together.The Sr Data Engineer, AVP is an intermediate level position responsible for... ...experience requiredHands on experience with AWS Glue, AWS Athena, AIRFLOW, SNOWFLAKEDatabase expertise on Database systems - MongoDB, Oracle...Full time$65 - $70 per hour
Position: Data Engineer- AWSLocation: Jersey City, New JerseyDuration: ContractJob ID: 172543Job Overview: As a Data Engineer III specializing... ...Redshift.Experience with scheduling/orchestration tools like Airflow or AWS Step Functions.Proficiency in Unix scripting, data...Full time- ...Data Engineer We are seeking an experienced professional with strong expertise in Snowflake, Python, Oracle PL/SQL, and reporting/BI tools... ...and Experience: Technical: Snowflake, Oracle Pl/SQL, DBT, Python, any BI reporting tool Strong hands-on experience with...
Resource Logistics
Jersey City, NJ1 day ago - ...Data EngineerShaped is an API for developers to seamlessly add personalized ranking... ...Job DescriptionWe are looking for a data engineer to design, build and optimize Shaped's... ...)Nice-to-have skills should include DBT, Meltano, Airflow, and Apache Flink (or other stream processing...Work at officeRemote work
Shaped
Brooklyn, NY17 hours ago - ...Data Engineer We are seeking a skilled Data Engineer to design, develop, and support modern data platforms and pipelines that power analytics... ...expertise in Snowflake, Python, SQL, AWS, Oracle, and Apache Airflow, with exposure to AI/Generative AI technologies....
E-Solutions
Jersey City, NJ17 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer - Airflow, dbt, Kubernetes/OpenShift. Be the first to apply!
Related searches
- data engineer contract Jersey City, NJ
- big data cloud engineer Jersey City, NJ
- big data developer Jersey City, NJ
- finance data engineer Jersey City, NJ
- software data engineer Jersey City, NJ
- data engineer machine learning Jersey City, NJ
- senior data quality engineer Jersey City, NJ
- data visualization developer Jersey City, NJ
- aws data engineer Jersey City, NJ
- data center engineer Jersey City, NJ