Senior Data Pipeline Engineer — Python, Spark & Kafka
Jobtailor
Jobtailor in Kentucky is seeking a Data Engineer to design, build, and maintain scalable data pipelines and ETL/ELT processes, leveraging Python, PySpark, and Java to transform large datasets. You will ingest structured and unstructured data via REST APIs, streaming platforms, and batch jobs, work with Kafka and Hadoop, and ensure data quality and governance in an Agile team environment. #J-18808-Ljbffr Jobtailor
Vacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the Senior Data Pipeline Engineer — Python, Spark & Kafka in Brooklyn, NY vacancy
$126k - $210k
...you will Build robust batch/streaming data pipelines and transformations that ensure... ...and dependencies using modern data engineering tools. Partner with analytics, AI... ...environments. ~ Deep expertise in Spark/Databricks, Kafka, SQL, and orchestration tools such as...SeniorTemporary workWorldwideFlexible hoursBNY Mellon
Jersey City, NJ4 days ago- ...Senior Bigdata Engineer Weehawken NJ Responsibilities... ...for Senior Cloud data Engineer having at... ...warehouse solution using Spark with Scala or python and also Investment... ...# Knowledge of Kafka, Event hubs and ADLS... ...-services, ci/cd pipeline and test automation...SeniorWork at office
Futran Tech Solutions Pvt. Ltd.
Weehawken, NJ2 days ago - ...The Senior Technical Specialist will be responsible for providing expertise in Apache spark, scala, and python. They will play a key role in developing and... .... Develop and implement data processing frameworks using... ...4. Knowledge of data engineering concepts and methodologies...Senior
Omni Inclusive
Jersey City, NJ4 days ago - ...Senior Data Engineer Jersey City, New Jersey, United States Role Overview Hands-on experience with Azure Services: Databricks, Data Factory and DevOps Proficient in Python, Apache Spark, and PySpark Write advance and complex SQL queries with solid experience...Senior
Inizio Partners
Jersey City, NJ3 days ago - ...Senior Data Engineer Location: Jersey City, NJ (Onsite role) Duration: 12... ...technologies (Informatica, SnapLogic, Kafka, etc.) Experience in data... ...experience using Python/Java Practical experience... ...with standard CI/CD tools and pipelines (Jenkins, Artifactory, uDeploy...SeniorContract work
Kasmo Global
Jersey City, NJ3 days ago - ...Data Engineer You will be part of a growing Data Engineering team that handles CLIENT data... ...Client frameworks and languages like R, Python etc.. The ideal candidate will be a technologist... ...Programming languages like R, Python, Kafka, Storm etc. Experience building...SeniorImmediate start
Cardinal Integrated
Secaucus, NJ3 days ago $133k - $158k
PowerToFly is seeking a Senior Data Engineer based in Kentucky to design and enhance applications and data pipelines crucial for retail operations. Candidates must have over 6 years in Data Engineering and 3 years with Azure technologies like Data Factory and Databricks...Senior- ...technology products. As a Senior Lead Software Engineer at JPMorganChase within... ...wide Marketing and Events Data Platform. We are looking for... ...years of Experience with Python ~2+ years of Experience... ...Data technologies (e.g. AWS, Spark, Kafka, Data Bricks etc.) ~...Senior
J.P. Morgan
Jersey City, NJ9 days ago - Jobtailor is seeking a data engineer to design, develop, and optimize scalable data pipelines in cloud environments. You will collaborate with analytics, product... ...5+ years in data engineering, with strong Python, SQL, and Spark skills, plus familiarity with Hadoop and major...Senior
- Responsibilities Design, develop, and optimize scalable data pipelines and cloud-based data solutions Collaborate... ...experience 5+ years of relevant data engineering experience Strong proficiency in Python, SQL, Spark Familiarity with big data technologies (Hadoop...Senior
- ...About the Job Opportunity The Senior Data Engineer plays a leading role in... ...designing and building scalable pipelines, setting best practices, and... .../ELT pipelines using SQL, Python, Talend, and Databricks to support... ...MDM platforms; knowledge of Kafka or real‑time streaming....SeniorLocal area
- Senior Data Engineer Established in 2021, Independence Pet Holdings is a corporate... ...building the platforms and pipelines that enable smarter... ...platforms and pipelines. Strong Python and SQL expertise. Strong SQL... .../event‑driven systems (Kafka, Kinesis). Solid experience...SeniorTemporary workWork at officeRemote workFlexible hours
$165k - $180k
...skilled and motivated Sr. AI Data Engineer with a proven track record in... ..., and maintain scalable data pipelines and workflows using Databricks... ...open-source tools such as Python, PySpark, and Apache Airflow... ...processing tools like Apache Kafka or Structured Streaming. Familiarity...SeniorWork experience placementH1bWork at officeLocal area- 6AM City, LLC is looking for Big Data Engineers to support a major technology company's data initiatives. This fully remote role will involve modernizing their data applications from Ab Initio to Spark and Scala, contributing to innovative software solutions. The successful...Remote job
- ...Job Title: Data Engineer Job Summary: We are seeking a skilled... ...and maintaining scalable data pipelines, optimizing data workflows,... ...programming language (e.g., Python, Java, Scala). ~... ...processing frameworks (e.g., Kafka, Spark, Flink). Knowledge of CI/...Remote workFlexible hours
Adidev Technologies Inc
Jersey City, NJ3 days ago - ...'s possible. As a Lead Software Engineer at JPMorganChase within Corporate Technology... ...languages including Java, Python, or Scala. Good understanding of... .... Extensive experience with big data technologies , including Apache Spark, for large-scale data processing and...Local area
J.P. Morgan
Jersey City, NJ9 days ago - ...Job Description: Core Java, spring boot, Oracle, microservices, Kafka, app-engine (Containers), REST/Web services, Angular, CI/CD, Junit Must Have : Core Java , Spark experience (with Java) and Hive, Spring framework, Kafka (if not Kafka them relatively...
Texas State Library and Archives Commision
Jersey City, NJ13 hours ago - ...Senior Data Engineer The New York City Employees' Retirement System (NYCERS) is seeking an experienced Senior Data Engineer to join our... ...Data Engineer will: Design and implement end-to-end ETL pipelines using IBM DataStage for legacy and modern data sources....SeniorWork at office
New York City | Jobs
Brooklyn, NY4 days ago - ...professionals for this role. JOB DESCRIPTION Tech - Lead Software Engineer, 603 (SWES04) Carry out critical tech solutions across... ..., testing, and operational stability Advanced in coding in Python Experience coding in Java Proficiency in automation and...Senior
J.P. Morgan
Jersey City, NJ14 days ago - ...As a Lead Software Engineer at JPMorganChase within... ...problems, with a focus on data engineering and Spark-based ETL/ELT... ...quality production code in Python/PySpark and Spark SQL... ..., including data pipeline reliability and lakehouse... ..., and skills Kafka familiarity (topic design...
J.P. Morgan
Jersey City, NJ9 days ago $152.5k - $170k
...logistics and fulfillment engine helps businesses to build and... ...future of direct mail. Senior Analytics Engineer As a member of the Data team, you will develop data pipelines and build data models that... ...production systems using dbt and Python. dbt Developer...SeniorRemote workGrabJobs
Jersey City, NJ13 hours ago- ...technology products. As a Senior Lead Software Engineer at JPMorgan Chase within... ...& Investment Bank Markets Data Strategies Engineering team... ...architecture, with a focus on Python development. Design and... ...using technologies such as Kafka streaming. Experience with...SeniorFor contractors
J.P. Morgan
Jersey City, NJ13 days ago - ...and deliver top-notch technology products. As a Senior Lead Software Engineer - Python/AWS/AI/LLM at JPMorganChase within the Asset Wealth... ...Design and implement highly scalable and reliable data processing pipelines and deploy model inference services Experiment,...SeniorFor contractors
J.P. Morgan
Jersey City, NJ9 days ago - Karsun Solutions, LLC seeks a Senior Data Engineer to design, implement, and operate data pipelines at scale using Databricks, PySpark, and Airflow, within AWS-based environments. You will work with stakeholders to optimize Medallion architecture across data layers, ensure...Senior
- A leading technology hiring firm based in Oklahoma is looking for a Sr. Data Center Operations Engineer. This role involves ensuring the reliability and performance of various data center systems, from installation and management of servers to collaboration with facility...Senior
$132k - $216k
The New York Times is looking for a Senior Data Engineer to join our team in Hoboken, NJ. This position requires a Master's degree in Computer Science, IT, or Engineering, along with relevant experience. The role offers a competitive salary ranging from $131,997 to $21...Senior- A leading data solutions firm is seeking a Senior Data Engineer to lead the design and development of scalable data solutions in the Property & Casualty insurance sector. You will architect complex data pipelines, mentor team members, and drive best practices across the...SeniorRemote job
- ...notch technology products. As a Senior Lead Software Engineer- Java/Python/ AI Solutions at JPMorganChase within... ...to and interact with external data sources, APIs, and enterprise tools... ...Build and maintain scalable data pipelines and data processing workflows for both...Senior
J.P. Morgan
Jersey City, NJ6 days ago $171k - $260k
...build, and deliver top-notch technology products. As a Senior Lead Software Engineer at JPMorgan Chase within the Commercial & Investment Bank'... ...on the principal technologies used by the team which are Python and TypeScript (React). Drives decisions that influence...SeniorFor contractorsJ.P. Morgan
Jersey City, NJ14 days ago$132k - $216k
Overview Senior Data Engineer - Wal‑Mart, Hoboken, NJ Qualifications Master's or equivalent in Computer Science, IT, Engineering (any), or related field + 1 year of experience in software engineering or related experience; OR Bachelor's or equivalent + 3 years of experience...SeniorTemporary work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Pipeline Engineer — Python, Spark & Kafka. Be the first to apply!
Related searches
- data engineer analytics Brooklyn, NY
- remote data engineer Brooklyn, NY
- junior data engineer remote Brooklyn, NY
- senior cloud data engineer Brooklyn, NY
- data infrastructure engineer Brooklyn, NY
- aws data engineer Brooklyn, NY
- senior data integration developer Brooklyn, NY
- data engineer machine learning Brooklyn, NY
- data center engineer Brooklyn, NY
- etl data engineer Brooklyn, NY