Senior Data Engineer: PySpark, Informatica & Hadoop Expert
Qode
Qode is seeking a Senior Data Engineer with 8-10 years of experience in Data Engineering and Data Analysis, located in Kentucky. The ideal candidate will have strong expertise in Informatica PowerCenter and advanced skills in PySpark for managing large-scale data processing. Responsibilities include designing and optimizing ETL processes and ensuring data quality. The candidate should possess a relevant degree, strong problem-solving abilities, and experience with Agile methodologies and client interaction. #J-18808-Ljbffr Qode
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer: PySpark, Informatica & Hadoop Expert in Brooklyn, NY vacancy
- Senior Data Engineer (Informatica & PySpark) Experience: 8-10 years in Data Engineering and Data Analysis. Informatica Expertise: Strong hands‑on experience... ...data processing, transformation, and analytics. Hadoop Ecosystem: Solid working knowledge of Hadoop...Senior
- A technology solutions company is seeking a skilled Java developer in New York to implement solutions for large data processing using NoSQL and Hadoop. The ideal candidate will have strong server-side Java experience and be involved in architectural discussions. Responsibilities...Senior
- ...have been doing cutting edge engineering work for Silicon Valley of the... ...on experience with Python and PySpark is preferred. Solid technical foundation (algorithms, data structures, database, unit testing... ...) and problem-solving skills Expert knowledge of Spark SQL (...SeniorRemote work
$100k - $180k
Selby Jennings is hiring a hands-on Data Center Engineer in New Jersey to support physical infrastructure across multiple facilities. The role demands expertise in server management and networking, with responsibilities including installation, maintenance, and troubleshooting...Senior$150k
...is seeking a highly skilled Senior Data Engineer who can balance deep technical... ...as the primary technical expert on the team, and gradually take... ...strong expertise in SQL, PySpark, and Databricks, including job... ...tools. ~ Familiarity with Hadoop ecosystem tools and ETL...SeniorSoni Resources
New York, NY4 days ago- An established industry player is seeking a skilled data engineer to design and maintain scalable data pipelines using Azure technologies. This role involves integrating data from various sources into the Azure Databricks platform, implementing ETL processes, and ensuring...Senior
$79.32k - $110.68k
Pyspark Data Engineer - Officer Apply (opens in new window) Job Req Id: 26953427 Location(s): Mississauga... ...and autonomy. Acts as SME to senior stakeholders and /or other team members... ...systems using frameworks like Apache Spark, Hadoop, and Kafka. Proficiency in Python...Full time- ...Senior Data Engineer / Data Architect Location: Jersey City, NJ (Hybrid) Duration: 12+ Months... ...development • Deep understanding of PySpark development principles, including RDDs,... ...large datasets. • Hands-on knowledge of Hadoop ecosystem components (HDFS, YARN) and...SeniorContract work
Lorven Technologies
Jersey City, NJ4 days ago - ...Senior Data Engineer- Jersey city, NJ Must have: Spark, Scala, Java, AWS (EMR) Nice to have: Python, S3 EC2, EKS, Hadoop, Impala, Hive, Airflow Domain knowledge a plus Data set size is 500m-1b rows per batch His resume review focuses...Senior
Apex Informatics
Jersey City, NJ19 hours ago - ...for a passionate certified Data Engineer. The successful candidate will... ...Primary skillset: Python/Pyspark & Azure, ADF, SQL, SQL Server... ...Databricks Nice to have: Informatica/ETL. Responsibilities... ...relevant software such as MySQL, Hadoop, or MongoDB Programming...Work experience placement
Forhyre
New York, NY21 days ago - ...Senior Data Lake Engineer/Developer-Tech Lead Duration: 6 months CTH Location: New York Job Description: Hands-on tech lead responsible for... ...haves: strong experience in big data technologies such as Hadoop data management tools for ingesting data, integrating data...Senior
Cardinal Integrated
New York, NY1 day ago - ...Senior Data Engineer Jersey City, New Jersey, United States Role Overview Hands-on experience with Azure Services: Databricks, Data... ...Factory and DevOps Proficient in Python, Apache Spark, and PySpark Write advance and complex SQL queries with solid...Senior
Inizio Partners
Jersey City, NJa month ago - ...About the job Senior Data Engineer - Databricks Job Overview: We are seeking a skilled Data Engineer to join our team. The successful... ...Technology, or related field. ~ Strong proficiency in PySpark, Python, SQL. ~ Strong experience in data modeling, ETL/...Senior
Inizio Partners
New York, NY1 day ago - ...Data Engineer (Financial Services - Enterprise Data Platform) Location: [Onsite / Hybrid... ...with strong experience in Oracle and Hadoop ecosystems to support large-scale... ...lakehouse architectures Experience with Informatica, Talend, or similar ETL tools...SeniorFull timeRemote work
FIRST SOFTSOLUTIONS INC
Jersey City, NJ4 days ago $125k - $140k
Blu Omega LLC is seeking a Cloudera Data Engineer to work remotely, focusing on designing and deploying data solutions within the Cloudera... ...methods. The ideal candidate has over 3 years of experience with Hadoop technologies, holds a Bachelor’s degree, and possesses strong...Remote job$160k - $210k
...Senior Data Engineer New York, NY or Los Angeles, CA The Opportunity This is an exciting time at Enigma. We're on the cusp of releasing... ...millions of U.S. small businesses (we use Databricks SQL, PySpark, and MLFlow). You'll be building on top of our innovative...SeniorEnigma Technologies
New York, NY1 day ago- ...Role: - Sr. Big Data Engineer Location : - Jersey City, NJ (Onsite) Duration : - Long term Contract Position: - Full-time... ...working experience in scalable data pipeline using Scala, Python, pyspark, Hadoop, Apache Spark, Spark SQL, Kafka, Nifi, ETL and Incremental...SeniorLong term contractFull timeWork experience placementFlexible hours
Maintec Technologies
Jersey City, NJ1 day ago $140k - $174k
...Senior Engineer Discover your opportunity with Mitsubishi... ...maintaining best practices for data stores) Position... ...: Provide expert level IT technical services... ...PostgreSQL, MongoDB, Hadoop Bigdata, DW systems... ...tools such as Talend, Informatica, AWS Glue, Data Sync,...SeniorWork at officeLocal areaRemote workMUFG
Jersey City, NJ19 hours ago- A leading data solutions company in New York is seeking a Mid-Senior level Data Engineer. The role involves designing and optimizing high-performance Spark-based data pipelines using Python/PySpark. Candidates should have strong experience with AWS services and data warehousing...Full time
- S&P Global is looking for a Data Engineer to build and maintain scalable data processing pipelines that support critical data sourcing and... ...engineering, and expertise in Python, SQL, and data ecosystems like PySpark and Databricks. You will contribute to various data solutions...
- ...Lead Data Engineer - Palantir & PySpark (Lead Data engineer role where experience should be on both hands on and leading the team.) Candidate preference : Should be in the United States and from East coast. Experience : 8-15 Years Location...Remote work
VBeyond
Jersey City, NJ3 days ago - ...About the job Senior Data Engineer Job Title: Senior Data Engineer Location: Remote (US) Salary 125K-155K + 12% bonus Experience... ...or general knowledge of Jinja templating in Python and/or PySpark ~ Agile experience and willingness to work with extended...SeniorRemote work
Inizio Partners
New York, NY19 hours ago - ...process: 2 Teams + 1 In-person interview Senior Data Engineer Job Responsibilities and... ...batch and streaming data pipelines using PySpark within the Medallion Lakehouse architecture... ...III/IV, IFRS 9, CECL, or FRTB ~ Expert-level proficiency in Python and PySpark...SeniorContract work
Compu-Vision Consulting
New York, NY3 days ago - ...proprietary AI Studio and AI Engines, the company helps drive the... ...their full potential with AI. Senior Data Engineer Are you an... ...The ideal candidate will be an expert in at least one major cloud data... ..., performance tuning), and PySpark/Apache Spark. Data Modeling...SeniorH1bLocal area
Fusemachines
New York, NY1 day ago - ...SQLPLSQL 10 years experience with at least 3 years experience as a data analyst Delivery focused technofunctional role Good... ...Programming experience with Python Programming experience with Hadoop will be added advantage Excellent analytical and problem solving...Senior
LTM
Jersey City, NJ19 hours ago - ...I have an opportunity for " Sr MDM Data Engineer - NYC,NY - Day 1 Onsite - Need Local Candidates... ...really appreciate it. Job Title : Senior Data Solution and Delivery Engineer(or)... ...of data architecture such as Informatica Power Center, IICS, SSIS, or similar ETL...SeniorContract workLocal areaImmediate start
Navtech
New York, NY19 hours ago - An established industry player is seeking a seasoned Informatica Developer with over 7 years of experience in data integration and analysis. This role emphasizes expertise in Informatica PowerCenter and IICS, along with strong skills in relational databases and SQL. The...Senior
- iTechStack is looking for a skilled developer to design and implement data processing systems using technologies like Apache Spark and Java... ...and redshift scripts, requiring strong knowledge of Spark, Pyspark, and related frameworks. The ideal candidate must be willing to...Senior
$160k - $240k
...Bloomberg is seeking a Senior Software Engineer for its Analytics Event Streaming team in New York.... ...will develop high-standard software and data streaming pipelines to ensure scalability... ...with big data technologies such as Hadoop and Kafka. Bloomberg offers a comprehensive...SeniorBloomberg
New York, NY4 days ago$150k - $180k
...(RegTech) team at DriveWealth develops data products to support the Compliance organization... ...requirements. We are looking for a Senior Data Engineer to take ownership of regulatory-related... ...Languages: Python, SQL, Spark (PySpark, Spark SQL) ~ Declarative Languages:...SeniorFull timeWork at officeWorldwideDriveWealth
New York, NY4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer: PySpark, Informatica & Hadoop Expert. Be the first to apply!
Related searches
- senior data center engineer Brooklyn, NY
- data science developer Brooklyn, NY
- etl data engineer Brooklyn, NY
- data engineer Brooklyn, NY
- big data cloud engineer Brooklyn, NY
- remote data engineer Brooklyn, NY
- senior data engineer Brooklyn, NY
- senior cloud data engineer Brooklyn, NY
- senior data integration developer Brooklyn, NY
- aws data engineer Brooklyn, NY