Senior Data Engineer
ValueMomentum
We are seeking a Senior Data Engineer with deep expertise in Apache Spark and hands‑on experience delivering production‑grade solutions on Databricks. This role centers on designing, optimizing, and operating large‑scale Spark data platforms that power analytics, machine learning (ML), and artificial intelligence (AI) use cases. The ideal candidate is a Spark practitioner who understands how to build efficient distributed data pipelines, optimize performance and cost, and enable ML workflows at scale. You will lead Spark pipeline design, collaborate closely with data scientists and analysts, and help operationalize ML and AI solutions across the enterprise. Key Responsibilities Design, build, and maintain distributed data pipelines using Apache Spark on Databricks Lead development of high‑performance Spark jobs for batch and near‑real‑time processing Implement complex data transformations using PySpark (DataFrame & Spark SQL APIs) Apply Spark best practices for partitioning, caching, joins, and shuffles Tune Spark jobs for performance, scalability, and cost efficiency Required Qualifications 12+ years of experience in Data Engineering. Strong hands‑on experience building and operating Apache Spark applications. Proven experience running Spark workloads in Databricks (production environments). Advanced proficiency in PySpark, Spark SQL, and Python. Experience working with large‑scale, distributed datasets in cloud environments (AWS preferred). Demonstrated experience supporting ML or AI pipelines on Spark. Strong understanding of data modeling, distributed systems, and data architecture. Experience designing reliable, automated, and observable Spark pipelines. About ValueMomentum ValueMomentum is a product development company. We have 25+ years in the market and we have products like Ifoundry, rating engine and Biz dynamics. We have been partnered with Guidewire, Duck Creek and Insurity . We have headquartered in NJ and PA. we have specialised in P&C insurance, we have 75+ clients implementing and delivering. we do have offshore development centres India, Canada, and UK. we have overall 6000+ employees overall the globe. #J-18808-Ljbffr
$61.7k - $109.5k
...Greater New York Insurance Companies is looking for a Data Engineer to design, build, and maintain scalable data pipelines for analytics and Generative AI initiatives. This remote position requires experience in the insurance domain, particularly with Guidewire data models...SeniorRemote work- ...Senior Data Engineer with Master Data Management (MDM) Responsibilities: Design and implement features of our TMR data model Oversee cloud data migration to TMR and production deployment Contribute to technical design discussions and architecture decisions Write high-...SeniorFull time
- ...Senior Data Engineer-2 This contract position is based in the Iselin, NJ area and involves designing and maintaining information systems tailored to user needs. The role includes the installation, configuration, and upkeep of operating systems, along with leading technical...SeniorContract work
- ...We are seeking a Senior Data Engineer with deep expertise in Apache Spark and hands‑on experience delivering production‑grade solutions on Databricks. This role centers on designing, optimizing, and operating large‑scale Spark data platforms that power analytics, machine...Senior
- ...Senior Data Engineer-2 (Onsite) Primary Location: Iselin, New Jersey V-Soft Consulting is currently hiring for a Senior Data Engineer-2 for our premier client in Iselin, New Jersey . Education and Experience " University (Degree...SeniorWork experience placementCurrently hiringLocal area
- ...users and to assist with the ongoing operation, maintenance, and development of the system. Collaborates with system analysts, engineers, and programmers to design systems and to determine project limitations and capabilities, performance requirements, systems performance...Senior
$106.9k - $176.5k
...career wherever you want it to go. Join EY and help to build a better working world. We are seeking a highly skilled Senior Consultant Data Engineer with expertise in cloud data engineering, specifically Databricks. The ideal candidate will have strong client...SeniorSummer holidayFlexible hours- ...SSE plc is seeking a Senior Data Engineer to play a key role in shaping data solutions for the Energy Markets team. The role involves designing robust data pipelines and delivering data solutions that drive commercial value. Candidates should have strong experience in...SeniorFlexible hours
£42.6k - £64k per year
...your finances, wellbeing and family. Working Pattern Permanent | Full Time | Flexible First options available. Role As a Senior Data Engineer within Energy Markets, you’ll play a key role in shaping how data supports safe, informed and forward looking decisions across...SeniorPermanent employmentFull timeFlexible hours- A technology consulting firm is seeking a Senior Data Engineer to design and implement features of their TMR data model in Piscataway, NJ. The role involves overseeing cloud data migration, writing high-quality code, and mentoring junior team members. Ideal candidates...SeniorFull time
- ...configure clinical study databases in EDC/CDM platforms. This role encompasses responsibilities including leading project builds, managing data integrations, and mentoring junior team members. The ideal candidate should have hands-on experience with Medidata Rave, Oracle...Senior
$105k - $158k
...Senior Java Data Engineer The Enterprise Data Frameworks team is seeking a Senior Java focused software engineer who builds and maintains large scale data processing systems using Java, Apache Spark, and Kafka. This role is intended for experienced backend engineers...SeniorWork at officeLocal areaRemote workMonday to FridayFlexible hours- ...Job Description Job Description Job Title: Junior and Senior Electrical Engineer - Data Center Facilities Job Type: Full-time Job Location: On-Site Edison, NJ (This is not a remote or hybrid job) Company Overview: BRUNS-PAK, an Information Technology/...SeniorFull timeMonday to Friday
- ...Scientist to enhance digital insights by developing and maintaining data pipelines within the Development Sciences and Clinical Supply organizations. You will work closely with experimentalists and engineers to ensure data integrity for robust modeling activities. The...Senior
$100k - $125k
...Tata Consultancy Services is hiring a Profisee MDM Engineer in Edison, New Jersey. The role requires at least 6 years of experience in data governance and MDM solution architecture. Key responsibilities include defining data governance policies, overseeing data stewardship...Senior- ...Accord Technologies Inc is looking for a Senior Data Engineer to join their team in Woodbridge Township, NJ. The role involves designing and maintaining data pipelines using technologies like Snowflake, Python, and Pyspark to support banking operations. Ideal candidates...SeniorContract work
- ...Title Senior Data Engineer Location Iselin, NJ (Need Onsite day 1, Hybrid 3 days from office) Duration 12 months. Position Type W2 contract Job Description We are seeking a skilled Data Engineer with expertise in Databricks, Snowflake, Python, Pyspark, SQL and Release...SeniorContract workWork at office
$100k - $150k
...experienced Hadoop Developer to design, build, and operate large-scale data processing pipelines. This position offers a fully remote setup... ...expertise in the Hadoop ecosystem along with solid software engineering skills. Responsibilities include developing end-to-end big-data...SeniorRemote job$167.84k
...must include the utilization of SQL for data querying & manipulation; Data warehousing... ...tools like Power BI, Tableau; and, Software engineering practices such as version control with... ...Management (USA), Inc. in Warren, NJ seeks a Senior Data Engineer to build a single source of...SeniorFull timeShift workDay shift- ...Senior, Data Engineer Position Purpose Provide a brief description as to the primary purpose of this job (no more than three to five sentences). Primary Duties/Responsibilities Develop and operate data management tools, monitoring data flows, data quality...SeniorWork at office2 days per week
$143k - $145k
...Experience Required 0 Minimum Education Required Master’s degree in Computer Science, Computer Engineering, or Data Analytics License(s) Required 0 Training Required/Provided Require skills and knowledge in Javascript, SQL, Python, AWS, Git, Agile Scrum...SeniorFull timeRemote workShift workDay shift- Senior Data Engineer with MDM Iselin, NJ (Onsite day 1, hybrid 3 days from office). Position type: W2 contract. Job Description We are seeking a highly skilled and experienced Senior Data Engineer specializing in Master Data Management (MDM) to join our data team. The...SeniorContract workWork at officeFlexible hours
- A leading provider of technology solutions is seeking a Database Engineer 4 for a contingent role in Port Reading, New Jersey. This position focuses on complex database engineering challenges, requiring over 5 years of experience, proficiency in Hadoop and GCP, and strategic...SeniorHourly payFull timeContract work
- ...executives, strategic execution, business continuity, resiliency, data services, regulatory relations, customer experience,... ...these critical functions. Within COO Technology we are seeking a Senior Data Engineer who will be responsible for designing GCP‑based data pipeline...SeniorFull timeWork experience placementWork at officeRemote work
- Engineering-Resource-Group is hiring a Senior Electrical Engineer for a permanent position in Port Reading, New Jersey. The successful candidate will specialize in designing electrical systems for data centers and mission-critical facilities, ensuring efficiency and reliability...SeniorPermanent employment
- ...Job Description Job Description Job Title: Senior Mechanical Engineer - Data Center Facilities Job Type: Full-time Job Location: On-Site Edison, NJ (this is not a remote or hybrid job). Company Information: Growing NJ Data Center Information Technology...SeniorFull timeWork at officeMonday to Friday
$140k - $155k
A global consulting firm is seeking a Senior Data Engineer to develop and manage MDM solutions within the financial sector. The role involves designing data platforms, evaluating MDM tools, and collaborating with business teams. Ideal candidates will have over 12 years...Senior- ...Data Engineer Global Development is embarking on a Digital Transformation project incorporating AI, machine learning, and automation to help us reduce cycle times, improve quality allowing us to focus on more meaningful work. We focus on developing and improving data...SeniorRemote workWorldwide
- A leading technology firm in New Jersey seeks a senior technical contributor to lead complex software applications. You will utilize your... ...fast-paced environment, alongside deep involvement in back-end data processing and full-cycle software development. Excellent...Senior
- A technology solutions provider is seeking a Senior Data Engineer specializing in Master Data Management (MDM) in Woodbridge Township, NJ. You will lead the development of comprehensive MDM solutions and collaborate with stakeholders to enhance data strategies. The ideal...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
- data science developer Edison, NJ
- senior data center engineer Edison, NJ
- data developer Edison, NJ
- junior data engineer remote Edison, NJ
- data engineer Edison, NJ
- finance data engineer Edison, NJ
- data center engineer Edison, NJ
- data engineer machine learning Edison, NJ
- data engineer analytics Edison, NJ
- senior brand designer Edison, NJ


