Data Engineer (Pyspark)

Data Engineer (Pyspark) Job Location: Jersey City Location: New York, NY, US Role Overview: Design, build, and optimize scalable data pipelines and ETL/ELT workflows using Databricks, Apache Spark, and Scala. Architect and manage data lake house solutions, build backend data services and APIs, and collaborate with cross‑functional teams to define data models and best practices. Responsibilities & Required Skills Design, build, and optimize scalable data pipelines and ETL/ELT workflows using Databricks (Unity Catalog, Delta Live Tables, Workflows, Asset Bundles), Apache Spark, and Scala. Architect and manage data lake house solutions leveraging Apache Iceberg and Delta Lake for table format management, versioning, time travel, and efficient data storage and retrieval at scale. Build and maintain robust backend data services and APIs, integrating Databricks with downstream systems, enabling real‑time and batch data consumption across enterprise platforms. Collaborate with data architects, analysts, and engineering teams to define data models, establish best practices, and drive continuous improvement across the data platform. Benefits Flexible work arrangements Healthcare including dental, vision, mental health, and well‑being programs Financial well‑being programs such as 401(k) and Employee Share Ownership Plan Paid time off and paid holidays, paid parental leave, family building benefits such as adoption assistance, surrogacy, and cryopreservation Social well‑being benefits like subsidized backup child/elder care and tutoring Mentoring, coaching, and learning programs Employee Resource Groups Compensation Base compensation range: $80,420 to $106,050. Additional compensation such as variable incentives, bonuses, or commissions may be eligible depending on the position and applicable laws. Equal Opportunity Employer Capgemini is an Equal Opportunity Employer encouraging inclusion in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status, or any other characteristic protected by law. #J-18808-Ljbffr Capgemini