Lead Data Engineer: Scalable Data Pipelines & Analytics
Chubb Group of Insurance Co
Chubb is the world’s largest publicly traded P&C insurance company and a leading commercial lines insurer in the United States. With operations in 54 countries and territories, Chubb provides commercial and personal property and casualty insurance, personal accident and supplemental health insurance, reinsurance, and life insurance to a diverse group of clients. As an underwriting company, we assess, assume, and manage risk with insight and discipline. We service and pay our claims fairly and promptly. We combine the precision of craftsmanship with decades of experience to conceive, craft and deliver the very best insurance coverage and service to individuals and families, and businesses of all sizes. Chubb is also defined by its extensive product and service offerings, broad distribution capabilities, direct-to-consumer platform partnerships, exceptional financial strength and local operations globally. The company serves multinational corporations, mid-size and small businesses with property and casualty insurance and risk engineering services; affluent and high net worth individuals with substantial assets to protect; individuals purchasing life, personal accident, supplemental health, homeowners, automobile and specialty personal insurance coverage; companies and affinity groups providing or offering accident and health insurance programs and life insurance to their employees or members; and insurers managing exposures with reinsurance coverage. Position Overview: We are seeking a highly skilled and experienced lead data engineer to join our dynamic team. The ideal candidate will be responsible for leading the design, development and implementation of scalable data pipelines, and ensuring the effective utilization of data in the business intelligence and decision-making. Position Summary Technical Hands-on role providing direction and thought leadership in implementation of data solutions and related downstream systems including the build of repositories, such as data warehouses, data lakes, using appropriate technologies. This role requires strong technical background, hands-on experience in Informatica IICS, Databricks Python, ADF, snowflake and other Azure technologies along with data analysis skills and leadership abilities. The candidate will work on multiple projects for delivery of data solutions, including new development, maintenance, and enhancements. The candidate will also assist with the daily operations, management, and oversight of team’s deliverables. Primary Responsibilities: The candidate will be responsible for design, and implement new solutions for complex data ingestions from multiple sources to enterprise data products with focus on automation, performance, resilience, and scalability, etc. Partner with Lead Architect, Data Product Manager (Product Owner) and Lead Data Integration Engineer to create strategic solutions introducing new technologies. Work with stakeholders including Management, Domain leads, and Teams to assist with data-related technical issues and support their data infrastructure needs. Strong development and programming experience in database management, ETL processes, data modeling, and infrastructure to developing APIs, front-end applications, and automated data pipelines. Experience in Informatica (IICS), Python, ADF, Azure Synapse, snowflake, Cosmos and Databricks Solid understanding of databases, real-time integration patterns and ETL/ELT best practices. From database management, ETL processes, data modeling, and infrastructure to developing APIs, front-end applications, and automated data pipelines Defining data retention policies, monitoring performance and advising any necessary infrastructure changes based on functional and non-functional requirements. Responsible for ensuring enterprise data policies, best practices, standards and processes are followed. Write up and maintain technical specifications, design documents and process flow. Mentor a team of onshore and offshore development resources to analyze, design, construct and test software development projects focused on analytics and data integration. Elaborate user stories for technical team and ensure that the team understands the deliverables. Effectively communicate, coordinate & collaborate with business, IT architecture and data teams across multi-functional areas to complete deliverables. Provide direction to the Agile development team and stakeholders throughout the project. Assist in Data Architecture design, tool selection and data flows analysis. Work with large amounts of data, interpret data, analyze results, perform gap analysis and provide ongoing reports. Handle ad-hoc analysis & report generation requests from the business. Respond to data related inquiries to support business and technical teams.
QUALIFICATIONS
7+years of proven working experience in ETL methodologies, Data integration and data migration. Informatica IICS, Databricks/Spark & Python hands-on development skills a must. Clear hands-on experience with database systems - SQL server, Oracle, Azure Synapse, Snowflake and Cosmos, Cloud technologies (e.g., AWS, Azure, Google), and NoSQL databases (e.g., Cosmos, MongoDB, DynamoDB) Skilled in backend technologies (Python, Java, Scala) & Front-end development (JavaScript, React, Angular). Extensive experience developing complex solutions focused on data ecosystem solutions. Extensive knowledge of data and analytics framework supporting data lakes, warehouses, marts, reporting, etc. In depth knowledge of data engineering and architecture disciplines Extensive experience working with Big Data tools and building data solutions for advanced analytics and Machine learning frameworks. Solid understanding of P&C Insurance data Technical expertise regarding data architecture, models and database design development Strong knowledge of and experience with Java, SQL, XML’s, Python, ETL frameworks and Databricks Working knowledge/familiarity with Git version control. Strong Knowledge of analyzing datasets using Excel Strong analytical skills with the ability to collect, organize, analyze, and disseminate significant amounts of information with attention to detail and accuracy. Proficient in learning new technologies with the ability to quickly understand capabilities and work with others to guide these into development. Good communication and presentation skills Solid problem solving, decision making and analytical skills. Knowledge & working experience with Duck creek is an added plus. Knowledge & working experience with Insurity Policy Decisions and/or IEV is an added plus. Experience with JIRA Other Skills / Experience: Experience being part of high-performance agile teams in a fast-paced environment. Must understand the system scope and project objectives to achieve project needs through matrix management and collaboration with other enterprise teams. Proven ability to produce results in the analysis, design, testing and deployment of applications. Strong team emphasis and relationship building skills; partners well with business and other IT/Data areas. Strong coaching / mentoring skills Applies technical knowledge to determine solutions and solve complex problems. Ability to be proactive, self-motivated, detail-oriented, creative, inquisitive, and persistent. Excellent communication and negotiation skills. Ability to organize, plan and implement work assignments, juggle competing demands and work under pressure of frequent and tight deadlines.ABOUT US
Chubb is a world leader in insurance. With operations in 54 countries, Chubb provides commercial and personal property and casualty insurance, personal accident and supplemental health insurance, reinsurance, and life insurance to a diverse group of clients. The company is distinguished by its extensive product and service offerings, broad distribution capabilities, exceptional financial strength, underwriting excellence, superior claims handling expertise and local operations globally. #J-18808-Ljbffr Chubb$127.31k - $167.1k
...Legend Biotech is seeking a Lead Data Engineer as part of the Information... ...operate enterprise-grade data pipelines using Microsoft Azure as... ...integration patterns, and scalable platform engineering in a GxP... ...in data engineering and analytic. Community lead to enable...PipelinePermanent employmentFull timeTemporary workFor contractorsLocal areaWorldwideFlexible hours- ...performance, and SLAs; troubleshoot and resolve data sync issues. Onboard new data sources in collaboration with analytics and business teams. Optimize ingestion pipelines for performance, cost efficiency, and scalability. Design and implement self-service ingestion frameworks...Pipeline
- ...Educational assistance program Overview The Data Engineer is responsible for designing, building, and optimizing scalable data solutions to support a wide range of business... ..., propose enhancements to existing data pipelines and structures, and ensure the reliability and...PipelineFlexible hours
$117k - $201.25k
Job Function Data Analytics & Computational Sciences Job Sub Function... ...teams, data scientists, data engineering/platform teams, and external... ...data access provisioning, data pipelines, harmonization and... ...are integrated, governed, and scalable within enterprise data environments...PipelineTemporary workLocal areaRemote work$130k - $160k
Role Overview The Manager, Data Engineering is responsible for leading the development and optimization... ...to enable advanced analytics and data-driven decision‑making... ..., and governance of data pipelines and platforms, ensuring they are scalable, reliable, and aligned with...PipelineWork at officeLocal areaImmediate startRemote work2 days per week$117k - $201.25k
...and recognize their merit. Job Function: Data Analytics & Computational Sciences Job Sub... ...to the design and implementation of a scalable knowledge graph infrastructure focused... ...services; develop ingestion and curation pipelines to ingest, normalize and map concepts across...PipelineFull timeTemporary workLocal areaRemote work$109k - $174.8k
...merit. Job Function: Data Analytics & Computational Sciences... ...the best talent for Lead Data Scientist About Innovative... ...managers, data engineers, and business leaders... ...reusability, and delivers scalable, cost-effective... ...LLM fine-tuning, RAG pipelines, embedding strategies,...PipelineFull timeTemporary workLocal areaImmediate start- Google Analytics Admin/Developer Contract Location:... ...and audit readiness 2 Data Governance Security Compliance... ...Tracking Framework Lead implementation using... ...controlled deployment pipelines Dev QA Prod Develop... ...Integration Regulated Data Engineering Integrate analytics...PipelineContract work
- A.M. Best is seeking a Data Engineer to design, build, and optimize scalable data solutions to meet diverse business needs. The role entails working collaboratively in a fast-paced environment, engaging with teams to gather requirements and improve data processes. Ideal...Flexible hours
- ...seeking an experienced Network Engineer specializing in DDI (DNS,... ...in ensuring the availability, scalability, and performance of mission‑critical... ...routing across multiple data centers or regions. Ensure... ...Exposure to DevOps practices and CI/CD pipelines. #J-18808-Ljbffr VeriiproPipeline
- ...on experience in AI/ML engineering, with strong depth in... ...graphs, unstructured data processing, and generative... ...intelligent data pipelines that transform large scale... ..., discovery, and analytics. Agentic Knowledge Base... ...graph data. Implement scalable ML systems using Python...Pipeline
- ...using FastAPI and Pydantic for data validation and serialization. Implement scalable service-layer logic for microservices... ...backend systems. MCP Server Engineering Build and optimize MCP server... ...deployment. Familiarity with CI/CD pipelines and Git-based workflows....PipelineContract work
- The Infrastructure Automation Engineer is responsible for designing... ..., reliability, and scalability of IT operations by leveraging... ...Orchestration Work with CI/CD pipelines (Azure DevOps, Jenkins, GitLab... ...testing. Soft Skills Strong analytical and problem solving...Pipeline
- ...advisor lifecycle and excels at building scalable, disciplined processes that enable advisor... ...conversations Maintain recruiting pipelines and transition timelines Partner with leadership... ..., and Dashboards Own CRM maintenance and data integrity for recruiting and onboarding...PipelineLocal area
$145.4k - $212.2k
...Cloud Architects and Solution Engineers to deliver solutions and... ...occupation delivering automated, scalable cloud solutions and ensuring... ...certificates to ensure compliance and data protection. Performing end‑to... ...(CI/CD). Implementing CI/CD pipelines using Jenkins and Azure...Pipeline- ...We are looking for a sharp Data Engineer to join our Company . We are not just moving... ...build, optimize, and maintain the pipelines that power our analytics, machine learning, and reporting.... ...Do:** Design & Build: Architect scalable ETL/ELT pipelines to ingest data from...PipelineFull timeHome officeFlexible hours
- ...Overview: senior-level 5G network engineering, AI/ML, and application... ...legacy telecom applications into scalable, cloud-native, Java-based... ...Analyze large-scale network data to deliver actionable insights... ...Exposure to AIOps, network analytics, and predictive maintenance models...Contract workWork experience placement
- GlobalPoint in Raritan, New Jersey is seeking a Senior Data Engineer to lead the design, development, and optimization of data solutions on... ...Databricks. This role involves implementing end-to-end data pipelines, optimizing data workflows, and collaborating with stakeholders...PipelineContract work
- ...Solutions Architect - Data Technologies Location:... ...practices across Business Analytics, Data Management,... ...advantage. We partner with leading technology companies and... ...practice is the engine of this transformation.... ...Warehouses, Lakehouses, Data Pipelines, Cloud platforms (AWS,...PipelineFull timeFlexible hours
- A leading technology firm is looking for a Cloud Data Engineer based in Raritan, New Jersey. The candidate should have at least 5 years of experience in designing and optimizing data pipelines with familiarity in Google Cloud services and Big Data technologies. Responsibilities...Pipeline
- An established industry player is seeking a skilled Data Architect with extensive experience in the pharmaceutical sector. This role involves designing scalable and flexible technical systems that enhance business value while ensuring compliance with regulatory standards...PipelineFlexible hours
- GCP dataPlace Cloud Data Engineer with experience in designing (min 5 years), building, and optimizing data pipelines. Experience with Google Cloud Composer, DataFlow, DataProc clusters, Apache Beam, Hadoop, BigQuery. Experience in process automation and application...Pipeline
- ...Duration: 6 Months+ Senior Data Engineer to lead the design, development, and... ...of end-to-end data pipelines on Azure, leveraging Databricks... ...and ADLS Gen 2. Implement scalable ETL/ELT pipelines for structured... ...management to support analytics and AI workloads. Monitor...Pipeline
- ...efficiency, and make smarter, data-driven decisions. We’re... ...front line of our growth engine — identifying, engaging,... ...’ll combine creativity, analytics, and persistence to... ...and discovery calls that lead to high conversion rates and pipeline contribution. Track and optimize...Pipeline
- TechDigital Group is seeking an experienced AI/ML Engineer based in Raritan, New Jersey. This role... ...grade Knowledge Graphs from unstructured data and requires over 10 years of experience... ...for data enrichment, and creating robust data pipelines. #J-18808-Ljbffr TechDigital GroupPipeline
- Role: SAP S4HANA Data Analytics Functional Consultant Location: Raritan... ...Databricks, Teradata). Lead ERP data ingestion from intake... ...Databricks (SQL-based data engineering) Teradata SAP Datasphere (... ...data integration and ingestion pipelines Strong understanding of batch...PipelineContract work
- An established industry player is seeking a Senior Data Scientist to transform unstructured big data into actionable insights. This pivotal role involves utilizing advanced machine learning algorithms and innovative data models to enhance client service delivery and optimize...
- ...technical experience in software engineering, with at least 3+ years in... ...GenAI, API architectures, data systems, ML pipelines, and cloud‑native... ...pivotal role in architecting, leading, and actively contributing... ...to deliver high-quality, scalable solutions while remaining...Pipeline
- Veriipro is looking for a data integration specialist with 5-7 years of experience managing Fivetran connectors across ERP, CRM, and... ...monitor performance, troubleshoot issues, and collaborate with analytics teams to onboard new data sources. Deep knowledge of cloud...
- ...reports, enhancements, and CDS views, Analytical CDS Views, AMDP, OData Ensures compliance... ...and deployment processes using CI/CD pipelines. Integrating SAP and non-SAP systems. Ensuring... ...SAP BTP monitoring tools and optimize scalability. Good problem-solving and debugging...PipelinePermanent employmentContract workLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer: Scalable Data Pipelines & Analytics. Be the first to apply!

