Senior Data Engineer

Data Engineer

Ready for a new challenge? Join Guidewire as a Data Engineer! We are building a new team to take advantage of our market leading position and access to data to build advanced predictive models and variables to drive the next generation of growth in the P&C insurance market. This is an opportunity to come on board early and shape our direction and have a broad impact on the insurance industry.

Responsibilities

• Participate in multiple simultaneous projects with a focus on data preparation and pipeline development for predictive modeling and machine learning. Includes:
• Data interrogation, exploratory data analysis, profiling, and reconciliation
• Data pipeline creation, revision and monitoring based on product manager and data scientist/actuarial input
• Feature creation, initial testing, and ongoing management
• Work collaboratively with other staff including product managers, data scientists, other data analysts, architects to solve problems, develop innovative approaches, and provide project status
• Create and manage data assets, datasets, features, and code with a focus on simplicity, scalability, reusability, and clear documentation
• Additional work assignments not related to specific project work such as new feature development, external data research, providing user feedback on new products and tools under development
• At Guidewire, we foster a culture of curiosity, innovation, and responsible use of AI—empowering our teams to continuously leverage emerging technologies and data-driven insights to enhance productivity and outcomes.

Qualifications

• Bachelors or Masters degree or equivalent industry experience
• Passion for solving complex data problems
• 7-10+ years of relevant experience
• Advanced, hands on experience building modeling datasets, pipelines and features for predictive modeling
• Extensive experience using DBT, Apache Iceberg, and AWS data capabilities like Airflow, Glue, Redshift, EMR to build ML data pipelines, with a strong focus on data quality and governance.
• Expert SQL skills, including advanced functions, table design, view creation, stored procedure and script design and coding, general performance tuning
• Proficient in data processing and transformations using Apache Spark.
• Working knowledge of Python
• Experience with version control systems (e.g., Git) for managing data pipelines and features.
• Understanding of MLOps principles and practices related to data preparation and feature engineering; experience using Sagemaker and feature stores a plus
• Familiarity with common challenges in integrating RDBMS-sourced data into a data warehouse, including temporal data handling, Change Data Capture (CDC), Slowly Changing Dimensions (SCD), and data modeling methodologies like Kimball and Data Vault
• Experience within a regulated industry (finance, insurance, etc…); P&C policy administration and claims processing concepts as well as US/Canadian P&C standard lines of business experience a plus
• Self-motivated and detail-oriented with desire to solve problems
• Demonstrated ability to embrace AI and apply it to your role as well as use data-driven insights to drive innovation, productivity, and continuous improvement.