Lead Software Engineer - Ab Initio

Salary: $61,000 - 101,000 per year Requirements:

• We require formal training or certification in software engineering concepts, along with 5+ years of applied experience.
• We need 5+ years of data engineering experience building and running production-grade data pipelines in cloud environments.
• We look for deep expertise in Amazon Web Services data platforms and data lake architectures, including hands-on experience with Ab Initio.
• We expect hands-on experience with modern data lake and warehousing technologies such as Databricks and Snowflake, as well as processing engines like Spark and Flink.
• We require proficiency in SQL, experience with Oracle Database, and one or more scripting or programming languages such as Java, Perl, or Unix scripting.
• We value experience using Agile delivery practices, including backlog prioritization and leading team ceremonies to support continuous improvement.
• We need experience with large-scale distributed data processing, performance tuning, and reliability practices such as monitoring, alerting, and incident response readiness.
• We require hands-on experience with enterprise-authorized AI-assisted development tools, with the ability to critically assess and validate AI-generated output.
• We look for understanding of responsible AI use in engineering workflows, including data sensitivity, secure handling of inputs and outputs, and resiliency and security expectations; experience coaching engineers on safe, compliant adoption is also valued.
• Preferred qualifications include experience with data modeling using Erwin.
• Preferred qualifications include AWS certification and/or Databricks certification.
• Preferred qualifications include 8+ years of overall experience, with a strong record as an individual contributor and experience setting technical direction for teams.
• Preferred qualifications include experience implementing data governance capabilities such as data cataloging, lineage, stewardship workflows, and access controls in enterprise environments.

• We design and deliver scalable batch data pipelines with strong performance, fault tolerance, and end-to-end observability.
• We develop and operate workflow orchestration to schedule, monitor, and manage data movement and transformations with clear operational ownership.
• We translate complex business needs into technical solutions aligned with data lake and data warehousing standards.
• We establish and maintain governance processes for data modeling, cataloging, ownership, lineage, and access control to strengthen trust and transparency.
• We optimize large-scale distributed processing workloads through performance tuning, efficient storage and compute patterns, and resilient runtime design.
• We mentor engineers through technical reviews, standards, and knowledge sharing to build engineering excellence and consistency.
• We perform advanced quantitative analysis on large datasets to identify trends and support data-informed decisions.
• We use enterprise-authorized AI capabilities within our work environment to accelerate design comprehension and pipeline analysis, validating outputs and handling data according to sensitivity and security requirements.
• We apply reuse-first, AI-assisted practices within SDLC and toolchain automation to reduce manual toil while preserving security, resiliency, and traceability/auditability expectations.

• Ab Initio
• AI
• AWS
• Cloud
• Databricks
• Flink
• Support
• Java
• Marketing
• Oracle
• Perl
• SQL
• Security
• Snowflake
• Spark
• Unix
• Web

More:

We are collaborating with J.P. Morgan to connect with exceptional professionals for this role. As a Lead Software Engineer within Corporate Technologys Data Governance and Controls Technology team, we build the data foundations that enable trusted insights, stronger controls, and better outcomes across the firm through scalable, well-governed data platforms. We design secure, resilient, high-performing data solutions and partner across business, analytics, and technology teams while mentoring engineers and setting technical standards. JPMorganChase is one of the oldest financial institutions, serving consumers, small businesses, and major corporate, institutional, and government clients under the J.P. Morgan and Chase brands. We offer a competitive total rewards package, with base salary determined by role, experience, skill set, and location, plus possible commission or discretionary incentive compensation in eligible roles. Our benefits may include comprehensive health coverage, wellness centers, retirement savings, backup childcare, tuition reimbursement, mental health support, and financial coaching. We value diversity and inclusion and are an equal opportunity employer. Our Corporate Functions team spans finance, risk, human resources, marketing, and other essential areas that help our business, clients, customers, and employees succeed.

last updated 36 week of 2026