Lead Software Engineer - Python & Big Data

Salary: $61,000 - 101,000 per year Requirements:

• Formal software engineering training or certification, plus 5+ years of applied experience
• Proven leadership delivering AI-first analytics and data engineering solutions at scale, including productized data mesh patterns, semantic layers, and ownership of the analytical data product lifecycle
• Experience building data ingestion and integration workflows, sourcing data from multiple platforms, and applying cleansing and transformation rules for analytics-ready datasets
• Deep hands-on experience with big data and modern data platforms such as Spark, Databricks, Snowflake, and Iceberg, including robust pipeline and data lake/lakehouse development
• Strong programming skills in Python and PySpark, or Java, with solid CI/CD and containerization practices
• Applied AI expertise in ML pipelines, NLP/LLMs, and agentic frameworks to build autonomous engineering agents under human-in-the-loop controls
• Governance expertise across lineage, data quality, and access control, with evidence generation aligned to regulatory expectations
• Comfortable working in an agile, collaborative environment with strong written and verbal communication skills
• Demonstrated experience leading approved AI-assisted software development tools while setting expectations for validating AI outputs for correctness, performance, and security
• Strong understanding of responsible AI use in engineering workflows, including data sensitivity, secure handling of inputs and outputs, and resilience and security expectations
• Proficiency across all aspects of the Software Development Life Cycle
• Preferred: Python and Java

• Collaborate with business and technology teams to develop AI-first analytics and data product solutions
• Define and enforce architecture for an AI-driven data product lifecycle, including semantic alignment, automated lineage and data quality, pipeline code generation, mesh registration, and self-service consumption
• Build and run autonomous data engineering agents that detect schema drift, recommend transformations, reconcile semantics, triage data incidents, and maintain governance evidence under human-in-the-loop controls
• Design analytics platforms for reporting and other analytics, including real-time and batch solutions
• Establish monitoring and alerting for performance, scalability, availability, and reliability events
• Provide technical leadership, guidance, and direction to teammates, and build prototypes for demonstrations to peers, business partners, and senior leaders
• Drive adoption of enterprise-approved AI-assisted engineering practices to improve code quality, delivery speed, and operational outcomes
• Apply SDLC toolchain knowledge, including enterprise-authorized AI-assisted development and automation capabilities, to increase automation value
• Lead migration and modernization from legacy analytics and reporting stacks to the strategic mesh ecosystem, reducing fragmentation and duplicated data products
• Industrialize entity resolution and parent identification with ML/LLM solutions, and standardize analytical product packaging to support reuse and monetization
• Embed governance, lineage, and data quality by design across critical domains and regulatory reporting to improve auditability and control posture

• AI
• Big Data
• CI/CD
• Cloud
• Databricks
• Support
• Java
• LLM
• Python
• PySpark
• Security
• Snowflake
• Spark
• Network

More:

We are collaborating with hackajob to connect with exceptional professionals for this opportunity. This Lead Software Engineer role sits within JPMorganChase Asset and Wealth Management, specifically the Global Prime Brokerage team, where we work in an agile, cloud-native environment to build secure, stable, and scalable technology products. Our focus is an AI-first transformation of data engineering and analytics, modernizing the strategic data mesh, reducing manual toil, improving auditability, and enabling self-service consumption. We offer a competitive total rewards package, with base pay determined by role, experience, skill set, and location, and eligible roles may also receive commission or discretionary incentive compensation. We provide a broad range of benefits and programs, including comprehensive health care coverage, on-site health and wellness centers, retirement savings, backup childcare, tuition reimbursement, mental health support, and financial coaching. We are committed to diversity, inclusion, and equal opportunity, and we support reasonable accommodations where needed. Our team within Asset & Wealth Management delivers investment management and private banking solutions and is driven by innovators who create technology that helps us operate more efficiently and better serve our clients.

last updated 34 week of 2026