Lead Software Engineer - Data Eng, PySpark

Salary: $61,000 - 101,000 per year Requirements:

• Formal software engineering training or certification, plus 5+ years of relevant hands-on experience
• Proven background in system design, application development, testing, and maintaining operational stability at enterprise scale
• Practical experience building and deploying production AI/ML solutions, including LLM-based applications and agentic architectures with tool use, memory, and multi-step reasoning in regulated environments
• Strong proficiency in one or more programming languages, especially Python and/or Java
• Advanced knowledge of application development and technical disciplines such as cloud, AI/ML, or data engineering
• Demonstrated experience using enterprise-approved AI-assisted software development tools and setting expectations for validating outputs for correctness, performance, and security
• Solid understanding of responsible AI practices in engineering workflows, including data sensitivity, secure handling of inputs and outputs, and resiliency and security controls
• Experience coaching senior engineers or leads on compliant AI usage patterns and controls
• Background in large-scale data processing, microservices, API design, Kafka, Redis, Memcached, observability tools, and orchestration frameworks
• Advanced working knowledge of relational and NoSQL databases, vector stores, data lake architectures, and data governance
• Practical cloud-native experience with AWS, Azure, or GCP
• Ability to present clearly and communicate effectively with senior leaders and executives
• Preferred: experience with modern data platforms such as Databricks or Snowflake
• Preferred: deep hands-on experience with Spark/PySpark and other big data technologies
• Preferred: expertise in open-source table formats and catalog services such as Apache Iceberg
• Preferred: experience with LLM orchestration frameworks and model serving infrastructure or managed endpoints such as AWS Bedrock or Azure OpenAI
• Preferred: familiarity with AI evaluation and observability practices, including eval frameworks, red-teaming, prompt drift detection, and cost/latency monitoring for LLM workloads

• We develop secure, high-quality production code for data-intensive applications and platforms, while reviewing and mentoring other engineers
• We create durable, reusable software frameworks and patterns that can be applied across teams and functions
• We design and govern agentic AI systems, including multi-agent workflows, tool integrations, and human-in-the-loop controls for regulated financial services environments
• We drive adoption and governance of approved AI-assisted engineering practices across teams to improve code quality, delivery speed, and operational outcomes
• We establish measurable validation standards, including secure coding, peer review, and automated testing, while promoting reuse of proven patterns and automation within the SDLC/TLM toolchain
• We apply knowledge of software development life cycle tools, including authorized AI-assisted development and automation capabilities, to increase the value of automation at scale
• We set engineering standards for LLM-based applications, including RAG pipelines, embedding workflows, vector store integrations, and model serving, with a focus on safety, observability, and reproducibility
• We drive adoption of advanced technical methods and practices aligned with current industry standards and product development methodologies
• We advise cross-functional teams on technology matters within our area of expertise

• Agentic AI
• AI
• API
• AWS
• Azure
• Big Data
• Cloud
• Databricks
• GCP
• Support
• Java
• Kafka
• LLM
• Model Serving
• NoSQL
• Python
• PySpark
• RAG
• Redis
• Security
• Snowflake
• Spark
• microservices
• Airflow
• Dynatrace
• Grafana
• Network
• Splunk

More:

We are JPMorganChase, collaborating with hackajob to connect with exceptional professionals for this Lead Software Engineer opportunity within our Corporate Technology Sector. In this role, you will help build a trusted global Know Your Customer and Risk Assessment Data Platform in a secure, stable, and scalable way, while working as part of an agile data engineering team. We are a large global financial institution with over 200 years of history, serving consumers, small businesses, corporations, institutions, and government clients through the J.P. Morgan and Chase brands. We offer a competitive total rewards package and a range of benefits and programs, subject to eligibility, including comprehensive health care, wellness centers, retirement savings, backup childcare, tuition reimbursement, mental health support, and financial coaching. We value diversity and inclusion, provide reasonable accommodations where needed, and our Corporate Technology team supports applications and technology needs across our corporate functions and technology controls agenda.

last updated 37 week of 2026