Principal Software Engineer - AI Foundations - Jersey City

Salary: $61,000 - 101,000 per year Requirements:

• Formal training or certification in software engineering concepts and at least 7 years of applied experience.
• Hands-on experience with system design, application development, testing, and operational stability for large-scale platforms and services.
• Expert proficiency in one or more programming languages, such as Python, Java, Scala, or Go, with strong code quality, testing, and debugging practices.
• Experience designing and leading adoption of agentic AI-enabled development practices across teams, including standards for human review, auditability, traceability, and secure handling of sensitive data.
• Strong understanding of responsible AI practices and engineering controls, including security, resiliency, data sensitivity, and risk-based governance; ability to influence senior technical leaders on safe, reusable approaches.
• Demonstrated ability to design and operate ML/LLM platforms, including reproducible training pipelines, experiment tracking, model and data versioning, and continuous evaluation.
• Practical cloud-native experience with containers, orchestration, infrastructure as code, and observability, plus experience operating production systems with defined SLOs.
• Experience applying new methods to complex technology problems in areas such as platform engineering, ML systems, data engineering, or distributed systems.
• Strong communication skills, including the ability to influence senior leaders and explain complex technical topics as clear decisions and trade-offs.
• Strong understanding of business outcomes and product delivery, with the ability to align platform roadmaps to measurable impact.
• Preferred: Experience with distributed computing and scalable model training or fine-tuning, including performance, cost, and reliability trade-offs.
• Preferred: Experience building LLM or agentic-system development platforms, including fine-tuning, evaluation harnesses, retrieval and tooling integration, and prompt or agent testing.
• Preferred: Experience with modern MLOps toolchains and production ML operations, including model CI/CD, registries, feature or data stores, and governance workflows.
• Preferred: Background in LLM evaluation, benchmarking, red-teaming, and quality measurement through offline and online evaluation, experimentation, and A/B testing.
• Preferred: Experience designing enterprise-scale multi-tenant platforms, reusable frameworks, and developer self-service capabilities.
• Preferred: Strong security-by-design experience for ML systems, including secrets, access control, data handling, supply chain controls, and resiliency engineering.
• Employment is subject to Section 19 of the Federal Deposit Insurance Act and contingent on our review of criminal conviction history, including pretrial diversions or program entries.

• Design, build, and troubleshoot AI-enabled applications and services, delivering scalable solutions.
• Develop secure, high-quality production code; review, debug, and improve code written by others.
• Own and support SDK and service integrations, maintaining their reliability, performance, and maintainability.
• Build and deliver AI-powered features using prompt design, function calling, and SDK or REST integrations.
• Design and implement end-to-end MLOps capabilities, including data and model versioning, reproducible training pipelines, model CI/CD, deployment approaches, and ongoing evaluation and monitoring.
• Contribute to advanced training methods such as distributed fine-tuning, RLHF/DPO-style workflows, synthetic data generation, and automated evaluation, and turn them into reusable platform components.
• Identify recurring issues and automate remediation to improve the reliability, resilience, and operational performance of AI features and services.
• Create durable, reusable frameworks and platform components for teams, aligned with modern product development practices.
• Work with business, product, and technology leaders to build alignment and deliver outcomes, while fostering diversity, opportunity, inclusion, and respect.
• Architect and govern agentic AI-enabled engineering workflows using enterprise-authorized tools, improving delivery speed, code quality, and operational outcomes while setting safeguards for validation, security, resilience, and reuse.
• Use software development lifecycle tools, including authorized AI-assisted development and automation capabilities, to increase the value of automation at scale.

• Agentic AI
• AI
• Architect
• CI/CD
• Cloud
• Fine-tuning
• Support
• Java
• LLM
• MLOps
• Model Training
• Python
• REST
• Scala
• Security
• Marketing

More:

We are collaborating with hackajob to connect professionals with this Principal Software Engineer role at JPMorganChase, within our Chief Data and Analytics Office. You will join an agile team at a leading global financial institution, contributing to trusted, secure, stable, and scalable technology products across the firm. Our history spans more than 200 years, and we provide financial services to consumers, businesses, and institutional and government clients. We offer competitive compensation and, for eligible roles, incentive pay, along with benefits that may include health care, wellness centers, retirement savings, backup childcare, tuition reimbursement, mental health support, and financial coaching. Our Corporate Functions teams support the success of our businesses, clients, customers, and employees. We are an equal opportunity employer, value diversity and inclusion, and provide reasonable accommodations for religious practices and disability-related needs.

last updated 42 week of 2026