Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

SR Principal Software Engineer - LLM Engineering

Chase

Senior Principal Software Engineer We're looking for a tech leader ready to take their career to new heights. Join the ranks of top talent at one of the world's most influential companies. As a Senior Principal Software Engineer at JPMorganChase within the Commercial & Investment Bank Trust & Safety Fraud Prevention team, you provide deep engineering expertise and work across agile teams to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. Leverage your deep expertise to consistently challenge the status quo, innovate for business impact, lead the strategic development behind new and existing products and technology portfolios, and remain at the forefront of industry trends, best practices, and technological advances. Job responsibilities Advises and leads on the strategy, architecture, and development of model serving solutions for different model architectures (including LLMs & GNNs) across cloud and on-premises environments, aligning initiatives to business outcomes. Defines and implements MLOps and LLMOps strategies for end-to-end model lifecycle management, including training, versioning, deployment, monitoring, and governance. Drives optimization of model inferencing for high throughput and low latency using quantization, model parallelism, intelligent batching, and hardware acceleration for all model architectures. Sets strategy and operating standards for agentic AI-enabled engineering across a portfolio (using enterprise-authorized tools within the work environment) to drive measurable improvements in delivery speed, reliability, and code quality (e.g., AI-orchestrated SDLC/TLM automation, release readiness gating, incident triage/root-cause acceleration, and large-scale refactoring/test modernization), while defining guardrails for validation, security, resiliency, and reuse across teams and functions. Applies knowledge of tools within the Software Development Life Cycle toolchain, including enterprise-authorized AI-assisted development and automation capabilities, to improve the value realized by automation at scale. Creates durable, reusable software and platform frameworks to standardize ML Engineering services, enabling scale across teams and functions. Establishes best practices for automation, CI/CD, and infrastructure-as-code using containerization and orchestration technologies. Partners closely with data science, platform engineering, and SRE teams to productionize models on AWS, ensuring observability, reliability, and cost efficiency. Leads deployment and optimization using model inference servers such as Triton Inference Server and vLLM for high-throughput, low-latency serving at scale. Oversees production operations for AI workloads, including monitoring, incident response, security, and compliance, with continuous improvement. Translates complex technical concepts and emerging trends into actionable strategies, influencing senior stakeholders and cross-functional partners to prioritize and deliver AI/ML capabilities that drive measurable business impact while promoting a culture of diversity, opportunity, inclusion, and respect. Required qualifications, capabilities, and skills Formal training or certification on software engineering concepts and 10+ years of applied experience. 8+ years of AI/ML engineering experience with significant expertise in LLMs, GNNs and other model architectures (e.g., GPT, Llama, Falcon, Mistral). Demonstrated success architecting and deploying LLM & GNN solutions on AWS (e.g., SageMaker, Bedrock, EKS) at enterprise scale; experience with Azure ML or GCP Vertex AI. Experience building LLM and GNN serving platforms in large-scale environments typical of major tech firms. Hands-on experience building LLM inference engines using Triton Inference Server and vLLM, including autoscaling, caching, and throughput optimization. Advanced proficiency in Python and optimization techniques applied to deep learning frameworks (PyTorch, TensorFlow, Hugging Face Transformers). Deep understanding of LLMOps/MLOps (e.g., MLflow, SageMaker Pipelines, Kubeflow) with a track record of implementing best practices at scale. Demonstrated experience designing and scaling agentic AI-enabled development patterns (using enterprise-authorized tools within the work environment) across teams/functions, including establishing governance for human-in-the-loop validation, traceability/auditability, and secure handling of sensitive inputs/outputs. Strong understanding of responsible AI use and control expectations at scale, including security/resiliency implications, data sensitivity, and risk-based governance; ability to advise senior leaders on safe adoption, reuse, and measurable outcomes. Expertise in inference optimization and distributed systems for large models focused on high-throughput, low-latency applications, including system design, testing, and operational stability for enterprise AI platforms. Excellent communication skills with proven collaboration with SRE to implement observability, incident response, and SLIs/SLOs for LLM services, and the ability to influence both technical and non-technical stakeholders to deliver value across functions at scale. Preferred qualifications, capabilities, and skills Master's or PhD in Computer Science, Engineering, or a related field (or equivalent experience). Practical cloud-native experience, including containerization (Docker), orchestration (Kubernetes), and infrastructure-as-code (Terraform, CloudFormation). Expertise in security, compliance, and governance for AI/ML deployments in regulated environments. Experience in trust and safety or fraud prevention domains; familiarity with payments platforms is a plus. Track record of contributions to open-source LLM projects or peer-reviewed research and/or experience presenting at industry conferences or leading technical communities. Familiarity with hardware acceleration strategies across GPUs, TPUs, and specialized inference runtimes. Experience in building java based applications This position is subject to Section 19 of the Federal Deposit Insurance Act. As such, an employment offer for this position is contingent on JPMorgan Chase's review of criminal conviction history, including pretrial diversions or program entries. About Us JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world's most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management. We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process. We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation. JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans About the Team J.P. Morgan's Commercial & Investment Bank is a global leader across banking, markets, securities services and payments. Corporations, governments and institutions throughout the world entrust us with their business in more than 100 countries. The Commercial & Investment Bank provides strategic advice, raises capital, manages risk and extends liquidity in markets around the world. Chase

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the SR Principal Software Engineer - LLM Engineering in Chicago, IL vacancy
  • Job DescriptionThe Principal AI Software Engineer will report to the Sr. Director, AI Center of Excellence, in the Technology Department. This role is the most...  ...deterministic logic to direct requests to the best-fit LLM, internal tool, or agentic pool, using cost, latency,... 
    Suggested

    Inspira Financial

    Oak Brook, IL
    2 days ago
  • $200k - $230k

     ...Looking to take on a high-impact engineering role at a major global market operator? This team is modernizing a real-time platforms...  ...options and equities markets. They’re searching for a Principal Software Engineer with deep C#/.NET expertise to lead the re-... 
    Suggested
    Flexible hours

    Saragossa

    Chicago, IL
    8 days ago
  • $164.6k - $288k

     ...exceptional service. We are seeking a highly experienced Senior Principal Software Engineer to support technical development of our AI-powered Code...  ...and scanning services.Expand and manage integrations with LLM-based security analysis capabilitiesEnhance automated vulnerability... 
    Senior
    Full time
    H1b
    Worldwide
    Flexible hours

    Northern Trust

    Chicago, IL
    4 days ago
  • Are you passionate about building scalable, modern software solutions that make complex data more accessible and actionable?Do you enjoy leading technical design, mentoring engineers, and working across the full technology stack to deliver high-impact products?About the... 
    Suggested
    Full time

    RELX Group

    Evanston, IL
    11 hours ago
  • Principal Software Engineer If you are looking for a game-changing career, working for one of the world's leading financial institutions, you've come to the right place. As a Principal Software Engineer at JPMorganChase within the Commercial and Investment Bank's Digital... 
    Suggested

    Chase

    Chicago, IL
    1 day ago
  • $142.8k - $274.8k

     ...In the Microsoft Frontier Company Engineering team, you won’t just build software; you’ll deliver real outcomes for...  ...solutions in days, not months. As a Principal Software Engineer , you will...  ...designing, deploying, and operating AI or LLM-based solutions, including prompt... 
    Ongoing contract
    Full time
    Local area
    Visa sponsorship
    Work visa

    Microsoft

    Chicago, IL
    7 hours ago
  • $114.6k - $234.6k

     ...6 to 10+ yearsApplicants are required to read, write, and speak the following languages: EnglishWhat You’ll DoAs a Principal Software Development Engineer, you will:Design, develop, and maintain production software supporting OCI network deployment and lifecycle management... 
    Temporary work
    Flexible hours

    Oracle Corporation

    Chicago, IL
    2 days ago
  •  ...Information Security (GIS) team is seeking a Cyber Threat Defense Sr AI/ML Engineer to build and integrate advanced AI and machine learning...  ...Develop and operationalize custom machine learning models and LLM-based workflows tailored to cybersecurity use cases, owning the... 
    Senior
    Work at office
    Shift work
    Day shift

    Bank of America Corporation

    Chicago, IL
    a month ago
  • $10,000 per month

     ...Company Palantir builds the world's leading software for data-driven decisions and operations....  ..., and more. The Forward Deployed Engineer, Internship Forward Deployed Engineering...  ...invention Build custom applications, LLM workflows, and production solutions engineered... 
    Part time
    Work experience placement
    Internship
    Work at office
    Remote work
    Work from home
    Shift work

    Palantir

    Chicago, IL
    1 day ago
  • $130k - $185k

     ...AI capabilities that power long‑term enterprise growth. The Software Engineering Director for AI Tooling plays a pivotal role in translating strategy...  .... Familiarity with modern AI ecosystems, including LLM frameworks, agent architectures, and prompt/tool orchestration... 
    Senior
    Work experience placement
    Summer holiday
    Work at office
    Flexible hours

    EY

    Chicago, IL
    1 day ago
  •  ...ambition, bringing modern, product-grade engineering practices into one of the most traditional industries there is. The Senior Software Engineer is a member of the Data & AI Engineering...  ...summarization, knowledge assistants, or LLM/AI services. MMD Services Inc. is... 
    Senior
    Work experience placement
    Local area

    MMD Services

    Chicago, IL
    1 day ago
  • Senior Principal Software Engineer We're looking for a tech leader ready to take their career to new heights. Join the ranks of top talent at one of the world's most influential companies. As a Senior Principal Software Engineer at JPMorganChase within the VPC Network organization... 
    Senior

    Chase

    Chicago, IL
    1 day ago
  •  ...technology organization building next-generation software solutions that help healthcare providers...  ...and accelerate revenue collection. The engineering team is developing a modern AI-powered...  ...AI-powered products, agents, or LLM integrations · Experience with AWS cloud... 
    Senior
    Full time
    Remote work

    Motion Recruitment

    Chicago, IL
    1 day ago
  •  ...What You’ll Do and Impact: ● Lead the enterprise-wide Engineering function, setting the vision and operating model to drive AI-first...  ...related field; Master’s degree preferred ● 15+ years of software engineering and architecture experience ● 10+ years of progressive... 
    Senior

    Alined Consulting Group

    Chicago, IL
    16 days ago
  • $98.3k - $135.2k

     ...Senior and Lead Software Engineers (AI Engineering, .NET, Azure) Chicago, Dallas, Houston or New York (Hybrid) Full-time, direct hire Multiple...  ...What You’ll Do Build AI into production applications: LLM features, retrieval-augmented generation (RAG), agents and... 
    Senior
    Full time
    Internship
    Relocation package

    1872 Consulting

    Chicago, IL
    3 days ago
  • $110k - $160k

     ...patients at precisely the right time.Our Engineering CultureWe operate in small, autonomous...  ...seeking a highly motivated and capable Senior Software Engineer to help advance our Diagnostics...  ...agents (e.g., Copilot, Cursor, LLM APIs) to accelerate development, refactor... 
    Senior
    Full time

    Tempus

    Chicago, IL
    2 days ago
  • $251k - $403.75k

     ...you excited about using AI to change how engineers build, operate, and debug systems at scale...  ...work as a team.About the roleAs a Senior Software Engineer on the Observability team, you'...  ...calling, agents, MCP, RAG, and evaluating LLM output).Solid programming experience (... 
    Senior
    Work at office
    Local area
    Remote work
    Monday to Thursday
    Flexible hours
    Shift work

    Roku

    Chicago, IL
    3 days ago
  • Job DescriptionWe are seeking a Sr. Salesforce Engineer to join our Salesforce Platform Engineering team. This role is ideal for an experienced...  ...should be comfortable owning solutions throughout the software delivery lifecycle, troubleshooting complex issues, contributing... 
    Senior
    Remote work

    Inspira Financial

    Oak Brook, IL
    1 day ago
  • Job Title: Sr. DevOps Engineer Primary Location: Hybrid - 2 Days in Evanston, IL Office Position Type: 6-Month Contract with Intent to Hire Overview This is a hands-on engineering opportunity for an experienced cloud professional who will help build, automate, and support... 
    Senior
    Contract work
    Work at office

    3B Staffing LLC

    Evanston, IL
    1 day ago
  • $106k - $130k

     ...Senior Site Reliability Engineer (SRE) Location: Chicago, IL Employment Type: Full-Time Work Arrangement: Hybrid Position...  ...of critical production services. This individual will apply software engineering, systems engineering, automation, and DevOps principles... 
    Senior
    Full time

    Prosum

    Chicago, IL
    13 days ago
  •  ...This is a platform engineering (build and automate) role, not a production-support-only or...  ...for example, using large language model (LLM) APIs, Model Context Protocol (MCP), or...  ...optimizing CI/CD pipelines in Harness to improve software delivery speed, including pipeline... 
    Senior
    Work experience placement

    PTR Global

    Chicago, IL
    1 day ago
  • $49 - $70 per hour

     ...Job Description Job Description Title: Sr. Site Reliability Engineer (SRE)     Location: Chicago, IL Employment Type : Contract Compensation: Pay Range:$49.00-$70.00 Per Hr. Description We are seeking a Senior Site Reliability Engineer for a contract... 
    Senior
    Contract work

    Mitchell Martin

    Chicago, IL
    24 days ago
  • $126k - $190k

     ...agencies rely on Relativity's legal AI software to securely surface and manage the most...  ...team within Relativity, with product and engineering led directly by Dorna Moini, CEO, and Pierre...  ...teams, including experience shipping LLM-powered features to real users through a... 
    Senior
    Remote work

    Relativity

    Chicago, IL
    1 day ago
  • $175k - $225k

     ...build, and maintain the platforms that IMC's software development lifecycle depends on,...  ...auditable. We are seeking a Software Engineer based in Chicago to build the software behind...  ...Curiosity and eagerness to learn about AI/LLM application patterns, even if you haven’t... 
    Permanent employment
    Full time
    Work experience placement

    IMC

    Chicago, IL
    1 day ago
  • $106k - $133k

     ...You’ll join a diverse team of engineers, data scientists, architects,...  ...and systems, including LLM-powered applications, retrieval...  ...services, data platforms, and software engineering practices to deliver...  ...3,000 - $166,000, and at the Principal level is $157,000 - $196,000.... 
    Senior
    Temporary work
    Work at office
    Local area

    Slalom

    Chicago, IL
    1 day ago
  • Sr. DevOps Engineer (Greenberg) Chicago, Los Angeles, New York What makes this Support Engineering role on the Prime team particularly interesting...  ...for the functioning and improvement of the entire software/infrastructure ecosystem - the breadth, depth, and scale of... 
    Senior
    Worldwide

    Democorp

    Chicago, IL
    1 day ago
  • $175.5k - $180k

    Tech & AI Senior Software Engineer - QuantumBlack, AI by McKinsey Job ID: 105333 Atlanta Boston Chicago Denver New Jersey New York City Raleigh...  ...AI systems and ensuring engineering quality, utilizing robust LLM evaluation frameworks, guardrails, and validation... 
    Senior
    Hourly pay
    Apprenticeship
    Work at office
    Local area
    Easy work

    McKinsey & Company

    Chicago, IL
    1 day ago
  • $114.5k - $194.7k

     ...leading technology and exceptional service. The Senior Lead, Security Engineer is an experienced individual contributor responsible for...  ...audit/regulatory response expectations.Nice to HaveExposure to AI/LLM security controls:AI gatewaysPrompt-injection defensesOWASP Top... 
    Senior
    Full time
    H1b
    Remote work
    Worldwide
    Flexible hours

    Northern Trust

    Chicago, IL
    4 days ago
  • $244k - $253.5k

     ...About The OpportunityWe're looking for a Principal Engineer to set the technical direction for this...  ...experience.10+ years of professional software engineering experience, including recent...  ...-on work building with or on top of LLM-based tooling (agents, MCP servers, coding... 
    Full time
    Temporary work
    Flexible hours

    GrubHub

    Chicago, IL
    3 hours ago
  • About the Role IAA is seeking a Principal Data Engineer to serve as the most senior individual contributor...  ...in Python and SQL, with strong software engineering fundamentals (testing, version...  ...data pipelines that support RAG, LLM, or modern AI workloads on enterprise... 
    Full time
    Worldwide

    RB Global

    Westchester, IL
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to SR Principal Software Engineer - LLM Engineering. Be the first to apply!