SR Principal Software Engineer - LLM Engineering
Chase
Senior Principal Software Engineer We're looking for a tech leader ready to take their career to new heights. Join the ranks of top talent at one of the world's most influential companies. As a Senior Principal Software Engineer at JPMorganChase within the Commercial & Investment Bank Trust & Safety Fraud Prevention team, you provide deep engineering expertise and work across agile teams to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. Leverage your deep expertise to consistently challenge the status quo, innovate for business impact, lead the strategic development behind new and existing products and technology portfolios, and remain at the forefront of industry trends, best practices, and technological advances. Job responsibilities Advises and leads on the strategy, architecture, and development of model serving solutions for different model architectures (including LLMs & GNNs) across cloud and on-premises environments, aligning initiatives to business outcomes. Defines and implements MLOps and LLMOps strategies for end-to-end model lifecycle management, including training, versioning, deployment, monitoring, and governance. Drives optimization of model inferencing for high throughput and low latency using quantization, model parallelism, intelligent batching, and hardware acceleration for all model architectures. Sets strategy and operating standards for agentic AI-enabled engineering across a portfolio (using enterprise-authorized tools within the work environment) to drive measurable improvements in delivery speed, reliability, and code quality (e.g., AI-orchestrated SDLC/TLM automation, release readiness gating, incident triage/root-cause acceleration, and large-scale refactoring/test modernization), while defining guardrails for validation, security, resiliency, and reuse across teams and functions. Applies knowledge of tools within the Software Development Life Cycle toolchain, including enterprise-authorized AI-assisted development and automation capabilities, to improve the value realized by automation at scale. Creates durable, reusable software and platform frameworks to standardize ML Engineering services, enabling scale across teams and functions. Establishes best practices for automation, CI/CD, and infrastructure-as-code using containerization and orchestration technologies. Partners closely with data science, platform engineering, and SRE teams to productionize models on AWS, ensuring observability, reliability, and cost efficiency. Leads deployment and optimization using model inference servers such as Triton Inference Server and vLLM for high-throughput, low-latency serving at scale. Oversees production operations for AI workloads, including monitoring, incident response, security, and compliance, with continuous improvement. Translates complex technical concepts and emerging trends into actionable strategies, influencing senior stakeholders and cross-functional partners to prioritize and deliver AI/ML capabilities that drive measurable business impact while promoting a culture of diversity, opportunity, inclusion, and respect. Required qualifications, capabilities, and skills Formal training or certification on software engineering concepts and 10+ years of applied experience. 8+ years of AI/ML engineering experience with significant expertise in LLMs, GNNs and other model architectures (e.g., GPT, Llama, Falcon, Mistral). Demonstrated success architecting and deploying LLM & GNN solutions on AWS (e.g., SageMaker, Bedrock, EKS) at enterprise scale; experience with Azure ML or GCP Vertex AI. Experience building LLM and GNN serving platforms in large-scale environments typical of major tech firms. Hands-on experience building LLM inference engines using Triton Inference Server and vLLM, including autoscaling, caching, and throughput optimization. Advanced proficiency in Python and optimization techniques applied to deep learning frameworks (PyTorch, TensorFlow, Hugging Face Transformers). Deep understanding of LLMOps/MLOps (e.g., MLflow, SageMaker Pipelines, Kubeflow) with a track record of implementing best practices at scale. Demonstrated experience designing and scaling agentic AI-enabled development patterns (using enterprise-authorized tools within the work environment) across teams/functions, including establishing governance for human-in-the-loop validation, traceability/auditability, and secure handling of sensitive inputs/outputs. Strong understanding of responsible AI use and control expectations at scale, including security/resiliency implications, data sensitivity, and risk-based governance; ability to advise senior leaders on safe adoption, reuse, and measurable outcomes. Expertise in inference optimization and distributed systems for large models focused on high-throughput, low-latency applications, including system design, testing, and operational stability for enterprise AI platforms. Excellent communication skills with proven collaboration with SRE to implement observability, incident response, and SLIs/SLOs for LLM services, and the ability to influence both technical and non-technical stakeholders to deliver value across functions at scale. Preferred qualifications, capabilities, and skills Master's or PhD in Computer Science, Engineering, or a related field (or equivalent experience). Practical cloud-native experience, including containerization (Docker), orchestration (Kubernetes), and infrastructure-as-code (Terraform, CloudFormation). Expertise in security, compliance, and governance for AI/ML deployments in regulated environments. Experience in trust and safety or fraud prevention domains; familiarity with payments platforms is a plus. Track record of contributions to open-source LLM projects or peer-reviewed research and/or experience presenting at industry conferences or leading technical communities. Familiarity with hardware acceleration strategies across GPUs, TPUs, and specialized inference runtimes. Experience in building java based applications This position is subject to Section 19 of the Federal Deposit Insurance Act. As such, an employment offer for this position is contingent on JPMorgan Chase's review of criminal conviction history, including pretrial diversions or program entries. About Us JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world's most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management. We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process. We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation. JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans About the Team J.P. Morgan's Commercial & Investment Bank is a global leader across banking, markets, securities services and payments. Corporations, governments and institutions throughout the world entrust us with their business in more than 100 countries. The Commercial & Investment Bank provides strategic advice, raises capital, manages risk and extends liquidity in markets around the world. Chase
- Job DescriptionThe Principal AI Software Engineer will report to the Sr. Director, AI Center of Excellence, in the Technology Department. This role is the most... ...deterministic logic to direct requests to the best-fit LLM, internal tool, or agentic pool, using cost, latency,...Suggested
$200k - $230k
...Looking to take on a high-impact engineering role at a major global market operator? This team is modernizing a real-time platforms... ...options and equities markets. They’re searching for a Principal Software Engineer with deep C#/.NET expertise to lead the re-...SuggestedFlexible hours$164.6k - $288k
...exceptional service. We are seeking a highly experienced Senior Principal Software Engineer to support technical development of our AI-powered Code... ...and scanning services.Expand and manage integrations with LLM-based security analysis capabilitiesEnhance automated vulnerability...SeniorFull timeH1bWorldwideFlexible hours- Are you passionate about building scalable, modern software solutions that make complex data more accessible and actionable?Do you enjoy leading technical design, mentoring engineers, and working across the full technology stack to deliver high-impact products?About the...SuggestedFull time
- Principal Software Engineer If you are looking for a game-changing career, working for one of the world's leading financial institutions, you've come to the right place. As a Principal Software Engineer at JPMorganChase within the Commercial and Investment Bank's Digital...Suggested
$142.8k - $274.8k
...In the Microsoft Frontier Company Engineering team, you won’t just build software; you’ll deliver real outcomes for... ...solutions in days, not months. As a Principal Software Engineer , you will... ...designing, deploying, and operating AI or LLM-based solutions, including prompt...Ongoing contractFull timeLocal areaVisa sponsorshipWork visa$114.6k - $234.6k
...6 to 10+ yearsApplicants are required to read, write, and speak the following languages: EnglishWhat You’ll DoAs a Principal Software Development Engineer, you will:Design, develop, and maintain production software supporting OCI network deployment and lifecycle management...Temporary workFlexible hours- ...Information Security (GIS) team is seeking a Cyber Threat Defense Sr AI/ML Engineer to build and integrate advanced AI and machine learning... ...Develop and operationalize custom machine learning models and LLM-based workflows tailored to cybersecurity use cases, owning the...SeniorWork at officeShift workDay shift
$10,000 per month
...Company Palantir builds the world's leading software for data-driven decisions and operations.... ..., and more. The Forward Deployed Engineer, Internship Forward Deployed Engineering... ...invention Build custom applications, LLM workflows, and production solutions engineered...Part timeWork experience placementInternshipWork at officeRemote workWork from homeShift work$130k - $185k
...AI capabilities that power long‑term enterprise growth. The Software Engineering Director for AI Tooling plays a pivotal role in translating strategy... .... Familiarity with modern AI ecosystems, including LLM frameworks, agent architectures, and prompt/tool orchestration...SeniorWork experience placementSummer holidayWork at officeFlexible hours- ...ambition, bringing modern, product-grade engineering practices into one of the most traditional industries there is. The Senior Software Engineer is a member of the Data & AI Engineering... ...summarization, knowledge assistants, or LLM/AI services. MMD Services Inc. is...SeniorWork experience placementLocal area
- Senior Principal Software Engineer We're looking for a tech leader ready to take their career to new heights. Join the ranks of top talent at one of the world's most influential companies. As a Senior Principal Software Engineer at JPMorganChase within the VPC Network organization...Senior
- ...technology organization building next-generation software solutions that help healthcare providers... ...and accelerate revenue collection. The engineering team is developing a modern AI-powered... ...AI-powered products, agents, or LLM integrations · Experience with AWS cloud...SeniorFull timeRemote work
- ...What You’ll Do and Impact: ● Lead the enterprise-wide Engineering function, setting the vision and operating model to drive AI-first... ...related field; Master’s degree preferred ● 15+ years of software engineering and architecture experience ● 10+ years of progressive...Senior
$98.3k - $135.2k
...Senior and Lead Software Engineers (AI Engineering, .NET, Azure) Chicago, Dallas, Houston or New York (Hybrid) Full-time, direct hire Multiple... ...What You’ll Do Build AI into production applications: LLM features, retrieval-augmented generation (RAG), agents and...SeniorFull timeInternshipRelocation package$110k - $160k
...patients at precisely the right time.Our Engineering CultureWe operate in small, autonomous... ...seeking a highly motivated and capable Senior Software Engineer to help advance our Diagnostics... ...agents (e.g., Copilot, Cursor, LLM APIs) to accelerate development, refactor...SeniorFull time$251k - $403.75k
...you excited about using AI to change how engineers build, operate, and debug systems at scale... ...work as a team.About the roleAs a Senior Software Engineer on the Observability team, you'... ...calling, agents, MCP, RAG, and evaluating LLM output).Solid programming experience (...SeniorWork at officeLocal areaRemote workMonday to ThursdayFlexible hoursShift work- Job DescriptionWe are seeking a Sr. Salesforce Engineer to join our Salesforce Platform Engineering team. This role is ideal for an experienced... ...should be comfortable owning solutions throughout the software delivery lifecycle, troubleshooting complex issues, contributing...SeniorRemote work
- Job Title: Sr. DevOps Engineer Primary Location: Hybrid - 2 Days in Evanston, IL Office Position Type: 6-Month Contract with Intent to Hire Overview This is a hands-on engineering opportunity for an experienced cloud professional who will help build, automate, and support...SeniorContract workWork at office
$106k - $130k
...Senior Site Reliability Engineer (SRE) Location: Chicago, IL Employment Type: Full-Time Work Arrangement: Hybrid Position... ...of critical production services. This individual will apply software engineering, systems engineering, automation, and DevOps principles...SeniorFull time- ...This is a platform engineering (build and automate) role, not a production-support-only or... ...for example, using large language model (LLM) APIs, Model Context Protocol (MCP), or... ...optimizing CI/CD pipelines in Harness to improve software delivery speed, including pipeline...SeniorWork experience placement
$49 - $70 per hour
...Job Description Job Description Title: Sr. Site Reliability Engineer (SRE) Location: Chicago, IL Employment Type : Contract Compensation: Pay Range:$49.00-$70.00 Per Hr. Description We are seeking a Senior Site Reliability Engineer for a contract...SeniorContract work$126k - $190k
...agencies rely on Relativity's legal AI software to securely surface and manage the most... ...team within Relativity, with product and engineering led directly by Dorna Moini, CEO, and Pierre... ...teams, including experience shipping LLM-powered features to real users through a...SeniorRemote work$175k - $225k
...build, and maintain the platforms that IMC's software development lifecycle depends on,... ...auditable. We are seeking a Software Engineer based in Chicago to build the software behind... ...Curiosity and eagerness to learn about AI/LLM application patterns, even if you haven’t...Permanent employmentFull timeWork experience placement$106k - $133k
...You’ll join a diverse team of engineers, data scientists, architects,... ...and systems, including LLM-powered applications, retrieval... ...services, data platforms, and software engineering practices to deliver... ...3,000 - $166,000, and at the Principal level is $157,000 - $196,000....SeniorTemporary workWork at officeLocal area- Sr. DevOps Engineer (Greenberg) Chicago, Los Angeles, New York What makes this Support Engineering role on the Prime team particularly interesting... ...for the functioning and improvement of the entire software/infrastructure ecosystem - the breadth, depth, and scale of...SeniorWorldwide
$175.5k - $180k
Tech & AI Senior Software Engineer - QuantumBlack, AI by McKinsey Job ID: 105333 Atlanta Boston Chicago Denver New Jersey New York City Raleigh... ...AI systems and ensuring engineering quality, utilizing robust LLM evaluation frameworks, guardrails, and validation...SeniorHourly payApprenticeshipWork at officeLocal areaEasy work$114.5k - $194.7k
...leading technology and exceptional service. The Senior Lead, Security Engineer is an experienced individual contributor responsible for... ...audit/regulatory response expectations.Nice to HaveExposure to AI/LLM security controls:AI gatewaysPrompt-injection defensesOWASP Top...SeniorFull timeH1bRemote workWorldwideFlexible hours$244k - $253.5k
...About The OpportunityWe're looking for a Principal Engineer to set the technical direction for this... ...experience.10+ years of professional software engineering experience, including recent... ...-on work building with or on top of LLM-based tooling (agents, MCP servers, coding...Full timeTemporary workFlexible hours- About the Role IAA is seeking a Principal Data Engineer to serve as the most senior individual contributor... ...in Python and SQL, with strong software engineering fundamentals (testing, version... ...data pipelines that support RAG, LLM, or modern AI workloads on enterprise...Full timeWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to SR Principal Software Engineer - LLM Engineering. Be the first to apply!
- principal software engineer Chicago, IL
- senior living Chicago, IL
- senior trade analyst Chicago, IL
- senior accountant manufacturing Chicago, IL
- senior manager customer operations Chicago, IL
- senior director information security Chicago, IL
- senior full stack web developer Chicago, IL
- senior technical director Chicago, IL
- senior service engineer Chicago, IL
- senior environment artist Chicago, IL








