Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI/LLM SRE Software Engineer III

J.P. Morgan

hackajob is collaborating with J.P. Morgan to connect them with exceptional professionals for this role.

JOB DESCRIPTION

Job description
We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.

As a Lead Software Engineer at JPMorgan Chase within the Employee Platforms team, you will be responsible for ensuring the reliability, scalability, and automation of AI-powered applications and infrastructure. You will partner with engineering, and other stakeholders to deliver modern observability, intelligent incident response, and autonomic operations across our applications.

Job responsibilities

  • Ensure reliability, scalability, and performance of AI-assisted application and platform operations.
  • Design and implement AI-driven solutions for intelligent alerting, noise reduction & auto-correlation systems.
  • Build and maintain observability, monitoring, and telemetry for AI application and platforms.
  • Build and support automation for alerting, anomaly detection, and self-healing workflows.
  • Collaborate with engineering, and other stakeholders to drive operational excellence.
  • Mentor and guide engineers on AIOps standards and operational excellence.
  • Define and execute the roadmap for AI-assisted SRE and observability.

     

Required qualifications, capabilities, and skills:

  • Formal training or certification on software engineering concepts and 5+ years applied experience
  • Demonstrates strong experience in SRE, DevOps, or Platform Engineering roles.
  • Strong hands-on experience with AWS (ECS, Lambda, API Gateway, Bedrock, CloudWatch, RDS, EKS).
  • Hands-on experience with AWS Bedrock, OpenAI, or LLM APIs.
  • Expertise in observability tools: OpenTelemetry, Grafana, Prometheus, ELK, CloudWatch.
  • Experience with CI/CD tools (GitHub Actions, Jenkins, Spinnaker ).
  • Proven track record in automation, operational tooling, and event-driven workflows.
  • In-depth understanding of distributed systems, microservices, and cloud architectures.

Preferred qualifications, capabilities, and skills:

  • Experience with AI-powered coding assistants like GitHub Copilot, windsurf.
  • Familiarity with prompt engineering, embeddings, and RAG pipelines.
  • Experience building operational copilots or chatbots for runbooks or troubleshooting.
  • Proficiency in Python (Go is a plus).

ABOUT US
JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world’s most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management.

We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process. 

We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.

JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans

ABOUT THE TEAM
Our professionals in our Corporate Functions cover a diverse range of areas from finance and risk to human resources and marketing. Our corporate teams are an essential part of our company, ensuring that we’re setting our businesses, clients, customers and employees up for success.

Vacancy posted 9 days ago
Similar jobs that could be interesting for youBased on the AI/LLM SRE Software Engineer III in Columbus, OH vacancy
  •  ...professionals for this role. JOB DESCRIPTION Infrastructure Engineer III – Software Deployment (Employee Compute) Location: Columbus, Ohio...  ...using scripting/programming (Python, PowerShell, .NET) and AI/Agentic AI to fully automate software delivery and... 
    Software

    J.P. Morgan

    Columbus, OH
    9 days ago
  •  ...and rewarding opportunity for you to take your software engineering career to the next level. As a Software Engineer III at JPMorganChase within the Enterprise technology...  ...problems Uses enterprise-authorized AI capabilities within the work environment to accelerate... 
    Software

    J.P. Morgan

    Delaware, OH
    7 days ago
  •  ...Onsetto is building a white-label, AI-powered platform that...  ...About the Role This role is for engineers who can independently own meaningful...  ..., and release quality Use LLM tools effectively to...  ...experience building production software systems Strong proficiency in... 
    Software
    Immediate start
    Remote work

    Onsetto, Inc

    Columbus, OH
    3 days ago
  • $118k - $178k

     ...*Comscore, Total Visits, March 2025) Day to Day As a Software Engineer III on the AI Gateway & Guardrails team at Indeed, you will own and drive...  ...s AI-powered products to large and small language models (LLM and SLM), and safeguards AI actions. You will work... 
    Software
    Work experience placement
    Local area

    Indeed

    Columbus, OH
    5 days ago
  • $121.9k - $182.8k

    Teradata Corporation (SE) is seeking a Site Reliability Engineer to enhance system reliability and scalability through innovative software solutions. The ideal candidate will have a Bachelor's degree in Computer Science and over 4 years of industry experience, especially... 
    Software

    Teradata Corporation (SE)

    Columbus, OH
    1 day ago
  •  ...technology products. As a Senior Lead Software Engineer at JPMorganChase within the CONSUMER &...  ...NextGen orchestration platform using advanced AI capabilities in Java & AWS.  Job...  ...augmented generation (RAG) pipelines and LLM APIs ⢠Deep knowledge in one or more... 
    Software
    For contractors

    J.P. Morgan

    Columbus, OH
    9 days ago
  •  ...and rewarding opportunity for you to take your software engineering career to the next level. As a Software Engineer III at JPMorgan Chase within the Consumer & Community...  ...Drives team adoption of enterprise-authorized AI-assisted engineering practices within the work... 
    Software

    J.P. Morgan

    Columbus, OH
    8 days ago
  •  ...notch technology products. As a Lead Software Engineer at JPMorganChase within the CONSUMER & COMMUNITY...  ...orchestration platform using advanced AI capabilities in Java & AWS.  Job...  ...leveraging AI Powered tools, RAG pipelines and LLM API's. ~ Proficient in coding in one... 
    Software

    J.P. Morgan

    Columbus, OH
    7 days ago
  •  ...limits of what's possible. As a Lead Software Engineer at JPMorgan Chase within the Consumer &...  ...critical technology solutions across Chase AI components - including Chase Agent,...  ...OpenTelemetry). ~ Practical understanding of LLM patterns: function calling/tools, RAG,... 
    Software

    J.P. Morgan

    Columbus, OH
    9 days ago
  • $121.4k - $218.6k

     ...challenges? Join our critical AI Hardware SRE Team! The AI Hardware SRE...  ...elite, high-density hardware and software infrastructure spanning the...  ...As a Senior Site Reliability Engineer, you will be responsible for:...  ...Leveraging advanced AI utilities and LLM-assisted development... 
    Software
    Work experience placement
    Work at office

    Akamai Technologies, Inc.

    Columbus, OH
    4 days ago
  •  .... Overview of Job Function: As a Software Engineer, you will be a core contributor to Verint...  ...documentation for supported features. AI/ML Integration and Continuous...  ...Integrate AI/ML capabilities — including LLM-powered features, automated scoring, and... 
    Software
    Local area
    Worldwide
    Shift work

    Verint Systems

    Columbus, OH
    2 days ago
  •  ...Cloud Solutions Engineer Location: Columbus, Ohio (Onsite) Employment...  ...Overview The Senior Cloud/AI Engineer will design, build,...  ...: 5+ years of experience in software, platform, or cloud...  ...Hands-on experience building LLM-based applications or AI agents... 
    Software
    Permanent employment
    Contract work

    Apex Systems Inc Defunct

    Columbus, OH
    1 day ago
  •  ...Overview of Job Function: As a Senior Software Engineer, you will take deep technical ownership...  ...the Principal Engineer and Tech Leads. AI/ML Integration and Innovation...  ...capabilities into product features including LLM-powered analytics, automated quality scoring... 
    Software
    Contract work
    Local area
    Shift work

    Verint Systems

    Columbus, OH
    4 days ago
  •  ...firm serving our corporate clients in all regions to have next generation trading capabilities at their fingertips. As a Lead Software Engineer at JPMorgan Chase within the Asset and Wealth Management (AWM), we are increasing our presence in Columbus and this is an... 
    Software
    For contractors

    J.P. Morgan

    Columbus, OH
    9 days ago
  •  ...Senior Engineer We are seeking a Senior Engineer to lead the technical...  ...systems, and supporting our AI-powered summarization portal (...  ...): RAG, chunking, embeddings, LLM summarization Security &...  ...~5+ years of experience in software/platform engineering, with at... 
    Software
    Work at office
    Local area
    2 days per week

    Liberty Information Technology Limited

    Columbus, OH
    3 days ago
  • $90k - $135k

     ...Software Engineer II - AI We are seeking a Software Engineer II - AI to join our AI Platform team. The ideal candidate will possess expertise...  ...focus on generative AI, with hands‑on experience in applying LLM frameworks such as LangChain. ~ Working knowledge of Retrieval... 
    Software
    Remote work

    McGraw-Hill Education

    Columbus, OH
    5 days ago
  • $100k

     ...Currently, we are looking for entry-level software programmers, Java full-stack developers,...  .../data scientists, and machine learning engineers for full-time positions with clients....  ...life cycle knowledge of statistics, gen AI, LLM, Python, computer vision, data visualization... 
    Software
    Full time
    H1b
    Remote work

    SynergisticIT

    Columbus, OH
    1 day ago
  •  ...cutting-edge solutions and transformative initiatives. As a Lead Software Engineer at JPMorgan Chase within the Consumer & Community Banking -...  ...and experience with Artificial Intelligence/Machine Learning (AI/ML) and Data Warehousing technologies Proficiency in front-... 
    Software

    J.P. Morgan

    Columbus, OH
    9 days ago
  •  ...role. JOB DESCRIPTION We have an exciting and rewarding opportunity for you to take your software engineering career to the next level.  As a Software Engineer III-ETL/PySpark at JPMorgan Chase within the Consumer and Community Banking Data Technology team, you... 
    Software

    J.P. Morgan

    Delaware, OH
    9 days ago
  •  ...processes, and release quality Use LLM tools effectively to...  ...Collaborate with product and engineering to define clear, testable solutions...  ...at the intersection of: AI systems running in real production...  ...building production software systems ~ Strong proficiency... 
    Software
    Full time
    Immediate start
    Remote work
    Flexible hours

    Onsetto, Inc

    Columbus, OH
    8 days ago
  • Senior Software Engineer (full stack) Full Time Columbus HQ / Remote As a Senior Full Stack Engineer, you...  ...Angular view. Nice-to-Haves (Training Provided) AI & Future Tech: Helping build our RAG-based AI agent and integrating LLM-driven features into the UI. Industrial IoT... 
    Software
    Remote job
    Full time

    Motion LLC

    Columbus, OH
    5 days ago
  •  ...turn possibility into production. As an AI Engineer at BWE, you design, build, and refine the...  ...into daily business workflows. From LLM-powered copilots to custom integrations...  ...experience in AI/ML engineering, automation, software development, or related technical roles.... 
    Software

    Bwecap

    Columbus, OH
    2 days ago
  •  ...analytics and data platform for AI. By delivering harmonized data...  ...where data scientists, ML engineers, and AI developers build, test...  ...Qualified Candidate 10+ years of software engineering experience,...  ...environments. Deep understanding of LLM integration patterns: RAG architectures... 
    Software
    Permanent employment
    Flexible hours

    Teradata Corporation (SE)

    Columbus, OH
    3 days ago
  •  ...Onsite. Client is seeking an experienced Artificial Intelligence (AI) Engineer, who possesses extensive knowledge and hands-on experience in...  ...prompt engineering, connecting chatbot systems to other software applications, supporting SharePoint On-Prem applications, and... 
    Software
    Remote work

    Morph Enterprise

    Columbus, OH
    1 day ago
  •  ...influential companies. As a Senior Principal Software Engineer at JPMorganChase within the Consumer &...  ..., etc.) ~ Deep expertise with Agentic AI ~ Experience with mentoring technology...  ...expertise Experience with AI/ML, LLM, Agentic AI and Generative AI is... 
    Software
    Bank staff

    J.P. Morgan

    Columbus, OH
    9 days ago
  • $60 - $70 per hour

    Get AI-powered advice on this job and more exclusive features. This range is provided...  ...with Innovative Career Paths Software Engineer Columbus, OH 6-month contract The Software...  ...weeks ago Full Stack Software Engineer III- Java/React/AWS IT Software Engineer - Full... 
    Software
    Permanent employment
    Full time
    Contract work
    Local area
    Remote work

    Brooksource

    Columbus, OH
    4 days ago
  • $66k - $98k

    (2) AI Developers (Software Development Specialist 1)- 20066914, 20066924 United States of America-OHIO-Franklin County-Columbus USD 66K-98K Mid...  ...Fraud Detection Deep learning | Fine Tuning | GPU Computing | LLM Inference | Language Models Algorithm Design | Fraud... 
    Software
    Full time
    Remote work
    Relocation package

    Aitopics

    Columbus, OH
    2 days ago
  •  ...professionals for this role. JOB DESCRIPTION Lead Software Engineer | Software Engineer III] - CMAS Strategic Initiatives   As a Software Engineer...  ...(CMAS) team, you will design and build software and AI capabilities, powering a new platform for customization... 
    Software

    J.P. Morgan

    Columbus, OH
    9 days ago
  • $65k - $85k

    Get AI-powered advice on this job and more exclusive features. Job Description: Quality Engineer III Hudson Manpower's Information Technology department is seeking a Quality Engineer...  ...for ensuring the quality of our software products through testing and analysis. You... 
    Software
    Full time
    Shift work

    Hudson IT and Manpower

    Columbus, OH
    4 days ago
  • $89.2k - $209.5k

     ...Description We’re looking for highly skilled AI engineers to design and build high-scale, cloud-...  ...Responsibilities ~ As a member of the software engineering division, you will assist in...  ..., and transformations. Contribute to LLM/agent-based features and analytics use... 
    Software
    Temporary work
    Flexible hours

    Oracle

    Columbus, OH
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI/LLM SRE Software Engineer III. Be the first to apply!