Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Engineer - AI Monitoring & Control Capabilities

Bank of America ATM

At Bank of America, we are guided by a common purpose to help make financial lives better through the power of every connection. We do this by driving Responsible Growth and delivering for our clients, teammates, communities and shareholders every day.

Being a Great Place to Work and providing a culture of caring is core to how we drive Responsible Growth. We are intentional about fostering an inclusive workplace where every teammate has the opportunity to succeed, build a career and contribute to our shared success. This includes attracting and developing exceptional talent, recognizing and rewarding performance, and supporting our teammates’ physical, emotional, and financial wellness through affordable, competitive and flexible benefits.

We value the unique perspectives individuals bring from all backgrounds and career paths - whether shaped by military service, community college education, or a wide range of work and life experiences. These journeys foster resilience, leadership and innovation, strengthening our workforce and positively impact the communities we serve.

Bank of America is committed to an in-office culture that supports collaboration, engagement, and career development. Our approach includes clear in-office expectations, while providing an appropriate level of flexibility based on role-specific responsibilities and business needs.

At Bank of America, you can build a successful career with opportunities to learn, grow, and make an impact. Join us!

This is a critical-delivery role responsible for engineering and operating vendor applications end to end within an on-premises OpenShift platform, directly supporting the enterprise's AI monitoring, controls, and governance commitments. You will develop and integrate application components, deploy and scale containerized services, and provide the production support that keeps these services reliable, performant, and audit-ready.

The domain is AI Agent operations. The applications you support deliver guardrails and observability for LLM powered systems across the enterprise, enabling the model observability, traceability, and evaluation needed to meet risk management, compliance, and regulatory expectations. Because this capability underpins key delivery milestones, the role demands strong engineering discipline, sound operational judgment, and a sense of urgency.

The ideal engineer learns new tools and environments quickly, brings a pragmatic build-and-operate mindset, and can lead cross-functional initiatives without formal authority.

Responsibilities:

  • Own delivery of critical vendor applications from build through production support in a fully on-premises OpenShift environment, meeting committed milestones and quality expectations.
  • Build and maintain APIs and integrations connecting vendor guardrail and observability platforms to enterprise AI Agent solutions.
  • Establish and manage workflows that monitor performance, safety, latency, throughput, quality, and guardrail effectiveness in support of AI risk and control objectives.
  • Implement and maintain model evaluation frameworks using LLM-as-a-Judge and specialized language models.
  • Develop observability dashboards and alerting using Grafana or similar tools, producing audit-friendly evidence and traceability.
  • Troubleshoot production issues and improve scalability, resilience, and operational efficiency to sustain availability for critical business services.
  • Contribute to evaluation methodologies and guardrail controls for agentic and multi-step AI systems.
  • Lead and mentor engineers, establish development standards, and drive process improvements across cross-functional delivery.
  • Provide input into financial planning, budget tracking, forecasting, and management of supported applications and services.

This is a hands on individual contributor position.

Required Qualifications:

  • Bachelor's or Master's degree in Computer Science, Data Science, MIS, a related field, or equivalent practical experience.
  • 10+ years of software engineering experience designing, building, and scaling production applications.
  • Strong proficiency in Python, including common data and ML libraries. Hands-on experience deploying and operating containerized workloads on OpenShift or Kubernetes.
  • Proven experience taking LLM- or RAG-based applications into production and maintaining them at scale.
  • Experience building APIs and integrating third-party platforms.
  • Working experience with AI Agents development, including OpenAI APIs and LangChain.
  • Practical understanding of inference performance optimization. Experience applying guardrails, observability, and model-based evaluation to AI applications.
  • Experience delivering within Agile and Agile-at-scale environments against firm timelines.
  • Proven ability to influence outcomes and meet delivery commitments in a matrixed organization without direct authority. Strong problem-solving, communication, and stakeholder management skills.

Desired Qualifications:

  • Experience delivering technology solutions within a large, complex, highly regulated enterprise, preferably financial services.
  • Fast learner able to ramp quickly on new technologies and tools.
  • Experience with annotation pipelines, feedback loops, fine-tuning, and model alignment techniques.
  • Familiarity with prompt versioning and lifecycle management.
  • Experience with vendor-provided guardrail and observability platforms such as Galileo, LangSmith, Arize, WhyLabs, Braintrust, Agenta, Fiddler, MLflow, Weights & Biases, LangFuse and RAGAS
  • Working knowledge of additional AI Agents frameworks such as LlamaIndex or Haystack.
  • Familiarity with evaluation and guardrails for agentic, multi-step AI workflows.
  • Collaborative and self-directed work style supporting engineering teams.

Skills:

  • Automation
  • Influence
  • Result Orientation
  • Stakeholder Management
  • Technical Strategy Development
  • Application Development
  • Architecture
  • Business Acumen
  • Risk Management
  • Solution Design
  • Agile Practices
  • Analytical Thinking
  • Collaboration
  • Data Management
  • Solution Delivery Process

Shift:

1st shift (United States of America)

Hours Per Week: 

40

Vacancy posted 29 days ago
Similar jobs that could be interesting for youBased on the Senior Engineer - AI Monitoring & Control Capabilities in Charlotte, NC vacancy
  • $105.4k - $207.8k

     ...Cyber SAP Internal Controls Senior Consultant/ Senior Engineering Management SpecialistJoin...  ...and develop controls for AI-enabled business processes...  ...change. The team supports capabilities across security...  ...for continuous control monitoring, access management, cloud... 
    Senior
    Local area

    Deloitte

    Charlotte, NC
    2 days ago
  • Job Title:Measurement-Based Grid Monitoring Analytics and Control Engineer - Staff Level IIILocation:Charlotte, NC, Dallas, TX, Knoxville, TN, Palo...  ...hardware-in-the-loop methodologies.Strong programming capabilities, preferably including Python, MATLAB, and C++.Excellent... 
    Suggested
    Full time
    Remote work
    Work from home
    Flexible hours

    Electric Power Research Institute

    Charlotte, NC
    3 days ago
  • $65 - $90 per hour

     ...REMOTE Sr. Instrumentation & Controls (I&C) Engineer Job Description This...  ..., and neutron flux monitoring system projects where applicable...  ...modification processes. Capability to independently drive engineering...  ...Artificial Intelligence (AI): We may use Artificial... 
    Senior
    Contract work
    Temporary work
    Work at office
    Remote work

    Actalent

    Charlotte, NC
    2 days ago
  •  ...are seeking an experienced Senior Inspection Engineer / CWI Welding Inspector to...  ...will be responsible for monitoring and verifying compliance with...  ...or manufacturing quality control • Experience with...  ...skills • Independent work capability • Client-facing communication... 
    Senior
    Work at office

    Energy Engg Americas LLC

    Charlotte, NC
    28 days ago
  • $159k - $279k

     ...highly experienced Senior Lead Systems Operations Engineer to provide technical...  ..., automation, and AI-enabled operations....  ...support by strengthening monitoring, alerting,...  ...strengthen technical capabilities, and establish engineering...  ...production controls, improves reliability... 
    Senior
    Full time
    Work experience placement
    Relocation package

    Wells Fargo

    Charlotte, NC
    2 days ago
  • $210k - $256.67k

     ...governed, cloud-based, AI-ready target-state...  ...durable delivery capability into bank’s own...  ...reverse engineering, lift-and-shift migration...  ...Manage program controls, financials, and contractual...  ...for executive and senior stakeholder groups...  ...adoption monitoring. Build and maintain... 
    Senior
    Full time
    Temporary work
    Shift work

    Infosys Consulting

    Charlotte, NC
    19 days ago
  •  ...job description:The Senior Infrastructure Engineer designs, builds, manages...  ...how infrastructure capabilities are delivered,...  ...enterprise standards and controls.**For this...  ...applies automation, monitoring, and optimization techniques...  ...1. Awareness of how AI-assisted engineering... 
    Senior
    Permanent employment
    Full time
    Part time
    H1b
    Work at office
    Work visa
    Shift work
    Day shift

    Truist

    Charlotte, NC
    1 day ago
  •  ...talented Sr Platform Engineer II (Copilot & Copilot...  ...and support enterprise AI, Copilot, and automation...  ..., and Power Platform capabilities to deliver measurable...  ...models, and governance controls.Experience with Power...  ...grounding, evaluation, and monitoring).Microsoft... 
    Senior
    Full time
    Work at office
    Flexible hours

    Pacific Life Insurance Company

    Charlotte, NC
    4 days ago
  •  ...experienced software engineer with a passion for...  ...network.The Senior Integration Engineer...  ...through deployment, monitoring, incident response...  ...reusable platform capabilities while extending...  ...automated quality controls. Develop solutions...  .... Experience with AI-assisted software... 
    Senior
    Full time
    Contract work
    Remote work

    EDRAY

    Charlotte, NC
    27 days ago
  • $134.5k - $265.1k

     ...Cyber SAP Internal Controls Manager/ Engineering Manager II Join Deloitte...  ...on controls for AI-enabled business processes...  .... The team supports capabilities across security...  ...continuous control monitoring, access management,...  ...-level employees to senior leaders, we believe... 
    Local area
    Visa sponsorship

    Deloitte

    Charlotte, NC
    22 hours ago
  •  ...adherence to schedules, budget control and efficient labor...  ...Financial and Performance Monitoring Conduct monthly cost reviews...  ...resolution and decision-making capabilities. Excellent verbal and written...  ...Four-year college degree in engineering or construction management... 
    Senior
    Full time
    For contractors
    For subcontractor
    Summer work
    Work at office
    Shift work
    Night shift
    Weekend work

    InServ Corp.

    Charlotte, NC
    3 days ago
  •  ...position may be filled as an Engineer III or one level higher as a Senior Engineer dependent upon...  ...Engineer is completely capable of working independently...  ...commissioning of the control system for each project....  ...estimating, scheduling, and monitoring of work activities under... 
    Senior
    Full time
    Contract work
    Remote work
    Visa sponsorship
    Relocation package

    Duke Energy

    Charlotte, NC
    1 day ago
  •  ...Job Description Job Description JOB SUMMARY Our Senior Automation and Controls Specialists are instrumental in building long-term customer...  ...commission building systems such as HVAC, lighting, power, and monitoring. JOB RESPONSIBILITIES Develop, build, test, and... 
    Senior

    McKenney's Inc.

    Charlotte, NC
    20 days ago
  •  ...Role: Senior Devops Engineer Location - Charlotte , NC...  ...developer self-service capabilities Capacity planning •...  ...• Familiarity with AI-assisted development...  ..., Grafana or similar monitoring tools Preferred Skills...  ..., and governance controls in CI/CD • Knowledge... 
    Senior

    AceStack LLC

    Charlotte, NC
    11 hours ago
  •  ...and Risk Management, the Senior Manager Global Internal Audit and Internal Controls coordinates key global...  ...processes and controls.Monitor emerging regulatory,...  ...including automation, AI-enabled testing, analytics...  ...analytical, and problem-solving capabilities.Ability to travel... 
    Senior
    Local area

    Circle K

    Charlotte, NC
    1 day ago
  • GCO Controls Monitoring & Testing Consultant II - Technology Issue Validation Join to apply for the...  ...improvements. Discuss material issues with senior management, including root cause and...  ...development, cloud, cybersecurity, data, or AI. Experience with ARCHER GRC Platform.... 
    Work at office
    Remote work

    Truist Financial Corporation

    Charlotte, NC
    2 days ago
  • $132.23k - $176.31k

     ...trusted network for the AI‑powered world,...  ...The Role The Senior Lead Marketing Data...  ...modern analytics capabilities, AI-ready data structures...  ...partnership with engineering, analytics, Adobe,...  ..., lineage, schema control, data quality, and...  ...quality controls, monitoring, validation,... 
    Senior
    Full time
    Temporary work

    Lumen

    Charlotte, NC
    3 days ago
  • $100k - $140k

     ...initiating a search for a Senior Substation P&C Engineer for our Richmond, VA and Charlotte...  ...as well as protection and control systems in a wide variety...  ..., procedures, training, monitoring systems, and record...  ...engineering audience.Highly capable self‑leadership with attention... 
    Senior
    For subcontractor
    Local area
    Remote work
    Flexible hours

    WSP Group

    Charlotte, NC
    1 day ago
  • $127k - $191k

    What You'll DoAs a Sr Engineer II (Team Leader, Model Operations &...  ...operates Principal's Enterprise AI pipeline platforms — the...  ...builders rely on to deploy, monitor, and maintain AI models in production...  ...the MOE team and grow its capabilities to own and design all layers... 
    Senior
    Hourly pay
    Permanent employment
    Temporary work
    Work experience placement
    H1b
    Work at office

    Principal Financial Group

    Charlotte, NC
    4 days ago
  •  ...support independent oversight of AI/ML and generative AI models...  ...and assessment of ongoing monitoring, change management, and remediations...  ..., Statistics, Physics, Engineering or an equivalent combination...  ...from technical practitioners to senior executives Experience in the... 
    Senior
    Full time
    Visa sponsorship

    Vanguard

    Charlotte, NC
    22 hours ago
  •  ...serve future generations. Employees in the Senior Engineer position solve problems in engineering...  ...organizing, estimating, scheduling and monitoring of work activities; decisions may...  ...Understands SEL (Schweitzer Eng. Labs) Control Element Settings Ranges and Accuracies... 
    Senior
    Work experience placement
    Local area
    Remote work
    Work visa
    Flexible hours

    Deriva Energy

    Charlotte, NC
    4 days ago
  • $114.08k - $218.03k

     ...available positions for this Senior role. Of which will be...  ...of business controls; including, risk and control...  ...regulatory exams, and monitoring of the first line of...  ...support, cloud engineering, information security...  ...Strong understanding of AI and emerging technology... 
    Senior
    Full time
    H1b
    Work at office
    Remote work
    Home office
    Relocation package
    Flexible hours

    USAA - United Services Automobile Association

    Charlotte, NC
    3 days ago
  •  ...Description Job Description Job Title: Senior Middleware Engineer / IBM MQ & Kafka Administrator...  ...Experience with GCP/OpenShift/Kubernetes ~ Monitoring tools such as Prometheus, Grafana,...  ..., user authentication and access controls. Monitor middleware infrastructure... 
    Senior
    Remote work

    eTeam Inc.

    Charlotte, NC
    21 days ago
  • $119.8k - $234.7k

     ...than 25% Profession: Hardware Engineering Discipline: Mechanical...  ...our cloud services. As a CO+I Senior Mechanical Engineer , you will...  ...storage, fuel polishing and level monitoring, and engine cooling Fire...  ...management system (BMS) controls and sequences of operation Responsibilities... 
    Senior
    Ongoing contract
    Full time
    For contractors
    Work at office
    Local area
    Worldwide

    Microsoft Corporation

    Charlotte, NC
    1 day ago
  •  ...analytics role. The Senior Manager will...  ...with longer-term capability building and reallocating...  ..., deployment, monitoring, and improvement....  ...with IT, Data Engineering, Digital Product,...  ...including pilots, controlled experiments,...  ...business owners. Data, AI & Responsible... 
    Senior
    Full time
    Flexible hours

    Electrolux

    Charlotte, NC
    4 days ago
  • $89 - $99 per hour

     ...Genesis10 is currently seeking a Senior AI Security Engineer for a contract position with a...  ...Secure AI agents, tool-calling capabilities, orchestration frameworks, APIs...  ..., identity and access controls, secrets management, monitoring, and detection capabilities... 
    Senior
    Hourly pay
    Permanent employment
    Contract work

    Genesis10

    Charlotte, NC
    21 days ago
  • $130k - $150k

     ...Description Position: AWS AI Senior Tech Lead Location...  .... Strong hands-on capability in Python,...  ...understanding of prompt engineering, agent orchestration,...  ...logging, model risk controls, and responsible AI practices...  ...SDLC, logging, monitoring, and resilience patterns... 
    Senior
    Full time
    Remote work

    Diverse Lynx

    Charlotte, NC
    21 days ago
  • $89 - $99 per hour

     ...Genesis10 is currently seeking a Senior AI Security Engineer for a contract position with a...  ...AI agents, APIs, tool-calling capabilities, orchestration frameworks, and...  ...Implement AI guardrails, access controls, secrets management, monitoring, and detection capabilities... 
    Senior
    Hourly pay
    Permanent employment
    Contract work

    Genesis10

    Charlotte, NC
    21 days ago
  •  ...unleashing the power of AI to create value at speed...  ...Song, Supply Chain and Engineering, and Talent, with advanced capabilities in AI and Data, Industry...  ...Develop robot programs, control logic, interfaces and adapters...  ..., exception handling, monitoring and coordinated... 
    Senior
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Charlotte, NC
    1 day ago
  • $80 - $88 per hour

     ...Job Description AI Integration Engineer - 26-02126 1yr Duration...  ..., security controls, and production operations...  ...technical advisor to senior leadership on highly...  ...requirements, and emerging Al capabilities into scalable...  ...observability and monitoring platforms such as... 
    Hourly pay
    Contract work
    Temporary work
    Work experience placement
    Remote work
    Flexible hours

    NTT DATA

    Charlotte, NC
    21 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Engineer - AI Monitoring & Control Capabilities. Be the first to apply!