Senior principal agent / software engineer
$96.8k - $251.6kOracle
Job Description
The Senior Principal AI Agent / ML Software Engineer is a Senior Staff-level, hands-on technical leadership role responsible for defining, building, and operating next-generation AI systems on Oracle Cloud Infrastructure (OCI). This person will set architecture and engineering direction for production-grade agentic AI platforms, autonomous workflows, scalable inference infrastructure, and enterprise AI applications used in large-scale, business-critical environments.
This role requires a proven engineer who can translate ambiguous product and platform goals into durable technical strategy, lead multi-team execution without direct authority, and remain deeply hands-on in design, code, reviews, operations, and incident follow-up. The ideal candidate combines deep distributed systems experience with practical AI-native engineering, including orchestration of LLMs, tools, APIs, memory, retrieval, evaluation, guardrails, and cloud services. The expectation is to ship, scale, and operate reliable, secure, observable, and cost-aware AI platform systems while raising the technical bar for engineers across the organization.
Responsibilities
Responsibilities
-
Serve as a senior technical owner for OCI AI platform capabilities, including agent execution, inference systems, model serving, AI workflow orchestration, evaluation, and observability.
-
Design, architect, and deliver scalable agentic AI systems capable of reasoning, planning, tool use, workflow execution, multi-step task orchestration, and safe human-in-the-loop escalation.
-
Build production-grade services for tool calling, agent memory, context management, Model Context Protocol (MCP) integration, vector retrieval, multi-agent coordination, policy enforcement, and evaluation.
-
Lead architecture across distributed services optimized for low latency, high throughput, GPU efficiency, reliability, cost, operability, and secure multi-tenant operation.
-
Define service boundaries, APIs, data models, state management, consistency tradeoffs, failure modes, SLIs/SLOs, rollout strategies, and operational readiness criteria for AI platform services.
-
Drive technical strategy across infrastructure, platform, security, data, and application engineering teams, converting broad goals into executable multi-quarter plans and measurable milestones.
-
Integrate AI agents securely and reliably with enterprise APIs, cloud services, databases, identity systems, secrets management, and external systems.
-
Establish AgentOps and LLMOps practices for tracing, monitoring, eval suites, regression testing, experimentation, safety guardrails, prompt/tool versioning, and production reliability.
-
Evaluate and operationalize emerging technologies in generative AI, agentic workflows, inference optimization, long-context systems, reasoning models, AI developer tooling, and agentic-first development.
-
Drive engineering excellence through code reviews, design reviews, test strategy, deployment automation, incident analysis, documentation, and AI-assisted development practices using tools such as Codex, Claude Code, Cursor, Copilot, or similar systems.
-
Mentor Staff and senior engineers, raise architectural standards, and influence engineering practices across OCI without requiring direct management authority.
-
Own critical production outcomes, including reliability, performance, security posture, cost efficiency, and supportability for the systems delivered.
Required Qualifications
-
Bachelor's, Master's, or Ph.D. in Computer Science, AI/ML, Engineering, or a related field, or equivalent practical experience.
-
12+ years of professional software engineering experience, including significant ownership of production systems; or equivalent experience demonstrating Senior Staff / Principal-level impact.
-
Proven track record as a Staff, Senior Staff, Principal, or equivalent technical leader influencing architecture and execution across multiple teams.
-
Deep experience designing, building, and operating high-scale distributed systems, cloud services, infrastructure platforms, or AI/ML platform services.
-
Hands-on experience with production AI systems, agentic AI applications, autonomous workflows, tool-using agents, multi-step orchestration, or multi-agent systems.
-
Practical experience with orchestration frameworks such as LangGraph, LangChain, CrewAI, AutoGen, LlamaIndex, or similar ecosystems.
-
Deep understanding of LLM application patterns, including prompt design, structured outputs, function/tool calling, context management, RAG, memory, tool safety, and evaluation.
-
Strong programming skills in Python and ability to contribute high-quality production code, reviews, tests, and debugging in complex distributed environments.
-
Strong expertise with Kubernetes, Docker, cloud-native infrastructure, service-to-service communication, scalability, fault tolerance, observability, and performance analysis.
-
Experience defining SLIs/SLOs, production readiness criteria, incident response practices, monitoring, tracing, experiments, and reliability programs for AI or distributed systems.
-
Strong understanding of AI safety, governance, security, and operational risks for autonomous or semi-autonomous systems, including data handling, access control, auditability, and human accountability.
-
Excellent written and verbal communication, with demonstrated ability to lead technical direction, resolve ambiguity, and influence senior stakeholders.
Preferred Qualifications
-
Experience optimizing large-scale GPU inference or training workloads for latency, throughput, utilization, availability, and cost.
-
Experience building or operating model serving, inference gateways, agent runtimes, workflow engines, developer platforms, or internal AI productivity platforms.
-
Experience integrating AI systems with enterprise APIs, databases, cloud services, vector databases, embeddings, retrieval systems, identity systems, and policy enforcement layers.
-
Experience with LLM fine-tuning, long-context systems, reasoning models, model routing, caching, batching, quantization, or emerging generative AI research.
-
Experience building evaluation frameworks for agentic systems, including offline evals, online experiments, golden tasks, adversarial testing, regression gates, and observability dashboards.
-
Experience using AI-assisted software development tools such as Codex, Claude Code, Cursor, Copilot, or similar systems in large-scale engineering environments.
-
Track record of defining architectural standards, platform capabilities, or engineering practices adopted across multiple teams or organizations.
-
Experience in enterprise, cloud infrastructure, regulated, security-sensitive, or mission-critical environments.
Disclaimer:
Certain U.S. based or U.S. customer or client-facing roles may be required to comply with applicable requirements, such as immunization/occupational health mandates, and/or drug testing requirements.
Range and benefit information provided in this posting are specific to the stated locations only
US: Hiring Range in USD from: $96,800 to $251,600 per annum. May be eligible for bonus, equity, and compensation deferral.
Oracle maintains broad salary ranges for its roles in order to account for variations in knowledge, skills, experience, market conditions and locations, as well as reflect Oracle's differing products, industries and lines of business.
Candidates are typically placed into the range based on the preceding factors as well as internal peer equity.
Oracle US offers a comprehensive benefits package which includes the following:
Medical, dental, and vision insurance, including expert medical opinion
Short term disability and long term disability
Life insurance and AD&D
Supplemental life insurance (Employee/Spouse/Child)
Health care and dependent care Flexible Spending Accounts
Pre-tax commuter and parking benefits
401(k) Savings and Investment Plan with company match
Paid time off: Flexible Vacation is provided to all eligible employees assigned to a salaried (non-overtime eligible) position. Accrued Vacation is provided to all other employees eligible for vacation benefits. For employees working at least 35 hours per week, the vacation accrual rate is 13 days annually for the first three years of employment and 18 days annually for subsequent years of employment. Vacation accrual is prorated for employees working between 20 and 34 hours per week. Employees working fewer than 20 hours per week are not eligible for vacation.
11 paid holidays
Paid sick leave: 72 hours of paid sick leave upon date of hire. Refreshes each calendar year. Unused balance will carry over each year up to a maximum cap of 112 hours.
Paid parental leave
Adoption assistance
Employee Stock Purchase Plan
Financial planning and group legal
Voluntary benefits including auto, homeowner and pet insurance
The role will generally accept applications for at least three calendar days from the posting date or as long as the job remains posted.
Career Level - IC5
About Us
Only Oracle brings together the data, infrastructure, applications, and expertise to power everything from industry innovations to life-saving care. And with AI embedded across our products and services, we help customers turn that promise into a better future for all. Discover your potential at a company leading the way in AI and cloud solutions that impact billions of lives.
True innovation starts when everyone is empowered to contribute. That's why we're committed to growing a workforce that promotes opportunities for all with competitive benefits that support our people with flexible medical, life insurance, and retirement options. We also encourage employees to give back to their communities through our volunteer programs.
We're committed to including people with disabilities at all stages of the employment process. If you require accessibility assistance or accommodation for a disability at any point, let us know by emailing View email address on jobs.institutedata.com or by calling View phone number on jobs.institutedata.com in the United States.
Oracle is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability and protected veterans' status, or any other characteristic protected by law. Oracle will consider for employment qualified applicants with arrest and conviction records pursuant to applicable law.
$96.8k - $251.6k
...reliability, and global performance. This is a senior individual contributor role for someone... ...problems, and raises the bar for engineering excellence across teams. Why OCI At... ...excellence. Qualifications ~10+ years of software engineering experience with deep...SeniorTemporary workFlexible hours$99.6k - $223.4k
...Cycle Management systems using LLMs and AI agents, helping clinicians focus more on... ...We’re looking for highly skilled AI engineers to design and build high-scale, cloud-based... ...or equivalent. • 6+ years of relevant software engineering experience. • Strong software...SuggestedTemporary workFlexible hours$99.6k - $223.4k
...be part of this mission-reimagining how software and the cloud work together to deliver mission... ...operates. We are seeking skilled engineers and builders to join our newly... ...Experience working closely with architects, principals, product, and program managers to deliver...SuggestedTemporary workWorldwideFlexible hours$99.6k - $223.4k
...Job Description Oracle is seeking an experienced Software Engineer to join a highly skilled team focused on building modern cloud and AI-enabled enterprise solutions. This role is ideal for a developer with strong hands-on experience in Oracle APEX, PL/SQL, Oracle Database...SuggestedTemporary workFlexible hours$145.6k - $209.3k
...team that succeeds together. Because at UKG, your work matters-and so do you. About the Role We are seeking a Principal Cloud Platform Software Engineer in Enterprise Solutions and Experience (ESE) org to lead the architecture and development of a cloud-native...SuggestedLocal area- A leading health services company is seeking a skilled professional for Application Development & Maintenance. The role requires designing solutions for Medical Transportation, supporting business teams, and technical guidance. Candidates should have a Bachelor's degree...SeniorRemote work
$99.6k - $223.4k
...design for scalability, reliability, and observability. Stay hands-on with coding, debugging, and production delivery. Drive engineering excellence through code reviews and best practices. Mentor engineers and elevate team capability. Partner cross-...Full timeTemporary workRemote workFlexible hours- A leading financial services company seeks a Sr Lead Software Engineer in Concord, NH. You will lead technology projects and collaborate on cloud-based solutions aimed at helping millions achieve financial empowerment. Ideal candidates will have over 6 years of engineering...SeniorRemote work
$186.07k - $218.9k
...efficiency, and safety of these fund movements. Our tooling serves Engineering, Customer Experience, Risk, and Compliance teams — enabling... ...we look for in you (ie. job requirements): ~5+ years of software development experience building large-scale distributed systems...SeniorLocal area$180k - $220k
...stepping onto a driven and highly collaborative team that is passionate about creating transformative change in healthcare. Senior Software Engineer The Role As a Senior Software Engineer, you will lead major initiatives that advance Datavant's platform scalability...Senior$186.07k - $218.9k
...system for our infrastructure spend, bridging the gap between Engineering, Finance, and Product. We manage the cost data across every product... ..., metered, and billed. Strong proficiency in backend software engineering (e.g., Go, Python, or Ruby) and a track record of...SeniorLocal areaImmediate start$197.4k - $232k
...curious humans pushing toward something bigger, together.One Confluent. One Team. One Data Streaming Platform.About the RoleSenior Software Engineers II at Confluent take ownership of critical backend systems that underpin our data streaming platform. You'll lead the design...Senior- ...A leading financial services company seeks a Sr. Distinguished Software Engineer to focus on anti-money laundering initiatives. This role involves driving innovation, optimizing business outcomes, and mentoring teams. The ideal candidate has extensive experience in software...SeniorRemote work
$79.2k - $178.1k
...transformations. • Contribute to LLM/agent-based features and analytics use cases.... ...and apply best practices in cloud, data engineering, and LLMOps. Mandatory Qualifications... ...or equivalent. • 5+ years of relevant software engineering experience. • Strong software...SeniorTemporary workFlexible hours$129.4k - $198.4k
...and efficiency of simulation tests used for autonomous vehicle software validation. Develop andmaintainGM's core simulation... ...insights on test operations, simulationtrustand healthtrendsto engineering teams and leadership. Drive scalablesimulationquality assessments...SeniorLocal areaRemote workWork from homeRelocationRelocation packageFlexible hours$79.2k - $178.1k
...Job Description Role Summary Oracle Health Platform Engineering builds core platform capabilities that enable Oracle Health... ..., documentation, and operations. We are seeking a Senior Software Developer (IC3) to design, develop, and operate backend services...SeniorTemporary workVisa sponsorshipFlexible hours$118k - $178k
...relevant job opportunities at every step of their journey, while creating clear, compounding value for employers. As a Senior Software Engineer (Front End), you will design and build software that powers shared platforms, services, and products to help deliver on this...SeniorWork experience placementLocal areaImmediate start$253.9k - $298.7k
...foster collaboration, connection, and alignment. Attendance is expected and fully supported. We’re looking to hire a Senior Staff Software Engineer to join one of our teams within the Platform Product Group. The Platform Product Group’s mission is to build a trusted,...SeniorLocal area$98.9k
...for this position What you can expect We're seeking a Senior DevOps Engineer to help build and maintain the infrastructure that powers... ...seamless and innovative communication solutions. These range from software development and machine learning to quality assurance teams...SeniorCasual workWork at officeRemote work2 days per week- A technology company is looking for a Senior Software Engineer II to take ownership of critical backend systems. This role involves leading the design of large-scale, distributed services while focusing on reliability and performance. Candidates with 5+ years of experience...SeniorRemote work
$116k - $144k
...Amentum is a global leader in advanced engineering and innovative technology solutions, trusted... .... We are seeking a highly skilled Senior Secure DevOps Engineer to join our team... ...and maintaining secure and efficient software development and operations workflows. The...SeniorHourly payContract workLocal area$67k - $136.8k
...this simple story. The opportunity As an FSO DevOps Engineer Senior Analyst, you’ll be based in our Service Delivery Center,... ...requirements, design, develop, integrate, test, and deploy distributed software applications. You will deliver high qualify systems with...SeniorSummer holidayFlexible hours$79.2k - $178.1k
...Job Description Cloud Engineering Infrastructure Development As a Senior Member of Technical Staff, you will own the software design and development for major components of Oracle's Cloud Infrastructure. You should be both a rock-solid developer, curious problem...SeniorTemporary workFlexible hours$130k - $150k
...Overview GovCIO is currently hiring fora Senior ServiceNow Developer to support the... ...automated workflows in accordance with the Software Lifecycle Management Plan (SLMP). Core... ...within the ServiceNow platform, utilizing App Engine, Flow Designer, and UI Builder to meet...SeniorFull timeCurrently hiringRemote workFlexible hours$165k - $190k
...eye health, and we believe we are well positioned to continue leading the advancement of eye health in the future. The AI Agent & ML Engineer will design, build, and optimize intelligent agents powered by advanced machine learning models, enabling process automation...Temporary workWork visa- Flexible part time jobs now available in your area! Perfect for stay at home Moms and Dads! Looking for an independent part time job while your children are in school? As your children go back to school this fall, this is a perfect opportunity to earn some extra income...Extra incomePart timeFlexible hoursShift work
$17 per hour
...keep up with their dental health, affordability, transparency, and access. Work from home as a Spanish Bilingual Scheduling Center Agent where you will partner with our patients to schedule their appointment(s), providing them critical access to care and improved dental...Hourly payFull timePart timeWork from homeShift workWeekend workAfternoon shift$209k - $238.5k
...Capital One is seeking a Senior Lead Software Engineer, Full Stack for their Shopping division. This remote-eligible role involves leading the development of innovative solutions, collaborating with product managers, and employing a variety of programming languages including...SeniorRemote work$79.2k - $178.1k
...Job Description Oracle Health Data Intelligence is growing and looking for a Senior Software Engineer to join the HealtheIntent - Identity Services team! This development team builds Personnel, Organization and Consumer services which are the base of the security models...SeniorTemporary workWork experience placementImmediate startFlexible hours- ...Training & development About our Agency: Our agency has proudly served the community since 1996 and is led by an experienced agent who previously worked as a Territory Manager with State Farm. With a small, close-knit team of two plus the agent, we offer a welcoming...Work at officeLocal areaFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior principal agent / software engineer. Be the first to apply!
- state farm agent Concord, NH
- work from home chat agent Concord, NH
- remote chat agent Concord, NH
- executive protection agent Concord, NH
- senior director product management Concord, NH
- senior manager customer operations Concord, NH
- senior data engineer Concord, NH
- senior vmware engineer Concord, NH
- senior performance engineer Concord, NH
- senior software design engineer Concord, NH


