Senior Software Engineer, AI Platform

Role Description

We are seeking a Sr AI Platform Engineer to build the shared product-integrity layer for customer-facing AI systems. This role will create the evaluation, observability, safety, and launch-readiness infrastructure needed to ship AI features with measurable quality, reliability, and customer impact. In this role, you will be responsible to:

• Build shared evaluation infrastructure for models, prompts, agents, and multimodal AI systems.
• Own golden datasets, regression suites, offline and online evals, and LLM-as-judge governance.
• Develop observability for model quality, latency, cost, drift, safety, and customer impact.
• Create launch-readiness gates for AI features across camera, agentic, personalization, multimodal, and energy products.
• Partner with Product, Analytics, Privacy, Security, and Engineering on trustworthy AI productization.
• Define reusable standards for AI quality, monitoring, safety, and operational readiness.

Qualifications

• Bachelor’s degree in Computer Science, Software Engineering, AI/ML, or a related technical field, and 5+ years of professional experience in software development, applied science, or ML engineering; or
• Master’s degree in Computer Science, Software Engineering, AI/ML, or a related technical field, and 2+ years of professional experience in software development, applied science, or ML engineering.
• Experience evaluating, deploying, or monitoring production AI systems.
• Strong Python and data engineering skills.
• Experience with offline/online evaluation, data quality, model monitoring, or observability systems.
• Familiarity with LLM evaluation, prompt evaluation, model regression testing, or safety guardrails.
• Strong communication skills and ability to set standards across teams.

Requirements

• Experience with LLM-as-judge, agent tracing, multimodal evals, golden datasets, or automated regression suites.
• Experience with GCP/AWS, Vertex AI, SageMaker, MLflow, Datadog, OpenTelemetry, Private Cloud or similar tooling.
• Experience with privacy-aware AI systems, customer trust metrics, or launch-readiness processes.
• Experience supporting computer vision, GenAI, recommendation, or edge AI products.
• Experience building developer platforms or internal AI tooling.

Benefits

• Paid holidays and flexible paid time away.
• Employee/Friends/Family Discounts.
• Medical/dental/vision/life coverage & 24/7 Medical Hotline.
• 401(k) + Employer Match.
• Employee Resource Groups.

Company Description

NRG is all about propelling the next generation of leaders forward. We are driven by our passion to create a smarter, cleaner and more connected future. We deliver innovative solutions that make our customers’ lives easier—helping them power, protect, and intelligently manage their homes and businesses.