Principal ML Engineer: Scoring, Production ML & GenAI

About Medical Guardian: Founded in 2005, Medical Guardian is a fast-growing digital health and safety company on a mission to help people live a life without limits. With 13 consecutive years on the Inc. 5000 list of Fastest Growing Companies,we’reredefining what it means to age confidently and independently. We support over625,000 membersnationwide with life-saving emergency response systems and remote patient monitoring solutions. Trusted by families, healthcare providers, and care managers, our work is powered by a culture of innovation, compassion, and purpose. Medical Guardian boasts a 95% customer satisfaction rate, a #1 ranking on 16 medical alert consumer choice sites and achieves a 4.7+ star rating on Google Reviews. Position Overview: We are looking for aPrincipal Machine Learning Engineerto serve as a hands-on technical leader for machine learning, predictive modeling, scoring, decisioning, and applied AI initiatives. This role will primarily focus onbuilding,validating, deploying, and improving machine learning models, while also bringing principal-level judgment to problem definition, model design, stakeholder engagement, and production readiness. This is ahands-on model-building role first. The ideal candidate should be comfortable spending most of their time working directly with data, features, models, scoring logic, validation methods, production workflows, and model improvement. They should also be able tooperatewith the maturity of a principal-level engineer: shaping unclear problems, making pragmatic technical decisions, mentoring others, and driving work forward without waiting for perfect requirements. Key Responsibilities: Hands-On Model Development Build, test,validate, and improve machine learning models for scoring, prediction, prioritization, risk detection, engagement, intervention targeting, and decision support. Perform exploratory data analysis, data quality assessment, feature engineering, model training, model selection, and performance evaluation. Develop practical ML models that balance predictive performance, explainability, stability, maintainability, and business usefulness. Work with structured, semi-structured, and operational data to create model-ready datasets and reusable features. Use tools such as Python, SQL, Spark, Databricks,MLflow, scikit-learn,XGBoost, or similar platforms and libraries. Move quickly from data exploration to prototype tovalidatedmodel to production-ready capability. Scoring, Scorecards, and Transparent Models Design and implement predictive scores, risk tiers, score bands, thresholds, cut points, and intervention logic. Build transparent and interpretable models where explainability is important, including logistic regression, generalized linear models, decision trees, monotonic models, calibrated models, scorecard-style models, or explainable boosting approaches. Evaluate models for accuracy, calibration, stability, drift, fairness, interpretability, and operational usefulness. Help stakeholders understand what a scorerepresentations, how it should be used, how it should not be used, and how changes in the score should be interpreted. Document model logic, features, assumptions, limitations, validation results, and recommended usage in a way that business and technical stakeholders can understand. Define the evidence needed to show that a model or score is valid, stable, explainable, actionable, and useful. Production ML andMLOps Partner with data engineering, analytics engineering, platform engineering, and application engineering teams to move models from experimentation into reliable production workflows. Support model deployment, batch scoring, real-time or near-real-time inference, model versioning, monitoring, retraining, and performance tracking. Help define data pipelines, feature pipelines, inference flows, model outputs, feedback loops, and monitoring requirements. Ensure models are observable, supportable, secure, scalable, and aligned with enterprise architecture and governance expectations. Establish practical monitoring and feedback loops todeterminewhether models continue to perform and create value over time. Product and Rapid-Build Execution Operate effectively in a rapid-build, startup-like environment where speed, ownership, and pragmatic decision-making are important. Turn early-stage ideas, ambiguous business needs, and rough concepts into working ML products, scores, prototypes, and production capabilities. Bring a product-engineering mindset to ML development, including user needs, workflow integration, adoption, usability, feedback loops, and measurable outcomes. Drive work forward without waiting for perfect requirements, while stillidentifyingcritical assumptions, risks, dependencies, and evidence needed before scaling. Partner with business and product stakeholders to define MVPs, iterate quickly, learn from usage, and improve models over time. Make smart tradeoffs between quick prototypes, durable platforms, transparent models, GenAI-enabled workflows, and longer-term ML architecture. Generative AI and AI Automation Support the design and development of GenAI-enabled solutions, including LLM-powered workflows, RAG, summarization, conversational agents, document intelligence, and decision-support tools. Help evaluate when GenAI isappropriate versuswhen traditional ML, rules, analytics, or transparent scoring models are a better fit. Partner with product, engineering, and business stakeholders to integrate predictive models, scores, and GenAI outputs into practical workflows. Applyappropriate evaluation, guardrails, monitoring, privacy controls, and human-in-the-loop processes for GenAI use cases. Help the organization balance innovation with explainability, safety, reliability, privacy, and operational usefulness. Requirement Shaping and Stakeholder Partnership Work directly with business, product, analytics, operations, and engineering stakeholders to clarify what a model is intended to predict, explain, recommend, or trigger. Translate business questions into measurable MLobjectives, target variables, features, validation approaches, and success metrics. Ask practical questions early: who will use the score, what action will it inform, what does a false positive or false negative mean, and how will we know the model is creating value? Communicate model behavior, tradeoffs, limitations, and recommended usage clearly to both technical and non-technical audiences. Help the team avoid becoming an AI ticket factory by shaping solutions, not just executing requests. Principal-Level Technical Leadership Provide technical leadership through hands-onexample, strong engineering judgment, and clear recommendations. Proactivelyidentifymodel risks, data gaps, unclear requirements, design issues, and opportunities for improvement. Helpestablishpractical standards for model development, validation, documentation, monitoring, and production readiness. Mentor other engineers and data scientists through code reviews, design reviews, modeling guidance, and shared best practices. Demonstrate high ownership by driving clarity, execution, and continuous improvement. Required Qualifications: 8+ years of professional experiencein machine learning, data science, software engineering, analytics engineering, applied AI, or related technical fields. 5+ years of hands-on machine learning model development experience, including feature engineering, model training, validation, evaluation, and iteration. 3+ years of experience deploying, operationalizing, or supporting modelsin production or business-critical environments. Strong hands-on experience withPython and SQL. Experience with modern ML and data platforms such as Databricks, Spark,MLflow, Snowflake, Azure, AWS, or similar technologies. Strong understanding of model evaluation, calibration, thresholding, score interpretation, monitoring, drift, retraining, andproductionML lifecycle management. Experience translating ambiguous business problems into concrete ML designs, model requirements, validation plans, and measurable outcomes. Ability to explain model behavior, model performance, assumptions, limitations, and tradeoffs to both technical and non-technical stakeholders. Strong engineering discipline, including clean code, reproducibility, versioning, testing, documentation, and maintainability. Ability to work independently as a senior hands-on contributor while also providing technical leadership and modeling judgment. Preferred Qualifications: 10+ years of relevant professional experiencein ML, data science, applied AI, software engineering, decisioning systems, commercial software, or production analytics. Experience buildingscorecards, risk scores, health scores, engagement scores, churn scores, fraud scores, credit-style models, prioritization models, or operational decision-support models. Experience with transparent or interpretable models such as logistic regression, GLMs, GAMs, decision trees, monotonic models, calibrated models, scorecard-based models, or Explainable Boosting Machines. Experience designing score bands, thresholds, risk tiers, intervention rules, recommended actions, or decision logic based on model outputs. Experience working incommercial software, SaaS, digital products, gaming, fintech,healthtech, consumer technology, marketplace, or other product-driven environments. Experience building ML, AI, analytics, or decisioning capabilities embedded into customer-facing products, operational workflows, commercial platforms, or revenue-impacting systems. Experience in startup, scale-up, innovation lab, new product development, or rapid-build environments where the candidate had tooperatewith ambiguity and drive work forward independently. Experience partnering with product managers, designers, software engineers, business leaders, and operational teams to turn ML models into usable product capabilities. Experience building MVPs,validatingassumptions, iterating based on feedback, and maturing prototypes into production systems. Experience with GenAI, LLMs, RAG, AI agents, prompt engineering, model evaluation, conversational AI, summarization, document intelligence, or AI-enabled workflow automation. Experience combining traditional ML models with GenAI-enabled workflows, such as using predictive scores to trigger outreach, summarize customer/member context, recommend next actions, or support human decision-making. Experience in healthcare, population health, remote patient monitoring, insurance, financial services, safety, operations, or other domains where model trust and explainability are important. Experience withMLOpspractices including model registries, deployment pipelines, monitoring, drift detection, retraining strategies, and model governance. Success in This Role Looks Like: High-quality models and scores are built,validated, deployed,monitored, and improved over time. Model outputs are explainable and trusted by business and operational stakeholders. Scores are connected to real decisions, workflows, interventions, or measurable outcomes. The organization moves faster because this person can turn ambiguity into working ML capabilities. The ML team has stronger standards for model development, validation, documentation, monitoring, and production readiness. Business partners understand what the models do, how to use them, where their limitations are, and how to interpret changes in outputs. The team avoids building models in isolation and instead builds ML capabilities that are connected to products, workflows, users, and business value. GenAI is applied thoughtfully where it improves workflow, decision support, summarization, automation, or user experience, without replacingappropriate modelgovernance or human judgment. Health Care Plan (Medical, Dental & Vision) Paid Time Off (Vacation, Sick Time Off & Holidays) Company Paid Short Term Disability and Life Insurance Retirement Plan (401k) with Company Match #J-18808-Ljbffr Medical Guardian