Applied Machine Learning & Data Engineering Senior Consultant II - National General

National General is a part of The Allstate Corporation, with an innovative drive that keeps us ahead of our customers’ evolving needs. We offer home, auto, accident and health insurance, as well as other specialty niche insurance products, through a large network of independent insurance agents and directly to consumers. Job Description Business Title: Applied Machine Learning Engineer Senior Consultant II About the Role This role supports high‑impact AI and data automation initiatives focused on improving data ingestion, transformation, and mapping processes across the organization. It is responsible for advancing AI‑assisted data mapping capabilities to reduce manual effort, enhance accuracy, and deliver scalable, maintainable solutions for development teams. Key Objectives Reduce manual mapping effort, improve data accuracy and processing efficiency, deliver scalable, maintainable AI‑driven pipelines. What You’ll Do Design and build AI‑powered data pipelines to process and transform structured and unstructured data (PDF, Excel, CSV, etc.) Develop and optimize LLM‑based solutions (prompt engineering, mapping, extraction, and transformation) Translate complex data and technical outputs into actionable insights for business stakeholders Partner with cross‑functional teams (product, engineering, business SMEs) to define and deliver solutions Validate and improve solution accuracy through testing, iteration, and stakeholder feedback Support integration of ML/AI solutions into enterprise systems and workflows (APIs, databases, cloud platforms) Document solutions to ensure scalability, maintainability, and long‑term adoption How your day to day looks Analyze and process carrier and CMS datasets Build AI/ML mapping logic using LLMs and prompts Develop data pipelines (Python/C# data processing logic, SQL, APIs, Azure) Validate outputs against expected results with business stakeholders Troubleshoot accuracy, performance, and edge cases Document pipelines and ensure production‑readiness Support integration into enterprise systems (C#, APIs, Azure) Work Mix 40% ML/prompt and mapping logic 35% data engineering / pipeline implementation 25% stakeholder collaboration and validation Required Qualifications 3+ years of related experience Strong proficiency in Python and SQL for data analysis and engineering Experience working with Generative AI / LLMs (prompt engineering, APIs, or similar) Hands‑on experience with data transformation, file parsing, and pipeline development Knowledge of DevOps practices (CI/CD pipelines, version control, cloud deployment) Familiarity with cloud platforms (preferably Azure) Ability to communicate effectively with both technical and non‑technical stakeholders Proven ability to work in ambiguous, fast‑evolving environments Preferred Qualifications Experience with C# / .NET integration or enterprise application development Familiarity with LLM frameworks (LangChain, etc.) or document processing tools Knowledge of API design, JSON processing, and system integration patterns Background in insurance, healthcare, or other regulated industries Compensation Base salary for this role ranges from $130,000 to $150,000 annually. Benefits Allstate provides a comprehensive technology setup, including a laptop, monitors, headset, keyboard, and mouse. Employees eligible to work from home also receive a monthly connectivity reimbursement to help offset internet costs. When working from home, you must have a dedicated, private workspace free from distractions, along with appropriate desk and seating. Reliable internet is required, with minimum speeds of 50 MB download and 5 MB upload. Equal Employment Opportunity Effective July 1, 2014, under Indiana House Enrolled Act (HEA) 1242, it is against public policy of the State of Indiana and a discriminatory practice for an employer to discriminate against a prospective employee on the basis of status as a veteran by refusing to employ an applicant on the basis that they are a veteran of the armed forces of the United States, a member of the Indiana National Guard or a member of a reserve component. It is the Company’s policy to employ the best qualified individuals available for all jobs. Therefore, any discriminatory action taken on account of an employee’s ancestry, age, color, disability, genetic information, gender, gender identity, gender expression, sexual and reproductive health decision, marital status, medical condition, military or veteran status, national origin, race (including traits historically associated with race, such as hair texture and protective hairstyles), religion (including religious dress), sex, or sexual orientation that adversely affects an employee’s terms or conditions of employment is prohibited. This policy applies to all aspects of the employment relationship, including, but not limited to, hiring, training, salary administration, promotion, job assignment, benefits, discipline, and separation of employment. #J-18808-Ljbffr Allstate Insurance Company