Senior AI Engineer

At Allstate, great things happen when our people work together to protect families and their belongings from life’s uncertainties. And for more than 90 years, our innovative drive has kept us a step ahead of our customers’ evolving needs. From advocating for seat belts, air bags and graduated driving laws, to being an industry leader in pricing sophistication, telematics, and, more recently, device and identity protection. 

Job Description

We are seeking a Senior AI Engineer on the Enterprise Intelligence Factory team to play a foundational role in building the enterprise Semantic Ontology & Dimension Factory Platform. This platform enables AI‑ready analytics by combining semantic ontologies, knowledge graphs, agentic AI, and data engineering to automatically generate business‑ready star schemas from heterogeneous enterprise data sources.


In this role, you will design and implement agent‑driven pipelines that leverage RDF/OWL ontologies, SPARQL, and Large Language Models (LLMs) to perform semantic alignment, dimension mining, and AI‑assisted data modelling at scale. You will work at the intersection of AI, semantics, and modern data platforms, helping establish engineering patterns and best practices for the team.


This is a hands‑on, senior individual-contributor role, ideal for engineers who enjoy building core platform capabilities rather than isolated experiments.

Key Responsibilities:

• Design, build, and maintain  agentic AI pipelines (using  Google ADK or similar frameworks ) to automate semantic mapping, dimension mining, and ontology‑driven reasoning.

• Create and evolve  enterprise ontologies in  RDF/OWL , including upper ontologies and domain extensions aligned to CIM (where applicable), to enable reusable enterprise semantics.

• Engineer  LLM ‑ powered services for schema understanding, semantic alignment, ontology enrichment, and AI‑assisted metadata generation, with a focus on accuracy, traceability, and scale.

• Implement  SPARQL querying and reasoning layers over knowledge graphs to drive downstream transformations and ensure consistent interpretation of business concepts.

• Architect and deliver  Python ‑ based microservices and batch pipelines that integrate semantic reasoning with modern data‑engineering workflows.

• Build and optimize  dimension and fact generation pipelines on  Microsoft Fabric (Lakehouse, Spark, SQL, orchestration) to produce business‑ready star schemas from heterogeneous sources.

• Define and enforce  engineering standards , design patterns, and reusable components for semantic and AI‑driven data platforms (quality, observability, security, and performance).

• Partner with data architects, domain SMEs, and governance teams to validate semantic definitions, manage change, and ensure platform scalability and adoption.

• Conduct code reviews, mentor engineers, and influence technical decisions across the platform to raise engineering quality and delivery velocity.

Required Skills & Qualifications:

• 6+ years of professional software engineering experience, with  strong proficiency in Python and GenAI .

• Hands‑on experience building  LLM ‑ based systems using commercial or open‑source models.

• Solid understanding of  semantic technologies : RDF, OWL, ontologies, knowledge graphs, and  SPARQL .

• Experience designing or working with  agentic AI frameworks (e.g., Google ADK, LangChain agents, or similar).

• Strong background in  data engineering concepts (ETL/ELT, star schemas, metadata‑driven pipelines).

• Experience building and operating systems on  cloud platforms , preferably  Microsoft Azure / Microsoft Fabric .

• Strong problem‑solving skills and ability to work in ambiguous, greenfield platform initiatives.

Preferred Skills:

• Experience with  enterprise data models (e.g., CIM or canonical models).

• Familiarity with  semantic alignment, ontology mapping, or data cataloguing tools .

• Exposure to  MLOps / LLMOps , model evaluation, and AI observability.

• Knowledge of  distributed systems , CI/CD pipelines, and containerisation.

• Experience building  AI ‑ assisted analytics or semantic layers for BI or NLQ use cases.

The hiring manager has flexibility to hire across several levels of seniority. The level will be determined by the selected applicant's skills and competencies.

#LI-TE1

Skills

Agentic AI, Agentic Design, AI Frameworks, Large Language Models (LLMs), LLM Guardrails, LLM Orchestration, Ontology, Python (Programming Language)

Compensation

Compensation offered for this role is 100,000.00 - 170,500.00 annually and is based on experience and qualifications.

The candidate(s) offered this position will be required to submit to a background investigation.

Joining our team isn’t just a job — it’s an opportunity. One that takes your skills and pushes them to the next level. One that encourages you to challenge the status quo. One where you can shape the future of protection while supporting causes that mean the most to you. Joining our team means being part of something bigger – a winning team making a meaningful impact.

Allstate generally does not sponsor individuals for employment-based visas for this position.

Effective July 1, 2014, under Indiana House Enrolled Act (HEA) 1242, it is against public policy of the State of Indiana and a discriminatory practice for an employer to discriminate against a prospective employee on the basis of status as a veteran by refusing to employ an applicant on the basis that they are a veteran of the armed forces of the United States, a member of the Indiana National Guard or a member of a reserve component.

For jobs in San Francisco, please click “” for information regarding the San Francisco Fair Chance Ordinance.

For jobs in Los Angeles, please click “” for information regarding the Los Angeles Fair Chance Initiative for Hiring Ordinance.

To view the “EEO Know Your Rights” poster click “”. This poster provides information concerning the laws and procedures for filing complaints of violations of the laws with the Office of Federal Contract Compliance Programs.

To view the FMLA poster, click “”. This poster summarizing the major provisions of the Family and Medical Leave Act (FMLA) and telling employees how to file a complaint.

It is the Company’s policy to employ the best qualified individuals available for all jobs. Therefore, any discriminatory action taken on account of an employee’s ancestry, age, color, disability, genetic information, gender, gender identity, gender expression, sexual and reproductive health decision, marital status, medical condition, military or veteran status, national origin, race (include traits historically associated with race, including, but not limited to, hair texture and protective hairstyles), religion (including religious dress), sex, or sexual orientation that adversely affects an employee's terms or conditions of employment is prohibited. This policy applies to all aspects of the employment relationship, including, but not limited to, hiring, training, salary administration, promotion, job assignment, benefits, discipline, and separation of employment.