Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Director, NLP & Market Research Data Engineering Lead

$159k - $233.2k
Full-time

Eli Lilly & Co

At Lilly, the work is demanding because patients are waiting. We unite caring with discovery to help make life better for people around the world, knowing that every decision, every detail, and every day matters. Headquartered in Indianapolis, Indiana, our over 50,000 employees around the globe take on complex challenges to discover and deliver life-changing medicines, strengthen how health is understood and managed, and support the communities we serve. This is hard, urgent, selfless work—but it’s work worth doing. If you’re driven by purpose and ready to bring your best to work that truly matters for patients, we invite you to join us. NLP & Market Research Data Engineering Lead Customer Insights and Analytics (CIA) At Lilly, we unite caring with discovery to make life better for people around the world. We are a global healthcare leader headquartered in Indianapolis, Indiana. Our 50,000+ employees around the world work to discover and bring life-changing medicines to those who need them, improve the understanding and management of disease, and give back to our communities through philanthropy and volunteerism. We give our best effort to our work, and we put people first. We're looking for people who are determined to make life better for people around the world. The Customer Insights and Analytics (CIA) organization is Lilly's business-facing insight and analytics capability, uniting Market Research and Analytics into a single, integrated partnership model that helps our business partners make faster, better, more customer-centered decisions.

Organization Overview

Customer Insights and Analytics (CIA) is Lilly's enterprise insight and analytics organization, built in three tiers: Strategic Intelligence teams embedded with each therapeutic area, functional-area Integrated Insights teams that own the insight craft, and foundational teams built for scale. Data Engineering is one of those foundational teams — it builds the governed, AI-ready data foundation once, centrally, so it can be reused across the business as Lilly embeds agentic AI at scale. Within Data Engineering, this role owns the unstructured-data and NLP foundation for Market Research.

Position Overview

The NLP & Market Research Data Engineering Lead builds and runs the engineered data foundation for unstructured and research data — the non-tabular sources that carry the consumer, patient, and HCP “why”: social-listening streams, survey verbatims, qualitative transcripts, call and advisory notes, secondary reports, and medical and scientific text. As Lilly extends its agentic platform beyond structured data, this is the engineering role that delivers the unstructured-data half of the AI-ready foundation for Market Research — the NLP and text pipelines, the enrichment and embedding layer, and the retrieval (RAG) foundation on which research agents and MR analytics depend. The role sits inside CIA's central Data Engineering function, reporting to the Head of Data Engineering & Risk Mitigation, and is a joint priority of Data Engineering and Agentic Intelligence & Products. It builds the capability centrally, once, and makes it reusable across the business — partnering with the embedded Research & Unstructured Data Product Owners, the Agent Factory, Research Science (which owns social listening and MR methods as central capabilities), the Strategic Intelligence Market Research teams, and the governance and stewardship functions. This role builds and runs the pipelines, the unstructured-data products, and the retrieval foundation; it does not frame or interpret the research, and it does not own the agents or Skills. Where the Agent Factory builds the agent and the Market Research teams frame the question, this role builds the governed, AI-ready data foundation they both depend on.

Key Objectives

  • Build & run the NLP / unstructured-data pipelines. Design and operate production NLP and text pipelines on Databricks (Unity Catalog, Delta) that ingest, parse, structure, and enrich Market Research's unstructured sources across the medallion (bronze → silver → gold).
  • Stand up the enrichment & embedding layer. Entity and theme extraction, topic modeling, sentiment, summarization, and embedding / vectorization — turning raw text into structured, queryable, feature-ready signal.
  • Own the retrieval / RAG data foundation. Chunking, embedding, vector indexing, and grounding so research agents reason over the full MR evidence base, in partnership with the Agent Factory and Head of AI.
  • Make unstructured data AI-ready & governed. Author and steward data contracts (ODCS); ensure PII, consent, classification, and provenance travel with the data into agentic consumption; partner with the Policy-as-Code function to render governance intent as enforced policy (OPA / Rego), with no leakage.
  • Establish data quality & evaluation for NLP. Accuracy, coverage, drift, and grounding / hallucination checks (pytest, DLT / Great Expectations), with monitoring and alerting so text data stays trustworthy and auditable.
  • Serve Market Research at scale. Engineer the pipelines behind social listening, brand-health, and secondary-MR text analysis, partnering with Research Science and the shared LBI Market Research pool that runs the analysis; establish reference architecture, reusable patterns, and self-service.
  • Set technical direction & standards. Own the standards for NLP and unstructured-data engineering across CIA; provide architectural review and gatekeeping for new data flows, integrations, and agent-consumption paths; provide technical direction and mentorship to engineers and the vendor / LBI bench.
  • Other key initiatives and special projects as needed.

Leadership

While there are no direct reports today, this person will work through Lilly's teams in India and across teams in CIA and View email address on joinrs.com to build out the Market Research data products (bronze and silver) needed to power agentic solutions for the teams. Leadership is exercised through technical direction, standards, mentorship, and influence across this matrixed set of partners rather than direct people management. The capability this role builds is new and expected to grow — as unstructured-data and Market Research engineering demand scales, this role is positioned to build and lead a small engineering team, and the successful candidate should be able to grow into people leadership over time.
  • Lead through influence today. Set technical standards and provide architectural review across CIA's unstructured-data and NLP engineering; direct and quality-assure the vendor / LBI engineering bench that helps deliver the work.
  • Mentor and develop. Coach engineers and analysts on NLP and unstructured-data engineering practice, and raise the technical bar across the extended team.
  • Build for a future team. Establish the standards, playbooks, reusable architecture, and onboarding patterns a future in-house team will inherit, so the capability can scale without re-engineering.
  • Grow into people leadership. As the function matures, take on direct reports — hiring, developing, and retaining engineering talent and shaping the operating model for the Market Research / unstructured-data engineering squad.
  • Team Lilly leadership. Lead through change, translate strategy into clear technical goals, remove barriers, and model an inclusive, high-trust team environment.
Key Relationships
  • Head of Data Engineering & Risk Mitigation — direct manager; sets the central engineering agenda and standards this role operates within.
  • Head of AI / Agentic Intelligence & Products and the Agent Factory — joint owners of the agentic roadmap and primary consumers of the retrieval / RAG foundation.
  • Research Science — owns social listening and Market Research methods as central capabilities; defines what “good” looks like for the signal this role engineers.
  • Strategic Intelligence Market Research teams (by therapeutic area) — frame the business and research questions the data foundation must serve.
  • Research & Unstructured Data Product Owners — translate research demand into the product backlog this role builds against.
  • Governance, Stewardship & Policy-as-Code — partner to ensure PII, consent, classification, and provenance are enforced in code.
  • LBI / vendor engineering bench — extended delivery capacity this role directs and quality-assures.
  • View email address on joinrs.com — platform and enterprise-engineering partner.

Basic Qualifications

  • Bachelor's degree in Computer Science, Data Engineering, or a related technical discipline.
  • 8+ years in data engineering, including building and operating production NLP, text-processing pipelines at enterprise scale.

Additional Skills / Preferences

  • Demonstrated experience designing lakehouse / medallion architectures (Databricks, Unity Catalog, Delta).
  • Hands-on NLP and text engineering — parsing and normalization, entity and topic extraction, embeddings / vectorization, and retrieval / RAG.
  • Advanced SQL and Python (PySpark), with data-quality and testing practices for production pipelines.
  • Working knowledge of data governance, classification, and access control (row- and column-level security), including the handling of sensitive and unstructured data.
  • Ability to influence and align technical and business partners without direct authority in an ambiguous, matrixed environment.
  • Experience with vector databases and search, LLM grounding, and agentic / RAG architectures on enterprise content.
  • Familiarity with market-research data — social listening, survey and verbatim data, qualitative transcripts, and secondary / medical-scientific text.
  • Data-contract frameworks (ODCS), policy-as-code (OPA / Rego), and Git-based CI/CD (Azure DevOps or equivalent); transformation- and infrastructure-as-code (dbt, Terraform).
  • Experience in regulated or healthcare data environments; awareness of HIPAA, consent, and MLR / content-governance obligations.
  • Readiness to build and lead a small engineering team as the capability scales; experience mentoring or leading engineers, formally or in a matrix, preferred.
  • Comfort building a capability that does not exist today, and translating clearly for research, engineering, and governance audiences.

Additional Information

  • Indianapolis, IN — hybrid.
  • 5–15% travel depending on business need.
  • Lilly is an EEO/Affirmative Action Employer and does not discriminate on the basis of age, race, color, religion, gender, sexual orientation, gender identity, gender expression, national origin, protected veteran status, disability, or any other legally protected status.
Lilly is dedicated to helping individuals with disabilities to actively engage in the workforce, ensuring equal opportunities when vying for positions. If you require accommodation to submit a resume for a position at Lilly, please complete the accommodation request form ( for further assistance. Please note this is for individuals to request an accommodation as part of the application process and any other correspondence will not receive a response. Lilly is proud to be an EEO Employer and does not discriminate on the basis of age, race, color, religion, gender identity, sex, gender expression, sexual orientation, genetic information, ancestry, national origin, protected veteran status, disability, or any other legally protected status. Our employee resource groups (ERGs) offer strong support networks for their members and are open to all employees. Our current groups include: Africa, Middle East, Central Asia (AMECA), Black Employees at Lilly (View email address on joinrs.com), Chinese Culture Network (CCN), EnAble, Evolve, Lilly Indian Network (LIN), Organization of Latinx at Lilly (OLA), Pride (LGBTQ+ Allies), Veterans Leadership Network (VLN) and Women’s Initiative for Leading at Lilly (WILL). Actual compensation will depend on a candidate’s education, experience, skills, and geographic location. The anticipated wage for this position is $159,000 - $233,200 Full-time equivalent employees also will be eligible for a company bonus (depending, in part, on company and individual performance). In addition, Lilly offers a comprehensive benefit program to eligible employees, including eligibility to participate in a company-sponsored 401(k); pension; vacation benefits; eligibility for medical, dental, vision and prescription drug benefits; flexible benefits (e.g., healthcare and/or dependent day care flexible spending accounts); life insurance and death benefits; certain time off and leave of absence benefits; and well-being benefits (e.g., employee assistance program, fitness benefits, and employee clubs and activities).Lilly reserves the right to amend, modify, or terminate its compensation and benefit programs in its sole discretion and Lilly’s compensation practices and guidelines will apply regarding the details of any promotion or transfer of Lilly employees. #WeAreLilly
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Director, NLP & Market Research Data Engineering Lead in Indianapolis, IN vacancy
  • $166.5k - $244.2k

     ...analytics capability, uniting Market Research and Analytics into a single,...  .... Position Overview The Senior Director, Global Market Research owns...  ...the US Marketing Analytics lead. This role reports to the Associate...  ...broader analytics and AI/data-foundation teams.... 
    Senior
    Full time
    H1b
    Visa sponsorship
    Work visa
    Relocation package
    Flexible hours

    Lilly

    Indianapolis, IN
    11 days ago
  • We Are  The beginning of a new Data & AI decade that will reshape work and society has...  ...You are A strong Data Architect / Data Engineering Lead who can provide technical leadership, architectural...  ...in trading, commodities, pricing, market data, supply chain, finance (e.g.,... 
    Suggested
    Temporary work
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Carmel, IN
    13 hours ago
  • $166.5k - $244.2k

     ...and analytics capability, uniting Market Research and Analytics into a single,...  ...decisions. Position Overview The Senior Director, Consumer Market Research is the lead of consumer and DTC market...  ...of Excellence, AI Products, and Data Science. Responsibilities Owning... 
    Senior
    Full time
    H1b
    Visa sponsorship
    Work visa
    Flexible hours

    Lilly

    Indianapolis, IN
    8 days ago
  •  ...Job Description Job Description Job Title: Senior Databricks Data Engineer Work Location: St. Louis, MO, Richardson, TX 75082 or Indianapolis...  ...a solid understanding of delivery methodology (SDLC) and lead teams in the implementation of the solution according to the... 
    Senior
    Contract work

    eTeam Inc.

    Indianapolis, IN
    20 days ago
  •  ...Senior Vice President, Marketing About the Company Prominent full-service credit...  ...President of Marketing to lead its marketing strategy and...  ...strategy, digital marketing, research, campaigns, analytics, and...  ...responsibly while protecting data and maintaining human accountability... 
    Senior

    Confidential

    Indianapolis, IN
    13 hours ago
  •  ...Managing Director, Marketing Services About the Company Full-service design-driven research & strategy firm Industry Management Consulting...  ...candidate will be a senior executive leader with a focus...  ...as well as a background in leading experiential marketing and... 
    Remote work

    Confidential

    Indianapolis, IN
    2 days ago
  • $105.4k - $207.8k

     ...by our industry depth to collaborate with leading solution providers and leverage your...  ...business solutions.Deloitte is seeking a Senior Consultant, Functional Transformation SAP...  .... Work You’ll Do As a PROJECT - Manager, Data and Insights on the SAP Data & Insights team... 
    Local area
    Remote work

    Deloitte

    Indianapolis, IN
    13 hours ago
  • Accenture helps the world's leading enterprises reinvent by building their...  ..., Song, Supply Chain and Engineering, and Talent, with advanced capabilities in AI and Data, Industry and Process, and Technology...  ...11/23/2026.Accenture offers a market competitive suite of benefits... 
    Senior
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Carmel, IN
    13 hours ago
  •  ...Leverage Elanco’s Enterprise Data and PaaS/SaaS Platforms to deliver...  ...and execution of systems engineering solutions, driving standards...  ...Veeva RIM, Ennov). Act as a lead mentor and coach, fostering a...  ...application in life science drug research and product safety; (2)... 
    Full time
    Work at office

    Elanco

    Indianapolis, IN
    5 days ago
  •  ...Head of GTM, Research Services About the Company International product research platform providing consumer insights...  ...is seeking a Head of GTM for Research Services to lead the commercial launch of a new market research service. This role is pivotal in blending the... 

    Confidential

    Indianapolis, IN
    3 days ago
  •  ...ClassWallet, a leading financial technology company in the United States serving agencies...  ...public funds, is seeking to hire a Senior Director, Marketing to join our team. Agencies use...  ...comfortable doing the work as leading it. ~ Data-driven, and fluent in marketing... 
    Senior
    Full time
    For contractors
    Local area
    Shift work

    ClassWallet

    Indianapolis, IN
    2 days ago
  • $284.7k - $390.9k

     ...communication skills and deep market insights. This high-...  ...a primary focus on Data Center Product Marketing...  ...will work closely with engineering, sales, central...  ...success. You will also lead a team of marketers to...  ...Conduct ongoing market research and competitive analysis... 
    Senior
    Full time
    Temporary work
    Work at office
    Local area
    Flexible hours

    CISCO Systems

    Indianapolis, IN
    13 hours ago
  •  ...Data Engineer Position Details Sector: Electric Utility, Energy, and Power Location: Carmel, IN (Hybrid - 3 days/week...  ...independently own development tasks while collaborating with senior technical leads, engineers, analysts, and business partners. This is a... 
    Contract work
    3 days per week

    Agility Partners

    Carmel, IN
    12 days ago
  •  ...Position: Data Engineer Azure Databricks & Synapse Lakehouse Location: Indianapolis, IN 46204 Client: State of Indiana Duration: 12+ Months Job Description: Seeking a data engineer to design, build, and maintain secure, scalable data solutions using... 

    Elite Workforce Inc

    Indianapolis, IN
    4 days ago
  •  ...to become one of the nation’s leading homebuilders. M/I Homes...  ...generation with divisions in 17 markets, including Austin, Charlotte,...  ...Coordinate appropriate market research initiatives that will determine...  ...effective partnerships with senior managers to determine specific... 
    Full time
    Work experience placement
    Work at office

    M/I Homes

    Indianapolis, IN
    19 hours ago
  •  ...Job DescriptionJob DescriptionOur Marketing Manager will be expected to visit our Midwest...  ...Marketing Manager will also be responsible for leading the company’s efforts in community...  ...market intelligence and provides market research informationUse the Salesforce platform to... 
    Extra income
    Full time
    Local area
    Weekend work

    Tennessee Fertility Institute

    Indianapolis, IN
    3 days ago
  •  ...Senior Brand Manager, Whole Earth and Natural Sweetener...  ...targets, track marketing performance, and evaluate...  ...management and need to build data driven plan...  ...reports to the Senior Director Brand Strategy, Whole Earth...  ...prioritization of efforts. Lead a broad range of activities... 
    Senior
    Work at office
    Flexible hours

    Heartland Food Products Group

    Indianapolis, IN
    26 days ago
  • Job Type Full-time Description This role is ideal for seasoned lead technicians with 5+ years in the industry. Our technicians & electricians...  ...limited to Service Technicians (POS Technicians, Electricians, Data Technicians, and other service technicians), and other positions.... 
    Weekly pay
    Full time
    Temporary work
    Work at office
    Remote work
    Flexible hours
    Shift work

    Staley Technologies Inc.

    Indianapolis, IN
    4 days ago
  •  ...Head of Growth Marketing, Paid Acquisition & High-Ticket Funnels About the Company Well...  ...is seeking a Head of Growth Marketing to lead paid acquisition and improve performance...  ...production and operating systems, and use market research to inform growth strategy. Candidates... 

    Confidential

    Indianapolis, IN
    2 days ago
  • $113k - $140k

     ...Description We are Olsson. We engineer and design solutions that...  ...for. We design large hyperscale data center campuses and colocation...  ...foundation of these projects. As a Senior Civil Engineer on our Data...  ...manager on some projects and lead design engineer on others.... 
    Senior
    Full time
    Work at office
    Remote work
    Flexible hours

    Olsson

    Fishers, IN
    22 days ago
  • $119k - $144k

     ...Senior Data Scientist – Market EvaluationYou will work with large and complex datasets...  ...understand and act upon.Lead end-to-end data science...  ...Science, Economics, Operations Research, or a related field; a...  ...platforms and modern software engineering practices, including Azure... 
    Senior
    Local area

    MISO

    Carmel, IN
    4 days ago
  •  ...Data Scientist SeniorLocation: This role requires associates to...  ...an office.The Data Scientist Senior is responsible for the development...  ...make an impact:Designs and lead predictive modeling projects to...  ...business.We offer a range of market-competitive total rewards that... 
    Senior
    Temporary work
    Work at office
    Local area
    1 day per week

    ANTHEM INSURANCE COMPANIES INC

    Indianapolis, IN
    2 days ago
  •  ...environment, offering competitive compensation and an industry-leading 401k contribution. Our team is built through merit and...  ...we give back! Join us today. We are seeking a skilled Data Analytics Engineer to join our team to support the U.S. Army Financial Management... 
    Work experience placement
    Remote work

    Systems Planning and Analysis, Inc

    Indianapolis, IN
    5 days ago
  •  ...The Vice President of Marketing and Communications is the organization’s senior leader for brand, strategic communications...  ...best to tell the story. The VPMC leads an integrated marketing and...  ...initiatives, products, programs, research, advocacy, community impact, and... 

    MIBOR

    Indianapolis, IN
    2 days ago
  • Senior Manager, Data & AI SolutionsAbout the RoleWe’re looking for an accomplished Data & AI leader...  ...real business impact.This person will lead AI initiatives from concept through...  ...measurementProvide leadership across Data Science, AI Engineering, Data Engineering, and Architecture... 
    Senior
    Full time

    Agility Partners

    Carmel, IN
    5 days ago
  • $50k - $56k

     ...Group is seeking a detail-oriented, analytical, and creative Marketing Strategy Coordinator to assist in the development, coordination...  ...strategies aligned with company objectives. Conduct market research to identify industry trends, customer preferences, competitive... 
    Work at office

    Dinamic AS Group

    Indianapolis, IN
    11 days ago
  • $53k - $57k

     ...is looking for a motivated and analytical Marketing Strategy Coordinator to support the development...  ...will work closely with internal teams to research market opportunities, coordinate marketing projects, analyze performance data, and contribute to strategies that enhance... 
    Work at office

    Strive Global

    Indianapolis, IN
    13 days ago
  • $55k - $65k

     ...creative, organized, and detail-oriented Marketing Coordinator to support our marketing initiatives, brand communications, market research, and employee engagement efforts. This position...  ...preferred. ~ Comfort interpreting data, learning new systems, and working... 
    Full time
    Work at office
    Afternoon shift

    Volumod Indy LLC

    Indianapolis, IN
    1 day ago
  •  ...Job Description Job Description Position: Engineering Lead Collaboration Location: Indianapolis, IN Position Requirements & Critical Experience ~ Bachelor's degree in Computer Science, Information Technology, or related field (or equivalent experience).... 

    Phoenix Business, Inc

    Indianapolis, IN
    18 days ago
  •  ...Vice President of Product Marketing & Pricing Strategy About the Company Leading provider of EHR & practice management...  ...should also be skilled in market research, customer insights, and competitive...  ..., the ability to influence senior leaders, and a leadership style... 

    Confidential

    Indianapolis, IN
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Director, NLP & Market Research Data Engineering Lead. Be the first to apply!