Senior Director, NLP & Market Research Data Engineering Lead
$159k - $233.2kEli Lilly & Co
At Lilly, the work is demanding because patients are waiting. We unite caring with discovery to help make life better for people around the world, knowing that every decision, every detail, and every day matters. Headquartered in Indianapolis, Indiana, our over 50,000 employees around the globe take on complex challenges to discover and deliver life-changing medicines, strengthen how health is understood and managed, and support the communities we serve. This is hard, urgent, selfless work—but it’s work worth doing. If you’re driven by purpose and ready to bring your best to work that truly matters for patients, we invite you to join us. NLP & Market Research Data Engineering Lead Customer Insights and Analytics (CIA) At Lilly, we unite caring with discovery to make life better for people around the world. We are a global healthcare leader headquartered in Indianapolis, Indiana. Our 50,000+ employees around the world work to discover and bring life-changing medicines to those who need them, improve the understanding and management of disease, and give back to our communities through philanthropy and volunteerism. We give our best effort to our work, and we put people first. We're looking for people who are determined to make life better for people around the world. The Customer Insights and Analytics (CIA) organization is Lilly's business-facing insight and analytics capability, uniting Market Research and Analytics into a single, integrated partnership model that helps our business partners make faster, better, more customer-centered decisions.
Organization Overview
Customer Insights and Analytics (CIA) is Lilly's enterprise insight and analytics organization, built in three tiers: Strategic Intelligence teams embedded with each therapeutic area, functional-area Integrated Insights teams that own the insight craft, and foundational teams built for scale. Data Engineering is one of those foundational teams — it builds the governed, AI-ready data foundation once, centrally, so it can be reused across the business as Lilly embeds agentic AI at scale. Within Data Engineering, this role owns the unstructured-data and NLP foundation for Market Research.Position Overview
The NLP & Market Research Data Engineering Lead builds and runs the engineered data foundation for unstructured and research data — the non-tabular sources that carry the consumer, patient, and HCP “why”: social-listening streams, survey verbatims, qualitative transcripts, call and advisory notes, secondary reports, and medical and scientific text. As Lilly extends its agentic platform beyond structured data, this is the engineering role that delivers the unstructured-data half of the AI-ready foundation for Market Research — the NLP and text pipelines, the enrichment and embedding layer, and the retrieval (RAG) foundation on which research agents and MR analytics depend. The role sits inside CIA's central Data Engineering function, reporting to the Head of Data Engineering & Risk Mitigation, and is a joint priority of Data Engineering and Agentic Intelligence & Products. It builds the capability centrally, once, and makes it reusable across the business — partnering with the embedded Research & Unstructured Data Product Owners, the Agent Factory, Research Science (which owns social listening and MR methods as central capabilities), the Strategic Intelligence Market Research teams, and the governance and stewardship functions. This role builds and runs the pipelines, the unstructured-data products, and the retrieval foundation; it does not frame or interpret the research, and it does not own the agents or Skills. Where the Agent Factory builds the agent and the Market Research teams frame the question, this role builds the governed, AI-ready data foundation they both depend on.Key Objectives
- Build & run the NLP / unstructured-data pipelines. Design and operate production NLP and text pipelines on Databricks (Unity Catalog, Delta) that ingest, parse, structure, and enrich Market Research's unstructured sources across the medallion (bronze → silver → gold).
- Stand up the enrichment & embedding layer. Entity and theme extraction, topic modeling, sentiment, summarization, and embedding / vectorization — turning raw text into structured, queryable, feature-ready signal.
- Own the retrieval / RAG data foundation. Chunking, embedding, vector indexing, and grounding so research agents reason over the full MR evidence base, in partnership with the Agent Factory and Head of AI.
- Make unstructured data AI-ready & governed. Author and steward data contracts (ODCS); ensure PII, consent, classification, and provenance travel with the data into agentic consumption; partner with the Policy-as-Code function to render governance intent as enforced policy (OPA / Rego), with no leakage.
- Establish data quality & evaluation for NLP. Accuracy, coverage, drift, and grounding / hallucination checks (pytest, DLT / Great Expectations), with monitoring and alerting so text data stays trustworthy and auditable.
- Serve Market Research at scale. Engineer the pipelines behind social listening, brand-health, and secondary-MR text analysis, partnering with Research Science and the shared LBI Market Research pool that runs the analysis; establish reference architecture, reusable patterns, and self-service.
- Set technical direction & standards. Own the standards for NLP and unstructured-data engineering across CIA; provide architectural review and gatekeeping for new data flows, integrations, and agent-consumption paths; provide technical direction and mentorship to engineers and the vendor / LBI bench.
- Other key initiatives and special projects as needed.
Leadership
While there are no direct reports today, this person will work through Lilly's teams in India and across teams in CIA and View email address on joinrs.com to build out the Market Research data products (bronze and silver) needed to power agentic solutions for the teams. Leadership is exercised through technical direction, standards, mentorship, and influence across this matrixed set of partners rather than direct people management. The capability this role builds is new and expected to grow — as unstructured-data and Market Research engineering demand scales, this role is positioned to build and lead a small engineering team, and the successful candidate should be able to grow into people leadership over time.- Lead through influence today. Set technical standards and provide architectural review across CIA's unstructured-data and NLP engineering; direct and quality-assure the vendor / LBI engineering bench that helps deliver the work.
- Mentor and develop. Coach engineers and analysts on NLP and unstructured-data engineering practice, and raise the technical bar across the extended team.
- Build for a future team. Establish the standards, playbooks, reusable architecture, and onboarding patterns a future in-house team will inherit, so the capability can scale without re-engineering.
- Grow into people leadership. As the function matures, take on direct reports — hiring, developing, and retaining engineering talent and shaping the operating model for the Market Research / unstructured-data engineering squad.
- Team Lilly leadership. Lead through change, translate strategy into clear technical goals, remove barriers, and model an inclusive, high-trust team environment.
- Head of Data Engineering & Risk Mitigation — direct manager; sets the central engineering agenda and standards this role operates within.
- Head of AI / Agentic Intelligence & Products and the Agent Factory — joint owners of the agentic roadmap and primary consumers of the retrieval / RAG foundation.
- Research Science — owns social listening and Market Research methods as central capabilities; defines what “good” looks like for the signal this role engineers.
- Strategic Intelligence Market Research teams (by therapeutic area) — frame the business and research questions the data foundation must serve.
- Research & Unstructured Data Product Owners — translate research demand into the product backlog this role builds against.
- Governance, Stewardship & Policy-as-Code — partner to ensure PII, consent, classification, and provenance are enforced in code.
- LBI / vendor engineering bench — extended delivery capacity this role directs and quality-assures.
- View email address on joinrs.com — platform and enterprise-engineering partner.
Basic Qualifications
- Bachelor's degree in Computer Science, Data Engineering, or a related technical discipline.
- 8+ years in data engineering, including building and operating production NLP, text-processing pipelines at enterprise scale.
Additional Skills / Preferences
- Demonstrated experience designing lakehouse / medallion architectures (Databricks, Unity Catalog, Delta).
- Hands-on NLP and text engineering — parsing and normalization, entity and topic extraction, embeddings / vectorization, and retrieval / RAG.
- Advanced SQL and Python (PySpark), with data-quality and testing practices for production pipelines.
- Working knowledge of data governance, classification, and access control (row- and column-level security), including the handling of sensitive and unstructured data.
- Ability to influence and align technical and business partners without direct authority in an ambiguous, matrixed environment.
- Experience with vector databases and search, LLM grounding, and agentic / RAG architectures on enterprise content.
- Familiarity with market-research data — social listening, survey and verbatim data, qualitative transcripts, and secondary / medical-scientific text.
- Data-contract frameworks (ODCS), policy-as-code (OPA / Rego), and Git-based CI/CD (Azure DevOps or equivalent); transformation- and infrastructure-as-code (dbt, Terraform).
- Experience in regulated or healthcare data environments; awareness of HIPAA, consent, and MLR / content-governance obligations.
- Readiness to build and lead a small engineering team as the capability scales; experience mentoring or leading engineers, formally or in a matrix, preferred.
- Comfort building a capability that does not exist today, and translating clearly for research, engineering, and governance audiences.
Additional Information
- Indianapolis, IN — hybrid.
- 5–15% travel depending on business need.
- Lilly is an EEO/Affirmative Action Employer and does not discriminate on the basis of age, race, color, religion, gender, sexual orientation, gender identity, gender expression, national origin, protected veteran status, disability, or any other legally protected status.
$166.5k - $244.2k
...analytics capability, uniting Market Research and Analytics into a single,... .... Position Overview The Senior Director, Global Market Research owns... ...the US Marketing Analytics lead. This role reports to the Associate... ...broader analytics and AI/data-foundation teams....SeniorFull timeH1bVisa sponsorshipWork visaRelocation packageFlexible hours- We Are The beginning of a new Data & AI decade that will reshape work and society has... ...You are A strong Data Architect / Data Engineering Lead who can provide technical leadership, architectural... ...in trading, commodities, pricing, market data, supply chain, finance (e.g.,...SuggestedTemporary workWork experience placementLive inWork at officeLocal area
$166.5k - $244.2k
...and analytics capability, uniting Market Research and Analytics into a single,... ...decisions. Position Overview The Senior Director, Consumer Market Research is the lead of consumer and DTC market... ...of Excellence, AI Products, and Data Science. Responsibilities Owning...SeniorFull timeH1bVisa sponsorshipWork visaFlexible hours- ...Job Description Job Description Job Title: Senior Databricks Data Engineer Work Location: St. Louis, MO, Richardson, TX 75082 or Indianapolis... ...a solid understanding of delivery methodology (SDLC) and lead teams in the implementation of the solution according to the...SeniorContract work
- ...Senior Vice President, Marketing About the Company Prominent full-service credit... ...President of Marketing to lead its marketing strategy and... ...strategy, digital marketing, research, campaigns, analytics, and... ...responsibly while protecting data and maintaining human accountability...Senior
- ...Managing Director, Marketing Services About the Company Full-service design-driven research & strategy firm Industry Management Consulting... ...candidate will be a senior executive leader with a focus... ...as well as a background in leading experiential marketing and...Remote work
$105.4k - $207.8k
...by our industry depth to collaborate with leading solution providers and leverage your... ...business solutions.Deloitte is seeking a Senior Consultant, Functional Transformation SAP... .... Work You’ll Do As a PROJECT - Manager, Data and Insights on the SAP Data & Insights team...Local areaRemote work- Accenture helps the world's leading enterprises reinvent by building their... ..., Song, Supply Chain and Engineering, and Talent, with advanced capabilities in AI and Data, Industry and Process, and Technology... ...11/23/2026.Accenture offers a market competitive suite of benefits...SeniorWork experience placementLive inWork at officeLocal area
- ...Leverage Elanco’s Enterprise Data and PaaS/SaaS Platforms to deliver... ...and execution of systems engineering solutions, driving standards... ...Veeva RIM, Ennov). Act as a lead mentor and coach, fostering a... ...application in life science drug research and product safety; (2)...Full timeWork at office
- ...Head of GTM, Research Services About the Company International product research platform providing consumer insights... ...is seeking a Head of GTM for Research Services to lead the commercial launch of a new market research service. This role is pivotal in blending the...
- ...ClassWallet, a leading financial technology company in the United States serving agencies... ...public funds, is seeking to hire a Senior Director, Marketing to join our team. Agencies use... ...comfortable doing the work as leading it. ~ Data-driven, and fluent in marketing...SeniorFull timeFor contractorsLocal areaShift work
$284.7k - $390.9k
...communication skills and deep market insights. This high-... ...a primary focus on Data Center Product Marketing... ...will work closely with engineering, sales, central... ...success. You will also lead a team of marketers to... ...Conduct ongoing market research and competitive analysis...SeniorFull timeTemporary workWork at officeLocal areaFlexible hours- ...Data Engineer Position Details Sector: Electric Utility, Energy, and Power Location: Carmel, IN (Hybrid - 3 days/week... ...independently own development tasks while collaborating with senior technical leads, engineers, analysts, and business partners. This is a...Contract work3 days per week
- ...Position: Data Engineer Azure Databricks & Synapse Lakehouse Location: Indianapolis, IN 46204 Client: State of Indiana Duration: 12+ Months Job Description: Seeking a data engineer to design, build, and maintain secure, scalable data solutions using...
- ...to become one of the nation’s leading homebuilders. M/I Homes... ...generation with divisions in 17 markets, including Austin, Charlotte,... ...Coordinate appropriate market research initiatives that will determine... ...effective partnerships with senior managers to determine specific...Full timeWork experience placementWork at office
- ...Job DescriptionJob DescriptionOur Marketing Manager will be expected to visit our Midwest... ...Marketing Manager will also be responsible for leading the company’s efforts in community... ...market intelligence and provides market research informationUse the Salesforce platform to...Extra incomeFull timeLocal areaWeekend work
- ...Senior Brand Manager, Whole Earth and Natural Sweetener... ...targets, track marketing performance, and evaluate... ...management and need to build data driven plan... ...reports to the Senior Director Brand Strategy, Whole Earth... ...prioritization of efforts. Lead a broad range of activities...SeniorWork at officeFlexible hours
- Job Type Full-time Description This role is ideal for seasoned lead technicians with 5+ years in the industry. Our technicians & electricians... ...limited to Service Technicians (POS Technicians, Electricians, Data Technicians, and other service technicians), and other positions....Weekly payFull timeTemporary workWork at officeRemote workFlexible hoursShift work
- ...Head of Growth Marketing, Paid Acquisition & High-Ticket Funnels About the Company Well... ...is seeking a Head of Growth Marketing to lead paid acquisition and improve performance... ...production and operating systems, and use market research to inform growth strategy. Candidates...
$113k - $140k
...Description We are Olsson. We engineer and design solutions that... ...for. We design large hyperscale data center campuses and colocation... ...foundation of these projects. As a Senior Civil Engineer on our Data... ...manager on some projects and lead design engineer on others....SeniorFull timeWork at officeRemote workFlexible hours$119k - $144k
...Senior Data Scientist – Market EvaluationYou will work with large and complex datasets... ...understand and act upon.Lead end-to-end data science... ...Science, Economics, Operations Research, or a related field; a... ...platforms and modern software engineering practices, including Azure...SeniorLocal area- ...Data Scientist SeniorLocation: This role requires associates to... ...an office.The Data Scientist Senior is responsible for the development... ...make an impact:Designs and lead predictive modeling projects to... ...business.We offer a range of market-competitive total rewards that...SeniorTemporary workWork at officeLocal area1 day per week
- ...environment, offering competitive compensation and an industry-leading 401k contribution. Our team is built through merit and... ...we give back! Join us today. We are seeking a skilled Data Analytics Engineer to join our team to support the U.S. Army Financial Management...Work experience placementRemote work
- ...The Vice President of Marketing and Communications is the organization’s senior leader for brand, strategic communications... ...best to tell the story. The VPMC leads an integrated marketing and... ...initiatives, products, programs, research, advocacy, community impact, and...
- Senior Manager, Data & AI SolutionsAbout the RoleWe’re looking for an accomplished Data & AI leader... ...real business impact.This person will lead AI initiatives from concept through... ...measurementProvide leadership across Data Science, AI Engineering, Data Engineering, and Architecture...SeniorFull time
$50k - $56k
...Group is seeking a detail-oriented, analytical, and creative Marketing Strategy Coordinator to assist in the development, coordination... ...strategies aligned with company objectives. Conduct market research to identify industry trends, customer preferences, competitive...Work at office$53k - $57k
...is looking for a motivated and analytical Marketing Strategy Coordinator to support the development... ...will work closely with internal teams to research market opportunities, coordinate marketing projects, analyze performance data, and contribute to strategies that enhance...Work at office$55k - $65k
...creative, organized, and detail-oriented Marketing Coordinator to support our marketing initiatives, brand communications, market research, and employee engagement efforts. This position... ...preferred. ~ Comfort interpreting data, learning new systems, and working...Full timeWork at officeAfternoon shift- ...Job Description Job Description Position: Engineering Lead Collaboration Location: Indianapolis, IN Position Requirements & Critical Experience ~ Bachelor's degree in Computer Science, Information Technology, or related field (or equivalent experience)....
- ...Vice President of Product Marketing & Pricing Strategy About the Company Leading provider of EHR & practice management... ...should also be skilled in market research, customer insights, and competitive... ..., the ability to influence senior leaders, and a leadership style...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Director, NLP & Market Research Data Engineering Lead. Be the first to apply!
- interactive marketing manager Indianapolis, IN
- marketing manager Indianapolis, IN
- marketing outreach manager Indianapolis, IN
- marketing manager healthcare Indianapolis, IN
- director capital markets Indianapolis, IN
- marketing automation manager Indianapolis, IN
- internet marketing manager Indianapolis, IN
- web marketing manager Indianapolis, IN
- marketing officer Indianapolis, IN
- senior marketing manager Indianapolis, IN





