Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead Data Engineer

Brown & Brown Insurance

Built on meritocracy, our unique company culture rewards self-starters and those who are committed to doing what is best for our customers. Brown & Brown is seeking a Lead Data Engineer to join our growing team in Plano, TX ! As a Lead Data Engineer, you will play a key role in advancing our Data & AI platform capabilities by designing, building, and operating modern data solutions that power Artificial Intelligence, Machine Learning, analytics, business intelligence, and enterprise insights. This role combines hands-on engineering with technical leadership. You will partner with product owners, architects, business stakeholders, and engineering teams to translate business needs into pragmatic, production-ready data solutions. You will own Data solutions across the engineering lifecycle, from architecture and design through development, deployment, and steady-state operations. You will establish engineering patterns and standards, improve platform capabilities, mentor engineers, resolve complex technical challenges, and help the team deliver reliable, governed, scalable, and cost-effective data products. What Will You Do? Lead the design, development, deployment, and operational support of scalable batch and streaming data solutions . Design and build Databricks-native data engineering solutions using Delta Lake, Lakeflow Declarative Pipelines, Databricks Jobs, Auto Loader, Structured Streaming, and Unity Catalog. Develop production-grade ingestion, transformation, and data-processing pipelines using Python, PySpark, Apache Spark, and SQL . Define technical designs, engineering standards, and reusable patterns that improve scalability, reliability, maintainability, and developer productivity. Build and maintain governed data solutions that improve the accuracy, consistency, accessibility, and trustworthiness of enterprise data. Develop reusable frameworks, libraries, templates, and automation that accelerate data ingestion, transformation, feature engineering, and consumption. Implement data-quality validation, monitoring, observability, and remediation capabilities for critical data assets. Integrate data solutions with enterprise governance capabilities, including metadata, lineage, classification, certification, ownership, and access controls . Develop governed data assets supporting AI, Machine Learning, advanced analytics, semantic models, APIs, Genie Spaces, and AI agents . Troubleshoot and optimize production workloads using Spark diagnostics, job logs, query plans, partitioning strategies, join optimization, and Adaptive Query Execution. Operate and continuously improve data solutions through performance monitoring, incident resolution, migrations, upgrades, observability, and cost optimization. Implement automated infrastructure and environment-aware deployments using Infrastructure as Code, Git, and CI/CD practices . Partner with product owners, architects, operations teams, and engineering teams to prioritize capabilities, address technical dependencies, and expand platform adoption. Lead technical design discussions, perform code and design reviews, drive architectural alignment, and proactively identify and remove technical blockers. Mentor engineers and foster a culture of engineering excellence, collaboration, continuous learning, and accountability . Required Qualifications Bachelor’s degree in computer science, Engineering, Mathematics, Information Systems, or a related STEM field, or equivalent education and professional experience. 8+ years of experience in data engineering or related software/data engineering disciplines , including significant hands-on experience building and supporting production data solutions. Strong hands-on experience with Databricks, Apache Spark/PySpark, Delta Lake, Python, and SQL . Experience designing and operating production-grade batch and streaming data pipelines . Experience with Databricks capabilities such as Lakeflow Declarative Pipelines, Databricks Jobs, Auto Loader, Structured Streaming, Delta Lake, and Unity Catalog . Experience designing reliable workflow orchestration, including scheduling, dependencies, parameters, retries, notifications, and operational monitoring. Experience implementing data governance and access controls with Unity Catalog , including catalogs, schemas, tables, views, external locations, storage credentials, lineage, and fine-grained permissions. Experience with Terraform, Databricks Asset Bundles, or comparable Infrastructure as Code approaches , along with Git and CI/CD practices. Strong experience troubleshooting and optimizing Spark workloads using tools and techniques such as Spark UI, job logs, query plans, partitioning, join optimization, and Adaptive Query Execution . Strong understanding of conceptual, logical, relational, dimensional, and physical data modeling . Experience delivering ETL/ELT solutions through the complete engineering lifecycle, from requirements and design through deployment and production support. Demonstrated ability to balance engineering quality, delivery speed, scalability, resiliency, and cost while making pragmatic technical trade-offs. Strong problem-solving skills with demonstrated ability to diagnose and resolve complex data and production issues. Demonstrated technical leadership, including solution design, code reviews, engineering standards, mentoring, and team unblocking . Ability to influence technical direction, facilitate alignment, and build consensus across engineering teams and stakeholders without relying on formal authority. Experience working within Agile delivery models such as Scrum, Kanban, or SAFe . Preferred Qualifications Prior experience serving as a technical lead, lead engineer, or senior engineer with responsibility for technical design and engineering standards. Advanced Python and/or Scala development experience. Experience with cloud platforms such as Microsoft Azure, AWS, or Google Cloud . Experience with cloud storage technologies such as Azure Data Lake Storage Gen2, Amazon S3, OneLake, or Google Cloud Storage . Experience with modern data platforms and open table technologies such as Snowflake, Apache Iceberg, Apache Hudi, or BigQuery . Experience with messaging and event-streaming technologies Experience with NoSQL technologies such as Cassandra or HBase . Experience designing or consuming REST APIs and web services . Experience developing governed data products supporting AI, Generative AI, Machine Learning, semantic models, APIs, advanced analytics, Genie Spaces, or AI agents . Experience implementing enterprise-scale data governance, data quality, metadata, and lineage capabilities . Experience working with insurance, Health data. Practical experience using AI-assisted development tools such as GitHub Copilot, Claude, or Databricks AI-assisted development capabilities to improve engineering productivity. What Will Put You Ahead Deep experience designing, building, and optimizing production-scale Databricks Lakehouse solutions. Experience building high-volume or near-real-time ingestion solutions Advanced Python experience developing reusable engineering frameworks, libraries, automation, and platform capabilities. Experience building governed, reusable data products for AI and Generative AI applications . Demonstrated ability to simplify complex technical architectures and establish reusable engineering patterns across teams. A track record of raising engineering standards while helping teams deliver incrementally and predictably. Strong technical judgment and the ability to identify the right balance between speed, simplicity, scalability, reliability, governance, and cost Teammate Benefits & Total Well-Being We go beyond standard benefits, focusing on the total well-being of our teammates, including: Health Benefits : Medical/Rx, Dental, Vision, Life Insurance, Disability Insurance Financial Benefits : ESPP; 401k; Student Loan Assistance; Tuition Reimbursement Mental Health & Wellness : Free Mental Health & Enhanced Advocacy Services Beyond Benefits : Paid Time Off, Holidays, Preferred Partner Discounts and more. Not reflective of all benefits. Enrollment waiting periods or eligibility criteria may apply to certain benefits. Benefit details and offerings may vary for subsidiary entities or in specific geographic locations. Recruiting Vendor Disclosure Statement Brown & Brown does not accept unsolicited resumes from external recruiters, recruitment vendors or employment agencies ("Recruiting Vendors"). Recruiting Vendors must have a valid written agreement and received prior written authorization from an authorized Brown & Brown representative before submitting candidates for any publicly posted role. Any unsolicited resumes submitted to Brown & Brown or its employees become the property of Brown & Brown, and no fees will be paid for such submissions. Additional information regarding this policy can be found on our careers page. The Power To Be Yourself As an Equal Opportunity Employer, we are committed to fostering an inclusive environment comprised of people from all backgrounds, with a variety of experiences and perspectives, guided by our Diversity, Inclusion & Belonging (DIB) motto, “The Power to Be Yourself”. Summary Location: Plano, TX, USA Type: Full time

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer in Plano, TX vacancy
  •  ...Data Engineering Lead Lead end-to-end delivery of large-scale data engineering initiatives, ensuring high-quality and timely outcomes. Architect, design, and implement scalable, cloud-native data platforms using Databricks, Apache Spark (Scala), and AWS services. Develop... 
    Suggested

    ConnectedX Inc

    Plano, TX
    3 days ago
  •  ...Lead Data Center Critical Facilities Engineer JLL empowers you to shape a brighter way. Our people at JLL and JLL Technologies are shaping the future of real estate for a better world by combining world class services, advisory and technology for our clients. We are... 
    Suggested
    Night shift

    JLL

    Richardson, TX
    19 hours ago
  • Job Description:DXC Technology is a leading global technology services provider helping the world's largest enterprises and public...  ...Property & Casualty, and Specialty Insurance.Position SummaryThe Data Engineering Lead is responsible for the design, development, governance,... 
    Suggested
    Minimum wage
    Full time
    Worldwide

    DXC Technology

    Plano, TX
    1 day ago
  •  ...the right person, but please make sure your candidate live with in the areas, This role is a 6 month Plus role The Lead Data Engineer will report to the Marketing Technology (MarTech) team and will support the development of the customer centric strategy to... 
    Suggested
    Remote work
    Flexible hours

    3B Staffing LLC

    Addison, TX
    2 days ago
  •  ...Description Job Description Summary: The engineer in this position should have a wealth of...  ...include the complete engineering of data centers including, but not limited to, infrastructure...  ...engineers, installation supervisors, lead installers, and installation techs.... 
    Suggested
    For contractors
    Work at office
    Local area

    Adex Corporation

    Plano, TX
    1 day ago
  •  ...Job Description Job Description Job Title : Senior Lead Data Engineer Client's Location: Scottsdale, AZ Work location : Richardson, TX - Onsite role Project Duration : 12 months Contract Interview: Three rounds - Video interview & 2nd round In... 
    Contract work

    Abode Techzone LLC

    Richardson, TX
    21 days ago
  • $30 - $32 per hour

     ...Job Description Job Description Job Title: Data Center Optical Engineer /  Field Services Work Location: Richardson, TX 75081 Duration: 1...  ...highly motivated and skilled Data Center Optical Engineer to lead work in customer environments and co-locations. ~ The... 
    Hourly pay
    Contract work
    Work at office
    Remote work

    LanceSoft Inc

    Richardson, TX
    1 day ago
  • We're looking for a Lead Data Platform Engineer to play a critical role in designing, optimizing, and governing enterprise-scale data and analytics platforms. In this role, you'll provide technical leadership while helping shape the future of data infrastructure across... 
    Hourly pay
    Freelance

    Solomon Page

    Plano, TX
    19 hours ago
  • $70 - $75 per hour

     ...Location: Plano, TX Salary: $70.00 USD Hourly - $75.00 USD Hourly Description: Our client is currently seeking a Data Engineer with strong experience in data modeling, data warehousing, and cloud-based data platforms. The ideal candidate will have hands-on experience... 
    Hourly pay

    Judge Group, Inc.

    Plano, TX
    1 day ago
  •  ...work on-site at a FedEx location several times per week. The Data Engineer Principal plays a pivotal role within FEC and provides dynamic...  ...test and maintenance of data pipelines at big data scale. Leads batch processing of collected data to ensure data is ready for... 
    Work experience placement

    FedEx Office

    Plano, TX
    3 days ago
  •  ...capture, manage, store and utilize structured and unstructured data from internal and external sources. Establishes and builds processes...  ...Minimum Requirements: Bachelor's degree in Electrical Engineering, Computer Engineering or related field of study Minimum cumulative... 
    Internship
    Local area

    Texas Instruments Incorporated

    Richardson, TX
    1 day ago
  • $50 - $60 per hour

     ...Hourly - $60.00 USD Hourly Description: No sponsorship or C2C for this role Must be a w2 employee of The Judge Group Data Engineer Location: Remote Duration: 6+ Months Contract (Subcontractor) About the Role We are seeking an experienced Data... 
    Hourly pay
    Full time
    Contract work
    For subcontractor
    Remote work

    Judge Group, Inc.

    Richardson, TX
    1 day ago
  • $10,000 per month

     ...Job Profile Summary The Data Engineer Principal plays a pivotal role within Dataworks and provides dynamic leadership at the enterprise...  ...build, test and maintenance of data pipelines at big data scale. Leads batch processing of collected data to ensure data is ready for... 
    Work experience placement

    FedEx Office

    Plano, TX
    3 days ago
  •  ...Object Technology Solutions, Inc (OTSI) – Data Center Engineer This is an immediate opening for a Data Center Engineer. Major Responsibilities...  ...similar environment, interacting directly with customers. Team lead experience preferred. Soft Skills : Must be a self‑starter... 
    Local area
    Immediate start
    Remote work
    Worldwide
    Shift work
    Night shift

    ARTSMARTUK LTD.

    Richardson, TX
    1 day ago
  •  ...Role: Junior Data Engineer Location: Plano, TX (Onsite) Fulltime - Permanent Job Description Must Have Technical/Functional Skills: ~ DataStage, SQL, Python, Snowflake, DBT Roles & Responsibilities ~1-3 years of experience... 
    Permanent employment
    Full time

    AceStack LLC

    Murphy, TX
    2 days ago
  •  ...truly a global presence of 20,000 movie lovers working together to make unforgettable experiences. Role Summary: The Senior Data Engineer is a hands-on technical role responsible for designing, developing, testing, deploying, and supporting scalable enterprise data... 
    Hourly pay
    Daily paid
    Permanent employment
    Full time
    Contract work

    Cinemark

    Plano, TX
    8 hours ago
  • $50 per hour

     ...Data Engineer Work Location: Plano, TX or Atlanta, GA Maximum Pay Rate: $50/hr (to me) Client: BOFA Candidate’s Experience: 5 Years of Experience Candidates will also need to go through a tech screening. We are looking for candidates with the following primary... 

    Argyle Infotech

    Plano, TX
    4 days ago
  •  ...for an experienced Software Developers and Engineers who has a passion for building software...  ...experience ~3+ years of experience as a Data Engineer, having built large and complex...  ...in product development and staffing for leading local, regional and national clients... 
    Full time
    Work at office
    Local area
    Immediate start

    r2 Technologies, Inc.

    Plano, TX
    3 days ago
  •  ...Job DescriptionJob DescriptionJob ID:113428-1 Job Title: Data Engineer Location: Onsite:Plano,TX Duration: 6 months (Extendable) Pay Rate: $40-$45/hr on W2 Description: Data Engineer Lead responsible for building and optimizing scalable data pipelines using DBT, Snowflake... 

    Artech

    Plano, TX
    1 day ago
  • $90k - $150k

     ...Job DescriptionJob DescriptionGenesis10 is currently seeking a Data Engineer for a direct hire opportunity with a Financial Services Organization located in Plano, TX or Camas, WA. Summary:In this role, you will design and deliver modern data solutions using cloud-based... 
    Permanent employment
    Contract work

    Genesis10

    Plano, TX
    1 day ago
  • $76 - $76.92 per hour

     ...to design complex and high performance Data architectureDeveloping and maintaining strong...  ..., high-impact resultsParticipating and leading key engagements, in developing plans and...  ...DataExcellent problem solving, hands-on engineering skills and communication skillsBroad... 
    Hourly pay
    Full time
    Local area
    Flexible hours

    Aditi Consulting

    Plano, TX
    3 days ago
  • $120k - $130k

     ...Job DescriptionJob Description Job Title: Sr. Snowflake Data Engineer Location: PLANO, TX ( Day 1 Onsite) Salary Range: $120-130K Job Summary: We are seeking a skilled Data Engineer with a strong background in Snowflake to join our dynamic team. The ideal candidate will... 

    Diverse Lynx

    Plano, TX
    4 days ago
  •  ...Description: We are seeking a Senior Data Engineer to support the evolution of an enterprise customer profile platform [Unified Customer Profile (UCP)] and its integration with a broad ecosystem of applications. In this role, you will design, develop, and optimize data... 
    Contract work

    United Software Group

    Plano, TX
    7 hours ago
  •  ...Job DescriptionJob DescriptionPosition would require the candidate to be a W2 employee of Donatech. US Citizenship Required. -Data Engineering: Design, develop, and maintain data pipelines and ETL processes to support data analytics and reporting needs. -Snowflake: Utilize... 

    Donatech

    Richardson, TX
    3 days ago
  •  ...You'll design and build large-scale big data solutions on Google Cloud, with Spark on...  ...leadership, and the delivery teams. You'll also lead and mentor other developers on the team....  ...field such as computer science, computer engineering, or a related field5–7 years of... 
    Contract work
    Temporary work

    Judit Inc

    Plano, TX
    1 day ago
  • $10,000 per month

     ...Job Profile Summary The Data Engineer Principal plays a pivotal role within Dataworks and provides dynamic leadership at the enterprise...  ..., test and maintenance of data pipelines at big data scale. Leads batch processing of collected data to ensure data is ready for... 
    Work experience placement

    FedEx

    Plano, TX
    7 hours ago
  •  ...You’ll design and build large-scale big data solutions on Google Cloud, with Spark on...  ...leadership, and the delivery teams. You’ll also lead and mentor other developers on the team....  ...field such as computer science, computer engineering, or a related field ~5–7 years of... 
    Contract work
    Temporary work

    Judit Inc

    Plano, TX
    1 day ago
  •  ...Data Engineer Highly experienced Data Engineer with expertise in cloud engineering, data engineering, and data warehousing, particularly...  ...deployment processes and ensure continuous integration. Leads teams in designing and developing centralized data warehouses... 

    ConnectedX Inc

    Plano, TX
    7 hours ago
  •  ...Role: Big Data Engineer Location: Plano, TX (Onsite) Client: Artech / JPMorgan Chase Mode: W2 Contract / Full Time...  ...and CloudWatch. Must be able to work with architects and lead engineers to design solutions to meet functional and non-functional... 
    Full time
    Contract work
    Work experience placement

    Exaways Corporation

    Plano, TX
    4 days ago
  •  ...Junior Data Engineer - Plano, TX (Contract to Hire) About the Role Join a fast-paced team as a Junior Data Engineer and launch your...  ...mentorship from experienced data professionals - Exposure to leading-edge data technologies and financial industry projects - Remote... 
    Full time
    Contract work
    Remote work

    Indotronix International Corporation

    Plano, TX
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!