Lead Data Engineer
Brown & Brown Insurance
Built on meritocracy, our unique company culture rewards self-starters and those who are committed to doing what is best for our customers. Brown & Brown is seeking a Lead Data Engineer to join our growing team in Plano, TX ! As a Lead Data Engineer, you will play a key role in advancing our Data & AI platform capabilities by designing, building, and operating modern data solutions that power Artificial Intelligence, Machine Learning, analytics, business intelligence, and enterprise insights. This role combines hands-on engineering with technical leadership. You will partner with product owners, architects, business stakeholders, and engineering teams to translate business needs into pragmatic, production-ready data solutions. You will own Data solutions across the engineering lifecycle, from architecture and design through development, deployment, and steady-state operations. You will establish engineering patterns and standards, improve platform capabilities, mentor engineers, resolve complex technical challenges, and help the team deliver reliable, governed, scalable, and cost-effective data products. What Will You Do? Lead the design, development, deployment, and operational support of scalable batch and streaming data solutions . Design and build Databricks-native data engineering solutions using Delta Lake, Lakeflow Declarative Pipelines, Databricks Jobs, Auto Loader, Structured Streaming, and Unity Catalog. Develop production-grade ingestion, transformation, and data-processing pipelines using Python, PySpark, Apache Spark, and SQL . Define technical designs, engineering standards, and reusable patterns that improve scalability, reliability, maintainability, and developer productivity. Build and maintain governed data solutions that improve the accuracy, consistency, accessibility, and trustworthiness of enterprise data. Develop reusable frameworks, libraries, templates, and automation that accelerate data ingestion, transformation, feature engineering, and consumption. Implement data-quality validation, monitoring, observability, and remediation capabilities for critical data assets. Integrate data solutions with enterprise governance capabilities, including metadata, lineage, classification, certification, ownership, and access controls . Develop governed data assets supporting AI, Machine Learning, advanced analytics, semantic models, APIs, Genie Spaces, and AI agents . Troubleshoot and optimize production workloads using Spark diagnostics, job logs, query plans, partitioning strategies, join optimization, and Adaptive Query Execution. Operate and continuously improve data solutions through performance monitoring, incident resolution, migrations, upgrades, observability, and cost optimization. Implement automated infrastructure and environment-aware deployments using Infrastructure as Code, Git, and CI/CD practices . Partner with product owners, architects, operations teams, and engineering teams to prioritize capabilities, address technical dependencies, and expand platform adoption. Lead technical design discussions, perform code and design reviews, drive architectural alignment, and proactively identify and remove technical blockers. Mentor engineers and foster a culture of engineering excellence, collaboration, continuous learning, and accountability . Required Qualifications Bachelor’s degree in computer science, Engineering, Mathematics, Information Systems, or a related STEM field, or equivalent education and professional experience. 8+ years of experience in data engineering or related software/data engineering disciplines , including significant hands-on experience building and supporting production data solutions. Strong hands-on experience with Databricks, Apache Spark/PySpark, Delta Lake, Python, and SQL . Experience designing and operating production-grade batch and streaming data pipelines . Experience with Databricks capabilities such as Lakeflow Declarative Pipelines, Databricks Jobs, Auto Loader, Structured Streaming, Delta Lake, and Unity Catalog . Experience designing reliable workflow orchestration, including scheduling, dependencies, parameters, retries, notifications, and operational monitoring. Experience implementing data governance and access controls with Unity Catalog , including catalogs, schemas, tables, views, external locations, storage credentials, lineage, and fine-grained permissions. Experience with Terraform, Databricks Asset Bundles, or comparable Infrastructure as Code approaches , along with Git and CI/CD practices. Strong experience troubleshooting and optimizing Spark workloads using tools and techniques such as Spark UI, job logs, query plans, partitioning, join optimization, and Adaptive Query Execution . Strong understanding of conceptual, logical, relational, dimensional, and physical data modeling . Experience delivering ETL/ELT solutions through the complete engineering lifecycle, from requirements and design through deployment and production support. Demonstrated ability to balance engineering quality, delivery speed, scalability, resiliency, and cost while making pragmatic technical trade-offs. Strong problem-solving skills with demonstrated ability to diagnose and resolve complex data and production issues. Demonstrated technical leadership, including solution design, code reviews, engineering standards, mentoring, and team unblocking . Ability to influence technical direction, facilitate alignment, and build consensus across engineering teams and stakeholders without relying on formal authority. Experience working within Agile delivery models such as Scrum, Kanban, or SAFe . Preferred Qualifications Prior experience serving as a technical lead, lead engineer, or senior engineer with responsibility for technical design and engineering standards. Advanced Python and/or Scala development experience. Experience with cloud platforms such as Microsoft Azure, AWS, or Google Cloud . Experience with cloud storage technologies such as Azure Data Lake Storage Gen2, Amazon S3, OneLake, or Google Cloud Storage . Experience with modern data platforms and open table technologies such as Snowflake, Apache Iceberg, Apache Hudi, or BigQuery . Experience with messaging and event-streaming technologies Experience with NoSQL technologies such as Cassandra or HBase . Experience designing or consuming REST APIs and web services . Experience developing governed data products supporting AI, Generative AI, Machine Learning, semantic models, APIs, advanced analytics, Genie Spaces, or AI agents . Experience implementing enterprise-scale data governance, data quality, metadata, and lineage capabilities . Experience working with insurance, Health data. Practical experience using AI-assisted development tools such as GitHub Copilot, Claude, or Databricks AI-assisted development capabilities to improve engineering productivity. What Will Put You Ahead Deep experience designing, building, and optimizing production-scale Databricks Lakehouse solutions. Experience building high-volume or near-real-time ingestion solutions Advanced Python experience developing reusable engineering frameworks, libraries, automation, and platform capabilities. Experience building governed, reusable data products for AI and Generative AI applications . Demonstrated ability to simplify complex technical architectures and establish reusable engineering patterns across teams. A track record of raising engineering standards while helping teams deliver incrementally and predictably. Strong technical judgment and the ability to identify the right balance between speed, simplicity, scalability, reliability, governance, and cost Teammate Benefits & Total Well-Being We go beyond standard benefits, focusing on the total well-being of our teammates, including: Health Benefits : Medical/Rx, Dental, Vision, Life Insurance, Disability Insurance Financial Benefits : ESPP; 401k; Student Loan Assistance; Tuition Reimbursement Mental Health & Wellness : Free Mental Health & Enhanced Advocacy Services Beyond Benefits : Paid Time Off, Holidays, Preferred Partner Discounts and more. Not reflective of all benefits. Enrollment waiting periods or eligibility criteria may apply to certain benefits. Benefit details and offerings may vary for subsidiary entities or in specific geographic locations. Recruiting Vendor Disclosure Statement Brown & Brown does not accept unsolicited resumes from external recruiters, recruitment vendors or employment agencies ("Recruiting Vendors"). Recruiting Vendors must have a valid written agreement and received prior written authorization from an authorized Brown & Brown representative before submitting candidates for any publicly posted role. Any unsolicited resumes submitted to Brown & Brown or its employees become the property of Brown & Brown, and no fees will be paid for such submissions. Additional information regarding this policy can be found on our careers page. The Power To Be Yourself As an Equal Opportunity Employer, we are committed to fostering an inclusive environment comprised of people from all backgrounds, with a variety of experiences and perspectives, guided by our Diversity, Inclusion & Belonging (DIB) motto, “The Power to Be Yourself”. Summary Location: Plano, TX, USA Type: Full time
- ...Data Engineering Lead Lead end-to-end delivery of large-scale data engineering initiatives, ensuring high-quality and timely outcomes. Architect, design, and implement scalable, cloud-native data platforms using Databricks, Apache Spark (Scala), and AWS services. Develop...Suggested
- ...Lead Data Center Critical Facilities Engineer JLL empowers you to shape a brighter way. Our people at JLL and JLL Technologies are shaping the future of real estate for a better world by combining world class services, advisory and technology for our clients. We are...SuggestedNight shift
- Job Description:DXC Technology is a leading global technology services provider helping the world's largest enterprises and public... ...Property & Casualty, and Specialty Insurance.Position SummaryThe Data Engineering Lead is responsible for the design, development, governance,...SuggestedMinimum wageFull timeWorldwide
- ...the right person, but please make sure your candidate live with in the areas, This role is a 6 month Plus role The Lead Data Engineer will report to the Marketing Technology (MarTech) team and will support the development of the customer centric strategy to...SuggestedRemote workFlexible hours
- ...Description Job Description Summary: The engineer in this position should have a wealth of... ...include the complete engineering of data centers including, but not limited to, infrastructure... ...engineers, installation supervisors, lead installers, and installation techs....SuggestedFor contractorsWork at officeLocal area
- ...Job Description Job Description Job Title : Senior Lead Data Engineer Client's Location: Scottsdale, AZ Work location : Richardson, TX - Onsite role Project Duration : 12 months Contract Interview: Three rounds - Video interview & 2nd round In...Contract work
$30 - $32 per hour
...Job Description Job Description Job Title: Data Center Optical Engineer / Field Services Work Location: Richardson, TX 75081 Duration: 1... ...highly motivated and skilled Data Center Optical Engineer to lead work in customer environments and co-locations. ~ The...Hourly payContract workWork at officeRemote work- We're looking for a Lead Data Platform Engineer to play a critical role in designing, optimizing, and governing enterprise-scale data and analytics platforms. In this role, you'll provide technical leadership while helping shape the future of data infrastructure across...Hourly payFreelance
$70 - $75 per hour
...Location: Plano, TX Salary: $70.00 USD Hourly - $75.00 USD Hourly Description: Our client is currently seeking a Data Engineer with strong experience in data modeling, data warehousing, and cloud-based data platforms. The ideal candidate will have hands-on experience...Hourly pay- ...work on-site at a FedEx location several times per week. The Data Engineer Principal plays a pivotal role within FEC and provides dynamic... ...test and maintenance of data pipelines at big data scale. Leads batch processing of collected data to ensure data is ready for...Work experience placement
- ...capture, manage, store and utilize structured and unstructured data from internal and external sources. Establishes and builds processes... ...Minimum Requirements: Bachelor's degree in Electrical Engineering, Computer Engineering or related field of study Minimum cumulative...InternshipLocal area
$50 - $60 per hour
...Hourly - $60.00 USD Hourly Description: No sponsorship or C2C for this role Must be a w2 employee of The Judge Group Data Engineer Location: Remote Duration: 6+ Months Contract (Subcontractor) About the Role We are seeking an experienced Data...Hourly payFull timeContract workFor subcontractorRemote work$10,000 per month
...Job Profile Summary The Data Engineer Principal plays a pivotal role within Dataworks and provides dynamic leadership at the enterprise... ...build, test and maintenance of data pipelines at big data scale. Leads batch processing of collected data to ensure data is ready for...Work experience placement- ...Object Technology Solutions, Inc (OTSI) – Data Center Engineer This is an immediate opening for a Data Center Engineer. Major Responsibilities... ...similar environment, interacting directly with customers. Team lead experience preferred. Soft Skills : Must be a self‑starter...Local areaImmediate startRemote workWorldwideShift workNight shift
- ...Role: Junior Data Engineer Location: Plano, TX (Onsite) Fulltime - Permanent Job Description Must Have Technical/Functional Skills: ~ DataStage, SQL, Python, Snowflake, DBT Roles & Responsibilities ~1-3 years of experience...Permanent employmentFull time
- ...truly a global presence of 20,000 movie lovers working together to make unforgettable experiences. Role Summary: The Senior Data Engineer is a hands-on technical role responsible for designing, developing, testing, deploying, and supporting scalable enterprise data...Hourly payDaily paidPermanent employmentFull timeContract work
$50 per hour
...Data Engineer Work Location: Plano, TX or Atlanta, GA Maximum Pay Rate: $50/hr (to me) Client: BOFA Candidate’s Experience: 5 Years of Experience Candidates will also need to go through a tech screening. We are looking for candidates with the following primary...- ...for an experienced Software Developers and Engineers who has a passion for building software... ...experience ~3+ years of experience as a Data Engineer, having built large and complex... ...in product development and staffing for leading local, regional and national clients...Full timeWork at officeLocal areaImmediate start
- ...Job DescriptionJob DescriptionJob ID:113428-1 Job Title: Data Engineer Location: Onsite:Plano,TX Duration: 6 months (Extendable) Pay Rate: $40-$45/hr on W2 Description: Data Engineer Lead responsible for building and optimizing scalable data pipelines using DBT, Snowflake...
$90k - $150k
...Job DescriptionJob DescriptionGenesis10 is currently seeking a Data Engineer for a direct hire opportunity with a Financial Services Organization located in Plano, TX or Camas, WA. Summary:In this role, you will design and deliver modern data solutions using cloud-based...Permanent employmentContract work$76 - $76.92 per hour
...to design complex and high performance Data architectureDeveloping and maintaining strong... ..., high-impact resultsParticipating and leading key engagements, in developing plans and... ...DataExcellent problem solving, hands-on engineering skills and communication skillsBroad...Hourly payFull timeLocal areaFlexible hours$120k - $130k
...Job DescriptionJob Description Job Title: Sr. Snowflake Data Engineer Location: PLANO, TX ( Day 1 Onsite) Salary Range: $120-130K Job Summary: We are seeking a skilled Data Engineer with a strong background in Snowflake to join our dynamic team. The ideal candidate will...- ...Description: We are seeking a Senior Data Engineer to support the evolution of an enterprise customer profile platform [Unified Customer Profile (UCP)] and its integration with a broad ecosystem of applications. In this role, you will design, develop, and optimize data...Contract work
- ...Job DescriptionJob DescriptionPosition would require the candidate to be a W2 employee of Donatech. US Citizenship Required. -Data Engineering: Design, develop, and maintain data pipelines and ETL processes to support data analytics and reporting needs. -Snowflake: Utilize...
- ...You'll design and build large-scale big data solutions on Google Cloud, with Spark on... ...leadership, and the delivery teams. You'll also lead and mentor other developers on the team.... ...field such as computer science, computer engineering, or a related field5–7 years of...Contract workTemporary work
$10,000 per month
...Job Profile Summary The Data Engineer Principal plays a pivotal role within Dataworks and provides dynamic leadership at the enterprise... ..., test and maintenance of data pipelines at big data scale. Leads batch processing of collected data to ensure data is ready for...Work experience placement- ...You’ll design and build large-scale big data solutions on Google Cloud, with Spark on... ...leadership, and the delivery teams. You’ll also lead and mentor other developers on the team.... ...field such as computer science, computer engineering, or a related field ~5–7 years of...Contract workTemporary work
- ...Data Engineer Highly experienced Data Engineer with expertise in cloud engineering, data engineering, and data warehousing, particularly... ...deployment processes and ensure continuous integration. Leads teams in designing and developing centralized data warehouses...
- ...Role: Big Data Engineer Location: Plano, TX (Onsite) Client: Artech / JPMorgan Chase Mode: W2 Contract / Full Time... ...and CloudWatch. Must be able to work with architects and lead engineers to design solutions to meet functional and non-functional...Full timeContract workWork experience placement
- ...Junior Data Engineer - Plano, TX (Contract to Hire) About the Role Join a fast-paced team as a Junior Data Engineer and launch your... ...mentorship from experienced data professionals - Exposure to leading-edge data technologies and financial industry projects - Remote...Full timeContract workRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!



