Data Engineer

Data Engineer

Brooksource

Fortune 500 Oil & Gas Client

Houston, TX

Overview

We are partnering with a rapidly growing data and AI team within a leading energy organization that is building out its core data engineering capabilities. This team serves as a centralized R&D function, enabling enterprise-wide analytics and AI initiatives by transforming complex, fragmented data into scalable, production-ready assets.

This role sits within a small but expanding pod led by a Data Science leader and works at the intersection of Data Engineering, Data Science, and AI. The team is focused on high-impact, reusable use cases that drive value across business units-removing the need for siloed development and accelerating innovation.

They are looking for a hands-on Data Engineer who can bring structure to evolving data environments, build scalable pipelines, and partner closely with both technical and business stakeholders. This is an opportunity to shape foundational data capabilities in a high-visibility, high-growth environment.

Key Responsibilities

• Design, build, and maintain scalable data pipelines using Azure and Databricks (ADF, Spark, Delta Lake).
• Develop robust ETL/ELT processes to ingest and transform structured, semi-structured, and unstructured data.
• Implement and optimize data architectures (e.g., Medallion/Bronze-Silver-Gold) to support analytics and AI use cases.
• Write high-performance data processing jobs using PySpark and Spark SQL.
• Collaborate with Data Scientists and AI Engineers to enable model development and production use cases.
• Translate ambiguous or evolving business needs into scalable, maintainable data solutions.
• Improve data reliability, quality, and performance across pipelines and platforms.
• Contribute to CI/CD and DevOps practices for data engineering workflows.
• Support development of reusable frameworks and proof-of-concept solutions for enterprise-wide adoption.

Required Qualifications

• 3+ years of experience in Data Engineering or a related role.
• Strong hands-on experience with Databricks and Azure Cloud (preferred; other cloud platforms considered).
• Proficiency in PySpark, Spark SQL, Python, and SQL.
• Experience building and maintaining ETL/ELT pipelines in modern data platforms.
• Solid understanding of distributed data processing, data modeling, and data architecture.
• Ability to operate effectively in less-defined environments and bring structure to evolving data challenges.
• Strong collaboration and communication skills across technical and non-technical teams.

Nice to Have

• Experience in Oil & Gas, energy, or manufacturing environments.
• Exposure to CI/CD, DevOps, and automated deployment practices.
• Familiarity with Data Science concepts (ML models, statistics, feature engineering).
• Experience supporting or integrating with AI/ML workflows.

Team & Environment

• Reports into a Data Science-led organization that partners closely with an adjacent AI Engineering group.
• Functions as a centralized capability supporting multiple business units.
• Small, pod-based team structure with significant growth planned.
• High visibility work tied directly to enterprise AI and digital transformation initiatives.

Disclaimer: Brooksource, Medasource, and Calculated Hire are part of the Eight Eleven Group family of companies and operate under Eight Eleven Group, LLC. All employees receive the same benefits, policies, and terms of employment.


EEO:
We are committed to creating an inclusive environment for all employees and applicants. We do not discriminate on the basis of race, color, religion, creed, sex, sexual orientation, gender identity or expression, national origin, ancestry, age, disability, genetic information, marital status, military or veteran status, citizenship, pregnancy (including childbirth, lactation, and related conditions), or any other protected status in accordance with applicable federal, state, and local laws.


Benefits & Perks:
Brooksource offers competitive medical, dental, vision, Health Savings Account, Dependent Care FSA, and supplemental coverage with plans that can fit each employee's needs. We offer a 401k plan that includes a company match and is fully vested after you become eligible, paid time off, sick time, and paid company holidays. We also offer an Employee Assistance Program (EAP) that provides services like virtual counseling, financial services, legal services, life coaching, etc.


Pay Disclaimer:
The pay range for this job level is a general guideline only and not a guarantee of compensation or salary. Additional factors considered in extending an offer include (but are not limited to) responsibilities of the job, education, experience, knowledge, skills, and abilities, as well as internal equity, alignment with market data, applicable bargaining agreement (if any), or other law.