Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Analyst, Lead Data Engineering

Enterprise Products Partners

Analyst, Lead Data Engineering

Tap into the professional possibilities of the largest publicly traded energy partnership that features one of the most diversified cash flow streams in the midstream segment of the energy industry. With dynamic career opportunities and a creative and supportive environment, our unique midstream energy organization offers the chance to share and be recognized for your ideas. Join our team and increase your opportunities for success. We are currently seeking an experienced Data Engineer to join the Big Dat and Advanced Analytics department. The Data Engineer will work closely with business domain experts to create an Enterprise Data Lakehouse to support data analytic use cases for the midstream oil and gas operations, engineering, and measurements business units. Responsibilities include, but are not limited to:

  • Design and implement reliable data pipelines to integrate disparate data sources into a single Data Lakehouse.
  • Design and implement data quality pipelines to ensure data correctness and building trusted datasets.
  • Design and implement a Data Lakehouse solution which accurately reflects business operations.
  • Assist with data platform performance tuning and physical data model support including partitioning and compaction.
  • Provide guidance in data visualizations and reporting efforts to ensure solutions are aligned to business objectives.
  • Automate and optimize the data lifecycle, find insights from raw data, and applying DevOps principle to data pipelines.
  • Work with business leaders to deliver custom software solutions meeting data needs.
  • Build and support a data platform for data engineering teams to build, deploy and manage applications.

Qualifications: The successful candidate will meet the following qualifications:

  • 5+ years of experience as a Data Engineer designing and maintaining data pipeline architectures.
  • 5+ years of in-depth programming experience in Python and SQL.
  • 5+ years in software development lifecycle experience with software engineering, development, testing, version control, refactoring, and deployment.
  • Experience with common Python Data Engineering packages including pandas, Numpy, Pyarrow, Pytest, Scikit-Learn, and Boto3.
  • Experience in implementing a Data Lakehouse using Apache Iceberg or Delta Lake.
  • Experience with data platform architecture responsible for high-level design, strategy and implementation of data infrastructure, including data modelling, designing scalable architectures and ensuring data governance, security and compliance.
  • Knowledgeable of modern data platform technologies including Apache Airflow, Kubernetes, and S3 Object Storage.
  • Experience with AWS, Snowflake, dbt and Airbyte is preferred.
  • Experience with infrastructure as code, building consistent and repeatable cloud infrastructure.

Primary Location: USA-Texas-Houston Shift: Day Job Travel: Yes, 10 % of the Time Unposting Date: Ongoing Organization: Info Tech Job: Information Technology Job Level: Individual Contributor

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Analyst, Lead Data Engineering in Houston, TX vacancy
  •  ...be recognized for your ideas. Join our team and increase your opportunities for success. We are currently seeking an experienced Data Engineer to join the Big Dat and Advanced Analytics department. The Data Engineer will work closely with business domain experts to... 
    Suggested

    EPCO Corporate

    Houston, TX
    13 hours ago
  •  ...Data Engineering Leader Key skill: DWH, ETL, Pyspark, ADB, ADF 10+ years of experience in data engineering, with at least 2 years in a leadership or senior developer role. Strong hands-on expertise in Azure ecosystem – including Azure Data Lake Storage (ADLS),... 
    Suggested

    E-Solutions

    Houston, TX
    13 hours ago
  •  ...NAVA Software solutions is looking for a Lead Data Engineer Details: Lead Data Engineer /Integrations Location: Houston TX - 3 days onsite Duration: Full time /Direct Hire POSITION SUMMARY The Senior Developer - Integrations is responsible... 
    Suggested
    Full time
    Shift work

    Nava Software Solutions

    Houston, TX
    13 hours ago
  •  ...Produce and distribute regular reports on weather events with potential impacts on energy markets or the TotalEnergies portfolio. Execute data‑driven projects using large weather and energy datasets in close collaboration with the MATS team in Geneva. Contribute to the... 
    Suggested
    Temporary work
    Seasonal work
    Local area
    Visa sponsorship
    Work visa
    Shift work

    TOTAL Deutschland GmbH

    Houston, TX
    5 days ago
  • $83.25k - $141.37k

     ...Job Description Sr Analyst (Data Governance) is responsible for the overall development, maintenance, and integrity of various reporting database. You will be responsible for testing, reviewing SQL queries, stored procedures and facilitating code reviews for improving... 
    Suggested
    Work experience placement

    Molina Healthcare

    Houston, TX
    4 days ago
  •  ...Senior Quantitative Analyst (Contract) Power the Future of Clean...  ...investment decisions. What You'll Lead & Deliver Collaboration...  ...explain the differences. Data Collection and Management:...  ...degree in economics, finance, engineering, or a related field. Proven... 
    Contract work
    For contractors
    Work at office
    Work from home
    Flexible hours
    1 day per week

    Direct Energie

    Houston, TX
    5 days ago
  •  ...A technology solutions firm in Houston is seeking a Business Analyst to gather and analyze business requirements. The role involves supporting solution implementation, conducting data analysis, and facilitating communication between stakeholders and technical teams. Ideal... 
    Full time

    Arthatech

    Houston, TX
    1 day ago
  •  ...Job Title: Quantitative Risk Analyst Contract Type: Permanent Time Type: Full time Job Description: Quantitative...  ...and seasonality. • Streamline and improve processes such as data quality checks and automate operations. • Special assignments... 
    Permanent employment
    Full time
    Contract work

    Gunvor

    Houston, TX
    1 day ago
  •  ...Data Scientist Opportunity At SynergisticIT, we aim to bring aboard IT professionals to help them build a rewarding career in cutting...  ...Bachelor's degree or Master's degree in Computer Engineering, Computer Science, Mathematics, Electrical Engineering, Information... 
    Part time
    H1b
    Relocation
    Flexible hours

    SynergisticIT

    Houston, TX
    4 days ago
  •  ...CGG Services (U.S.) Inc. is looking for a highly motivated individual to join our Houston Data Center team focusing on development, implementation, and support. The ideal candidate will have experience in High Performance Computing (HPC) and a proactive approach to data... 

    CGG

    Houston, TX
    5 days ago
  • $64k - $76k

     ...A leading oncology research institute in Houston, Texas is seeking a Postdoctoral Fellow who will lead data engineering efforts for large-scale translational oncology studies. The role involves designing and maintaining research-grade data infrastructures and collaborating... 
    Full time

    MD Anderson Cancer Center

    Houston, TX
    4 days ago
  •  ...Data Engineering Director Location: Houston, TX (4 days in the office) Reports To: VP Data Engineering Help us insure it Tokio Marine HCC is a global industry-leading specialty insurance group, backed by the strength and stability of the Tokio Marine Group... 
    Work at office
    Local area

    Tokio Marine HCC

    Houston, TX
    1 day ago
  • $75k

     ...A leading funeral and cemetery service provider in Houston, TX is seeking a detail-oriented Financial Analyst to support financial planning and operational efficiency. The role involves monitoring key performance indicators and assisting in financial reviews. Candidates... 
    Work at office
    Remote work
    1 day per week

    Carriage Services

    Houston, TX
    5 days ago
  •  ...Data Engineer At the heart of global supply, Trafigura connects vital resources to power and build the world. Through our Oil & Petroleum Products, Gas and Power, and Metals and Minerals, commercial divisions, we use infrastructure, logistics and financing to connect... 

    Trafigura

    Houston, TX
    2 days ago
  •  ...Senior Data Engineer (Contract) We are looking for a highly skilled Senior Data Engineer to design, build, and optimize scalable data solutions in a hybrid work environment. The ideal candidate will have strong expertise in Python and Snowflake, with a focus on pipeline... 
    Contract work
    3 days per week

    Kasmo Global

    Houston, TX
    2 days ago
  •  ...Lead Data Engineer Databricks Location: Houston, TX Onsite Day 1 Experience Required: 10–12 years Required Skills & Qualifications: Lead Data Engineer Relevant experience to be more than 8-9 years, Strong and proficient in Databricks, DLT (Delta Live Tables... 

    InterSources

    Houston, TX
    2 days ago
  •  ...Data Engineer Location: Houston, TX (Onsite) Duration: Contract Experience: 10+ Years Skills | Must-Haves: .NET and C# experience Spark experience experience with large data sets PowerBI experience experience using CI/CD DevOps pipelines Job... 
    Contract work

    Syntricate Technologies

    Houston, TX
    5 days ago
  •  ...Senior Data Engineer The Senior Data Engineer designs, builds, and owns the enterprise data...  ...dashboards and supports BI developers and analysts consuming the platform. Data...  ...delivery vendors, and participates in and may lead sprint planning, grooming, and effort... 
    Work experience placement

    Fracht Group

    Houston, TX
    3 days ago
  •  ...Data Engineer Provide subject matter expertise and hands on delivery of data capture, curation and consumption pipelines on Azure. Delivery of design/architecture for transformations and modernizations of enterprise data solutions using Azure cloud data technologies... 

    Software Technology Inc

    Houston, TX
    2 days ago
  •  ...inclusive culture. NRG fosters a strong sense of belonging that leads to better collaboration and business performance. Our company...  ..., Instagram, LinkedIn and X. Position Summary: The Data Engineer is responsible for building, maintaining, and supporting data... 

    NRG Energy

    Houston, TX
    4 days ago
  •  ...development of technology solutions. - Develop and maintain data integration solutions (including ETL/ELT design and architecture...  ...model design. - Analyze requirements and apply architectural and engineering concepts to develop solutions that meet business needs while... 
    Minimum wage
    Contract work
    Temporary work
    Work experience placement

    MAXIMUS

    Houston, TX
    3 days ago
  •  ...Senior Data Engineer - (100% Remote) Fully Remote: Work from anywhere with flexible hours that fit your lifestyle. Award-Winning...  ...performance and cost-efficiency. Partner with data scientists, analysts, and business teams to ensure the reliability and... 
    Remote work
    Flexible hours

    Elios, Inc.

    Houston, TX
    2 days ago
  •  ...Senior Data Engineer Quanex is looking for a Sr. Data Engineer to join our team located in Houston, Texas. The Sr. Data Engineer...  ...resolution of data-related incidents. Partner with BI developers, analysts, and business stakeholders to deliver high-quality data... 
    Local area
    Relocation

    Quanex Building Products

    Houston, TX
    4 days ago
  •  ...depends on a trustworthy, well-governed data foundation that turns raw sensor signals,...  ...reliable, decision-ready information. The Data Engineer, within the Data & AI team, designs,...  ...Enablement & Collaboration Partner with analysts and stakeholders to deliver datasets and... 
    Full time
    Temporary work
    Work at office
    Local area
    Flexible hours

    Fervo Energy

    Houston, TX
    4 days ago
  •  ...Position: Software Engineer (Big Data) Duration: 3-6 Months CTH Location: Houston/Plano , TX This is a W2 position that requires candidates to be onsite for 2-3 days in a week (Hybrid role). Required Skills: Hadoop. Java... 
    2 days per week
    3 days per week

    TriOptus LLC

    Houston, TX
    2 days ago
  •  ...Data Engineer III Location: Houston TX (Hybrid – 3 Days/week On-Site) Job Type: Long Term Contract Need Local and Senior – 12+...  ...will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure... 
    Long term contract
    Local area
    3 days per week

    Samprasoft

    Houston, TX
    3 days ago
  • $106.9k - $176.5k

     ...working world. We are seeking a highly skilled Senior Consultant Data Engineer with expertise in cloud data engineering, specifically...  ...provide tailored solutions that meet their business objectives. Lead end-to-end data pipeline development, including data ingestion... 
    Summer holiday
    Flexible hours

    EY

    Houston, TX
    1 day ago
  •  ...Senior Data Engineer - Remote 100% Contract-Long Term--CTH Visa Independent Only Senior Data Engineer - What You Will Do: Assist in building a world-class Big Data platform which will give us power to process streams of data , as... 
    Contract work
    Remote work

    MHK TECH INC

    Houston, TX
    5 days ago
  • $110k - $160k

     ...This company is a value-based care provider that manages a number of data ingestion points for third-party API integration. Great work-life balance and remote work! Job Details Salary : $110,000 - $160,000 per year A Bit About Us This company provides services... 
    Local area
    Remote work

    Jobot

    Houston, TX
    5 days ago
  •  ...cabinets. The company is hiring dedicated data engineers to ensure its data is accessible,...  ...efficient. This role collaborates with data analysts to create data pipelines for data from...  ...interpersonal skills. ~ Experience leading data development projects. ~ Excellent... 

    Foxconn Industrial Internet - FII

    Houston, TX
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Analyst, Lead Data Engineering. Be the first to apply!