Technology Lead | Energy Oil & Gas - Midstream | ETRM - Products

Company Description: IMCS Group is one of the fastest growing MWBE (Minority Woman Owned Enterprise) staffing firms in the U.S. We focus on bringing a Diversity Recruitment approach to Fortune 500 companies within North America and EMEA region contingent labor programs. IMCS Group excels in providing top talent in IT, Healthcare, Engineering, Finance, Light Industrial, Contact Center, and Clerical. We have offices in the US, Canada, Mexico, and India in which we can provide support to our clients.

Description: Job Title: Technology Lead | Energy Oil & Gas - Midstream | ETRM - Products
Work Location: Houston, TX 77079
Vendor Rate: ***/hr
Contract duration: 6months
Target Start Date: 15 Jun 2026

Job Details:

Must Have Skills
We need 1 ADF Data Engineer at Houston USA location with below JD -

Experience: 5-8 years in data engineering with at least 3+ years on Azure.
Azure Data Factory: Pipelines, data flows (mapping/wrangling), triggers, integration runtimes, parameterization, error handling & retries.
Azure Databricks: Databricks Notebooks, Jobs/Workflows, PySpark/Scala, Delta Lake, cluster configuration and optimization.
Programming: Advanced Python or Scala (at least one), strong coding standards, modularization, and unit testing (e.g., pytest).
SQL: Expert-level SQL (CTEs, window functions, query tuning), working with large datasets.
Data Storage & Formats: ADLS Gen2, Delta Lake, Parquet, partitioning, Z-Ordering, OPTIMIZE/VACUUM.
Ops & CI/CD: Git, branching strategies, CI/CD for ADF/Databricks; environment promotion; Infrastructure-as-Code exposure is a plus.

Minimum years of experience

8-10 years

Top 3 responsibilities you would expect the Subcon to shoulder and execute

Coding and Development
UI testing
Stakeholder management

Custom Fields:
Name: Intake Call Completed
Value: true

Name: Intake Call Requested
Value: true

EEOC Disclaimer: IMCS Group is an equal opportunity employer and makes employment decisions without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran status, disability status, age, or any other status protected by law. IMCS Group is committed to maintaining an inclusive workforce, where employees are hired, retained, compensated, and promoted based on their contributions to our Company.