ADF Data Engineer
Temporary
Neshent Technologies
Experience : 8–10 years overall, with 3+ years of Azure experience.
Required Skills
- Strong hands-on experience with Azure Data Factory (ADF) — pipelines, data flows, triggers, integration runtimes, parameterization, error handling, and retries.
- Strong experience with Azure Databricks — Notebooks, Jobs/Workflows, PySpark/Scala, Delta Lake, cluster configuration, and optimization.
- Advanced Python or Scala with strong coding standards, modularization, and unit testing (pytest).
- Expert SQL — CTEs, window functions, query tuning, and large datasets.
- Experience with ADLS Gen2, Delta Lake, Parquet, partitioning, Z-Ordering, OPTIMIZE, and VACUUM.
- Experience with Git, branching strategies, and CI/CD for ADF/Databricks.
- Exposure to Infrastructure as Code (IaC) is a plus.
Roles and Responsibilities
- Coding & Development: Design, develop, and optimize ADF/Databricks data pipelines and solutions.
- UI Testing: Perform functional/UI testing, data validation, and troubleshooting.
- Stakeholder Management: Collaborate with stakeholders, understand requirements, and communicate project status/issues effectively.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the ADF Data Engineer in Houston, TX vacancy
- ...ADF Data Engineer Houston, TX, 77079 Hire Type: Contract Experience: 5 8 years in data engineering with at least 3+ years on Azure. Azure Data Factory: Pipelines, data flows (mapping/wrangling), triggers, integration runtimes, parameterization, error handling...SuggestedFull timeContract work
$103k - $170k
...mission depends on a trustworthy, well-governed data foundation that turns raw sensor signals,... ..., decision-ready information. The Data Engineer, within the Data & AI team, designs,... ...orchestration tooling (Databricks Workflows, Airflow, ADF pipelines) and dbt for...SuggestedTemporary workWork at officeLocal areaRemote workFlexible hours$95k - $150k
...work in a collaborative environment? As an experienced Senior Data Engineer you will have the ability to share new ideas and collaborate on... ...develop and optimize ETL/ELT pipelines using Azure Data Factory (ADF) and Databricks Write and tune PySpark / Spark SQL notebooks...SuggestedPermanent employment$30 - $35 per hour
Data Engineer- DatabricksLocation: Remote - CST HoursEmployment Type: Full-Time ConsultantDuration: Project Based Contract Through End of Year... ...support a modern Databricks + Snowflake + Azure Data Factory (ADF) Enterprise Data Warehouse (EDW) ecosystem, combining data...SuggestedFull timeContract workLocal areaRemote workShift work- Senior Data Engineer Location: Houston, TX Contract Length: 12+ Months Job Ref: 247245 Seeking a Senior Data Engineer to support Enterprise... ...with orchestration tools such as Airflow, Azure Data Factory (ADF), or AWS Glue Experience working with both structured and...SuggestedContract work
$95k - $110k
...part of how we work. Position Overview As part of the Data Integration & Delivery Team, the Data Engineer position will be responsible for the analysis,... ...data sets. Some ETL Tool experience; SSIS, Informatica, ADF Some experience in the Commercial and/or Specialty insurance...Temporary workWork at officeLocal areaFlexible hours- ...be recognized for your ideas. Join our team and increase your opportunities for success.We are currently seeking an experienced Data Engineer to join the Big Dat and Advanced Analytics department. The Data Engineer will work closely with business domain experts to create...
- ...Time, RegularBuild, test, and deploy highly scalable and reliable data pipelines. Create and deploy both math and machine learning... ...RequirementsMINIMUM EDUCATION: Bachelor's degree in Computer Science or Engineering or Information Technology.*MINIMUM EXPERIENCE: Two (2) years of...Full time
- ...Terminals, a port and logistics provider, and Nala Renewables, investing in wind, solar and battery storage projects.Main purposeThe Data Engineer will be responsible for building and maintaining the data integration infrastructure that underpins Trafigura's North American...Full time
$100.79k - $160.26k
...DLA Piper is a place you can engage in meaningful work and grow your career. Let’s see what we can achieve. Together.SummaryThe Data Engineer, Solutions & Data role designs, builds, and operates data pipelines and data integration processes that translate raw data into...Full timeWork at officeRemote workRelocationVisa sponsorshipRelocation package$134.5k - $265.1k
Position Summary Join our AI & Engineering team in transforming technology platforms, driving innovation, and helping make a significant... ...operate integrated/verticalized sector solutions in software, data, AI, network, and hybrid cloud infrastructure. These solutions...Local areaVisa sponsorship- ...petrochemicals; and 14 billion cubic feet of natural gas storage capacity.We are currently seeking an experienced Python Software Engineer to join the Big Data and Advanced Analytics department. The Python Software Engineer will work closely with Data Engineers and Data...
$80k - $133k
Job Family:Data Science & AnalysisTravel Required:Up to 10%Clearance Required:Ability to Obtain Public TrustWhat You Will Do:Guidehouse seeks a Senior Data Engineer to design, develop, and optimize modern data platforms, pipelines, and cloud-based analytics solutions. The...Full timeContract workFlexible hours- The Senior Data Engineer supports the planning, development and use of middleware technologies and services for integrating systems and exposing, transporting, and consuming data in a secure and reliable manner across a hybrid of applications, services and trading partners...Full timeFlexible hours
- ...containerization and streaming technologies, and Python, .NET, Node, Java and SQL to design, implement and support full life-cycle data engineering projects for current and future Summary of Operations application and other Planning applications requiring large data...Full time
$128k - $249k
...search for talented visionaries and your search for important and impactful work lead to the same place.We are seeking a Senior Data Engineer to join the firm. The Senior Data Engineer contributes to the Enterprise Applications, Data, and AI Platforms group, designing scalable...Full timeTemporary workLocal areaRemote workFlexible hoursAfternoon shift- 3 days onsite, Houston TX Senior DB2 SQL Data Engineer We are seeking a Senior DB2 SQL Data Engineer with expert-level proficiency in SQL stored procedures and deep familiarity with the DB2 IBM iSeries system (not Z/OS, not mainframe). The ideal candidate will have...Contract work
$118.7k - $218.6k
Position Summary Lead AI and Data Science Engineer II Drive the design and delivery of advanced analytics, artificial intelligence (AI), and generative artificial intelligence (GenAI) solutions that inform Talent strategy and workforce decisions. In this role, you...$128k - $252.5k
...that transform our clients' businesses. We are hiring a Senior Data Scientist to collaborate directly with clients to design and develop... ....Working with a team of interdisciplinary data scientists, engineers, architects, and consultants, our work includes novel areas...Local area- ...successfully tripled the size of our company since going public in December 2021 while maintaining a strong balance sheet. The Sr. Data Engineer- Operationsis responsible for designing, building, and operating scalable, reliable, and secure data pipelines that support...Full timeWork at officeRemote work
$116.2k - $229.1k
Position Summary Join our AI & Engineering team in transforming technology platforms, driving innovation, and helping make a significant... ...operate integrated/verticalized sector solutions in software, data, AI, network, and hybrid cloud infrastructure. These solutions...Local areaVisa sponsorship- ...Key Responsibilities: Team Leadership: Lead and mentor a team of data engineers, providing guidance and support to ensure high performance and professional growth. Project Management: Oversee the planning, execution, and delivery of data integration projects, ensuring...
TechDigital Group
Houston, TX1 day ago - ...Castleton Commodities International (CCI), we are redefining how data and technology shape the future of energy trading. Our Data... ...technology drives strategy and performance in energy markets.Our Data Engineering team is integral to our mission, ensuring the seamless...Full timeWork at officeLocal area
- ...Blue Shield of CA is seeking a Senior Data Engineer to lead the design, build, and operation of complex data pipelines and cloud data solutions across the enterprise. This hands-on technical leader will contribute to engineering best practices and drive production readiness...
Blue Shield of CA
Houston, TX4 days ago - ...Quanex is looking for a Sr. Data Engineer to join our team located in Houston, Texas. The Sr. Data Engineer is responsible for designing, building, and maintaining scalable data pipelines and architectures that support enterprise reporting, analytics, and integration...Local areaRelocation
Quanex
Houston, TX3 days ago $140k - $180k
...Sr. Data Engineer Mariana Minerals is a software-first, vertically integrated minerals company on a mission to supply the critical minerals powering modern energy, AI, and defense technologies. We're reimagining the minerals supply chain by combining deep industry expertise...Contract workImmediate startShift workMMI Textiles, Inc.
Houston, TX4 days ago- ...year legacy while eagerly embracing the future Want to be part of this? We currently have an exciting opportunity for Sr Data Engineer to join our Tailored Technology team. This individual will assist with assessing the design, development, and maintenance of...Summer workWork at officeRemote workMonday to FridayFlexible hoursWeekend work
Tailored Brands Inc
Houston, TX2 days ago - ...Senior Data Engineer - (100% Remote) Fully Remote: Work from anywhere with flexible hours that fit your lifestyle. Award-Winning Culture: Be part of a company recognized for exceptional employee satisfaction, inclusivity, and professional development. Competitive...Remote workFlexible hours
Elios, Inc.
Houston, TX3 days ago - Job Summary We are seeking a Lead Data Engineer to provide hands-on technical leadership for a strategic enterprise data migration initiative supporting an Oracle Fusion Cloud implementation. This role is responsible for solution architecture, delivery planning, technical...
$131k - $218.3k
Position Summary Our Deloitte AI & Engineering team to transform technology platforms, drive innovation, and help make a significant... ...the possible, and fulfill their mission promise. Our AI & Data offering provides a full spectrum of solutions for designing, developing...Local area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to ADF Data Engineer. Be the first to apply!
Related searches
- aws data engineer Houston, TX
- big data devops engineer Houston, TX
- big data developer Houston, TX
- software data engineer Houston, TX
- data center engineer Houston, TX
- big data cloud engineer Houston, TX
- director data engineering Houston, TX
- big data engineer Houston, TX
- senior data integration developer Houston, TX
- data developer Houston, TX