Data Architect / Data Engineering Consultant
Full-time
IT MINDS L.L.C.
Title:- Data Architect / Data Engineering Consultant
100%Onsite
Location- Irving, TX.
Required Qualifications
12-15 years in data architecture, data engineering, or enterprise architecture.
7 or more Hands-on development background.
Experience with Databricks and Snowflake.
And/or-
Strong expertise in data warehousing, Lakehouse architecture, ETL/ELT, data modeling, and event-driven integration.
Experience in regulated financial services.
We are looking for a hands-on Data Architect / Data Engineering Consultant with strong expertise in Python, PySpark, Spark optimization, distributed data processing, Hive/Impala, SQL, and production ETL troubleshooting .
The consultant will be responsible for understanding end-to-end data flows, developing and troubleshooting data pipelines, optimizing distributed processing workloads, performing SQL-based data reconciliation, and supporting production data platforms.
Key Responsibilities
- Design, develop, enhance, and troubleshoot ETL/ELT data pipelines .
- Develop and maintain data processing solutions using Python and PySpark .
- Work extensively with Apache Spark , including performance tuning and optimization.
- Analyze Spark jobs to identify performance bottlenecks related to partitions, shuffles, joins, data skew, caching, serialization, and resource utilization .
- Work with distributed data processing concepts and large-volume datasets.
- Develop complex SQL queries for data transformation, validation, reconciliation, and troubleshooting .
- Perform source-to-target reconciliation and investigate data discrepancies.
- Work with Hive and Impala for querying and processing large datasets.
- Troubleshoot production ETL failures, data quality issues, performance problems, and batch-processing failures.
- Perform root-cause analysis and implement permanent fixes for recurring production issues.
- Understand and troubleshoot end-to-end data flows , from source systems through ETL processing to downstream consumers.
- Work with Linux environments, shell commands, batch processing, and job scheduling.
- Collaborate with engineering, application, and business teams to resolve complex data issues.
- Participate in technical design discussions and provide recommendations for scalable and maintainable data solutions.
- Document technical designs, data flows, troubleshooting procedures, and production resolutions.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Data Architect / Data Engineering Consultant in Irving, TX vacancy
- ...Role: Senior AI & Data Engineering Consultant Seeking a Senior AI & Data Engineering Consultant to design and implement AI-powered Contract & Invoice Extraction solutions using Databricks, Azure OpenAI, OCR, RAG, and Agentic AI frameworks to automate intelligent...SuggestedContract workWork at office
VeeRteq Solutions Inc.
Irving, TX1 day ago - Big Data Engineer Consultant Big Data Engineers serve as the backbone of the Strategic Analytics organization, ensuring both the reliability... ...infrastructures. Big Data Engineers have the capability to architect highly scalable end-to-end pipeline using different open source...SuggestedLocal area
- Indotronix UK seeks a Senior Data Engineer with 10-12+ years of healthcare-data experience to design, build, and optimize enterprise data platforms. You will leverage Snowflake, SQL, and Medallion Architecture to create scalable pipelines and robust data solutions, driving...Suggested
- Anblicks is seeking a Data Engineering Manager to oversee the design, development, and maintenance of our data infrastructure and pipelines. You will lead a team of engineers and collaborate with analytics and product teams to deliver robust data solutions. The role emphasizes...Suggested
$125k - $140k
...Roles & Responsibilities Job Title: Data Engineer -ML Job Description: We are looking for a highly skilled and passionate Data Engineer with strong Python/PySpark experience and understanding of AL/ML models to implement AL/ML models in OnPrem...SuggestedTata Consultancy Services
Irving, TX18 hours ago- ...spark scala batch pipelines GCP, AWS - data pipelines Oozie, Airflow, Composer -... ...Description ~ Experience in data engineer, Data Analytics ~ Big Data Technologies... ...technical discussion sor review as a technical consultant for feasibility study (technical...
Omni Inclusive
Irving, TX18 hours ago - ...Data Engineer/Developer With Python And SQL Irving, TX (Onsite) Full time Key Responsibilities Design, develop, and implement... ...jobs to ensure data quality and accuracy. Collaborate with data architects, data scientists, and business analysts to understand data...Full time
Echo IT Solutions
Irving, TX2 days ago - ...Senior Data Engineer We are seeking a Senior Data Engineer to design, build, and maintain scalable data infrastructure that powers analytics, reporting, and strategic decision-making. This role focuses on developing robust data pipelines, API integrations, and governance...
Peyton Resource Group
Irving, TX3 days ago - ...Data Engineer (x3) Profile data ingestion requirements from SORs, Data Lakes or Data Warehouses Configure data pipelines using Azure Synapse Analytics or Data Bricks Configure Azure SQL or PostgreSQL tables, views, indexes, etc. Required Qualifications:...
Software Technology Inc
Irving, TX3 days ago - ...Job description : Data Engineer Location: Irving, TX 12+ Months Only W2 Python/Pyspark/sql candidate. Cloud nice... ...plus In this contingent resource assignment, you may: Consult on or participate in moderately complex initiatives and...
Zortech Solutions
Irving, TX2 days ago $72 - $92 per hour
...significantly reducing and/or eliminating the demands to travel. As a Data Engineer you will be responsible for designing developing and... ...QA testing and stakeholder communications Interface and consult with marketers analysts and cross functional partners to understand...Hourly payLive inWork at officeLocal areaFlexible hoursAccenture
Irving, TX1 day ago- ...Job Title: Sr. Data Engineer Location: Irving, TX - tue, wed, thu onsite We are seeking a Data Engineer to design, develop, and maintain data integration and transformation solutions. This role focuses on building reliable, scalable data pipelines using Databricks...
Jobs via Dice
Irving, TX2 days ago $119.8k - $234.7k
...and business growth. By uniting product, engineering, marketing, sales, customer success, and... ...that outpaces the market. MCAPS-Core Data & Applied AI (DAAI) is a centralized... ...and continuous delivery disciplines. Architect and deliver next-generation AI platforms...Ongoing contractLocal areaRemote workMicrosoft Corporation
Irving, TX2 days ago- ...Job Title Required Skills: ~10+ years of experience in solutioning data pipeline for large enterprise data warehouse applications using AWS, Data Lake, Data Ingestion, Data Transformation, Computation, Orchestration, Reporting & Data Analytics ~ Good experience...
Syntricate Technologies
Irving, TX18 hours ago - ...Job Description Insight Global is seeking a Data Engineer to support a large-scale modernization program within the Analytics & Behavioral Change organization at a major enterprise healthcare company. This is a builder role, where engineers will execute against a well...
Insight Global
Irving, TX1 day ago - ...Data Engineer – Onsite Locations: Raleigh, NC | Irving, TX | Chandler, AZ | New Jersey, NJ | Charlotte, NC | San Leandro, CA Duration: Long term Required Skills: Strong Python and/or Java development experience. Hands-on experience with Spark, Flink, streaming...
E-Solutions
Irving, TX1 day ago $120k - $130k
...Senior Engineer Job Description Must Have Technical/Functional Skills • Experience developing and supporting database solutions using... ...and optimization required. • Hands-on experience using Python for data processing, analytics, or data engineering workflows required. •...Tata Consultancy Services
Irving, TX2 days ago$125k - $140k
...Roles & Responsibilities Job Title: Data Engineer Job Description: We are seeking a highly skilled and motivated Data Engineer to play a pivotal role in designing, building, and optimizing our next-generation scalable data pipelines. This position requires...Tata Consultancy Services
Irving, TX2 days ago- ...Data Engineer (Contract)- 5 new contract openings Location : Onsite 2 days a week Irving, TX or Hartford, CT - Only... ...e.g., standard SQL for BigQuery). Collaborate with data architects and business stakeholders to define migration strategies, validate...Contract work2 days per week
3B Staffing LLC
Irving, TX3 days ago $77.4k - $135.4k
...In this role, you will design, develop, and support scalable data and database solutions that enable analytics and innovation across... ...solutions. Partner with application developers, data engineers, BI teams, and analytics partners to deliver integrated solutions...Vizient
Irving, TX1 day ago$80.42k - $106.05k
...Hybrid) About The Role ~ Stock Plan Services an equity compensation services division of client is seeking an experienced Data Migration Engineer who can help design and leads execution of complex data migration initiatives Owns key components of migration delivery and...Full timeLocal areaFlexible hoursCapgemini
Irving, TXa month ago- ...Sr Data Engineer Location Canada Toronto Requirements ~6-8 years of experience with Ab Initio in ETL projects ~ Expertise as an Ab Initio Technical Expert ~ Strong problem-solving skills: Able to analyze issues, identify root causes, and implement timely...
United IT
Irving, TX3 days ago - ...Data Solutions Engineer As a part of our Big Data Product team, the Data Solutions Engineer will be responsible for developing and validating... ...and ETL standards, collaborate with Product Managers, Architects and Senior Developers to establish the physical application...Work experience placement
Samprasoft
Irving, TX4 days ago - ...Data Engineer Location: Dallas, TX (3 days onsite/week) Duration: Contract Interview Mode: In person Interview. Must Have: ~5+ years of experience in data engineering ~ Python ~ SQL ~ Data Warehouse ~ Experience with development, operation support and data...Contract work3 days per week
Intellisoft Technologies
Irving, TX1 day ago - ...Sr. Data Engineer Opportunity At Orion180 At Orion180, we don't just stand out for what we do; we shine because of how we do it. Our mission is to deliver an exceptional insurance experience through innovative technology, unparalleled customer service, and a comprehensive...Work at office
Orion180
Irving, TX3 days ago - ...Data Engineer – Implementation Consultant We are currently onboarding North America based OPCO’ s (Operating companies) to their new digital platform (Spark) which is built on Kubernetes running in AZURE, the customer and associate experience (CX/AX) on their new SPARK...
Argyle Infotech
Irving, TX3 days ago - ...Position Title: Sr. Data Engineer (SQL / Databricks) Work Mode: Hybrid 3 days WFO (Tuesday, Wednesday and Thursday) Client Office Location: Irving, TX Interview: Face-to-Face Client Interview Job Summary We are seeking a highly skilled Senior...Work at office
VeeRteq Solutions Inc.
Irving, TX1 day ago - ...numerous opportunities to apply its repeatable playbook to grow both organically and through acquisition. We are hiring a Data Engineer to support our corporate Information Technology department which works in partnership with our portfolio companies. With our...Work experience placementWork at office
Auto Air Export, Inc.
Irving, TX24 days ago - Harnham in Addison, TX, is seeking a Senior Data Engineer to shape a new enterprise data platform. You will build a Snowflake-based environment... ...as analytics and AI initiatives mature. You’ll work with consultants and stakeholders to deliver trusted datasets for reporting...
- Capgemini is seeking a skilled professional in Dallas, Texas, to develop and maintain Terraform modules for Google Cloud Platform services. The ideal candidate will have over 3 years of experience in designing reusable modules, implementing Infrastructure-as-Code, and integrating...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Architect / Data Engineering Consultant. Be the first to apply!
Related searches
- data center architect Irving, TX
- database designer Irving, TX
- data integration architect Irving, TX
- data architect Irving, TX
- big data cloud engineer Irving, TX
- big data developer Irving, TX
- finance data engineer Irving, TX
- software data engineer Irving, TX
- hadoop big data developer Irving, TX
- data engineer machine learning Irving, TX