Data Architect / Data Engineering Consultant
Full-time
IT MINDS L.L.C.
Title:- Data Architect / Data Engineering Consultant
100%Onsite
Location- Irving, TX.
Required Qualifications
12-15 years in data architecture, data engineering, or enterprise architecture.
7 or more Hands-on development background.
Experience with Databricks and Snowflake.
And/or-
Strong expertise in data warehousing, Lakehouse architecture, ETL/ELT, data modeling, and event-driven integration.
Experience in regulated financial services.
We are looking for a hands-on Data Architect / Data Engineering Consultant with strong expertise in Python, PySpark, Spark optimization, distributed data processing, Hive/Impala, SQL, and production ETL troubleshooting .
The consultant will be responsible for understanding end-to-end data flows, developing and troubleshooting data pipelines, optimizing distributed processing workloads, performing SQL-based data reconciliation, and supporting production data platforms.
Key Responsibilities
- Design, develop, enhance, and troubleshoot ETL/ELT data pipelines .
- Develop and maintain data processing solutions using Python and PySpark .
- Work extensively with Apache Spark , including performance tuning and optimization.
- Analyze Spark jobs to identify performance bottlenecks related to partitions, shuffles, joins, data skew, caching, serialization, and resource utilization .
- Work with distributed data processing concepts and large-volume datasets.
- Develop complex SQL queries for data transformation, validation, reconciliation, and troubleshooting .
- Perform source-to-target reconciliation and investigate data discrepancies.
- Work with Hive and Impala for querying and processing large datasets.
- Troubleshoot production ETL failures, data quality issues, performance problems, and batch-processing failures.
- Perform root-cause analysis and implement permanent fixes for recurring production issues.
- Understand and troubleshoot end-to-end data flows , from source systems through ETL processing to downstream consumers.
- Work with Linux environments, shell commands, batch processing, and job scheduling.
- Collaborate with engineering, application, and business teams to resolve complex data issues.
- Participate in technical design discussions and provide recommendations for scalable and maintainable data solutions.
- Document technical designs, data flows, troubleshooting procedures, and production resolutions.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Data Architect / Data Engineering Consultant in Irving, TX vacancy
- ...Role: Senior AI & Data Engineering Consultant Seeking a Senior AI & Data Engineering Consultant to design and implement AI-powered Contract & Invoice Extraction solutions using Databricks, Azure OpenAI, OCR, RAG, and Agentic AI frameworks to automate intelligent...SuggestedContract workWork at office
VeeRteq Solutions Inc.
Irving, TX2 days ago $127k - $150k
Position Summary Healthcare Data Engineer Sr. Consultant Deloitte Consulting's technology professionals help clients identify and solve their most critical information and technological challenges. We provide advisory through end-to-end implementation services as...SuggestedLocal areaVisa sponsorshipDeloitte
Dallas, TX2 hours ago- ...Job Description Job Description Data/Information Architect – Consultant Duration - 12+ Months Location: Columbia, SC Duration: 12 Months+... ...Science, Information Technology, Mathematics, Engineering, or a related field. Experience developing, deploying...Suggested
Compu-Vision - IT
Dallas, TX2 days ago - Anblicks is seeking a Data Engineering Manager to oversee the design, development, and maintenance of our data infrastructure and pipelines. You will lead a team of engineers and collaborate with analytics and product teams to deliver robust data solutions. The role emphasizes...Suggested
$125k - $140k
...Description We are looking for a highly skilled and passionate Data Engineer with strong Python/PySpark experience and understanding of AL... .... Salary Salary Range: $125,000 to $140,000 per year Education BACHELOR OF COMPUTER SCIENCE #J-18808-Ljbffr Tata Consultancy ServicesSuggested$132.1k - $178.8k
Are you passionate about standardizing data platforms and automating data engineering to drive analytics and reporting? Do you excel in dynamic, fast-paced environments and find joy in converting data into actionable insights? Are you adept at implementing data governance...WorldwideFlexible hoursAmazon
Irving, TX4 days ago$46 - $51 per hour
DescriptionKforce has a client that is seeking a Data Engineer - MarTech in Irving, TX.Responsibilities:* Design, develop, and maintain scalable data solutions to support business and operational needs* Build and manage data pipelines, integrations, and workflows for efficient...KForce
Irving, TX3 days ago- Job-ID29140640Reference26-23915Remote50% RemoteData Management EEO: “Mindlance is an Equal Opportunity Employer and does not discriminate in employment on the basis of - Minority/Gender/Disability/Religion/LGBTQI/Age/Veterans.”
Mindlance
Irving, TX4 days ago $80.42k - $106.05k
...Hybrid) About The Role ~ Stock Plan Services an equity compensation services division of client is seeking an experienced Data Migration Engineer who can help design and leads execution of complex data migration initiatives Owns key components of migration delivery and...Full timeLocal areaFlexible hoursCapgemini
Irving, TXa month ago$100k - $120k
...Job Description Job Description -Title: Data Engineer -Pay Range: $100-$120K -Location: Dallas-Fort Worth, TX -Benefits: Medical, Dental, Vision, 401(k) We are looking to bring on a 3-6 year Data Engineer to our growing team. What we will need is someone...Addison Group
Irving, TXa month ago$56.19k - $87.56k
...About The Role ~ Stock Plan Services, an equity compensation services division of client, is seeking an experienced Junior Data Migration Engineer who executes data migration tasks, builds pipelines, and supports validation efforts under guidance from senior engineers...Full timeLocal areaFlexible hoursCapgemini
Irving, TXa month ago- ...numerous opportunities to apply its repeatable playbook to grow both organically and through acquisition. We are hiring a Data Engineer to support our corporate Information Technology department which works in partnership with our portfolio companies. With our...Work experience placementWork at office
Auto Air Export, Inc.
Irving, TXa month ago $90k - $110k
...Data EngineerWe are seeking a highly skilled and motivated Data Engineer to play a pivotal role in designing, building, and optimizing our next-generation scalable data pipelines. This position requires expertise in processing massive datasets using cutting-edge technologies...Tata Consultancy Services
Irving, TX4 days ago- Capgemini is seeking a skilled professional in Dallas, Texas, to develop and maintain Terraform modules for Google Cloud Platform services. The ideal candidate will have over 3 years of experience in designing reusable modules, implementing Infrastructure-as-Code, and integrating...
- Anblicks is seeking a Principle Snowflake Data Engineer to join our team in Irving, TX. The role focuses on designing and delivering end-to-end Snowflake data platforms, leveraging Azure/AWS clouds, and applying AI-driven automation to optimize development workflows. Ideal...
- Harnham in Addison, TX, is seeking a Senior Data Engineer to shape a new enterprise data platform. You will build a Snowflake-based environment... ...as analytics and AI initiatives mature. You’ll work with consultants and stakeholders to deliver trusted datasets for reporting...
- ...Job description : Data Engineer Location: Irving, TX 12+ Months Only W2 Python/Pyspark/sql candidate. Cloud nice... ...plus In this contingent resource assignment, you may: Consult on or participate in moderately complex initiatives and...
Zortech Solutions
Irving, TX3 days ago - ...Overview: Job Title : Big Data Engineer Location : Irving TX (hybrid role) (Only local candidates) Duration : 12 Months Roles... ...and ETL standards, collaborate with Product Managers, Architects and Senior Developers to establish the physical application framework...Work experience placementLocal area
Guru Schools
Irving, TX18 hours ago $72 - $92 per hour
...significantly reducing and/or eliminating the demands to travel. As a Data Engineer you will be responsible for designing developing and... ...QA testing and stakeholder communications Interface and consult with marketers analysts and cross functional partners to understand...Hourly payLive inWork at officeLocal areaFlexible hoursAccenture
Irving, TX2 days ago- ...Job Description Insight Global is seeking a Data Engineer to support a large-scale modernization program within the Analytics & Behavioral Change organization at a major enterprise healthcare company. This is a builder role, where engineers will execute against a well...
Insight Global
Irving, TX2 days ago $77.4k - $135.4k
...In this role, you will design, develop, and support scalable data and database solutions that enable analytics and innovation across... ...solutions. Partner with application developers, data engineers, BI teams, and analytics partners to deliver integrated solutions...Vizient
Irving, TX2 days ago- ...Summary: The Data Analytics Engineer will be a foundational technical contributor within ADT's Data & AI organization. This role sits at the intersection of data engineering and data analysis, responsible for designing, building, and optimizing clean, reliable, and well...Remote workHome office
RiseMe
Irving, TX1 day ago $106.4k - $203.6k
...accelerates customer outcomes and business growth. By uniting product, engineering, marketing, sales, customer success, and partners around a... ...in natural language. Every one of those layers rests on data engineering that has to be correct, fast, governed, and always...Ongoing contractContract workLocal areaMicrosoft Corporation
Irving, TX1 day ago- ...Reference26-25574In this contingent resource assignment, you may: Consult as an expert to develop or influence initiatives and resources... ...personnel. Required Qualifications: 7+ years of Business Systems Data or Business Systems Design experience, or equivalent...
Mindlance
Irving, TX4 days ago - ...Data Engineer Manager As a Data Engineer Manager, you will design and maintain data platform road maps and data structures that support... ...technical solutions. This role demands a hands-on architect who can navigate complex environments, mentor teams, and drive...Immediate start
Digitas
Irving, TX2 days ago - ...online. Job Summary We are seeking a highly skilled and experienced Principal Data Engineer to join our team. As a Principal Data Engineer, you will be responsible for architecting, designing, and implementing scalable and robust data solutions that enable...Full timeLocal area
Vistra
Irving, TX4 days ago $90k - $125k
Snowflake Data Engineer Job Description: Snowflake Data Engineer - focuses on designing, building, and optimizing cloud data warehousing... ...as AWS, Microsoft Azure, or Google Cloud Platform. Salary Range- $90,000-$125,000 a year Location: Irving, TX Tata Consultancy Services- JOB TITLE : Data Engineer III Ref. # : 4500.069 JOB LOCATION : Irving, Texas JOB DUTIES : Help clients develop and/or maintain data systems that serve their business needs. Provide recommendations for systems to meet requirements and develop project plans. Work as a...Relocation
- Job Titile: Data Engineer Work Location; Irving, Texas Duration: 8+ Months Job Description: Specific Skills Experience or knowledge of relational SQL and NoSQL databases, including Postgresand Cassandra. Strong understanding of in-memory processing and data formats...
- Role Sr Data Engineer Location Canada Toronto Requirements 6-8 years of experience with Ab Initio in ETL projects Expertise as an Ab Initio Technical Expert Strong problem-solving skills: Able to analyze issues, identify root causes, and implement timely, effective solutions...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Architect / Data Engineering Consultant. Be the first to apply!
Related searches
- senior data center engineer Irving, TX
- senior cloud data engineer Irving, TX
- senior data integration developer Irving, TX
- data developer Irving, TX
- data engineer Irving, TX
- big data cloud engineer Irving, TX
- data engineering intern summer Irving, TX
- data engineer analytics Irving, TX
- big data devops engineer Irving, TX
- junior big data engineer Irving, TX