Data Engineer with GCP and Pyspark
$55 - $60 per hourApTask
Job Description
Job Description
About Client:
The client provides information technology (IT) services, including business outsourcing, infrastructure technology, and application services. The application service offered by the company includes application development, maintenance, and support. The markets served by the company are financial services and insurance, healthcare, manufacturing, government, transportation, communications, and consumer and retail industries.
- Design, build, and harden production-grade data pipelines for ingest, curation, reconciliation, DQ monitoring, lineage, and notifications.
- Contribute to and extend the generic pipeline framework so federated teams can onboard data consistently and at speed.
- Engineer data transformations primarily using PySpark on GCP (Dataproc/Sparkflow) and BigQuery as the main query engine.
- Implement best practices for schema management, performance, reliability, and cost efficiency across large-scale datasets (Parquet, Iceberg).
- Integrate with centralized data cataloging and governance (e.g., Dataplex/Knowledge Catalog or equivalent), and support automated lineage harvesting.
- Collaborate with platform, security, and central cloud teams; support hybrid access patterns using Starburst where needed.
- Operate with an ownership mindset in an on-time, production SLAs environment, ensuring resilient, observable, and recoverable data flows.
- 3 years (L3) / 6 years (L4) hands-on data engineering in production environments.
- Strong SQL skills and proficiency building data transformations at scale.
- Practical experience with Spark (preferably PySpark) and big data file formats (Parquet; familiarity with Iceberg concepts).
- Experience delivering reliable, scheduled pipelines with monitoring, alerting, and incident response.
- Understanding of data cataloging, metadata, and lineage concepts, and why they matter for governance and reuse.
- Exposure to GCP data services (e.g., Dataproc/Spark, BigQuery). Deep infra setup knowledge is not required; collaboration with central cloud teams is expected.
- Solid software engineering practices: version control, CI/CD, testing, code reviews, and documentation.
- Experience building reusable pipeline frameworks or platform components adopted by multiple teams.
- Familiarity with Starburst/Trino for federated query across hybrid environments.
- Knowledge of data quality frameworks, reconciliation, and auditability in regulated or enterprise settings.
- Python proficiency; Java experience a plus (willingness to work primarily in Python).
- Background in operational data environments with time-bound SLAs and prod support rotations.
- Exposure to AI/ML model lifecycle platforms or MLOps concepts (platform enablement rather than model authoring).
- High ownership, bias for action, and clear communication with technical and non-technical partners.
- Comfort operating in a fast-scaling organization with evolving scope. has context menu
ApTask is a leading global provider of workforce solutions and talent acquisition services, dedicated to shaping the future of work. As an African American-owned and Veteran-owned company, ApTask offers a comprehensive suite of services, including staffing and recruitment solutions, managed services, IT consulting, and project management. With a focus on excellence, collaboration, and innovation, ApTask provides unparalleled opportunities for professional growth and development. As a member of the ApTask team, you will have the chance to connect businesses with top-tier professionals, optimize workforce performance, and drive success across diverse industries. Join us at ApTask and be part of our mission to empower organizations to thrive while fostering a diverse and inclusive work environment.
Applicants may be required to attend interviews in person or by video conference. In addition, candidates may be required to present their current state or government issued ID during each interview.
Candidate Data Collection Disclaimer:
At ApTask, we prioritize safeguarding your privacy. As part of our recruitment process, certain Personally Identifiable Information (PII) may be requested by our clients for verification and application purposes. Rest assured, we strictly adhere to confidentiality standards and comply with all relevant data protection laws. Please note that we only collect the necessary information as specified by each client and do not request sensitive details during the initial stages of recruitment.
If you have any concerns or queries about your personal information, please feel free to contact our compliance team at View email address on ziprecruiter.com.
Applicant Consent:
By submitting your application, you agree to ApTask's ( Terms of Use and Privacy Policy, and provide your consent to receive SMS and voice call communications regarding employment opportunities that match your resume and qualifications. You understand that your personal information will be used solely for recruitment purposes and that you can withdraw your consent at any time by contacting us at View phone number on ziprecruiter.com or View email address on ziprecruiter.com. Message frequency may vary. Msg & data rates may apply.
$60k - $135k
...of capabilities in consulting design engineering and operations we help clients realize... ...future-ready sustainable businesses. With over 230000 employees and business partners... ...us at . Job Description Role: Data Engineer - PySpark Location: Irving TX (3 Days onsite/...SuggestedMinimum wageFull timeLocal area3 days per week- ...Description Job Description Job Title : Senior GCP Architect – Data & AI/GenAI Platform Engineering Location: Irving, TX – Onsite Duration: 6 Months... ...: At least 15 years of total IT experience with over 5 years as Architect. Must have 7+ years of experience...Suggested
- ...their careers and expertise with KPMG. Looking ahead, we anticipate... ...seeking a Sr. Associate, Data Science Engineer to join our Consulting... ...service providers (e.g., AWS, GCP, Azure) to provide a first-in... ...hands-on expertise in Python, PySpark, SQL, Databricks, and...SuggestedH1bLocal area
- ...client in Irving, TX that is seeking a Data Engineer. Responsibilities: * Build, maintain... ...pipelines using Python, SQL, and Spark/PySpark * Integrate data from applications, operational... ..., and application workflows * Partner with technical teams to develop data...SuggestedHourly payContract work
- ...TXEmployment Type: 1099, C2C, W-2Company: SRI Tech SolutionsRole: Data Engineer - Lakehouse (PySpark / Databricks / Airflow / AWS)Location: Dallas, TX (Day 1... ..., reporting, and regulatory needs. Works extensively with PySpark on Databricks, orchestrates workflows with Apache...Suggested
- ...Data Engineer Discover your future at Citi. Working at Citi is far more than just a job. A career with us means joining a team of more than 230,000 dedicated people from around the... ...Expertise in Unix shell scripting, Python, PySpark ETL expertise on AbInitio tool (EME,...
- ...Job Title: Data Engineer Location: Irving, TX - Onsite Fulltime Job Description:... ...cutting-edge technologies like Apache Spark, PySpark, and Hive within Cloudera Platform. Your... ...Collaboration: Partner closely with data scientists, business analysts, and...Full time
- ...offers an exceptional quality of life, with affordable housing, excellent transportation... ...We are actively recruiting for a Sr. Data Engineer to join our growing team! We... ...strong scripting proficiency in Python (or PySpark). ~ Orchestration & ETL: Extensive hands...Full timeWork at office
$116.2k - $229.1k
Position Summary Data-driven organizations need modern cloud analytics solutions that... ...insight and action. As a Sr Consultant, GCP Cloud Analytics, you will help clients... ...organizations need to navigate the future with confidence, embracing decision making with...Local areaVisa sponsorship- ...Job Description Job Description Python Developer – data engineering – GCP – Working Exp with LLMs etc building custom Python applications for large-scale data building pipelines for data processing and deploying in GCP Solid foundation in Machine Learning...Work from homeFlexible hours
- ...The beginning of a new Data & AI decade that will reshape... ...into this future with a clear strategy and purpose... ...Data Architect / Data Engineering Lead who can provide... ..., Delta Lake, PySpark, SQL, and modern cloud... ...such as Azure, AWS, or GCP.Experience with data governance...Temporary workWork experience placementLive inWork at officeLocal area
- ...Change the world. Love your job. As a Data Engineering intern, you'll help build the data... ...making across the organization. You'll work with cutting-edge data technologies and cloud... ...Spark), cloud services (AWS, Azure, or GCP), or machine learning concepts through coursework...InternshipVisa sponsorship
- Overview We are looking for a Senior Data Engineer with strong 7-10 year hands-on experience in Azure and Microsoft Fabric to help modernize... ...have experience with Azure Data Factory, notebooks, Spark/PySpark, and building scalable data pipelines that support analytics...Full time
$52 - $57 per hour
...client in Irving, TX that is seeking a Data Engineer.Responsibilities:* Build, maintain, and... ...pipelines using Python, SQL, and Spark/PySpark* Integrate data from applications, operational... ..., and application workflows* Partner with technical teams to develop data interfaces...$107.12k - $160.68k
...We are seeking a highly skilled and motivated Senior Data Platform Engineer, AVP (Python/PySpark, Microsoft SSIS, SQL Server, ETL & Database Development... ...pipelines, Microsoft SSIS, and large-scale data platforms , with experience troubleshooting production data applications...Full time- ...Senior Manager, Data Engineering Apply Now ( Save Job Job ID R26_5743 Address 3200 Hackberry... ...7-Eleven is an iconic family of brands with over 86,000 locations, surpassing every... ...data platforms (Azure preferred; AWS or GCP acceptable). · Experience with data quality...Hourly pay
$125.76k - $188.64k
...: CitiCiti is looking for a Data Analytics Lead Engineer to design, build, and operate... ...Mortgage and Personal Loans with high reliability and... ...such as Hadoop, Apache Spark, PySpark, Databricks, Delta Lake, Hive... ...certification in AWS, Azure, or GCP.A proactive approach to troubleshooting...Full timeWork at officeRemote work- ...that exists in the business by analyzing the data, scale and support digital transformation... ...Develop, train and deploy ML models on GCP (Vertex AI, BigQuery ML) Build data and... ...pipelines; monitor model performance Work with data and product teams to productionize AI...
- ...We are looking for an experienced AI and Synthetic Data Engineer to develop synthetic-data pipelines and AI experiments for computer vision... ...checks, and reproducible dataset releases. Collaborate with AI, computer vision, and simulation teams to improve data quality...Full time
$116.2k - $229.1k
...Join Deloitte’s AI & Engineering practice and help organizations... ...platforms, modernize data environments, and... ...transformation. You will work with business and technology... ...Google Cloud Platform (GCP) • Experience with... ...frameworks using PySpark • 1+ year leading complex...Local areaVisa sponsorship- ...Data Engineer Loc: Remote/Hybrid- only from Raleigh, NC | Phoenix, AZ | Dallas, TX Employment... ...and disaster recovery Collaborate with data scientists, analysts, and cross-... ...RDS, SQS, SNS) Proficiency in Python, PySpark, and advanced SQL Experience with Airflow...Full timeRemote work
- ...Job Summary The Data Engineer is a hands - on technical role at the delivery core of TDIndustries' data platform build - out. This is not a support or maintenance role - it is an engineering role with direct accountability for building the data pipelines, lakehouse architecture...
$50 - $60 per hour
...DescriptionKforce has a client that is seeking a Data Engineer in Coppell, TX.Summary:We're seeking a... ...role focused on Databricks, SQL, Python/PySpark, data modeling, and medallion... ...documentation, and production support* Partner with data engineers and analysts to deliver...- ...Data Engineer Location: Remote/Hybrid- only from Raleigh, NC | Phoenix, AZ | Dallas, TX... ...leveraging Qlik Replicate, DBT Cloud, snowflake with CICD. • Hands-on experience building... ...services. • Proficiency in Python, Pyspark, advanced SQL for ingestion frameworks and...Full timeRemote work
- ...AmTrust is seeking a highly motivated and accomplished Cloud Data Engineer with expertise in Azure Databricks, Azure Synapse Analytics, SQL,... ...business intelligence. Strong technical skills in Python, PySpark, SQL, T-SQL, and Scala are required, along with experience building...Work experience placementFlexible hours
$165k - $180k
...skills and experience — talk with your recruiter to learn more.... ...excited about building modern data platforms from the ground up?... ...We’re seeking a Lead Data Engineer to help migrate a legacy, on‑... ...formats like Apache Iceberg PySpark or distributed data processing...Full time- ...unexpected. We invite you to grow your career with us, experience our caring culture, and... ...in Financial Services & Insurance Data Engineer PRIMARY PURPOSE : The Gen AI... ...services Mastery of Python, SQL, and PySpark. Deep experience with data orchestration...Full timeWork at officeLocal area
$161k - $266k
...countries and territories worldwide. Together with our customers, we’re helping build a... ...potential. Title and Summary Lead Data Engineer Overview: Mastercard’s Data Commercialization... ...Advanced proficiency with Apache Spark/PySpark, Delta Lake, SQL, and Python for large-...Full timePart timeImmediate startWorldwideFlexible hours3 days per week$60 - $70 per hour
...Company Overview: Req ID: 383020 NTT DATA strives to hire exceptional,... ...passionate individuals who want to grow with us. If you want to be part of an inclusive... ...Description: Job Title: Senior Cloud Engineer – Multi-Cloud (GCP. AWS, and Azure) Department: IT...Hourly payRemote work- ...Position Summary: Hillwood is seeking a Senior Data Engineer to join its Corporate IT team in Dallas,... ...units. This role partners closely with business stakeholders and technology... ...Abilities: Strong proficiency in SQL, Python, PySpark, and modern data engineering development...Full timeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer with GCP and Pyspark. Be the first to apply!
- data engineer analytics Irving, TX
- data science developer Irving, TX
- data engineer manager Irving, TX
- big data developer Irving, TX
- big data devops engineer Irving, TX
- data center engineer Irving, TX
- big data cloud engineer Irving, TX
- big data engineer Irving, TX
- junior big data engineer Irving, TX
- senior data center engineer Irving, TX







