Data Engineer
Cloud BC Labs
Position Data Engineer Location Dallas, TX / Pittsburgh, PA / Cleveland, OH (Onsite) Term C2C/W2 role Duration Long Term Job Description Data Engineer with 5+ years of experience in designing, developing, and maintaining scalable data pipelines supporting analytics, reporting, and operational platforms. The ideal candidate will have strong expertise in Spark, PySpark, Airflow, SQL, Data Lakes, and large-scale batch processing environments. Responsibilities Design and build scalable data pipelines aligned with business requirements. Process large datasets using batch and near real-time processing frameworks. Ensure data quality, consistency, governance, and reliability across systems. Support data integration and transformation initiatives for analytics and reporting platforms. Maintain metadata repositories, data dictionaries, and technical documentation. Participate in data architecture reviews and data model validation activities. Support analytics, reporting, and risk management platforms. Collaborate with cross-functional teams to align enterprise data solutions with business objectives. Required Qualifications 5+ years of experience in Data Engineering and Big Data processing. Strong expertise in: Apache Spark (Spark Core, Spark SQL) PySpark Large-scale batch processing Experience working with structured and semi-structured data, complex transformations, and performance tuning. Hands‑on experience with data ingestion and integration from: Oracle SQL Server Hive HDFS Amazon S3 Experience building and maintaining curated data models. Experience writing data to: Hive Tables Data Lakes (Iceberg) Downstream reporting systems Strong SQL and data modeling skills. Hands‑on experience with Apache Airflow: DAG Development Scheduling Monitoring Workflow Orchestration Proficiency in Shell Scripting: Job Automation File Validation Dependency Management Logging & Error Handling Spark Job Execution Data Archival & Purging Strong understanding of batch processing and scheduling frameworks. Experience migrating job schedules from: CA7 Control‑M Airflow Experience implementing CI/CD for data pipelines. Experience ensuring data quality, reliability, governance, and compliance in regulated environments. Strong communication and documentation skills. Preferred Skills Banking / Financial Services Domain Risk Reporting Platforms Data Governance Enterprise Data Architecture Near Real-Time Data Processing Key Technologies Apache Spark | Spark SQL | PySpark | Apache Airflow | SQL | Hive | HDFS | S3 | Iceberg | Oracle | SQL Server | Shell Scripting | ETL | Data Pipelines | Data Modeling | Control-M | CA7 | CI/CD #J-18808-Ljbffr Cloud BC Labs
$157k - $184.4k
...want to hear from you. What We Need: Multiple Positions Available COMPANY: McKesson Corporation POSITION: Senior Data Engineer LOCATION: 6555 State Highway 161, Irving, TX 75039 JOB DUTIES: Design and implement scalable and efficient data pipelines...SuggestedRemote workMCKESSON
Irving, TX6 hours ago- Lead Data Engineer page is loaded## Lead Data Engineerlocations: Dallas, TXtime type: Full timeposted on: Posted Todayjob requisition id: R13159**The Company**NorthMark Compute & Cloud (NMC[2]) is backed by dedicated leadership and investment, with a clear mission as it...SuggestedTemporary workFlexible hours
- We’re looking for a Lead Data Engineer to help design, build, and scale a modern enterprise data platform on AWS. This is a hands‑on role for someone who enjoys solving complex data problems, building high‑performance pipelines, and shaping how data is used across an organization...Suggested
- ...Jenkins Understanding containerization and performance tuning in Data Pipelines 3+ years experience in development using Python,... ...Ability to change and adapt quickly, mentoring and leading other engineers from a technical capacity Solution Architecting experience Excellent...Suggested
- Humana Inc is seeking a Lead Data Engineer in Dallas, Texas to drive the modernization and optimization of its Medicaid data platform. This role is key in owning the Data Warehouse and improving data access and security as part of the Market BI team. The ideal candidate...Suggested
- A leading investment firm in Dallas, TX is seeking a Lead Data Engineer to advance big data engineering and analytics capabilities. The role involves designing scalable data platforms, implementing data mesh architecture, and ensuring data quality. Candidates should have...
- HumCap's client is looking for an Analytics / Reporting Engineer to join the Enterprise Reporting team. You'll build and maintain the data pipelines, dashboards, and reporting infrastructure that drive decision-making across the business. This is a hands‑on role — you'...Temporary work
- I'm currently supporting a hospitality organization that is investing heavily in its modern data platform and looking to hire a Cloud Data Engineer to help drive that transformation. This is a hands‑on engineering role focused on building and optimizing cloud‑based data...Work at office
- 9+year of experience in data engineering, machine learning, or AI deployment. Proficiency with Palantir Foundry (pipelines, code workbooks, ontology modeling). Strong programming skills in Python, Scala, or Java; experience with Spark and cloud platforms. Hands-on experience...
- Data Engineers design and build data pipelines to collect, process, and store data. They ensure data availability and quality. Key skills include data warehousing, ETL processes, and programming. Build and maintain robust ETL pipelines for efficient data ingestion, transformation...
- ...A great place to work. Current job opportunities are posted here as they become available. We’re looking for an experienced Data Engineer to help design, build, and optimize modern data pipelines that power analytics, BI, and machine learning across NEP Group. In this...Remote workFlexible hours
- ...testimonials. Role Description Freight brokers put an incredible amount of trust in Highway and that trust will be extended to you. The Data Engineer will be responsible for scaling Highway’s platform in AWS using the best DevOps practices. This role reports directly to the...
$110k - $125k
...standards for technical and domain expertise, we deliver innovative and strategic solutions in Strategy, Analytics, Digital Engineering, Cloud, Data & AI, Experience Design, and Marketing. Our Co-Innovation methodology is a unique engagement model designed to align...Local areaWorldwideWork visa- InterEx Group is seeking a Data Engineer to support modernization projects for a large retail client in Dallas, TX. The role requires strong experience with Dataiku and collaboration with analytics and AI teams. This onsite position offers flexibility with contract or contract...Contract work
$115k - $130k
As a Data Engineer, you will be part of a talented team of engineers responsible for the deployment and configuration of cloud resources to meet individual client business needs in AWS. Client engagements cover a wide variety of business requirements and require our engineers...$90k - $150k
Job Overview The Data Engineer is responsible for designing, building, and maintaining data pipelines and integrations that power GEI’s AI solutions and digital initiatives. This role focuses on ensuring enterprise data is accessible, reliable, and governed so that AI capabilities...- Job Title : ETL/ELT Data Engineer Responsibilities Analyze and build ETL data assets using IBM Datastage, Informatica, dbt and on‑premises databases such as Netezza or cloud data warehouses such as AWS S3 and Snowflake. Build ELT transformations using dbt and Python....Permanent employmentContract workLocal area
- Data Engineer - Dataiku | Onsite Dallas, TX Overview Working with a large enterprise retail client currently investing heavily across data, analytics and AI transformation initiatives. They’re looking for a Data Engineer with strong Dataiku experience to support ongoing...Contract work
$114.75k - $135k
Job Title Data Engineer Job Description Summary Key Objectives: Supports the development, optimization, and maintenance of Cushman & Wakefield’s commercial real estate (CRE) forecasting infrastructure across the Americas. This role is focused on engineering robust data...Minimum wageFlexible hours- Hybrid Every Other Week onsite in Westlake, TX Our client seeks a Data Engineer to join the Enterprise Data organization and collaborate with global engineers on cloud-native data solutions. You will design and deliver data platforms and pipelines using Airflow, Spark,...
- Job Description Insight Global is looking for a Data Engineer to join one of our largest financial clients in Bangalore or Hyderabad. This person will be joining their Enterprise Technology Operations group supporting a critical firm‑wide initiative focused on modernizing...
- Hybrid Every Other Week onsite in Westlake, TX Our client seeks a Data Engineer to build a modern data platform using Apache Iceberg on AWS with Spark, Kafka, and Python. The role emphasizes scalable data pipelines, distributed processing, and lakehouse best practices...Hourly pay
$80.5k - $157.5k
We are looking for a Senior Data & Platform Engineer. Candidates will design and operate data pipelines that connect heterogeneous source systems, normalize data into consumption‑ready models in Snowflake, and build AI‑powered agents that surface intelligence across the...Local area- Job Overview The Data Engineer designs, builds, and supports the data pipelines, integrations, and curated datasets that power analytics, reporting, and AI initiatives for PBK’s Architecture vertical and broader AEC operations. This role owns integrations across enterprise...Remote work
- ...specialists and provides care teams that guide patients through the healthcare journey. Position Overview Lantern is looking for a Data Engineer II to join our Data Engineering team. The ideal candidate will have solid experience building data pipelines, working with batch...Temporary workWork at office3 days per week
- ...statistics, and plan diagrams for troubleshooting and optimization. Data Integration & Pipeline Development Develop and manage data... ...Build multi‑agent systems for advanced search and recommendation engines. Use frameworks like LangChain or LangGraph for orchestrating...Work at office
- JOB SUMMARY We are seeking a highly motivated Engineer to join our Datastore Migration Factory team. This critical and high-visibility project involves the end-to-end migration of our on-premise Data Lake to an AWS-hosted Lakehouse. The Engineer will play a crucial role...Local area
$114.75k - $135k
Cushman & Wakefield is seeking a Data Engineer in Dallas, Texas to enhance their commercial real estate forecasting infrastructure. The role involves engineering robust data pipelines, automating workflows, and ensuring data integrity. Candidates should have a degree in...- Blutic is seeking a skilled Data Engineer with 5+ years of experience with strong hands‑on experience in pipeline migration, consumption pattern migration, data reconciliation, and quality validation. The ideal candidate should have practical experience working with Snowflake...Full time
- ...authorized to work in the United States on a full-time basis. Role Summary Loopback Health is seeking an innovative and team-oriented Data Engineer to join our team. In this role, you will be responsible for designing, building, and maintaining scalable data pipelines and...Full timeVisa sponsorshipWork visa
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
- remote data engineer Dallas, TX
- entry level big data engineer Dallas, TX
- big data devops engineer Dallas, TX
- data engineer Dallas, TX
- data engineer contract Dallas, TX
- software data engineer Dallas, TX
- big data cloud engineer Dallas, TX
- junior big data engineer Dallas, TX
- sr information security engineer Dallas, TX
- director data engineering Dallas, TX