Lead Big Data Engineer: Real-Time Pipelines & Cloud
Compunnel
Compunnel, Inc. in Plano, TX seeks a Lead Data Engineer to design and implement scalable data platforms across the enterprise. You will build data pipelines, data models, and governance practices while delivering measurable improvements to developer productivity and data quality. You will lead cross‑functional teams, work with Snowflake, Databricks, Redshift and cloud platforms, and mentor engineers to raise the bar on performance, reliability, and data-driven decision making. #J-18808-Ljbffr Compunnel
- Capital One is seeking a Senior Lead Data Engineer to drive real-time data platforms and streaming pipelines in a cloud environment. You will lead a team of engineers building scalable data pipelines using Spark, Flink, Kafka, Snowflake and Redshift while ensuring best...PipelineCloud
- Capital One seeks a Senior Lead Data Engineer in Plano, TX to design and implement... ...data platforms, drive real-time insights, and lead a team of engineers across big data technologies. You will work... ...to deliver secure, resilient cloud-based data solutions. #J-1880...Cloud
- Capital One is seeking a Senior Lead Data Engineer to lead the design and build of an enterprise-level... ...a team using Flink, Spark, Kafka and cloud data warehouses like Snowflake/Redshift,... ...in application development, 2+ years in big data, and 1 year in cloud computing (AWS...Cloud
- The Lead Data Engineer will be responsible for designing, developing, testing, implementing... ...will focus on building data pipelines, data movement solutions, data... ...expertise in Python, SQL, cloud technologies, distributed computing, real-time data processing, data...PipelineCloud
$209k - $238.5k
...reliable analytics pipelines. This onsite Senior Lead Data Engineering position in Plano,... ...tolerant to deliver timely insights Develop next... ...datasets using big data technologies such... ...NoSQL systems and cloud data warehousing services... ...working on real-time data and streaming...PipelineCloudInternship$209k - $238.5k
...Senior Lead Data Engineer Do you love building and pioneering... ...'ll be part of a big group of makers,... ..., who solve real problems and meet... ...provides meaningful and timely insights Build the... ...Streaming Data Pipelines and Analytics Data... ...NoSQL databases and Cloud based data...PipelineCloudFull timePart timeInternshipLocal area- Public Storage is seeking a data engineer to advance its data platform and models, spanning batch and streaming pipelines on GCP. You will optimize data flows... ...experience, and hands-on work with real-time data systems, graph data, and cloud-native tools to drive scalable...PipelineCloud
- ...Data Engineering LeadLead end-to-end delivery of large... ...high-quality and timely outcomes. Architect... ...scalable, cloud-native data platforms... ...and streaming data pipelines with strong emphasis... ...operational efficiency. Lead implementation of... ...-on experience in Big Data and Data...PipelineCloud
- ...Lead Data EngineerLocations: Richmond - VA / McLean - VA... ...deployment of scalable data engineering solutions that deliver... ...design and implement data pipelines and workflows.Ensure the smooth integration and real-time processing of data using cloud technologies like AWS....PipelineCloudWork at office
$140k - $170k
We are seeking a Lead Data Engineer to lead our Data Architecture and Data... ...automate best-of-breed data pipelines using platforms such as Snowflake... ...Experience with AWS cloud platform Deep understanding... ...pipelines, warehousing, and real-time data streaming Proven leadership...PipelineCloudFull time- ...Technology Senior Management Forum in Plano, TX is seeking a Senior Lead Data Engineer to build enterprise-grade streaming platforms onsite. You... ...partners, delivering scalable, low-latency analytics pipelines. You will work with Java, Scala, Python, and Spark/Flink, while...Pipeline
- ...' experience.Experience with big data frameworks (i.e. Hadoop and Spark... ...building automated data pipelines, 5+ years of experience.Experience... ....Experience with Google Cloud Platform.Experience with GCP... ...Data Factory)Experience with real-time and streaming technology (i.e...PipelineCloud
- .../ Yearly (Full Time)Employment Type:... ...SolutionsRole:GCP data EngineerLocation... ...motivated Data Engineer to join our team... ...completion in a dynamic cloud environment.Core... ...development.Pipeline Development:... ...Implement and support Big Data solutions... ...(scheduled) and real-time/...PipelineCloudFull time
$179.4k - $204.7k
...Lead Data EngineerDo you love building and pioneering... ...'ll be part of a big group of makers,... ...disruptors, who solve real problems and meet... ...are seeking Data Engineers who are passionate... ...NoSQL databases and Cloud based data warehousing... ...working on real-time data and streaming...CloudFull timePart timeInternshipH1bLocal area- ...Consultancy Services is seeking a Senior Big Data Engineer with 10-13 years of hands‑on experience... ..., optimize, and govern end‑to‑end data pipelines across on‑prem and cloud environments. Responsibilities include building real‑time ingestion, optimizing Delta Lake, and...PipelineCloud
- ...opportunities with real growth potential... ...highly skilled Senior Data Engineer to design, build,... ...-grade data pipelines using Azure technologies... ...batch and real-time data processingEnable... ...(or equivalent cloud certifications) are... ...data processing and big data...PipelineCloudHourly payDaily paidContract work
$70 - $75 per hour
...SolutionsRole: GCP data ArchitectLocation:... ...motivated Data Engineer to join our team.... ...completion in a dynamic cloud environment.Core... ...model development.Pipeline Development:... ...Implement and support Big Data solutions for... ...batch (scheduled) and real-time/streaminganalytics...PipelineCloudHourly pay- Apptad Inc. is seeking a Senior Data Engineer to join the Data & Intelligence team supporting... ..., Python, and Azure. You will lead data engineering, real-time processing, data quality, and... ...architecture and production-readiness across pipelines, security, and cost optimization...Pipeline
- ...Lead Software Engineer We have an opportunity to impact your... ...Infrastructure Platforms - Data and Specialty... .../data transformation pipelines to production. They will... ...optimize Spark-based batch/real-time workflows and data... ...(HBase/Cassandra), cloud data tooling (Azure/AWS...PipelineCloud
- ...Senior Software Engineer - Python Developer... ...building large-scale, cloud-based big data and MLOps... ...and APIs to access timely, accurate, and relevant... ...-efficient ML pipelines using Python, AWS... ...ECS/Fargate). Lead technical design... ...of APIs, Real-Time Systems, and...PipelineCloudFlexible hours
$50 - $55 per hour
...in Business Intelligence and Data warehousing • Experience handling... ...Kafka, message queues, and real-time stateful services. •... ...Have: • Knowledge of CI/CD pipelines for data engineering projects. • Experience with cloud-based big data platforms • AWS S3/Athena...PipelineCloud- ...what's possible.As a Lead Software Engineer at JPMorganChase within... ...Platforms - Data and Speciaity Services... .../data transformation pipelines to production. They will... ...optimize Spark-based batch/real-time workflows and data... ...stores (HBase/Cassandra), cloud data tooling (Azure/...PipelineCloudWork at office
$193.4k - $220.7k
Lead Data Engineer (Python, PySpark, DynamoDB) (Enterprise Platforms... ..., you'll be part of a big group of makers,... ...disruptors, who solve real problems and meet real... ...community Collaborate with cloud enablement product manager... ...working on real-time data and streaming applications...CloudFull timePart timeInternshipH1b- ...with talented engineers and data scientists. You... ...platform that drives real business... ...excellence.As a Lead Software Engineer... ...across multi-cloud environments (AWS... ...accountsDesign pipelines to ingest,... ...reducing Mean Time to Resolution (... ...Service Management.Big Data Pipelines:...PipelineCloud
$179.4k - $204.7k
Lead Data Engineer (Java, Python, AWS) - Do you love building and... ...One, you’ll be part of a big group of makers,... ...and disruptors who solve real problems and meet real... ...and NoSQL databases and cloud‑based data warehousing... ...experience working on real‑time data and streaming applications...CloudInternshipLocal area- ...Have Skills: Data Bricks Admin Azure... ...an experienced Cloud Platform... ...Architect and optimize big data pipelines using Apache Spark... ...advisor to data engineering and analytics teams... ...enterprise goals. Lead proof-of-concept... ...Databricks, real time data ingestion, data...PipelineCloudContract work
- Kyndryl is seeking an AI Data Engineer to architect high-performance data infrastructure for autonomous systems. You will design real-time pipelines for agentic AI, transforming vast IT logs into optimized vector embeddings, and ensure fast retrieval for reasoning loops...Pipeline
$158.6k - $181k
...you'll be part of a big group of makers,... ...disruptors, who solve real problems and meet... .... We are seeking Data Engineers who are passionate... ...our data pipeline architecture. In this... ...expertise in Python and cloud-based data... ...provides meaningful and timely insights. Build the...PipelineCloudFull timePart timeInternshipH1bLocal area$61k - $101k
...certification in software engineering concepts, plus at... ...-latency, scalable data operations and supporting real-time lookups, updates,... ...scalable ETL pipelines for structured and... ...demonstrated experience leading the use of approved... ..., and cloud architecture using...PipelineCloudWork at office$110k - $130k
Job Description Senior Big Data Engineer with 10-13 years of experience specializing in... ...Silver/Gold Data Modeling Big Data ETL Pipeline Development SQL Real‑time Data Ingestion Frameworks Data... ..., Bitbucket Workflow Orchestration Cloud & On‑Prem Big Data Platforms Mandatory...PipelineCloud
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Big Data Engineer: Real-Time Pipelines & Cloud. Be the first to apply!
- senior cloud data engineer Plano, TX
- principal cloud engineer Plano, TX
- senior principal cloud computing engineer Plano, TX
- senior devops cloud engineer Plano, TX
- senior cloud network engineer Plano, TX
- aws cloud infrastructure engineer Plano, TX
- remote cloud architect Plano, TX
- cloud developer Plano, TX
- cloud engineer Plano, TX
- senior cloud security engineer Plano, TX


