GCP Big Data Engineer: Real-Time Pipelines & Java APIs
TechDigital Group
A leading company is seeking a highly skilled Engineer with expertise in building GCP-based data pipelines and REST APIs. The role involves designing and optimizing data solutions while collaborating with various stakeholders to enhance data-driven initiatives. Candidates should possess strong problem-solving abilities and a collaborative mindset, with proficiency in GCP tools and programming languages. #J-18808-Ljbffr TechDigital Group
- ...Limited is seeking a skilled data engineer in the United States,... ...'ll build and optimize data pipelines and infrastructures to enhance... ...role will involve developing APIs, real-time data processing, and upholding... ...and significant expertise in GCP technologies. This role offers...PipelineRemote workFlexible hours
- The New York Times is seeking a Senior Data Engineer in New York City to contribute to the Customer-Facing Data Products team. This role involves developing real-time data pipelines and APIs that serve customer needs. The ideal candidate has over 5 years of experience in...Pipeline
- Apex Systems is hiring a Data Engineer for a fully remote position anywhere... ...and operationalizing data pipelines to support advanced analytics... ...experience, specifically with SQL, Big Data processing, and... ...programming languages such as C#, Java, or Python. #J-18808-Ljbffr...PipelineJavaBig dataRemote job
- ...seeking experienced Data Engineers to design,... ...large-scale data pipelines (Azure, AWS, GCP) Develop data ingestion... ...scalable APIs and ensure system... ...performance. Manage big data infrastructure... ...Proficiency in Go, Java, Python, or Scala... ...solutions and real-time data processing....PipelineJavaBig data
$225k - $275k
...experienced AI Data Engineer to join our... ...maintaining robust data pipelines that power... ...high-quality, timely, and relevant... ...third-party APIs. Implement real-time and batch... ...(e.g. Java, Scala, Go, Rust... ...or similar Big Data Technologies... ...or equivalent GCP services Databases...PipelineJavaBig data$170k - $240k
...Google Cloud Data Engineer with a strong... ...independently, ensuring timely delivery and... ...pipelines leveraging Google... ...pipelines on GCP. Perform data... ...(Python or Java) handling windowing... ...teams (real‑time threat monitoring... ...in Big Data environments... ..., and API design and usage...PipelineJavaBig dataPermanent employmentFull timeRemote work2 days per week3 days per week$60k - $80k
...yr Full Stack Java Developer |... ...Employment Type: Full-time (Contract or... ...places elite engineering talent into... ...cloud, data, and software... ...scalable data pipelines , robust data... ...support batch and real-time... ..., or similar big data technologies... ...platforms like AWS , GCP , or Azure...PipelineJavaBig dataFull timeContract workRemote work- ...looking to hire a Data Engineer to be a part of our... ..., including real time business metrics and... ...our core backend API team. The individual... ...systems to handle the big data ecosystem... ...utilize the data pipeline to provide actionable... ...languages such as Python, Java or equivalent 5+...PipelineJavaBig dataFlexible hours
- ...Overview Role: Data Engineer + Gen AI Location: NYC... ...data governance, real-time analytics, and enterprise... ...PySpark + Data Pipeline Orchestration Tool... ...Kubernetes, Fast API Responsibilities... ...services (Big Query, Dataflow, Dataproc... ...expertise in coding in Java/Python/Scala. 3+...PipelineJavaBig dataWorldwide
$130k - $196.5k
...LiveRamp is a data collaboration platform... ...processing pipelines using Spark,... ...Airflow, and related big‑data... ...both batch and real‑time use cases. Lead... ...documents. Champion engineering best practices... ...in Python, Go, Java, or Scala. 3+ years... ...such as AWS, GCP, Azure, or similar...PipelineJavaBig dataWork from homeFlexible hours$130k - $196.5k
LiveRamp is looking for a seasoned data engineering professional to design and... ...scalable data processing pipelines. You'll lead collaborations with... ...and drive the overall Big Data infrastructure strategy.... ...matching plan and flexible paid time off. #J-18808-Ljbffr LiveRampPipelineBig dataFlexible hours- ...the foundational data infrastructure that... ...exchanges. As a Big Data Platform Engineer, you will design,... ...ship reliable pipelines. You will be at the... ...across batch and real-time pipelines AI Integration... ...with platform APIs Build the... ...engineering skills in Java, Scala, or Python...PipelineJavaBig dataWork experience placement
- ...insurance and risk engineering services;... ...experienced lead data engineer to join... ...scalable data pipelines, and ensuring the... ...to developing APIs, front-end... ...of databases, real-time integration patterns... ...technologies (Python, Java, Scala) & Front... ...working with Big Data tools and...PipelineJavaBig dataWork experience placementLocal area
$150k - $180k
...seeking a Senior Data Engineer with specialized expertise... ...that enable real-time data processing... ...robust data streaming pipelines that transform and... ...in Python, Java, and Scala for streaming... ...management Big Data Technologies:... ...Understanding of data APIs, REST services, and...PipelineJavaBig dataTemporary workWork at officeImmediate start$112.29k - $161.28k
...Director, Data Engineering PHM is the leading health... ...and develop big data solutions built... ...strategy, managing data pipelines, and ensuring the... ...data, real time, on-demand, batch... ...large data sets Java, C# or R experience... ...Experience with REST API calls Experience...PipelineJavaBig dataTemporary workFreelanceFlexible hours$130k - $196.5k
...LiveRamp is the data collaboration... ...data processing pipelines using Spark, Airflow... ..., and related big data... ...both batch and real-time use cases. Lead... ...documents. Champion engineering best practices... ...- Python, Go, Java or Scala. ~3... ...such as AWS, GCP, Azure or similar...PipelineJavaBig dataWork from homeFlexible hoursNight shift$99k - $232k
...Competency: Data, Analytics &... ...Applicable Time Type: Full time... ...analytics engineering focus on leveraging... ...data pipelines, data integration... ...Architect, GCP Data Engineer... ...across batch and real-time data... ...such as Python, Java, or Scala -... ...with big data technologies...PipelineJavaBig dataFull timeH1b$120k - $150k
...| Microsoft Fabric & Data Are you ready to lead... ...looking for a Senior GCP Data Engineer to support a major Azure... ...and optimize GCP data pipelines Work with BigQuery, Dataflow... ...Implement streaming / real-time solutions (Pub/Sub,... ...in Python or Java Experience with ETL /...PipelineJavaFull time- ...We are seeking a Data Engineer to build and maintain scalable data... ...performance across batch and real-time processing systems. Key... ...Build and maintain ETL/ELT pipelines for batch and streaming... ...skills in Python, Scala, or Java Experience with big data tools and workflow orchestration...PipelineJavaBig data
- ...maintain ETL/ELT pipelines to collect and transform... ...and optimize data architectures and... ...failures. Integrate APIs and third-party... ..., Scala , or Java . Hands-on experience... ...Experience with big data frameworks... ...Factory, Synapse) , or GCP (BigQuery, Dataflow...PipelineJavaBig data
- ...Job Summary This Senior Data Engineer will be part of the... ...organization using Python, Java, Kafka and other big data solutions,... ...ensure the accurate and timely execution of business processes... ...maintain scalable data pipelines and build out new API integrations to support...PipelineJavaBig dataRemote work
$77 - $82 per hour
...for an experienced Data Engineer Responsibilities:... ...and maintain data pipelines using PySpark. Collaborate... ...proficiency in Java application... .... Experience with Big Data ecosystems, including... ...in RESTful API development and integration... .... Experience in real‑time data streaming and...PipelineJavaBig dataContract workImmediate start$180k
...motivated Senior Data Engineer to join our dynamic... ...in Ohio. This full-time position offers an... ...and pipelines. You will work closely... ...about leveraging big data technologies... ...languages such as Python, Java, or Scala. Extensive... .... Experience with real-time data processing...PipelineJavaBig dataFull time- ...experienced Senior Data Engineer to join our growing... ...optimizing our data pipeline architecture to... ...strong background in big data technologies,... ...services (e.g., AWS, GCP, Azure). Develop and... ...g., Python, Scala, Java). Deep expertise... ...such as generous paid time off, company-...PipelineJavaBig dataRemote work
$80.5k - $157.5k
...Job Title: Data Engineer (Ab Initio, OzoneCH, Flink) Location... ..., event-driven data pipelines, ensuring low-latency... ...downstream databases in near-real-time. Key Responsibilities... ...and compliance across big data platforms.... ...Teradata). Experience in Java , Scala, Python or...PipelineJavaBig dataWork at office$175.07k - $325.13k
Warner Media, LLC. is seeking a Senior Staff Data Engineer in New York, NY. The role involves designing and delivering data pipelines that process billions of ad events daily... ...tech systems, and act as a domain expert in big data engineering, mentoring junior engineers...PipelineBig data- Texture is seeking a skilled Data Engineer in New York to design and optimize data pipelines for a revolutionary approach in the energy sector. You will ensure data... ...availability for analysis, working with a variety of big data technologies. The ideal candidate has at...PipelineBig data
$140k - $200k
...digital assets and data center... ...is hiring two Data Engineers – one Associate (3... ...an expert on data pipelining and big data processing frameworks... ...technologies (Python, Go, Java) and have a... ...building data pipelines, APIs, and reporting... ...Flexible Time Off (paid) 3% 401(...PipelineJavaBig dataWork at officeLocal areaFlexible hours- NLM It Solutions is seeking a Data Engineer in the United States to build and manage real-time and batch data pipelines. This role demands expertise in SAP BODS, Striim, BigQuery, and GCP Composer to design and implement efficient ETL processes and optimize SQL performance...PipelineFull time
$75k - $90k
...Mets are seeking a Data Engineer for its Data... ...frequencies, including real‑time in‑game data. Onboard... ...environments; GCP or Azure required.... ...data from FTP and API sources. Experience... ...data structures and pipelines in the cloud,... ...solutions. Knowledge of big‑data frameworks,...PipelineBig dataFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to GCP Big Data Engineer: Real-Time Pipelines & Java APIs. Be the first to apply!
- remote data engineer New York, NY
- data engineer intern New York, NY
- entry level big data engineer New York, NY
- big data devops engineer New York, NY
- entry level data engineer New York, NY
- data engineer New York, NY
- data engineer contract New York, NY
- software data engineer New York, NY
- data engineer graduate New York, NY
- data intelligence engineer New York, NY

