GCP Big Data Engineer: Real-Time Pipelines & Java APIs
TechDigital Group
A leading company is seeking a highly skilled Engineer with expertise in building GCP-based data pipelines and REST APIs. The role involves designing and optimizing data solutions while collaborating with various stakeholders to enhance data-driven initiatives. Candidates should possess strong problem-solving abilities and a collaborative mindset, with proficiency in GCP tools and programming languages. #J-18808-Ljbffr TechDigital Group
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the GCP Big Data Engineer: Real-Time Pipelines & Java APIs in New York, NY vacancy
- ...Limited is seeking a skilled data engineer in the United States,... ...'ll build and optimize data pipelines and infrastructures to enhance... ...role will involve developing APIs, real-time data processing, and upholding... ...and significant expertise in GCP technologies. This role offers...PipelineRemote workFlexible hours
- ...Engineer II – Big Data, GCP with Java SpringBoot Location – NYC, NY (3 days onsite) Highly skilled engineer with a solid experience of building Bigdata, GCP Cloud based real time data pipelines and REST APIs with Java frameworks. The engineer will play a crucial...PipelineJavaBig data
$148.7k - $199.4k
...Walt Disney Company (France) is hiring a Software Engineer in New York to develop and support real-time data systems and APIs used across ABC News and Disney platforms. This... ...development experience, particularly in Java/Spring Boot. The hiring range is $148,700 - $19...Java- The New York Times is seeking a Senior Data Engineer in New York City to contribute to the Customer-Facing Data Products team. This role involves developing real-time data pipelines and APIs that serve customer needs. The ideal candidate has over 5 years of experience in...Pipeline
- ...seeking experienced Data Engineers to design,... ...large-scale data pipelines (Azure, AWS, GCP) Develop data ingestion... ...scalable APIs and ensure system... ...performance. Manage big data infrastructure... ...Proficiency in Go, Java, Python, or Scala... ...solutions and real-time data processing....PipelineJavaBig data
- A leading performance marketing engine in New York is seeking a Senior Data Engineer to contribute to the development of Micro Batch/Real Time streaming pipelines. This role involves working closely... ...Science and experience with big data tools like Bigtable and Apache...PipelineBig data
- ...A data analytics company is seeking a Senior Data Engineer to design and build high-performance real-time data platforms for analytics and operational intelligence... ...work on streaming data pipelines and distributed systems... ..., and proficiency in Java and Python. This position...PipelineJavaFull timeRemote work
- ...Role: GCP Consultant Location... ...: Big Query - Warehouse/ data marts -... ...frameworks using Java for both batch... ...needs. c - Real-time streaming of... ...production-level data pipelines using Kafka;... ...SQL, Compute Engine, Cloud... ...connecting to on-prem API from google...PipelineJavaBig dataRemote workFlexible hours
- ...seeking a Senior Event Streaming Engineer to support a Fortune 100 client in their enterprise data transformation. The role focuses on designing scalable, real-time data pipelines using Apache Kafka and... ...skills in SQL and either Python, Java, or Scala. This position...PipelineJava
$225k - $275k
...AI Data Engineer New York, New York, United... ...robust data pipelines that power... ...high-quality, timely, and relevant... ...and third-party APIs. Implement real-time and batch... ...language (e.g. Java, Scala, Go, Rust... ...or similar Big Data... ...or equivalent GCP services Databases...PipelineJavaBig data$170k - $240k
...Google Cloud Data Engineer with a strong... ...independently, ensuring timely delivery and... ...pipelines leveraging Google... ...pipelines on GCP. Perform... ...pipelines (Python or Java) handling... ...teams (real‑time threat monitoring... ...in Big Data environments... ...frameworks, and API design and...PipelineJavaBig dataPermanent employmentFull timeRemote work2 days per week3 days per week- ...Big Data Engineer – Cassandra Location: New York, NY Fully Onsite... ...solutions Develop data pipelines for ingestion, processing... ...~ Proficiency in Java, Scala, or Python ~ Experience... ...platforms (AWS, Azure, or GCP) Experience with real-time or streaming data...PipelineJavaBig data
- ...Analytics Software Engineer (Core... ...Type: Full-Time Note: We... ...mission-critical data platform environment... ..., data pipelines, and... ...plugins, and APIs to enhance analytics... ...in Python, Java, or C++ Hands... ...with big data analytics... ...-critical or real-time data systems...PipelineJavaBig dataFull time
- ...Role Data Engineer + Gen AI Location NYC (Hybrid... ...data governance, real-time analytics, and enterprise... ...PySpark + Data Pipeline Orchestration Tool... ...Kubernetes, Fast API... ...Platform services (Big Query, Dataflow, Dataproc... ...expertise in coding in Java/Python/Scala. ~3...PipelineJavaBig dataWorldwide
$99k - $232k
...Competency: Data, Analytics &... ...Applicable Time Type: Full time... ...analytics engineering focus on leveraging... ...data pipelines, data integration... ...Architect, GCP Data Engineer... ...across batch and real-time data... ...such as Python, Java, or Scala -... ...with big data technologies...PipelineJavaBig dataFull timeH1b$176k - $210k
...Senior Data Engineer, Sentinel United States... ...combining de-identified, real-world patient data... ...infrastructure, pipeline automation,... ...reported issues in a timely manner Participated... ...building backend APIs and microservices.... ...accessibility. Big Data Frameworks:...PipelineBig dataFor contractorsWork experience placementWork at officeLocal areaRemote workFlexible hours- Staff Engineer page is loaded## Staff... ...innovative data solutions. In... ...and delivering real business... ...optimize data pipelines and monthly data... ...in Python (Java is a plus).*... ...Experience with big data... ...preferred; Azure or GCP also welcome)... ...offices at any time. Those who...PipelineJavaBig dataFull timeContract workTemporary workWork at officeLocal areaRemote workFlexible hours2 days per week3 days per week
$120k - $150k
...| Microsoft Fabric & Data Are you ready to lead... ...looking for a Senior GCP Data Engineer to support a major Azure... ...and optimize GCP data pipelines Work with BigQuery, Dataflow... ...Implement streaming / real-time solutions (Pub/Sub,... ...in Python or Java Experience with ETL /...PipelineJavaFull time- ...Azure), DataBricks , Scala, Java, Spark, Pyspark, Python,**... ...of experience with Azure Data Factory and Databricks with Big Data ecosystem tools (e.g.... ...the EDL for big data pipelines, architectures & data sets... ...warehouse, high speed indexes, real-time reporting systems and...PipelineJavaBig data
- ...maintain ETL/ELT pipelines to collect and transform... ...and optimize data architectures and... ...failures. Integrate APIs and third-party... ..., Scala , or Java . Hands-on experience... ...Experience with big data frameworks... ...Factory, Synapse) , or GCP (BigQuery, Dataflow...PipelineJavaBig data
- ...Role: - Sr. Big Data Engineer Location : - Jersey City, NJ... ...Contract Position: - Full-time INTERVIEW MODE : 2... ...in scalable data pipeline using Scala, Python, pyspark... ..., Shell, Spark with Java/Python on Hadoop or... ...of working on Nifi, APIs and Unix Environment will...PipelineJavaBig dataLong term contractFull timeWork experience placementFlexible hours
- ...A leading crypto exchange is looking for a Data Engineer to join their data team. The candidate will work with cloud computing and big data technologies to build and optimize data pipelines, ensuring data accuracy. Responsibilities include managing end-to-end business...PipelineBig data
- ...Job Titel: Data Engineer Location: Berkeley Heights, NJ Job... ..., event-driven data pipelines, ensuring low-latency... ...downstream databases in near-real-time. Key Responsibilities:... ...and compliance across big data platforms.... ...Teradata). Experience in Java , Scala, Python or...PipelineJavaBig dataWork at office
$165k - $300k
...BNSF is seeking a Data Engineer to design data streaming solutions and manage data pipelines remotely. The ideal candidate has at least 6 years of experience in data engineering, proficient in Python, SQL, and Java. This role offers a competitive salary range from $16...PipelineJavaH1bRemote work$175.07k - $325.13k
Warner Media, LLC. is seeking a Senior Staff Data Engineer in New York, NY. The role involves designing and delivering data pipelines that process billions of ad events daily... ...tech systems, and act as a domain expert in big data engineering, mentoring junior engineers...PipelineBig data- ...About the Team OKX data team is... ...science. We are data engineers, data analysts and... ...cloud computing and big data technologies... ...Kafka, etc. Expert in real-time big data processing... ...and real-time data pipelines to ensure data timeliness... ...foundation in Java, with backend...PipelineJavaBig dataWork experience placement
$160k - $240k
Bloomberg is seeking a Senior Software Engineer for its Analytics Event Streaming team... ...develop high-standard software and data streaming pipelines to ensure scalability, reliability, and... ...oriented programming and familiarity with big data technologies such as Hadoop and...PipelineBig data- ...Big Data Engineer Mandatory skills: Apache Spark/ Hive/ Kafka... ...build scalable data pipelines, develop ML models, and... .... Ingest data from APIs, file systems, and databases... ..., Apache Hive. Stream real-time data using Kafka,... ...Work with AWS, Azure, GCP, Databricks. Store and...PipelineBig data
- ...the United States is seeking a Senior Data Engineer to build and maintain a reliable... ...role involves developing historical and real-time data pipelines, mentoring junior staff, and ensuring... ...environments using Terraform and AWS/GCP. This position offers significant responsibility...Pipeline
- ...established industry player is seeking a skilled Data Engineer with extensive experience in developing... ...building and maintaining critical data pipelines, collaborating with cross-functional... ...have a strong background in AWS and big data technologies, along with a passion...PipelineBig data
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to GCP Big Data Engineer: Real-Time Pipelines & Java APIs. Be the first to apply!
Related searches
- junior data developer New York, NY
- director data engineering New York, NY
- junior big data engineer New York, NY
- data engineer graduate New York, NY
- senior data engineer New York, NY
- data platform engineer New York, NY
- sr information security engineer New York, NY
- senior data integration developer New York, NY
- data developer New York, NY
- data engineer New York, NY

