GCP Big Data Engineer: Real-Time Pipelines & Java APIs
TechDigital Group
A leading company is seeking a highly skilled Engineer with expertise in building GCP-based data pipelines and REST APIs. The role involves designing and optimizing data solutions while collaborating with various stakeholders to enhance data-driven initiatives. Candidates should possess strong problem-solving abilities and a collaborative mindset, with proficiency in GCP tools and programming languages. #J-18808-Ljbffr
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the GCP Big Data Engineer: Real-Time Pipelines & Java APIs in New York, NY vacancy
- ...Senior Data Platform Engineer - Vice President Apply... ...and make a real impact. Job... ...solutions, robust data pipeline architectures,... ..., real-time streaming platforms... ...experience in Java (Java 11+ preferred... ..., DataStream API, and state... ...Kafka, and various big data storage/...PipelineJavaBig dataFull timeShift workNight shift
- ...Limited is seeking a skilled data engineer in the United States,... ...'ll build and optimize data pipelines and infrastructures to enhance... ...role will involve developing APIs, real-time data processing, and upholding... ...and significant expertise in GCP technologies. This role offers...PipelineRemote workFlexible hours
- ...Engineer II – Big Data, GCP with Java SpringBoot Location – NYC, NY (3 days onsite) Highly skilled engineer with a solid experience of building Bigdata, GCP Cloud based real time data pipelines and REST APIs with Java frameworks. The engineer will play a crucial...PipelineJavaBig data
$148.7k - $199.4k
...Line - The Walt Disney Company is seeking a Software Engineer to develop real-time data systems and APIs for platforms like ABC News and ESPN. The ideal candidate... ...in software development, particularly with Java and Spring Boot, and has strong problem-solving skills...Java$148.7k - $199.4k
...Walt Disney Company (France) is hiring a Software Engineer in New York to develop and support real-time data systems and APIs used across ABC News and Disney platforms. This... ...development experience, particularly in Java/Spring Boot. The hiring range is $148,700 - $19...Java- The New York Times is seeking a Senior Data Engineer in New York City to contribute to the Customer-Facing Data Products team. This role involves developing real-time data pipelines and APIs that serve customer needs. The ideal candidate has over 5 years of experience in...Pipeline
- ...seeking experienced Data Engineers to design,... ...large-scale data pipelines (Azure, AWS, GCP) Develop data ingestion... ...scalable APIs and ensure system... ...performance. Manage big data infrastructure... ...Proficiency in Go, Java, Python, or Scala... ...solutions and real-time data processing....PipelineJavaBig data
- A leading performance marketing engine in New York is seeking a Senior Data Engineer to contribute to the development of Micro Batch/Real Time streaming pipelines. This role involves working closely... ...Science and experience with big data tools like Bigtable and Apache...PipelineBig data
- ...digital media company is seeking a Senior Data Engineer to design and implement streaming data pipelines that process billions of user signals... ...experience, strong proficiency in Python or Java, and hands-on experience with real-time data processing. Responsibilities...PipelineJava
- ...seeking a Senior Event Streaming Engineer to support a Fortune 100 client in their enterprise data transformation. The role focuses on designing scalable, real-time data pipelines using Apache Kafka and... ...skills in SQL and either Python, Java, or Scala. This position...PipelineJava
- ...Smadex is looking for a Data Engineering Team Lead in Austin, TX, to drive the engineering organization... ...teams, focusing on optimizing data for real-time machine learning applications. This... ...in data engineering, leadership, and big data architectures. Join a dynamic,...PipelineBig dataFull time
- ...is seeking a highly skilled Python Data Engineer to work remotely. The ideal candidate... ...in data engineering, particularly in big data processing and cloud... ...include designing and developing data pipelines, implementing real-time streaming solutions, and collaborating...PipelineBig dataRemote work
- ...Role: GCP Consultant Location... ...: Big Query - Warehouse/ data marts -... ...frameworks using Java for both batch... ...needs. c - Real-time streaming of... ...production-level data pipelines using Kafka;... ...SQL, Compute Engine, Cloud... ...connecting to on-prem API from google...PipelineJavaBig dataRemote workFlexible hours
$225k - $275k
...experienced AI Data Engineer to join our... ...maintaining robust data pipelines that power... ...high-quality, timely, and relevant... ...third-party APIs. Implement real-time and batch... ...(e.g. Java, Scala, Go, Rust... ...or similar Big Data Technologies... ...or equivalent GCP services Databases...PipelineJavaBig data$170k - $240k
...Google Cloud Data Engineer with a strong... ...independently, ensuring timely delivery and... ...pipelines leveraging Google... ...pipelines on GCP. Perform... ...pipelines (Python or Java) handling... ...teams (real‑time threat monitoring... ...in Big Data environments... ...frameworks, and API design and...PipelineJavaBig dataPermanent employmentFull timeRemote work2 days per week3 days per week- ...Big Data Engineer – Cassandra Location: New York, NY Fully Onsite... ...solutions Develop data pipelines for ingestion, processing... ...~ Proficiency in Java, Scala, or Python ~ Experience... ...platforms (AWS, Azure, or GCP) Experience with real-time or streaming data...PipelineJavaBig data
- ...the foundational data infrastructure that... ...exchanges. As a Big Data Platform Engineer, you will design,... ...ship reliable pipelines. You will be at the... ...across batch and real-time pipelines AI Integration... ...with platform APIs Build the... ...engineering skills in Java, Scala, or Python...PipelineJavaBig dataWork experience placement
- ...Analytics Software Engineer (Core... ...Type: Full-Time Note: We... ...mission-critical data platform environment... ..., data pipelines, and... ...plugins, and APIs to enhance analytics... ...in Python, Java, or C++ Hands... ...with big data analytics... ...-critical or real-time data systems...PipelineJavaBig dataFull time
- ...Role Data Engineer + Gen AI Location NYC (Hybrid... ...data governance, real-time analytics, and enterprise... ...PySpark + Data Pipeline Orchestration Tool... ...Kubernetes, Fast API... ...Platform services (Big Query, Dataflow, Dataproc... ...expertise in coding in Java/Python/Scala. ~3...PipelineJavaBig dataWorldwide
- ...Staff Engineer page is loaded## Staff... ...innovative data solutions. In... ...and delivering real business... ...optimize data pipelines and monthly data... ...in Python (Java is a plus).*... ...Experience with big data... ...preferred; Azure or GCP also welcome)... ...offices at any time. Those who...PipelineJavaBig dataFull timeContract workTemporary workWork at officeLocal areaRemote workFlexible hours2 days per week3 days per week
$131.6k - $244.4k
...Senior Software Engineer is accountable... ...systems. Develop APIs and... ...AdTech partners and data providers. Data... ...implement ETL pipelines and real-time data processing... ...optimization. Work with big data frameworks... ...expertise with Java, Scala, or... ...platforms (AWS/GCP/Azure). Strong...PipelineJavaBig dataTemporary workLocal area$99k - $232k
...Competency: Data, Analytics &... ...Applicable Time Type: Full time... ...analytics engineering focus on leveraging... ...data pipelines, data integration... ...Architect, GCP Data Engineer... ...across batch and real-time data... ...such as Python, Java, or Scala -... ...with big data technologies...PipelineJavaBig dataFull timeH1b$120k - $150k
...| Microsoft Fabric & Data Are you ready to lead... ...looking for a Senior GCP Data Engineer to support a major Azure... ...and optimize GCP data pipelines Work with BigQuery, Dataflow... ...Implement streaming / real-time solutions (Pub/Sub,... ...in Python or Java Experience with ETL /...PipelineJavaFull time$176.72k - $265.08k
...Senior AI & Data Engineering Lead - Senior Vice President... ...-Throughput Data Pipelines:** You will lead... ...data. + **Real-time Stream Processing:... ...leadership qualities.**Big Data Technologies*... ...cloud provider (AWS, GCP, Azure) and their... ...queries. - **Scala/Java:** Often...PipelineJavaBig dataFull time- ...Azure), DataBricks , Scala, Java, Spark, Pyspark, Python,**... ...of experience with Azure Data Factory and Databricks with Big Data ecosystem tools (e.g.... ...the EDL for big data pipelines, architectures & data sets... ...warehouse, high speed indexes, real-time reporting systems and...PipelineJavaBig data
- ...maintain ETL/ELT pipelines to collect and transform... ...and optimize data architectures and... ...failures. Integrate APIs and third-party... ..., Scala , or Java . Hands-on experience... ...Experience with big data frameworks... ...Factory, Synapse) , or GCP (BigQuery, Dataflow...PipelineJavaBig data
$230k - $290k
...sellers are building real businesses across... ...updates on our news and engineering blogs and join us... ...commerce. Role The Data team at Whatnot... ...machine learning, real-time analytics, stream... ...write well-tested, API-driven applications... ...-time processing pipelines at scale. Strong experience...PipelineWork at officeLocal areaRemote workWork from home- ...Role: - Sr. Big Data Engineer Location : - Jersey City, NJ... ...Contract Position: - Full-time INTERVIEW MODE : 2... ...in scalable data pipeline using Scala, Python, pyspark... ..., Shell, Spark with Java/Python on Hadoop or... ...of working on Nifi, APIs and Unix Environment will...PipelineJavaBig dataLong term contractFull timeWork experience placementFlexible hours
$160k - $240k
...Bloomberg is seeking a Senior Software Engineer for its Analytics Event Streaming team... ...develop high-standard software and data streaming pipelines to ensure scalability, reliability, and... ...oriented programming and familiarity with big data technologies such as Hadoop and...PipelineBig data- ...responsibilities, focusing on developing agent tools, integrating APIs, and implementing data pipelines. The role emphasizes strong expertise in API... ...interfaces and interactive visualizations, ensuring performance optimization for real-time applications. #J-18808-Ljbffr...PipelineFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to GCP Big Data Engineer: Real-Time Pipelines & Java APIs. Be the first to apply!
Related searches
- senior data center engineer New York, NY
- bi data engineer New York, NY
- data engineer manager New York, NY
- data science developer New York, NY
- junior data developer New York, NY
- etl data engineer New York, NY
- entry level big data engineer New York, NY
- data engineer New York, NY
- big data cloud engineer New York, NY
- junior big data engineer New York, NY

