GCP Big Data Engineer: Real-Time Pipelines & Java APIs
TechDigital Group
A leading company is seeking a highly skilled Engineer with expertise in building GCP-based data pipelines and REST APIs. The role involves designing and optimizing data solutions while collaborating with various stakeholders to enhance data-driven initiatives. Candidates should possess strong problem-solving abilities and a collaborative mindset, with proficiency in GCP tools and programming languages. #J-18808-Ljbffr TechDigital Group
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the GCP Big Data Engineer: Real-Time Pipelines & Java APIs in New York, NY vacancy
- ...Engineer II – Big Data, GCP with Java SpringBoot Location – NYC, NY (3 days onsite) Highly skilled engineer with a solid experience of building Bigdata, GCP Cloud based real time data pipelines and REST APIs with Java frameworks. The engineer will play a crucial...PipelineJavaBig data
United IT
New York, NY3 days ago - ...seeking experienced Data Engineers to design,... ...large-scale data pipelines (Azure, AWS, GCP) Develop data ingestion... ...scalable APIs and ensure system... ...performance. Manage big data infrastructure... ...Proficiency in Go, Java, Python, or Scala... ...solutions and real-time data processing....PipelineJavaBig data
Object Computing
New York, NY4 days ago - A leading performance marketing engine in New York is seeking a Senior Data Engineer to contribute to the development of Micro Batch/Real Time streaming pipelines. This role involves working closely... ...Science and experience with big data tools like Bigtable and Apache...PipelineBig data
- ...Role: GCP Consultant Location... ...: Big Query - Warehouse/ data marts -... ...frameworks using Java for both batch... ...needs. c - Real-time streaming of... ...production-level data pipelines using Kafka;... ...SQL, Compute Engine, Cloud... ...connecting to on-prem API from google...PipelineJavaBig dataRemote workFlexible hours
Futran Tech Solutions Pvt. Ltd.
Jersey City, NJ4 days ago - ...seeking a Senior Event Streaming Engineer to support a Fortune 100 client in their enterprise data transformation. The role focuses on designing scalable, real-time data pipelines using Apache Kafka and... ...skills in SQL and either Python, Java, or Scala. This position...PipelineJava
$225k - $275k
...AI Data Engineer New York, New York, United... ...robust data pipelines that power... ...high-quality, timely, and relevant... ...and third-party APIs. Implement real-time and batch... ...language (e.g. Java, Scala, Go, Rust... ...or similar Big Data... ...or equivalent GCP services Databases...PipelineJavaBig dataSchonfeld
New York, NY1 day ago- ...Big Data Engineer – Cassandra Location: New York, NY Fully Onsite... ...solutions Develop data pipelines for ingestion, processing... ...~ Proficiency in Java, Scala, or Python ~ Experience... ...platforms (AWS, Azure, or GCP) Experience with real-time or streaming data...PipelineJavaBig data
Staffing the Universe
New York, NY3 days ago - ...Analytics Software Engineer (Core... ...Type: Full-Time Note: We... ...mission-critical data platform environment... ..., data pipelines, and... ...plugins, and APIs to enhance analytics... ...in Python, Java, or C++ Hands... ...with big data analytics... ...-critical or real-time data systems...PipelineJavaBig dataFull time
Navitas Healthcare LLC
New York, NY16 hours ago - ...Role Data Engineer + Gen AI Location NYC (Hybrid... ...data governance, real-time analytics, and enterprise... ...PySpark + Data Pipeline Orchestration Tool... ...Kubernetes, Fast API... ...Platform services (Big Query, Dataflow, Dataproc... ...expertise in coding in Java/Python/Scala. ~3...PipelineJavaBig dataWorldwide
Nucleusteq
New York, NY4 days ago $99k - $232k
...Competency: Data, Analytics &... ...Applicable Time Type: Full time... ...analytics engineering focus on leveraging... ...data pipelines, data integration... ...Architect, GCP Data Engineer... ...across batch and real-time data... ...such as Python, Java, or Scala -... ...with big data technologies...PipelineJavaBig dataFull timeH1bPwC
New York, NY7 days ago$176k - $210k
...Senior Data Engineer, Sentinel United States... ...combining de-identified, real-world patient data... ...infrastructure, pipeline automation,... ...reported issues in a timely manner Participated... ...building backend APIs and microservices.... ...accessibility. Big Data Frameworks:...PipelineBig dataFor contractorsWork experience placementWork at officeLocal areaRemote workFlexible hoursKomodo Health
New York, NY3 days ago$120k - $150k
...| Microsoft Fabric & Data Are you ready to lead... ...looking for a Senior GCP Data Engineer to support a major Azure... ...and optimize GCP data pipelines Work with BigQuery, Dataflow... ...Implement streaming / real-time solutions (Pub/Sub,... ...in Python or Java Experience with ETL /...PipelineJavaFull timeEmpiric
New York, NY4 days ago- ...Azure), DataBricks , Scala, Java, Spark, Pyspark, Python,**... ...of experience with Azure Data Factory and Databricks with Big Data ecosystem tools (e.g.... ...the EDL for big data pipelines, architectures & data sets... ...warehouse, high speed indexes, real-time reporting systems and...PipelineJavaBig data
Guru Schools
New York, NY1 day ago - ...maintain ETL/ELT pipelines to collect and transform... ...and optimize data architectures and... ...failures. Integrate APIs and third-party... ..., Scala , or Java . Hands-on experience... ...Experience with big data frameworks... ...Factory, Synapse) , or GCP (BigQuery, Dataflow...PipelineJavaBig data
Purple Drive
Jersey City, NJ4 days ago - ...Role: - Sr. Big Data Engineer Location : - Jersey City, NJ... ...Contract Position: - Full-time INTERVIEW MODE : 2... ...in scalable data pipeline using Scala, Python, pyspark... ..., Shell, Spark with Java/Python on Hadoop or... ...of working on Nifi, APIs and Unix Environment will...PipelineJavaBig dataLong term contractFull timeWork experience placementFlexible hours
Maintec Technologies
Jersey City, NJ3 days ago - ...A leading crypto exchange is looking for a Data Engineer to join their data team. The candidate will work with cloud computing and big data technologies to build and optimize data pipelines, ensuring data accuracy. Responsibilities include managing end-to-end business...PipelineBig data
Framework Ventures
New York, NY4 days ago - ...Job Titel: Data Engineer Location: Berkeley Heights, NJ Job... ..., event-driven data pipelines, ensuring low-latency... ...downstream databases in near-real-time. Key Responsibilities:... ...and compliance across big data platforms.... ...Teradata). Experience in Java , Scala, Python or...PipelineJavaBig dataWork at office
Percient, Inc.
New York, NY3 days ago $165k - $300k
...BNSF is seeking a Data Engineer to design data streaming solutions and manage data pipelines remotely. The ideal candidate has at least 6 years of experience in data engineering, proficient in Python, SQL, and Java. This role offers a competitive salary range from $16...PipelineJavaH1bRemote workBNSF
New York, NY4 days ago- ...About the Team OKX data team is... ...science. We are data engineers, data analysts and... ...cloud computing and big data technologies... ...Kafka, etc. Expert in real-time big data processing... ...and real-time data pipelines to ensure data timeliness... ...foundation in Java, with backend...PipelineJavaBig dataWork experience placement
Framework Ventures
New York, NY4 days ago - ...the United States is seeking a Senior Data Engineer to build and maintain a reliable... ...role involves developing historical and real-time data pipelines, mentoring junior staff, and ensuring... ...environments using Terraform and AWS/GCP. This position offers significant responsibility...Pipeline
Ethena Labs
New York, NY4 days ago $160k - $240k
Bloomberg is seeking a Senior Software Engineer for its Analytics Event Streaming team... ...develop high-standard software and data streaming pipelines to ensure scalability, reliability, and... ...oriented programming and familiarity with big data technologies such as Hadoop and...PipelineBig data- ...Big Data Engineer Mandatory skills: Apache Spark/ Hive/ Kafka... ...build scalable data pipelines, develop ML models, and... .... Ingest data from APIs, file systems, and databases... ..., Apache Hive. Stream real-time data using Kafka,... ...Work with AWS, Azure, GCP, Databricks. Store and...PipelineBig data
Omni Inclusive
Jersey City, NJ1 day ago - ...established industry player is seeking a skilled Data Engineer with extensive experience in developing... ...building and maintaining critical data pipelines, collaborating with cross-functional... ...have a strong background in AWS and big data technologies, along with a passion...PipelineBig data
TechDigital Group
New York, NY4 days ago - ...Data Engineer New York, New York, United States About... ...experience with REST API design and... ...years experience with real-time and streaming technology... ...Experience building automated big data pipelines ~ Experience... ...Experience in Azure/GCP. Solid understanding...PipelineBig data
Inizio Partners
New York, NY11 days ago - ...Data Foundations Engineer The Data Foundations Engineer... ...performance data pipelines and enabling analytics... ...batch and near-real-time data pipelines.... ...metrics. Instrument APIs and user journeys... ..., Scala, or Java. ~ Hands-on experience... ...AWS, Azure, or GCP. ~ Comfortable...PipelineJava
Apolis
New York, NY1 day ago - ..., cloud-native data platforms on Google... ...batch and real-time data pipelines using BigQuery,... ...practices Mentor engineers, conduct design... ...Sets • GCP Data Services:... ...Advanced SQL, Python (Java/Scala a plus)... ...In addition to big query, storage... ...gateway and API, Dataplex, basic...PipelineJava
Mphasis
New York, NY2 days ago $125.3k - $179k
We are seeking a Data Engineer to join our Artist-... ...large-scale data pipelines with data processing... ...systems and big data technologies... ...preferably in Scala or Java, and demonstrating... ...products that add real value to millions... ...operates within the EST time zone for...PipelineJavaBig dataFlexible hours- ...Senior Software Engineer The Senior... ...systems. Develop APIs and... ...AdTech partners and data providers. Data... ...implement ETL pipelines and real-time data processing... .... Work with big data frameworks... ...expertise with Java, Scala, or Python... ...platforms (AWS/GCP/Azure). Strong...PipelineJavaBig data
Warner Bros.
New York, NY3 days ago $75k - $90k
...Data Engineer The New York Mets are seeking a... ...frequencies including real time in-game data... ...premise and cloud (GCP or Azure experience... ...data from FTP and API data sources ~ Experience... ...and data pipelines in the cloud, preferably... ...~ Knowledge of big data frameworks,...PipelineBig dataFlexible hoursMLB - New York Mets
Corona, NY1 day ago$90k - $135.29k
...Intelligence is seeking a Data Engineer to support the... ...maintaining data pipelines, managing surgical... ...and liaisons for real world application... ...Scala/Python/ Java. Must be flexible... ...configuration of big data software and... ...challenges of our time — discovering and...PipelineJavaBig dataTraineeshipLocal areaImmediate startFlexible hoursMount Sinai Health System
New York, NY3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to GCP Big Data Engineer: Real-Time Pipelines & Java APIs. Be the first to apply!
Related searches
- junior data developer New York, NY
- director data engineering New York, NY
- junior big data engineer New York, NY
- data engineer graduate New York, NY
- senior data engineer New York, NY
- data platform engineer New York, NY
- sr information security engineer New York, NY
- senior data integration developer New York, NY
- data developer New York, NY
- data engineer New York, NY