Real-Time Data Engineer: Kafka & Spark, REST APIs
Stepping Up Solutions
Stepping Up Solutions is seeking a skilled Data Engineer to join their Data Technology team. The successful candidate will design and implement scalable data infrastructure while ensuring the efficiency of data transformations developed by data scientists. The role involves optimizing a data processing portal for real-time analytics and maintaining data in both MySQL and NoSQL systems. Candidates should have significant experience in a data-intensive environment and proficiency in Java or Python. #J-18808-Ljbffr Stepping Up Solutions
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Real-Time Data Engineer: Kafka & Spark, REST APIs in San Francisco, CA vacancy
- ...Technologies, Inc. is seeking a MarTech Data Engineer to lead end-to-end engineering initiatives... ...architect event-driven systems powering real-time marketing experiences and automated... ...Campaign, Azure Data Factory, Databricks, Spark SQL/Streaming, Python and Scala. #J-188...Suggested
- Swish Analytics is seeking Data Engineers to have a direct impact on the infrastructure and delivery... ...of our core data offerings, including real-time analytics for sports data. This is a... ...ETL pipelines, and build production-grade APIs to deliver predictive sports insights...SuggestedRemote job
- Orb is building the runtime layer for usage-based billing, entitlements, and real-time analytics. You will own a surface end to end, from customer conversations to API design and rollout, shaping primitives that other teams rely on. You will work across the product, design...Suggested
- ...Data Engineer RadiumOne is seeking a Data Engineer to join our Data... ...for the companies two real-time analytics platforms. You... ...AWS to our in-house servers (Kafka – Spark) allowing for the portal to... ...plus. Experience building RESTful APIs Scripting languages like...SuggestedLocal area
Stepping Up Solutions
San Francisco, CA5 days ago - ...Amsterdam. You’ll own a product surface end to end, from customer conversations through API design, implementation, and rollout. You’ll design and ship alerting and analytics, build real-time entitlement and spend-control primitives, and shape the roadmap that other teams...Suggested
- ...Everyone at Orb has real ownership over... ...questions in real time: what has this customer... ...it's real systems engineering: alerts, balances,... ...surface where API design, clarity, and... ...APIs and data models that other... ...Streaming Platforms: Kafka + Spark Streaming Cloud...Full timeWork at officeRemote workFlexible hours3 days per week
Orb
San Francisco, CA15 hours ago - ...driven mobile advertising company in San Francisco is seeking a Data Engineer to join its engineering team. This role involves designing,... ...data pipelines, and proficiency in technologies such as Kafka and Spark. This position offers an opportunity to drive performance and...
- ...join a small team responsible for back‑office systems supporting traders, risk management and accounting. You will work on real‑time and batch data processing, reporting, and database design in a Linux environment. The role emphasizes collaboration with traders and risk...
$160k - $240k
Togetherai in San Francisco is hiring a Senior Data Engineer to design and build data infrastructure handling millions of events. You will work with cross-functional teams developing real-time analytics systems and contributing to the company's mission of advancing AI technology...- ...unicorn AI-powered customer communications platform, seeks a Data Engineer to build data sets powering churn prediction and feature adoption... ..., Data Science, Analytics, and Applied Scientists to enable real-time dashboards and AI-driven insights. Join a fast-moving,...
- ...building the industry’s leading compensation platform, blending real-time data with AI. The Data Team supports thousands of customers by... ...collaboration across data science, product, and software engineering. Equity, top-tier health coverage, and growth opportunities...Remote job
- Pave’s Data Team is looking for a Data/Analytics Engineer to help redefine how we measure labor markets and compensation. You’ll extend data models and build scalable pipelines powering our real-time compensation platform. Your work will directly impact thousands of customers...
$165k - $230k
NexHealth in San Francisco is seeking a Software Engineer to tackle challenging problems in healthcare integration. You will develop real-time API solutions to synchronize health records, driving significant growth and improvements in systems. The ideal candidate has extensive...$180k - $260k
...sellers are building real businesses... ...on our news and engineering blogs and join us... ...commerce. Role Data is crucial to... ..., ML, and real-time applications.... ...semantic layers, APIs, and real-time query... ...(e.g., Kafka, Debezium), transformation... ...(dbt, Spark, Flink), orchestration...Full timeWork at officeLocal areaRemote workWork from homeHome officeWhatnot
San Francisco, CA15 hours ago$162k - $216k
A cutting-edge technology firm in San Francisco is seeking a Software Engineer - Infrastructure to design and maintain a robust data streaming architecture. You will lead the near real-time data streaming platform while collaborating closely with stakeholders to simplify...$150k - $250k
...Role We are hiring a Sr Data Engineer / Data Lead to own... ...and be the person the rest of the engineering... ...factory‑floor data in real time Implement data lifecycle... ...application logic (APIs, event‑driven systems... ...pipeline frameworks (Spark, Flink, Kafka, Airflow, dbt, or...Full timeContract work- ...Everyone at Orb has real ownership over... ...questions in real time: what has this customer... ...it's real systems engineering: alerts, balances,... ...surface where API design, clarity, and... ...APIs and data models that other... ...Streaming Platforms: Kafka + Spark Streaming Cloud Platform...Work at officeRemote workFlexible hours3 days per week
- Data/ETL Engineer (Founding Team) Location: San Francisco... ...Area Type: Full-Time Compensation:... ...and expose secure APIs for downstream services... ...frameworks (Kafka, Airbyte, Meltano,... ...Familiarity with GraphQL, RESTful APIs, and... ...want to model the real world, not just process...Full time
$130.05k - $175.95k
The Onyx Research Data Platform organization... ...leadership, data engineering, infrastructure ,... ...and reducing time spent on “data mechanics... ...predictions in real-time Data Engineering... ...the use of APIs. They define and embed... ...data space, such as Spark, Kafka, Storm, etc., and...Local area$185k - $221.4k
...Build and own production data infrastructure.... ...commercial data from REST APIs, XML feeds, and file-... ...right shape at the right time. Uphold high engineering standards and... ...resolution across messy real-world sources, and data... ...patterns; comfortable with Spark or Trino at scale...Remote workFlexible hours$220.5k - $245k
.... Discord seeks a seasoned Data Engineer, focusing on our advertising... ...surfaces. Build batch and near real‑time pipeline infrastructure... ...Experience with Conversion Data and APIs, MMP integrations, or... ...pipeline infrastructure (e.g., Kafka, Spark Streaming, or equivalent) in...Full timeTemporary work- APPIT Software Solutions is hiring a Senior Data Engineer (Apache Spark) in San Francisco, USA . Lead the design of large-scale distributed data... ...computing best practices and Spark internals Build and maintain real-time and batch data pipelines with robust fault-tolerance...Flexible hours
$207k - $276k
...practices into the engineering organization.... ...point of expertise on Data Engineering, Data... ...technologies Java RESTful Web Services (Java... ...such as Kafka, Tibco EMS or JMS... ...python, pySpark, Spark), BI Reporting, Python... ...Knowledge of real time payment networks(RTP...Hourly payWork at officeImmediate startVisa sponsorshipWork visaFlexible hoursEarly Warning Services
San Francisco, CA5 days ago$197.6k - $296.4k
About the RoleAs a Staff Data Engineer, you will be a... ...infrastructure that powers real-time member experiences, analytics... ...services — across Kafka event streams and... ...that serves real-time APIs, analytical workloads,... ...e.g., PySpark, Flink, Spark) and data warehouse design...Work at officeLocal areaImmediate startRemote workWorldwide3 days per week- ...leading robotic delivery company in San Francisco is seeking a Data Engineer to join their Data Team. In this role, you will design and... ...background in Python, SQL, and Google Cloud Platform. This full-time position offers a unique opportunity to impact urban logistics...Full time
$90.2k - $112.7k
...space company and data company all rolled... ...processing, and software engineering, our office is a... ....This is a full-time, hybrid role which... ...Programs Manager and the rest of the DataViz team... ...new datasets, APIs, platforms, and technical... ...in advance and/or real-time. Opting out...Full timeTemporary workWork at officeLocal areaRemote workHome office3 days per week$200k - $300k
...AI research to systems engineering to product design — creating... ...We’re looking for a Real-time Graphics Engineer who... ...our open source renderer Spark, expanding its feature... ..., the modern graphics API stack, efficiently utilizing... ...applications around 3D data is particularly...Full timeWorld Labs
San Francisco, CA15 hours ago- CoreWeave is seeking a Front End Engineer to advance its History data-visualization stack. You will enhance the core line plots driving real-time visualization for ML experiments and ensure high-performance rendering at scale in a UX-focused UI. Join a fast-moving team...
- Diamond Foundry Inc. is seeking a detail-oriented Software Engineer to strengthen our data collection, software interfaces, and infrastructure used... ...metrics and analyzing the manufacturing process in real time. You will work with a team of veteran scientists and engineers...
- A tech startup in San Francisco is seeking a Backend Engineer to own their Java-based web application. This position requires expertise in distributed systems, RESTful APIs, and a passion for delivering excellent user experiences. The ideal candidate will work collaboratively...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Real-Time Data Engineer: Kafka & Spark, REST APIs. Be the first to apply!
Related searches
- data platform engineer San Francisco, CA
- aws data engineer San Francisco, CA
- data engineer graduate San Francisco, CA
- big data devops engineer San Francisco, CA
- big data developer San Francisco, CA
- software data engineer San Francisco, CA
- data center engineer San Francisco, CA
- big data cloud engineer San Francisco, CA
- director data engineering San Francisco, CA
- hadoop big data developer San Francisco, CA