Real-Time Data Engineer: Kafka & Spark, REST APIs
Stepping Up Solutions
Stepping Up Solutions is seeking a skilled Data Engineer to join their Data Technology team. The successful candidate will design and implement scalable data infrastructure while ensuring the efficiency of data transformations developed by data scientists. The role involves optimizing a data processing portal for real-time analytics and maintaining data in both MySQL and NoSQL systems. Candidates should have significant experience in a data-intensive environment and proficiency in Java or Python. #J-18808-Ljbffr Stepping Up Solutions
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Real-Time Data Engineer: Kafka & Spark, REST APIs in San Francisco, CA vacancy
- ...Technologies, Inc. is seeking a MarTech Data Engineer to lead end-to-end engineering initiatives... ...architect event-driven systems powering real-time marketing experiences and automated... ...Campaign, Azure Data Factory, Databricks, Spark SQL/Streaming, Python and Scala. #J-188...Suggested
- Orb is building the runtime layer for usage-based billing, entitlements, and real-time analytics. You will own a surface end to end, from customer conversations to API design and rollout, shaping primitives that other teams rely on. You will work across the product, design...Suggested
- ...Description RadiumOne is seeking a Data Engineer to join our Data Technology... ...for the companies two real-time analytics platforms. You... ...to our in-house servers (Kafka - Spark) allowing for the portal to... ...plus. Experience building RESTful APIs. Experience in agile software...SuggestedLocal area
- ...Everyone at Orb has real ownership over... ...questions in real time: what has this customer... ...it's real systems engineering: alerts, balances,... ...surface where API design, clarity, and... ...APIs and data models that other... ...Streaming Platforms: Kafka + Spark Streaming Cloud...SuggestedFull timeWork at officeRemote workFlexible hours3 days per week
Orb
San Francisco, CA16 hours ago - ...driven mobile advertising company in San Francisco is seeking a Data Engineer to join its engineering team. This role involves designing,... ...data pipelines, and proficiency in technologies such as Kafka and Spark. This position offers an opportunity to drive performance and...Suggested
- RZR Global Inc. is seeking a talented Data Engineer to join our engineering team in San Francisco, CA. In this role, you will architect... ...should have extensive experience with tools such as Kafka, Spark, and ClickHouse, as well as a strong problem-solving mindset...
$200k - $210k
...looking for a Lead Software Engineer to join Real-Time Events (RTE). This is a... ...high-volume event data that powers Zeta Marketing... ...experience with event streaming (Kafka or equivalent), Python services and APIs (e.g. FastAPI), and pipeline processing (Spark/EMR or equivalent) where...- Kyndryl is seeking an AI Data Engineer to architect high-performance data infrastructure for autonomous systems, building real-time pipelines that transform massive IT logs into optimized embeddings. You will scale vector infrastructure for sub-second retrieval speeds,...
- ...building the industry’s leading compensation platform, blending real-time data with AI. The Data Team supports thousands of customers by... ...collaboration across data science, product, and software engineering. Equity, top-tier health coverage, and growth opportunities...Remote job
- Beast Industries in San Francisco Bay Area is building an AI-first data platform from the ground up. You will own and operate telemetry... ...and embed AI tooling into workflows. The role focuses on real-time monitoring, data quality, and scalable identity stitching across...
$165k - $230k
NexHealth in San Francisco is seeking a Software Engineer to tackle challenging problems in healthcare integration. You will develop real-time API solutions to synchronize health records, driving significant growth and improvements in systems. The ideal candidate has extensive...- Auth21 is seeking a skilled software engineer to design and operate a self-service streaming... ...powering ingestion pipelines and real-time data processing in a distributed environment.... ...systems and scalable automation to manage Kafka fleets, improving developer experience....
- ...Staff Data EngineerAs a technical leader on... ...infrastructure that powers real-time member experiences,... ...a Senior Data Engineer owns individual... ...services — across Kafka event streams and transactional... ...serves real-time APIs, analytical... ...., PySpark, Flink, Spark) and data warehouse...Work at officeLocal areaImmediate startRemote workWorldwide3 days per week
Hinge Health
San Francisco, CA4 days ago $150k - $250k
...Role We are hiring a Sr Data Engineer / Data Lead to own... ...and be the person the rest of the engineering... ...factory‑floor data in real time Implement data lifecycle... ...application logic (APIs, event‑driven systems... ...pipeline frameworks (Spark, Flink, Kafka, Airflow, dbt, or...Full timeContract work- Data/ETL Engineer (Founding Team) Location: San Francisco... ...Area Type: Full-Time Compensation:... ...and expose secure APIs for downstream services... ...frameworks (Kafka, Airbyte, Meltano,... ...Familiarity with GraphQL, RESTful APIs, and... ...want to model the real world, not just process...Full time
$130.05k - $175.95k
The Onyx Research Data Platform organization... ...leadership, data engineering, infrastructure ,... ...and reducing time spent on “data mechanics... ...predictions in real-time Data Engineering... ...the use of APIs. They define and embed... ...data space, such as Spark, Kafka, Storm, etc., and...Local area$185k - $221.4k
...Build and own production data infrastructure.... ...commercial data from REST APIs, XML feeds, and file-... ...right shape at the right time. Uphold high engineering standards and... ...resolution across messy real-world sources, and data... ...patterns; comfortable with Spark or Trino at scale...Remote workFlexible hours$220.5k - $245k
.... Discord seeks a seasoned Data Engineer, focusing on our advertising... ...surfaces. Build batch and near real‑time pipeline infrastructure... ...Experience with Conversion Data and APIs, MMP integrations, or... ...pipeline infrastructure (e.g., Kafka, Spark Streaming, or equivalent) in...Full timeTemporary workLocal area- ...Staff Data EngineerForm Energy is hiring... ...a Staff Data Engineer to build the data... ..., turning real-time field telemetry... ...trustworthy data the rest of the company can... ...such as Apache Spark (PySpark and/or... ...systems, including Kafka and/or Kinesis.... ..., Druid); REST APIs and webhooks; energy...Immediate startRelocation package
Form Energy, Inc.
Berkeley, CA16 hours ago - fal in San Francisco is seeking a Senior Data Engineer to build data infrastructure powering cost, margin, and performance analytics across internal systems and partner APIs. You’ll design low-latency ingestion paths, instrument core infra, and create durable pipelines...Relocation package
- ...leading robotic delivery company in San Francisco is seeking a Data Engineer to join their Data Team. In this role, you will design and... ...background in Python, SQL, and Google Cloud Platform. This full-time position offers a unique opportunity to impact urban logistics...Full time
$88.97k - $287.91k
...Salesforce is hiring Forward Deployed Engineers focused on Data 360, Salesforce’s real-time data engine that unifies data... ..., SQL, Apex, Flow, Python, the REST Query API, the Interaction SDK, Salesforce... ...Databricks, BigQuery, Redshift, Kafka, cloud object storage, or an...Full time$90.2k - $112.7k
...space company and data company all rolled... ...processing, and software engineering, our office is a... ....This is a full-time, hybrid role which... ...Programs Manager and the rest of the DataViz team... ...new datasets, APIs, platforms, and technical... ...in advance and/or real-time. Opting out...Full timeTemporary workWork at officeLocal areaRemote workHome office3 days per week- ...redesign, analytics, modern data platforms, and agentic... ...As an Associate Data Engineer, you will help design,... ..., storage, batch and real-time processing, semantic enrichment, retrieval, APIs, visualization, data... ...technologies such as Spark, Hadoop, Kafka, Airflow, dbt,...Internship
$200k - $300k
...AI research to systems engineering to product design — creating... ...We’re looking for a Real-time Graphics Engineer who... ...our open source renderer Spark, expanding its feature... ..., the modern graphics API stack, efficiently utilizing... ...applications around 3D data is particularly...Full timeWorld Labs
San Francisco, CA16 hours ago- ...Lead Data Engineer - Job DescriptionResponsibilitiesDevelopment Tasks:Collect... ...data pipelines using Kafka streams.Implement solutions using... ...Boot Java and Databricks Spark streaming.Leadership Duties:Lead... ...pipelines in different modes – near real time, batch, realtime.Solid...
My3Tech Inc
San Francisco, CA4 days ago $160k - $220k
...Lead Data EngineerLocation: San Francisco,... ...seeking a Lead Data Engineer to architect, build... ...internal systems, APIs, and third-party data... ...; experience with Spark or distributed processing... ...architectures (Kafka, Event Hub,... ...Mobility Standing 20% of time Sitting 70% of time...Q-Cells
San Francisco, CA16 hours ago$147k - $181k
...shaping the future of real estate for a better... .... About JLL and Data PlatformJLL is a leading... ...frameworks, APIs, and developer-facing... ...involvesAs a Senior Data Engineer on the Data... ...troubleshooting via Spark UI.Experience designing... ...00% of salary Paid Time Off and Company...Full timeContract workLocal areaRemote work- Diamond Foundry is looking for a detail-oriented Software Engineer to strengthen data collection, interfaces, and infrastructure for real-time manufacturing metrics. You will work with scientists and engineers to improve software experiences, automate tasks, and ensure...
$150k - $200k
...and AI Assist Pro delivers real-time guidance so people can do... ...We're customer-obsessed, data-driven, and focused on delivering... ...S3, with Flink CDC into Kafka for ingestion and dbt-on-Spark via Apache Kyuubi on EKS... ...deserves. Right now, our engineers wear two hats — owning the...WorldwideAircall.io, Inc.
San Francisco, CA10 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Real-Time Data Engineer: Kafka & Spark, REST APIs. Be the first to apply!
Related searches
- data engineer analytics San Francisco, CA
- principal data engineer San Francisco, CA
- senior cloud data engineer San Francisco, CA
- data center engineer San Francisco, CA
- staff data engineer San Francisco, CA
- director data engineering San Francisco, CA
- big data devops engineer San Francisco, CA
- data engineer manager San Francisco, CA
- sr data engineer San Francisco, CA
- data engineer San Francisco, CA