Real-Time Data Engineer: Kafka & Spark, REST APIs
Stepping Up Solutions
Stepping Up Solutions is seeking a skilled Data Engineer to join their Data Technology team. The successful candidate will design and implement scalable data infrastructure while ensuring the efficiency of data transformations developed by data scientists. The role involves optimizing a data processing portal for real-time analytics and maintaining data in both MySQL and NoSQL systems. Candidates should have significant experience in a data-intensive environment and proficiency in Java or Python. #J-18808-Ljbffr Stepping Up Solutions
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Real-Time Data Engineer: Kafka & Spark, REST APIs in San Francisco, CA vacancy
- ...mark on culture. Overview The Data Engineering team is seeking a Data... ...- Self‑Service Analytics & Real‑Time Data Platforms. In this role... ...processing frameworks such as Spark. Experience integrating data... ...real‑time data pipelines using Kafka, Pub/Sub, or similar...Suggested
- ...evaluating how AI models perform in the real world. Created by researchers from UC... ...progress. We’re a team of researchers, engineers, academics, and builders from places like... ...of scalable, high-performance real-time data and API infrastructure. In this role, you’ll architect...SuggestedPermanent employmentWork at office
- ...month contract. The position requires strong Java development skills, experience with Kafka and NoSQL databases like Cassandra or Couchbase. Responsibilities include designing scalable APIs and maintaining consumer-facing features. Ideal candidates will have over 8 years...SuggestedContract workLocal areaRemote work
$160k - $225k
...synthesizes complex employee data, pinpoints risky behaviors,... ...to people automatically, in real time, right where they work. Backed... ...product Work closely with engineering, data science, and product... ...large-scale data workflows (Spark, Kafka, etc.) Experience with modern...SuggestedWork experience placementRelocation packageFlexible hours- ...Francisco seeks a skilled integration engineer to join its team. In this... ...will design and build complex data pipelines, working with... ...reliability and efficiency in real-time. The ideal candidate will have... ...in Python, and experience with API integrations. This is an opportunity...Suggested
$250k
...stealth team of hardcore engineers, designers, and... ...hiring an experienced Data/ML Engineer to build the... ...serving that holds up under real-world load. You’ll work... ...trustworthy datasets and real-time capabilities that power... ...(e.g., Flink, Spark), including correctness...$160k - $225k
...synthesizes complex employee data, pinpoints risky behaviors,... ...to people automatically, in real time, right where they work. Backed... ...product Work closely with engineering, data science, and product... ...data processing systems (e.g., Kafka, Spark, or similar technologies)...Work experience placementRelocation packageFlexible hours- ...Description RadiumOne is seeking a Data Engineer to join our Data Technology... ...for the companies two real-time analytics platforms. You... ...AWS to our in-house servers (Kafka – Spark) allowing for the portal to... ...plus. Experience building RESTful APIs. Experience in agile...Local area
Stepping Up Solutions
San Francisco, CA2 days ago - ...analytics platform, seeks a Senior Software Engineer for the Data Pipeline team in San Francisco Bay Area. You will design and operate real‑time and batch ingestion systems, ensuring... ...zero downtime, using Java and Python on Kafka, Temporal, DynamoDB, and Kubernetes,...
$200k - $260k
A leading AI infrastructure company is seeking a Senior Platform Engineer to manage the API and infrastructure layer for voice workloads. This pivotal role involves building real-time WebSocket and APIs and designing autoscaling for voice applications. Candidates should...- RZR Global Inc. is seeking a talented Data Engineer to join our engineering team in San Francisco, CA. In this role, you will architect... ...should have extensive experience with tools such as Kafka, Spark, and ClickHouse, as well as a strong problem-solving mindset...
- ...driven mobile advertising company in San Francisco is seeking a Data Engineer to join its engineering team. This role involves designing,... ...data pipelines, and proficiency in technologies such as Kafka and Spark. This position offers an opportunity to drive performance and...
- ...join a small team responsible for back‑office systems supporting traders, risk management and accounting. You will work on real‑time and batch data processing, reporting, and database design in a Linux environment. The role emphasizes collaboration with traders and risk...
$180k - $195k
A technology firm focused on grid management is seeking a Senior Data Engineer to design and scale data infrastructure for real-time monitoring of the electrical grid. You will develop data pipelines that transform sensor data into actionable insights, ensuring high data...$160k - $220k
Peregrine is seeking a Data Infrastructure Engineer in San Francisco to take deep ownership of the data layer supporting our AI-enabled platform. You will design and operate a high-throughput, real-time data integration platform and collaborate with teams to define data...$160k - $220k
Peregrine in San Francisco is seeking a Data Infrastructure Engineer to own the data layer that drives their operations. You will be responsible... ...for architecting systems that handle massive volumes of real-time data. The ideal candidate will have a passion for data infrastructure...$165k - $230k
NexHealth in San Francisco is seeking a Software Engineer to tackle challenging problems in healthcare integration. You will develop real-time API solutions to synchronize health records, driving significant growth and improvements in systems. The ideal candidate has extensive...- ReadyOn, headquartered in San Francisco, seeks a Data Engineer to lead data platform development. This role involves designing scalable... ...Snowflake, and Python, and will play a crucial role in orchestrating real-time workflows and ensuring data integrity. #J-18808-Ljbffr...
$99k - $147k
Paramount is seeking a Data Engineer for Self-Service Analytics & Real-Time Data Platforms in San Francisco, California. You will design scalable data products and develop solutions for analytics and AI applications. The ideal candidate has 2-4+ years of data engineering...$160k - $240k
Together AI is seeking a Senior Data Engineer to build and operate scalable data infrastructure for its mission-critical systems. You will work closely with our engineering team to design real-time analytics and billing systems capable of processing millions of events daily...$150k - $250k
...Role We are hiring a Sr Data Engineer / Data Lead to own... ...and be the person the rest of the engineering... ...factory‑floor data in real time Implement data lifecycle... ...application logic (APIs, event‑driven systems... ...pipeline frameworks (Spark, Flink, Kafka, Airflow, dbt, or...Full timeContract work$185k - $221.4k
...Build and own production data infrastructure.... ...commercial data from REST APIs, XML feeds, and file-... ...right shape at the right time. Uphold high engineering standards and... ...resolution across messy real-world sources, and data... ...patterns; comfortable with Spark or Trino at scale...Remote workFlexible hoursForesite Labs
San Francisco, CA1 day ago- Data/ETL Engineer (Founding Team) Location: San Francisco... ...Area Type: Full-Time Compensation:... ...and expose secure APIs for downstream services... ...frameworks (Kafka, Airbyte, Meltano,... ...Familiarity with GraphQL, RESTful APIs, and... ...want to model the real world, not just process...Full time
$225k - $285k
...learning research engineer at Scale AI . The rest of our team comes... ...at the exact time they’re looking for... ...market. As Senior Data Engineer for Enrichment... ...with data vendor APIs and the economics... ..., Dagster, Spark). Experience with... ...-person enables real-time collaboration...- ...leading robotic delivery company in San Francisco is seeking a Data Engineer to join their Data Team. In this role, you will design and... ...background in Python, SQL, and Google Cloud Platform. This full-time position offers a unique opportunity to impact urban logistics...Full time
$130.05k - $175.95k
The Onyx Research Data Platform organization... ...leadership, data engineering, infrastructure ,... ...and reducing time spent on “data mechanics... ...predictions in real-time Data Engineering... ...the use of APIs. They define and embed... ...data space, such as Spark, Kafka, Storm, etc., and...Local area- Decagon in San Francisco is looking for a Senior Data Infrastructure Engineer to design and operate the data systems that power its AI products.... ...and hands-on experience with technologies like ClickHouse, Kafka, and Airflow. The role offers a competitive salary range and...
- Peregrine is seeking a Data Infrastructure Engineer in San Francisco to take ownership of the data layer that supports all company operations. This... ...distributed data pipelines using technologies like Apache Spark and establishing best practices for data management....Work at office
- A tech startup in San Francisco is seeking a Backend Engineer to own their Java-based web application. This position requires expertise in distributed systems, RESTful APIs, and a passion for delivering excellent user experiences. The ideal candidate will work collaboratively...
- CoreWeave is seeking a Front End Engineer to advance its History data-visualization stack. You will enhance the core line plots driving real-time visualization for ML experiments and ensure high-performance rendering at scale in a UX-focused UI. Join a fast-moving team...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Real-Time Data Engineer: Kafka & Spark, REST APIs. Be the first to apply!
Related searches
- data engineer analytics San Francisco, CA
- data engineer manager San Francisco, CA
- remote data engineer San Francisco, CA
- junior data engineer remote San Francisco, CA
- senior cloud data engineer San Francisco, CA
- data platform engineer San Francisco, CA
- data infrastructure engineer San Francisco, CA
- aws data engineer San Francisco, CA
- director data engineering San Francisco, CA
- big data developer San Francisco, CA