Real-Time Data Engineer: Kafka & Spark, REST APIs
Stepping Up Solutions
Stepping Up Solutions is seeking a skilled Data Engineer to join their Data Technology team. The successful candidate will design and implement scalable data infrastructure while ensuring the efficiency of data transformations developed by data scientists. The role involves optimizing a data processing portal for real-time analytics and maintaining data in both MySQL and NoSQL systems. Candidates should have significant experience in a data-intensive environment and proficiency in Java or Python. #J-18808-Ljbffr Stepping Up Solutions
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Real-Time Data Engineer: Kafka & Spark, REST APIs in San Francisco, CA vacancy
- A technology company in San Francisco is seeking a Senior Software Engineer to design and build APIs for delivering real-time data to customers. The role involves hands-on collaboration with engineering teams and utility partners, requiring expertise in API development...Suggested
- ...Description RadiumOne is seeking a Data Engineer to join our Data Technology... ...for the companies two real-time analytics platforms. You... ...AWS to our in-house servers (Kafka – Spark) allowing for the portal to... ...plus. Experience building RESTful APIs. Experience in agile...SuggestedLocal area
Stepping Up Solutions
San Francisco, CA1 day ago - ...professional software engineering experience building and... ...(backend services, data platforms, or ML/AI infrastructure... ...frameworks such as Spark, Kafka, or Flink , Machine... ...) Background in real-time decision engines or stateful... ...them with our APIs to enable real-time scoring...Suggested
$140k - $160k
...Reports To: VP of Engineering FLSA Status:... ...Type: Full-Time Compensation:... ...carriers in real time. Every... ...technology and data‑driven... ...Databricks, Kafka, DBT) Define... ...Integrate LLM APIs (OpenAI, Anthropic... ...technologies (Kafka, Spark, HEVO,... ...in Python and RESTful API...SuggestedFull timeLocal areaFlexible hours$200k - $260k
A leading AI infrastructure company is seeking a Senior Platform Engineer to manage the API and infrastructure layer for voice workloads. This pivotal role involves building real-time WebSocket and APIs and designing autoscaling for voice applications. Candidates should...Suggested- Arena Club is looking for a Senior Data Engineer to join their team in San Francisco, California. In this role, you will enhance operational... ...include managing ETL pipelines and leading the migration to real-time data processing. If you are passionate about data-driven...
- ...driven mobile advertising company in San Francisco is seeking a Data Engineer to join its engineering team. This role involves designing,... ...data pipelines, and proficiency in technologies such as Kafka and Spark. This position offers an opportunity to drive performance and...
- Judgment Labs, based in San Francisco, is seeking a Senior Data Infrastructure Engineer to design and scale real-time data pipelines critical for agent behavior analysis. The ideal candidate should have over 6 years of experience managing high-throughput, petabyte-scale...
$95k - $230k
...the team to use at any time. We’ll consider your application... ...home. YOUR ROLE AS A DATA ENGINEER AT 0X You're excited... ...ETL pipelines for real-time and batch data processing... ...development of 0x Data APIs to support internal and... ...Experience with Apache Kafka or other data pub/sub...Remote jobWork at officeLocal areaWork from homeFlexible hours$160k - $225k
...driven security company based in California is looking for a Data Infrastructure Engineer. This role focuses on designing and maintaining scalable... ...of experience in data infrastructure, a strong grasp of real-time and batch processing, and familiarity with cloud...Flexible hours$185k - $225k
...rely on to retrieve real‑time, accurate, and... ...Our team includes engineers, researchers, product... ...looking for a hands‑on Data Engineer to help... ...Databricks, AWS, and Kafka, while helping ensure... ...like Databricks, Spark, Kafka, and AWS services... ...in December to rest and recharge* • A...Full timeContract workFor contractorsFor subcontractorWork at officeImmediate startRemote workWork from homeFlexible hoursY.O.U.
San Francisco, CA14 hours ago$135k - $180k
...thinking about — in real time, at scale, across every screen. Our data exists with the... ...transformations using Apache Spark (PySpark/Scala)... ...and manage REST APIs to support secure... ...analysts, and software engineers to deliver... ...streaming data pipelines (Kafka, Flink) $135,000...- RZR Global Inc. is seeking an experienced Data Engineer in San Francisco. This role involves designing and maintaining large-scale data... ...should have over 6 years in data engineering, expertise in Kafka, Spark, and ClickHouse, and possess a degree in Computer Science or...
$160k - $240k
Together AI is seeking a Senior Data Engineer to build and operate scalable data infrastructure for its mission-critical systems. You will work closely with our engineering team to design real-time analytics and billing systems capable of processing millions of events daily...- Kindredventures in San Francisco is looking for a talented engineer to develop full-stack solutions with intuitive user... ...hardware and design to ensure seamless integration, architect real-time APIs, and optimize data pipelines for low-latency applications. This is an...Full time
$150k - $250k
...Role We are hiring a Sr Data Engineer / Data Lead to own... ...and be the person the rest of the engineering... ...factory-floor data in real time Implement data lifecycle... ...application logic (APIs, event-driven systems... ...pipeline frameworks (Spark, Flink, Kafka, Airflow, dbt, or...Full timeContract work- Data/ETL Engineer (Founding Team) Location: San Francisco... ...Area Type: Full-Time Compensation:... ...and expose secure APIs for downstream services... ...frameworks (Kafka, Airbyte, Meltano,... ...Familiarity with GraphQL, RESTful APIs, and... ...want to model the real world, not just process...Full time
$130.05k - $175.95k
The Onyx Research Data Platform organization... ...leadership, data engineering, infrastructure ,... ...and reducing time spent on “data mechanics... ...predictions in real-time Data Engineering... ...the use of APIs. They define and embed... ...data space, such as Spark, Kafka, Storm, etc., and...Local area£75k - £95k per year
Join to apply for the Data Engineer role at Surecall Tech Join to apply... ...that help customers in real-time, and now they’re looking for... ...pipelines (batch + real-time) using Spark, Kafka, Airflow, dbt Designing... ...governance in mind Integrating APIs and external data sources...Full timeFreelanceRemote workFlexible hours$168k - $240k
...Staff Data Engineer The Data team is responsible for designing... ...both batch and real‑time / streaming workloads... ...such as Python, SQL, Spark, Flink, Beam, or equivalents... ...streaming data (e.g. Kafka, Kinesis, Flink, Spark... ...chain indexing, chain APIs, etc. Experience with...Contract workWork at officeRemote workFlexible hoursI did my part and supported the Regular Toilet
San Francisco, CA10 days ago$225k - $285k
...learning research engineer at Scale AI . The rest of our team comes... ...at the exact time they’re looking for... ...market. As Senior Data Engineer for Enrichment... ...with data vendor APIs and the economics... ..., Dagster, Spark). Experience with... ...-person enables real-time collaboration...$185k - $221.4k
...Build and own production data infrastructure.... ...commercial data from REST APIs, XML feeds, and file-... ...right shape at the right time. Uphold high engineering standards and... ...resolution across messy real-world sources, and data... ...patterns; comfortable with Spark or Trino at scale...Remote workFlexible hours- Founders Bay Inc. is looking for a hands-on Data Engineer in San Francisco to build and scale our modern data platform. You will work closely... ...The role requires strong experience with Databricks, AWS, and Kafka, along with skills in Python and SQL. You will have the...
- APPIT Software Solutions is hiring a Senior Data Engineer (Apache Spark) in San Francisco, USA . Lead the design of large-scale distributed data... ...computing best practices and Spark internals Build and maintain real-time and batch data pipelines with robust fault-tolerance...Flexible hours
$215.2k - $245.6k
...Lead Data Engineer Do you love building and pioneering in the technology... ...doers and disruptors who solve real problems and meet real... ...MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) 4+ years of experience working on real‑time data and streaming applications...InternshipLocal areaCapital One National Association
San Francisco, CA14 hours ago- ...We are seeking a Lead Data Engineer to architect, build, and... ...Salesforce), internal systems, APIs, and third‑party data... ...; experience with Spark or distributed... ...streaming architectures (Kafka, Event Hub, streaming pipelines... ...: Standing 20% of time, Sitting 70% of time, Walking...
Q-Cells
San Francisco, CA14 hours ago - Gerra Group in San Francisco is seeking a Senior Software Engineer to build core infrastructure for petabyte-scale data collection for leading robotics companies. You will design distributed systems for real-time sensor data and own critical data pipeline systems. The...
- ...Role: We are looking for a Senior Data Infrastructure Engineer to build and scale the real-time data pipelines that power agent... ...and batching systems (Kafka, Spark, Flink, or Ray) operating at petabyte... ...building pipelines that call LLM APIs at scale: request batching,...
$250k - $380k
...Francisco Employment Type Full time Department Scaling... ...Role We are looking for an engineer to design and implement the... ...maintain standardized dataset APIs, including for multimodal (MM) data that cannot fit in memory.... ...or dataset scaling for real-time data About OpenAI OpenAI...Full timeWork at officeLocal areaRelocation packageFlexible hours- Decagon AI, Inc. is looking for a Senior Data Infrastructure Engineer to design and operate the data systems that power its AI products. The successful... ...data infrastructure and proficiency with data technologies such as ClickHouse and Kafka. #J-18808-Ljbffr Decagon AI, Inc.
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Real-Time Data Engineer: Kafka & Spark, REST APIs. Be the first to apply!
Related searches
- remote data engineer San Francisco, CA
- data engineer intern San Francisco, CA
- entry level big data engineer San Francisco, CA
- big data devops engineer San Francisco, CA
- data engineer San Francisco, CA
- data engineer contract San Francisco, CA
- software data engineer San Francisco, CA
- data engineer graduate San Francisco, CA
- big data cloud engineer San Francisco, CA
- junior big data engineer San Francisco, CA