Software Engineer - Data Streaming Platforms
Eccalon LLC
Software Engineer – Data Streaming Platforms EOE Statement: Eccalon provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training. EEO is the law. Category: Software Engineer Description We are seeking a Software Engineer with a strong focus on data streaming and real‑time processing platforms to help design, build, and operate scalable, high‑throughput, low‑latency systems. This role will work on distributed systems that ingest, process, and deliver streaming data used for analytics, machine learning, monitoring, and mission‑critical applications. You will collaborate closely with data engineers, platform engineers, product teams, and infrastructure to ensure reliability, performance, and scalability across streaming pipelines. Responsibilities Design, build, and maintain scalable data streaming pipelines Develop and operate event‑driven architectures using streaming technologies Implement real‑time and near‑real‑time data processing applications Ensure data correctness, ordering, fault tolerance, and exactly‑once or at‑least‑once semantics as required Contribute to the design and evolution of streaming platforms and internal data infrastructure Build resilient, high‑availability services capable of handling large volumes of data Optimize systems for throughput, latency, and resource efficiency Participate in capacity planning and performance tuning Implement monitoring, logging, alerting, and metrics for streaming applications Debug production issues related to performance, lag, data loss, or backpressure Support on‑call rotations and incident response for critical data systems Improve automation, deployment pipelines, and operational tooling Collaborate with product, analytics, and ML teams to support data use cases Write clean, maintainable, and well‑tested code Participate in design reviews, code reviews, and technical discussions Contribute to documentation and engineering best practices Required Qualifications Bachelor’s degree in Computer Science, Computer Engineering, or a related technical field (or equivalent practical experience). 3+ years of professional software engineering experience. Systems Programming: 2+ years of hands‑on experience programming real‑time applications at the low‑level / packet level using C, C++, or Rust. Must be highly comfortable with manual memory management, pointer manipulation, and multi‑threaded optimizations. Strong experience in a modern concurrency language like Go or Python for stream orchestration, tooling, and control‑plane API development. Network Protocols: Deep, foundational understanding of UDP and TCP/IP networking mechanics. Direct experience managing socket programming, custom congestion control, packet pacing, and error correction techniques (ARQ / selective retransmission). Media Transport: Proven experience with broadcast and linear video workflows, including media containers and multiplexing (specifically MPEG‑TS wrappers). Experience building custom stream troubleshooting, diagnostic, or real‑time monitoring software. Codecs: Codec‑agnostic architecture mindset with low‑level implementation knowledge of H.264/AVC, H.265/HEVC, and emerging standards like AV1. Automation & Scripting: Strong scripting capabilities in Python or Bash for stream orchestration, pipeline automation, and local‑first systems management. Preferred Qualifications Direct development experience with libsrt, librist, RTMP, or similar APIs. Deep familiarity with open‑source media frameworks like FFmpeg, Astreamer, GStreamer, and low‑level packet streaming tools. Experience using network analysis to debug packet loss, jitter, clock drift, and MTU issues on live networks. Familiarity with AWS, GCP, or Azure specifically regarding networking components (firewall traversal, listener/caller architecture, and high‑bandwidth ingress). Lightweight containerization experience or portable streaming endpoints or edge‑compute tools. Knowledge of serialization formats (like Protobuf or JSON) strictly for control‑plane APIs and performance telemetry aggregation. Job Type: Full‑Time (Exempt) #J-18808-Ljbffr Eccalon LLC
- ...Job Title Senior Platform Software Engineer - GCP & Data Platforms Overview / Summary We are seeking a Platform Software Engineer... ...~2+ years of experience with data pipelines and streaming technologies such as Apache Beam and Kafka ~ Experience...Platform
- Eccalon LLC in Detroit, Michigan is looking for a Software Engineer focused on data streaming platforms. The role involves designing and maintaining high-throughput, low-latency systems for real-time processing and analytics. The ideal candidate will have over 3 years of...PlatformFull time
$216.42k
...robust, and spike-resistant data consumption, data mining, and... ...next generation data processing platform using Beam and Spark in the... ...systems in the cloud. Champion engineering excellence by continuously... ...(5) years of experience as a Software Engineer, Programmer Analyst,...PlatformLocal areaRemote workWork from home$123.8k - $173.1k
We are seeking an Engineering Manager, Data Platform & Governance to lead the development of our data capabilities... ...will partner closely with Product, Software Engineering, AI/ML, Security, Legal,... ...data pipelines, ETL/ELT processes, streaming architectures, and data integration...PlatformTemporary workWork at office- Motion Recruitment Partners LLC is looking for an AI Engineer/Data Scientist in Detroit, Michigan. The role involves developing AI solutions, leveraging technologies such as Python, SQL, and Databricks. With 2+ years of experience in AI or data science and a Bachelor’s...Platform
- ...Glue and PySpark. Integrate data from various sources into... .... Mentor and guide junior engineers on the team. Continuously... ...concepts across both batch and streaming patterns Solid understanding... ...in various database platforms, ETL solutions/products, Infrastructure...PlatformWork experience placementWork at office2 days per week3 days per week
- ...Global Services Inc in Dearborn, MI is seeking an experienced Data Engineer (GCP) to design, build, and maintain scalable data solutions.... ...role emphasizes developing reliable data pipelines and data platforms for efficient data handling. With 7+ years of experience required...Platform
- Rocket, based in Detroit, seeks a Senior Data Engineer to design, develop, and maintain data platforms. The role requires 7 years of data solution experience, proficiency in SQL and NoSQL, and expertise in Python. As a senior team member, you’ll mentor others and ensure...Platform
- An established industry player seeks a Data Factory Engineer to join their innovative team in Dearborn. This role involves designing and implementing ingestion patterns for a cutting-edge data platform using Google Cloud technologies. The ideal candidate will have extensive...Platform
- ...Full-Stack Software Engineer We are the movers of the world and the makers... .... Utilizing a Google Cloud Platform (GCP) edge-to-cloud... ...Integration: Architect and manage data pipelines using SQL and NoSQL... ...Management Systems. Streaming & IoT: Understanding of real...PlatformFull timeImmediate startRemote workRelocationFlexible hours
$85.4k - $192.9k
...seeking an experienced Full-Stack Software Engineer to build the software... ...seamlessly with cloud backends. Data Architecture: Design and... ...building on Google Cloud Platform (GCP) or similar (AWS/Azure)... ...) for real-time data streaming. A passion for "Agentic"...PlatformImmediate startVisa sponsorshipRelocation packageFlexible hours$140k - $200k
...include frontend and backend engineers, AI research scientists, and... ...The responsibilities of our Platform team include building and maintaining... ...'re looking to hire for our Data side of our AI team at... ...We are looking for a skilled Software Engineer to join us. What...PlatformRemote jobFull timeWork at officeShift work- A leading technology firm in Michigan is seeking a Senior Data Engineer to design and maintain robust data solutions. Responsibilities include ensuring data infrastructures are efficient and scalable while collaborating with business stakeholders to meet data requirements...Platform
- ...The Role As a senior engineer, you will lead the... ...operation of secure cloud platforms and services. You will... ...solutions. Design data models and manage data... ..., and event streaming. Mentor and coach other... ...years of experience as a software engineer or security engineer...PlatformLocal areaWork from home
- Canopy Limited is seeking an Engineering Manager for Data Platform & Governance to lead the development of data capabilities across connected security products. This role is vital for defining our data strategy and building scalable platforms. The ideal candidate will have...Platform
- ...ideal candidate will have over 8 years of experience in AI/ML engineering, coaching stakeholders, and delivering client-facing... .... Key responsibilities include deploying ML systems, building data platforms, and leading workshops with partners. #J-18808-Ljbffr SMEPlatform
- A leading outdoor communities company is seeking a Senior Data Engineer to build and maintain their Azure data platform. The role involves developing data governance policies, managing data ingestion, and mentoring the data team. Candidates should have a Bachelor's Degree...Platform
$163k - $369.8k
...professionals delivers a full stack of integrated cloud capabilities across data, edge, integrated infrastructure and applications, deep... ...cloud and AI offerings. You’ll be responsible for aligning platform capabilities, industry priorities, and commercialization strategy...PlatformWork experience placementLive inWork at officeLocal area- ...Consulting Firm is seeking an AI/ML Engineer for a top Signal Processing... ...working with time-series data. Develop specialized... ...states from underlying data streams to support large-scale sensing... ...Kubernetes) or working with cloud AI platforms (AWS, Azure, Google) is...PlatformHourly payFull timeWeekend work
- ...Job Title: Senior Data Engineer (GCP, Big Data, Data Warehousing) Overview / Summary: We are seeking a Senior Data Engineer... ...for reliable workflows Design and manage data platforms including data warehouses, data lakes, and lakehouse architectures...Platform
$85.4k - $232.7k
...obsessed, entrepreneurial, and data-driven and is dedicated to... ...Connected Vehicle Cloud Platform, which connects over 26... ...Delivery: Take ownership of software services from initial... ...handling massive, real-time data streams. Drive Engineering Excellence: Champion clean...PlatformImmediate startWorldwideFlexible hours$140.63k - $184.14k
...further. What you'll be able to do: Data Engineer - positions offered by Ford Motor... ...deliver reusable patterns using Google Cloud Platform (GCP) services: Big Query, Dataflow,... ...App Engine, as well as real-time data streaming platforms like Apache Kafka, GCP Pub/Sub...PlatformImmediate startWork from homeFlexible hours$174.9k - $222k
...Description The Role As a Senior Software Engineer on GM's Notification Platform team , you will play a key role... ...databases ( SQL and NoSQL ), data modeling, and caching strategies.... ...notification systems , or event streaming technologies . Hands-on...PlatformTemporary workWork experience placementLocal areaWork from homeRelocation packageFlexible hours$138.7k - $175.45k
...Data Engineering Role This role is categorized as hybrid. This means... ...data scientists, analysts, software engineers, and business teams... ...support for enterprise data platforms. ~ Data engineering experience... ...optimize scalable batch and streaming data pipelines using...PlatformFull timeH1bRelocation packageFlexible hours$99.55k
...Consult with managerial, engineering, and technical... ...development of security software. RATE OF PAY $99,549... ...integration. Identify systems data, hardware, and... ...process Document aThingz Platform configuration... ...techno functional work streams Subject matter in the...PlatformOdd jobWork experience placementRemote workRelocationFlexible hours- ...Vice President of Data Engineering and Analytics About the Company Fast-growing iGaming... ...gaming, fintech, or high-volume consumer platforms, and a deep understanding of key... ...with orchestration tools, real-time data streaming, and a background in fraud detection or...Platform
- FastTek Global in Dearborn, Michigan is looking for a Data Engineer to design, build, and maintain efficient data solutions. Ideal candidates... ...in data mining, business intelligence, and Google Cloud Platform. Responsibilities include collaborating with stakeholders, designing...Platform
$150k - $195k
...the digital infrastructure platform within Consor Engineers, a leading North American... ...are looking for a Senior Software Engineer who is equally comfortable... ...clearly about algorithms, data structures, and system... ...serialization, and Redis Streams for real-time data...PlatformLocal areaRemote work$56 - $62 per hour
...Description We’re looking for a Senior Data Engineer to build and maintain the data pipelines... ...data ecosystems, including CRM platforms, CDPs, or Martech/Adtech data flows Exposure... ...data environments Working knowledge of streaming data pipelines or event-driven architectures...Platform$100k - $110k
Immediate need for a talented Big Data Engineer . This is a Fulltime opportunity with long-term... .... Develop and manage real-time data streaming solutions using Apache Kafka. Create... ...operational efficiency across cloud-based data platforms. Participate in code reviews,...PlatformFull timeLocal areaImmediate start
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer - Data Streaming Platforms. Be the first to apply!
- software engineer internship remote Detroit, MI
- machine learning software engineer Detroit, MI
- senior robotics software engineer Detroit, MI
- software developer night shift Detroit, MI
- software engineer entry level Detroit, MI
- software development engineer aws Detroit, MI
- startup software engineer Detroit, MI
- part time software developer remote Detroit, MI
- graduate software engineer Detroit, MI
- senior software engineer remote Detroit, MI


