Data Engineer

Data Engineer Company: Asylon Location: 52 Buttonwood Street, Norristown, PA 19401 Salary: $120,000 - $160,000 a year | Full-time Work setting: In-person Benefits: 401(k); Health insurance; Paid time off; Vision insurance; Dental insurance Job details Pay: $120,000 - $160,000 per year Job type: Full-time Schedule: Monday to Friday; Weekends as needed Full job description Job Overview We are seeking an experienced Data Engineer to architect, build, and maintain the complex, real-time data streams generated by our fleet of mobile and static robots. This role manages video, telemetry, and sensor data, ensuring low-latency processing for real-time monitoring, efficient debugging, and training of machine learning models. Due to the nature of the projects, applicants must be a U.S. Person as defined by 22 C.F.R. §120.62. This includes U.S. Citizens, lawful permanent residents, refugees, or asylees. Primary duties include: Design, build, and optimize high-throughput, low-latency data pipelines using cloud (Azure) and on-prem services, specialized for streaming and time-series data. Manage and process data generated from robot telemetry (position, velocity, battery life, etc.). Develop solutions for efficient ingestion, storage, and retrieval of high-resolution video and Lidar point cloud data. Facilitate efficient access to data for R&D teams. Work with software engineers to define data formats and communication protocols for transmission from the robot to the cloud. Implement mechanisms for dealing with intermittent connectivity and ensuring data completeness. Required Skills and Experience: Minimum of 3 years of hands-on experience in a Data Engineering role, with significant focus on real-time or streaming data. Experience with data storage services, including cloud-based (e.g., Azure Data Lake) and self-hosted. Expert-level proficiency in Python and data query languages. Experience with streaming data processing frameworks. Experience with time-series databases. Preferred Experience: 5+ years of experience in Data Engineering, particularly within robotics, IoT, or autonomous systems. Experience handling and processing video data at scale. Familiarity with Kubernetes for deploying scalable processing applications. Knowledge of geospatial data (GIS) processing and mapping libraries. Strong understanding of networking concepts and low-latency data transfer protocols relevant to robotics. Education: Bachelor’s degree (Required) Work Location: In person Application Question(s): Are you a U.S. Person as defined by 22 C.F.R. §120.62. This includes U.S. Citizens, lawful permanent residents, refugees, or asylees. Job Type: Full-time Pay: $120,000 - $160,000 per year #J-18808-Ljbffr