Data Engineer

Must Have Technical/Functional Skills

• 5+ years of data engineering experience.

• Demonstrated experience processing unstructured and multimodal data, including video, images, LiDAR, GNSS, IMU, and telemetry.

• Experience building pipelines that create curated AI training datasets through ingestion, synchronization, transformation, validation, and publishing.

• Strong Python and SQL skills with experience in distributed data processing frameworks.

• Experience with cloud data platforms, object storage, data lake or lakehouse patterns, workflow orchestration, and version control.

• Knowledge of data quality, metadata, lineage, schema management, and reproducible dataset pipelines.

 

Roles & Responsibilities

• Design, develop, and maintain scalable pipelines for camera, LiDAR, GNSS, IMU, and telemetry data.

• Normalize, synchronize, enrich, and package multimodal data for annotation and AI training.

• Implement automated checks for completeness, integrity, calibration, timestamps, formats, and dataset consistency.

• Create reusable data models, metadata standards, lineage, and dataset-versioning practices.

• Optimize pipeline performance, reliability, observability, and cost.

• Troubleshoot data defects and collaborate with AI, annotation, quality, and platform teams.

• Document technical designs, operating procedures, and handoffs.