Data Engineer - AI

To support data operations, the full-time Data Engineer - AI will create and manage Spark and SQL scripts for data validation and integration, optimize queries, and collaborate with cross-functional teams in a remote environment. Key responsibilities Create and execute Spark and SQL scripts for data management and validation Optimize queries to enhance task efficiency and perform data analysis to identify issues Collaborate with engineering and cloud operations teams to troubleshoot and resolve data-related issues Required qualifications Bachelor's degree in Computer Science, Information Technology, or equivalent experience 3+ years of experience with big data technologies (e.g., Spark, Hadoop) and cloud platforms (e.g., AWS, Azure, GCP) 3+ years of experience with RDBMS and proficiency in SQL or ETL tools Familiarity with data pipeline orchestration tools (e.g., Airflow, Databricks Workflows) Experience in data analysis, preferably in the healthcare industry