Data engineer

Skills :

Role Summary

We are seeking a Data Engineer to help design build and scale a modern Realty Data Platform on AWS and Databricks This role will be responsible for developing data pipelines integrating data from multiple internal and external sources and creating trusted datasets that support analytics reporting and AIML driven insights across the Real Estate organization The ideal candidate combines strong hands on data engineering skills with experience in cloud native architectures largescale data processing and modern lake house platforms

Required Skills Experience

Data Engineering

Strong experience building ETLELT pipelines

Proficiency in Python PySpark and SQL

Experience working with Apache Spark and distributed data processing frameworks

Knowledge of data modeling data quality and data transformation techniques

Databricks

Hands-on experience with the Databricks Lakehouse Platform

Experience with Delta Lake Databricks Workflows and Unity Catalog

Ability to develop optimization and troubleshoot Databricks notebooks and jobs

AWS

Experience with AWS data services such as

Amazon S3

AWS Glue

Lambda

IAM

Event driven integrations and APIs

Understanding of cloud native data architecture patterns

Data Integration

Experience integrating data through REST APIs JDBC connections batch file transfers or streaming mechanisms

Familiarity with structured semi structured and unstructured data formats including JSON CSV and Parquet

AIML Advanced Analytics

Experience preparing and engineering datasets for machine learning and AI workloads

Understanding of AIML concepts feature engineering and model lifecycle processes

Exposure to Databricks ML MLflow vector search or Generative AI capabilities is a plus

Ability to collaborate with business teams to identify opportunities for predictive analytics trend analysis document intelligence and operational insights