Data Engineer

Job Title

• 2–3 years of hands-on experience in Data Engineering

• Strong experience in Python and PySpark/Spark for large-scale data processing

• Experience working with Databricks and Delta Lake architecture

• Good understanding of SQL (PostgreSQL) and NoSQL databases (MongoDB, Redis)

• Exposure to Kafka Streaming or real-time data processing frameworks

• Experience with Azure or AWS cloud platforms

• Understanding of data partitioning, performance tuning, and in-memory optimizations

• Experience working in Linux/Unix environments

• Knowledge of CI/CD pipelines and production deployment practices

• Familiarity with REST APIs and application development concepts

• Understanding of software design patterns and system architecture

• Exposure to multi-user data platforms and access management

• GenAI exposure (preferred): understanding of LLM workflows, prompt versioning, evaluation frameworks