Data Engineer

Data Engineer / Database Engineer

We are seeking a skilled and motivated Data Engineer / Database Engineer to support our growing team providing an enterprise data warehouse and visualization environment. The ideal candidate will have hands-on experience with Microsoft SQL Server, ETL pipelines, and cloud-based data ingestion tools—especially AWS Glue. You will be responsible for maintaining and enhancing our database systems, enabling near real-time data pipelines from source databases (Oracle, SQL, etc) to Microsoft SQL Server, and ensuring secure, efficient, and scalable data access.

Key Responsibilities:

• Support and maintain Microsoft SQL Server environments, with flexibility to adapt to alternative database platforms as the architecture evolves.
• Design and implement data pipelines using AWS Glue for efficient and scalable data ingestion.
• Build and maintain a near real-time data ingestion framework from Oracle databases to Microsoft SQL Server.
• Develop and manage ETL processes, including incremental/delta-based extraction of raw data from source systems.
• Build and optimize relational database schemas, ensuring performance, scalability, and data integrity.
• Implement and manage fine-grained roles and permissions in SQL Server to enforce data security and access control policies.
• Work closely with Data Analysts, Software Engineers, and other stakeholders to ensure data systems meet business requirements.
• Monitor and troubleshoot data pipelines and workflows to ensure reliability and consistency.

Qualifications:

• Proven experience with Microsoft SQL Server administration and development.
• Proficiency in ETL/ELT concepts and experience with tools like AWS Glue, Apache Spark, or equivalent.
• Solid understanding of Oracle database systems and data extraction methodologies (especially delta/change data capture techniques).
• Experience with cloud data platforms, particularly AWS (S3, Glue, RDS, etc.).
• Strong SQL skills and experience with role-based access control in database systems.
• Familiarity with scripting or programming languages (e.g., Python, Shell) for automation and data processing.
• Ability to work independently and communicate effectively in a collaborative team environment.

Preferred Skills (Not Required):

• Proficiency with Oracle GoldenGate or equivalent CDC (Change Data Capture) tools for real-time replication.
• Experience with modern data architectures (e.g., Data Vault 2.0).
• Knowledge of CI/CD practices for data engineering.
• Exposure to data cataloging and metadata management tools.