Database Developer

Database Developer

Software Guidance & Assistance, Inc., (SGA), is searching for a Database Developer for a right to hire assignment with one of our premier financial services clients in Rutherford, NJ.

Responsibilities

Design, develop, and maintain robust and scalable data solutions within our data lakehouse architecture, leveraging Apache Iceberg for open table format management.

Develop and optimize data ingestion, transformation, and curation processes using technologies compatible with Iceberg, Oracle, and Starburst.

Utilize Starburst (Trino) for high-performance querying and data virtualization across various data sources, including Iceberg tables and Oracle databases.

Work extensively with Oracle databases for enterprise data management, including schema design, stored procedures, performance tuning, and data integration.

Collaborate with data architects, data scientists, and business intelligence teams to translate business requirements into technical data models and data solutions.

Implement and manage ETL/ELT pipelines to move data efficiently between Oracle, data lake storage (e.g., S3, ADLS), and Iceberg tables.

Ensure data quality, integrity, and security across all data platforms, adhering to data governance standards.

Perform performance tuning and optimization for queries running on Starburst, Iceberg tables, and Oracle databases.

Participate in the evaluation and adoption of new data technologies and best practices to enhance our data platform capabilities.

Troubleshoot and resolve complex data-related issues, ensuring high availability and reliability of data infrastructure.

Document technical specifications, data flows, data models, and operational procedures.

Mentor junior team members and contribute to a culture of continuous learning and improvement.

The ideal candidate will be instrumental in designing, developing, and optimizing our data lakehouse environment, integrating traditional enterprise data sources with cutting-edge open table formats and query engines. This role demands a strong understanding of database development, data modeling, ETL/ELT processes, and distributed data processing.

Required Skills

Bachelor's degree in Computer Science, Information Systems, Data Engineering, or a related technical field.

7-10 years of experience in database development or data engineering roles.

Proven hands-on experience with Apache Iceberg for managing large-scale, high-performance table formats in a data lake context.

Strong expertise in Oracle database development, including SQL, PL/SQL, schema design, indexing, and performance tuning.

Experience with Starburst (Trino) for distributed query processing and federated queries across heterogeneous data sources.

Proficiency in SQL for complex data manipulation, analysis, and optimization.

Solid understanding of data warehousing concepts, dimensional modeling, and ETL/ELT methodologies.

Experience with cloud platforms (e.g., AWS, Azure, GCP) and their data storage services (e.g., S3, ADLS, GCS).

Familiarity with distributed data processing frameworks (e.g., Apache Spark, Flink).

Experience with version control systems (e.g., Git).

Excellent analytical, problem-solving, and communication skills, with the ability to articulate complex technical concepts.

Preferred Skills

Master's degree in a related field.

Experience with other data lake table formats (e.g., Delta Lake, Apache Hudi).

Knowledge of other distributed query engines (e.g., Presto, Athena, Dremio).

Proficiency in programming languages such as Python or Scala for data engineering tasks.

Experience with workflow orchestration tools (e.g., Apache Airflow, Dagster).

Familiarity with data governance tools and practices in a data lakehouse environment.

Relevant industry certifications (e.g., Oracle Certified Professional, AWS Certified Data Analytics).