Data Engineer

Job Title

Responsibilities:

• Design and implement data ingestion and pipeline workflows as per business needs and technical specifications.
• Works independently and collaboratively with team; keeping the project team and leaders in the loop.
• Prepares detailed specifications from which data ingestion and pipeline processes are developed.
• Develops and implements technical solutions by code development and tool configuration.
• Querying databases using SQL to extract relevant data for analysis and troubleshooting of defects/bugs.
• Responsible for the development and execution of testing and implementation plans. Can perform unit, system, integration and user acceptance testing. Documents results.
• Participates in project planning and development or assumes responsibility for a project of limited scope.
• Provides options for and estimates of possible coding.
• May be responsible for the completion of a phase of a project or small projects depending on complexity.
• Estimates and tracks time required to complete work, for project budgeting and financial tracking.
• Conducts and participates in reviews of solution designs, configurations and code.
• Provides technical expertise for project and baseline support teams.
• Adheres to security standards to comply in the handling/processing/storing of sensitive data.
• Adheres to development standards and provides development standards recommendations.

Education Level: 4-Year Bachelor's Degree

Years of Experience: 3+ years of professional experience

Technical Skills and Qualifications:

• Must have:
  • Google Pub/Sub
  • BigQuery
  • Google Dataform
  • Data ingestion to Big Query experience
  • Google Cloud Storage
  • Cloud Composer
  • GitHub
  • SQL
• Good to have:
  • Cloud Data fusion
  • DBMS connectivity and interaction experience (SQL Server, DB2, Oracle)
  • Experience calling RESTful API's and SOAP Webservices
  • Experience integrating with other Google resources, databases, and services
  • Jira
  • Confluence