GCP Developer

GCP Developer

Location: Atlanta, GA

Required Qualifications:

• Candidate must be located within commuting distance of Atlanta, GA or be willing to relocate to the area.
• Bachelor's Degree or foreign equivalent, will consider work experience in lieu of a degree
• 7+ years of experience with Information Technology and Data engineering.
• 3+ years of experience in Big Data on Big Data, Python, Scala, Spark
• Over 2+ years of experience as data engineer working on cloud based data lakes.
• Experience on developing and supporting applications deployed in GCP (DataProc, Dataflow, Composer, Big Query, BigTable, GCS and various operators in DAG).
• Good experience in end-to-end implementation of DW BI projects, especially in data warehouse and data mart developments.
• Strong knowledge and hands-on experience in SQL, Unix shell scripting
• Knowledge and experience with full SDLC lifecycle

Preferred Qualifications:

• 4+ years of experience in software development life cycle
• 4+ years of experience in Project life cycle activities on development and maintenance projects
• Experience in Developing and supporting databases and related ETL (batch and real time processing). 3+ years of Experience in developing and supporting Hadoop systems / ETL pipelines.
• Good understanding of Data integration, Data Quality and data architecture
• Hands on knowledge of Google Cloud Platform on GCS, Bigtable, BigQuery
• Proficient in a Scala, Python programming for building and automating data pipelines
• Experience in building streaming pipelines using Kafka
• Experience with Java, Customer Data Platform products or In house implementations and TDD Test Driven Development.
• Good expertise in impact analysis due to changes or issues
• Experience in preparing test scripts and test cases to validate data and maintaining data quality
• Pre and post validation of data, strong skills in data validation frameworks, reconciliation of large data set between different systems
• Strong understanding and hands-on programming/scripting experience skills – UNIX shell, Perl, and JavaScript
• Hands-on development, with a willingness to troubleshoot and solve complex problems
• Good to have knowledge on container technology such as Docker, and Kubernetes
• Good to have knowledge on build management and CI/CD tools (Concourse, Jenkins), and monitoring tools (App Dynamics, etc.)
• Good knowledge on Airflow orchestration and preparing DAGs
• Ability to work in team in diverse/ multiple stakeholder environment
• Ability to communicate complex technology solutions to diverse teams namely, technical, business and management teams
• Experience managing team size of 2-3 would be a plus
• Excellent verbal and written communication skills
• Experience and desire to work in a Global delivery environment