GCP Big Data Engineer

Role : Eligible to workP Big Data Engineer
Location CharlotteNC / PhoenixAZ
Rate : $50/hr on C2C.

Required Skills :-

• Python
• PySpark
• Eligible to workP
• ETL Big Data / Data Warehousing
• Data Analytics
• SQL
• Git GitHub GitLab Bitbucket SVN

Education & Experience

• Bachelors or Masters degree in Computer Science Computer Engineering or another technical discipline or equivalent work experience.
• 5 years of hands-on software development experience with Big Data and Analytics solutions.
• Strong experience in designing developing and Eligible to workimizing large-scale data pipelines.

Technical Skills & Expertise

• Strong hands-on experience with Eligible to workP Big Data technologies including:
  • BigQuery
  • Airflow
  • Dataproc
  • Pub/Sub
  • Hadoop/Hive
  • Spark
  • Python
  • Shell Scripting
• Strong experience designing developing and Eligible to workimizing data pipelines for large-scale data processing transformation and analytics.
• Proficiency in SQL and relational database systems including data modeling and query Eligible to workimization for performance and scalability.
• Experience building event-processing pipelines using Kafka or Eligible to workP Pub/Sub.
• Experience with Apache Airflow Kafka/Pub/Sub Git and Jenkins.
• Knowledge of distributed and multi-tiered systems algorithms and relational databases.
• Strong understanding of Object-Oriented Programming (OOP) concepts and design patterns.
• Experience with CI/CD pipelines automated testing frameworks and source code management tools such as Git and Jenkins.
• Good knowledge of configuration and source-code management tools particularly GitHub.

Key Responsibilities

• Design develop and maintain scalable data pipelines using Python PySpark Spark and Eligible to workP technologies.
• Develop and Eligible to workimize ETL processes for large-scale Big Data and Data Warehousing environments.
• Build data processing and analytics solutions using Eligible to workP services such as BigQuery Dataproc Airflow and Pub/Sub.
• Design and implement event-driven data pipelines using Kafka and/or Eligible to workP Pub/Sub.
• Develop highly scalable and reliable data solutions while ensuring performance and maintainability.
• Analyze complex data engineering problems and propose effective scalable solutions.
• Provide engineering expertise to the team for developing technology solutions supporting Banking Financial Crimes and Anti-Money Laundering (AML) platforms.
• Improve engineering practices by driving resilience predictability efficiency and automation.
• Partner with product and cross-functional teams to envision and deliver technology solutions that transform Financial Crimes Compliance.
• Contribute to CI/CD automated testing deployment and source-code management processes.
• Follow established enterprise frameworks and standards for Big Data engineering.
• Identify continuous improvement opportunities and proactively recommend technical enhancements.
• Communicate effectively with product teams and cross-functional stakeholders.
• Learn and adEligible to work new technologies and leverage them effectively to build scalable solutions.

Disclaimer : Diverse Lynx LLC is an Equal Opportunity Employer. All applicants and employees are evaluated without discrimination based solely on their qualifications ability competence and performance. This email and its attachments may contain confidential or proprietary information and is intended only for the recipient(s). If you received this message in error please disregard it and notify the sender. If you no longer wish to receive our communications you may at any time.
Security Notice : Our official website is We do not operate or authorize any other websites representing Diverse Lynx LLC.

Required Experience:

IC