GCP Data Engineer

GCP Data Engineer

Location: Phoenix, AZ

Job Type: Contract

Job Description:

• A solid experience and understanding of considerations for large-scale solutioning and operationalization of data warehouses, data lakes and analytics platforms on GCP is a must
• Monitors the Data Lake constantly and ensures that the appropriate support teams are engaged at the right times
• Design, build and test scalable data ingestion pipelines, perform end to end automation of ETL process for various datasets that are being ingested
• Determine best way to extract application telemetry data, structure it, send to proper tool for reporting (Kafka, Splunk)
• Create reports to monitor usage data for billing and SLA tracking
• Work with business and cross-functional teams to gather and document requirements to meet business needs
• Provide support as required to ensure the availability and performance of ETL/ELT jobs
• Provide technical assistance and cross training to business and internal team members
• Collaborate with business partners for continuous improvement opportunities

Qualifications:

• 6+ years of experience in Data Engineering with an emphasis on Data Warehousing and Data Analytics
• 4+ years of experience with one of the leading public clouds
• 4+ years of experience in design and build of salable data pipelines that deal with extraction, transformation, and loading
• 4+ years of experience with Python, Scala with working knowledge on Notebooks
• 3+ years hands on experience on GCP Cloud data implementation projects (Dataflow, DataProc, Cloud Composer, Big Query, Cloud Storage, GKE, Airflow, etc.)
• At least 2 years of experience in Data governance and Metadata Management
• Ability to work independently, solve problems, update the stake holders
• Analyze, design, develop and deploy solutions as per business requirements
• Strong understanding of relational and dimensional data modeling
• Experience in DevOps and CI/CD related technologies
• Bachelor's Degree in Computer Science, Information Technology, Engineering, or related field
• Excellent written, verbal communication skills, including experience in technical documentation and ability to communicate with senior business managers and executives
• Excellent analytical, problem solving, and troubleshooting skills in large data warehousing environments

About Us:

InterSources Inc, a Certified Diverse Supplier, was founded in 2007, offers innovative solutions to help clients on Digital Transformations across various domains and industries. Our history spans over 13 years and today we are an Award-Winning Global Software Consultancy solving complex problems with technology. We recognize that our employees and our clients are our strengths as the diverse talents and opportunities they bring to the table enables us to grow as a global platform and they are causally linked with our success. We provide strategic and technical advice, and we have expertise in areas covering Artificial Intelligence, Cloud Migration, Custom Software Development, Data Analytics Infrastructure & Cloud Solutions, Cyber Security Services etc. We make reasonable accommodations for clients and employees and we do not discriminate based on any protected attribute including race, religion, colour, national origin, gender sexual orientation, gender identity, age, marital status. We also are a Google Cloud partner company. We align strategy with execution and provide secure service solutions by developing and using the latest technologies that thrives our resources to deliver industry leading capabilities to our clients and customers, making it convenient for our clients to do business with InterSources Inc. Our teams also drive growth by refining technology driven client experiences that put the users first, providing an unparalleled experience. This results in strengthening the core technologies of clients, enabling them to scale with flexibility, create seamless digital experiences and build lifelong relationships.