Lead Data Engineer - Remote must be in USA
Rootshell Enterprise Technologies
Lead Data Engineer
Remote must be in USA Skill Set: Pyspark, Python, AWS, GIS, Palantir Foundry Need a SME in Python coding (Data structures and algorithms) Responsibilities
• Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.
• Collaborate with product and technology teams to design and validate the capabilities of the data platform
• Identify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater scalability
• Provide technical support and usage guidance to the users of our platform's services.
• Drive the creation and refinement of metrics, monitoring, and alerting mechanisms to give us the visibility we need into our production services.
Qualifications
• Experience building and optimizing data pipelines in a distributed environment
• Experience supporting and working with cross-functional teams
• Proficiency working in Linux environment
• 5+ years of advanced working knowledge of SQL, Python, and PySpark
• Knowledge on Palantir
• Experience using tools such as: Git/Bitbucket, Jenkins/CodeBuild, CodePipeline
• Experience with platform monitoring and alerts tools
Remote must be in USA Skill Set: Pyspark, Python, AWS, GIS, Palantir Foundry Need a SME in Python coding (Data structures and algorithms) Responsibilities
• Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.
• Collaborate with product and technology teams to design and validate the capabilities of the data platform
• Identify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater scalability
• Provide technical support and usage guidance to the users of our platform's services.
• Drive the creation and refinement of metrics, monitoring, and alerting mechanisms to give us the visibility we need into our production services.
Qualifications
• Experience building and optimizing data pipelines in a distributed environment
• Experience supporting and working with cross-functional teams
• Proficiency working in Linux environment
• 5+ years of advanced working knowledge of SQL, Python, and PySpark
• Knowledge on Palantir
• Experience using tools such as: Git/Bitbucket, Jenkins/CodeBuild, CodePipeline
• Experience with platform monitoring and alerts tools
Vacancy posted more than 2 months ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer - Remote must be in USA. Be the first to apply!
Related searches
- research data coordinator United States
- data loss prevention analyst United States
- data auditor United States
- data analysis part time United States
- data operator United States
- data United States
- minimum data set coordinator United States
- alliance data United States
- oncology data United States
- data governance United States