Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Data Engineer

Diverse Lynx

Job DescriptionJob Description ROLE_DESCRIPTION - Payrate 60/hr Overview: We are seeking an experienced AWS Data Engineer with expertise in ETL processes, AWS Lambda, Redshift, and proficiency in Python and PySpark. This role requires hands-on experience with cloud-based architecture, data engineering, and working with large-scale data processing systems. The ideal candidate will play a critical role in building and maintaining scalable, efficient, and secure ETL pipelines within the AWS ecosystem. Key Responsibilities: " Design, develop, and maintain robust ETL workflows to extract, transform, and load data from various sources to AWS Redshift and other cloud-based systems. " Leverage AWS Lambda to build serverless computing solutions for real-time data processing and automation. " Work with AWS data storage and processing services, including S3, Redshift, Athena, and Glue, to support data processing pipelines. " Utilize Python and PySpark to create and Eligible to workimize data transformation logic and analytical queries. " Collaborate with cross-functional teams to understand data requirements and provide efficient data solutions. " Monitor and Eligible to workimize cloud-based infrastructure for performance, reliability, and cost efficiency. " Troubleshoot and resolve data pipeline issues, ensuring minimal downtime and high data accuracy. " Implement automation and monitoring tools to enhance reliability. Required Skills and Qualifications: " Proven experience working with AWS services, including Lambda, Redshift, S3, Athena, Glue, and CloudWatch. " Strong knowledge and hands-on experience with Python and PySpark for data transformation and processing. " Expertise in building and Eligible to workimizing ETL pipelines in a cloud environment. " In-depth understanding of relational databases, data warehousing, and performance tuning in Redshift. " Strong problem-solving and troubleshooting skills. " Familiarity with infrastructure as code tools like AWS CloudFormation. " Experience with version control (e.g., Git) and CI/CD pipelines. " Solid understanding of data security, data privacy, and compliance frameworks. " Ability to work in an agile, fast-paced environment.

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in Malvern, IA vacancy
  •  ...DescriptionOverviewThis is a hybrid role - 2 days remote and 3 days in the Malvern, PA office.CubeSmart is seeking a Manager, Data Engineering to lead the team responsible for building and evolving the enterprise data platform that powers analytics, reporting, AI, and... 
    Suggested
    Work at office
    Remote work

    CubeSmart

    Malvern, IA
    4 days ago
  •  ...Job DescriptionJob DescriptionWe are seeking an experienced Senior Full Stack Developer to support a critical enterprise modernization...  ...meet tight quarterly deliverables. You will work closely with engineering teams to build robust Java/Spring Boot REST APIs and modern... 
    Senior

    V-Soft Consulting Group

    Malvern, IA
    4 days ago
  • Hillcrest Health & Living is seeking a compassionate PRN Occupational Therapist to join the rehabilitation team at Glen Haven Village in Glen Haven. The role offers flexible, as-needed scheduling and the opportunity to help aging adults regain independence and improve quality...
    Senior
    Relief
    Flexible hours

    Hillcrest Health & Living

    Glenwood, IA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!