Senior Data Engineer

Job Title

Design and develop scalable Big Data applications on distributed platforms to support large-scale data processing and analytics needs. Able to partner with others in solving complex problems by taking a broad perspective to identify innovative solutions. Strong skills building positive relationships across Product and Engineering. Able to influence and communicate effectively, both verbally and written, with team members and business stakeholders. Able to quickly pick up new programming languages, technologies, and frameworks. Collaborate effectively in a high-speed, results-driven work environment to meet project deadlines and business goals. Utilize Data Warehousing tools such as SQL databases, Presto, and Snowflake for efficient data storage, querying, and analysis. Demonstrated experience in learning new technologies and skills.

Experience & Skills Fitment:

• 5+ years of experience in developing scalable Big Data applications or solutions on distributed platforms.
• 4+ years of experience working with distributed technology tools, including Spark, Python, Scala.
• Working knowledge of Data warehousing, Data modelling, Governance and Data Architecture.
• Proficient in working on Amazon Web Services(AWS) mainly S3, Managed Airflow, EMR/ EC2, IAM etc.
• Experience working in Agile and Scrum development process.
• 3+ years of experience in Amazon Web Services (AWS) mainly S3, Managed Airflow, EMR/ EC2, IAM etc.
• Experience architecting data product in Streaming, Serverless and Microservices Architecture and platform.
• 3+ years of experience working with Data platforms, including EMR, Airflow, Databricks (Data Engineering & Delta)
• Experience with creating/configuring Jenkins pipeline for smooth CI/CD process for Managed Spark jobs, build Docker images, etc.
• Working knowledge of Reporting & Analytical tools such as Tableau, Quicksite etc.

Benefits:

• Kloud9 provides a robust compensation package and a forward-looking opportunity for growth in emerging fields.

Equal Opportunity Employer:

• Kloud9 is an equal opportunity employer and will not discriminate against any employee or applicant on the basis of age, color, disability, gender, national origin, race, religion, sexual orientation, veteran status, or any classification protected by federal, state, or local law.