Cloud Engineer

Job Title

Technical Must Haves: Dremio application management with one year or more is a must have. Dremio performance tuning is a big plus. Data bricks or equivalent (Spark, PySpark) experience is a must have. EKS experience and experience in an AWS environment is a must have. Rest API development experience is a plus.

Vetting Questions -

1) Please describe the most significant performance issue that you have encountered for Dremio. Please list the exact steps that you took to resolve this performance issue. What was the impact of your resolution attempt? 2) Please describe the most complex business transformations that you have implemented using Data bricks? What was the volume of the data? What challenges did you face?

Job Description:

Required Skills:

• Dremio application management with one year or more experience is a must have.
• Strong hands on experience building ETL pipelines using Apache Spark.
• Hands on experience with AWS services such as Glue, EMR, Lambda, Step Functions, CloudTrail, CloudWatch, SNS, SQS, S3, VPC, EC2, RDS, IAM.
• Proficient in Python and/or Scala programming languages
• Knowledge of application development lifecycles, & continuous integration/deployment practices
• Experience with development on AWS and cloud native applications
• Experience with S3, DynamoDB, Kinesis and Snowflake
• Experience with Developing Data Platforms on AWS
• Proficient in Agile Software Development methodology, processes, and practices.
• Experience with the full ELK Stack - Elasticsearch, Logstash, Kibana, Beat agents and REST API integration.
• Experience with programming languages like GoLang, Java, JSON etc.
• Fine tuning the Search Relevancy according to the business requirements.
• Develop Elastic alerting solutions using Watchers and Kibana.
• Generate Alerts that will integrate into Service Now/Jira for ticketing.