Data Engineer

Data EngineerPortland, Los Angeles, Las Vegas, Denver, Vancouver, BCWhat You Will Do:Build new systems to provide real-time streaming analytics and event processing pipeline based on fast data architectureBuild enterprise grade data lake to support both business analytical needs and next generation data infrastructureBuilding data integration toolkit for backend servicesSupport our data science team in deploying new algorithms for matchmaking, fraud and cheat detectionFind better ways to move massive amounts of data from a variety of sources to formats consumable by reporting systems and peopleImprove monitoring and alarms that impact data integrity replication lagSupport our product development team in creating new events to measure/trackWhat You Need:Basic Qualifications:At least 4-5 years of experience in Scala/Java or Python programmingAWS data products (Data pipelines, Athena, Pinpoint, S3, etc)Experience deploying data infrastructureExperience with recognized industry patterns, methodologies, and techniquesNice to Haves:Familiarity with Agile engineering practices2+ years of experience on Kubernetes, Helm chart4+ years of experience with Spark, Scala and/or Akka4+ years of experience with Spark Streaming, Storm, Flink, or other Stream Processing technologies2+ years of experience working with Kafka or similar data pipeline backbone4+ years of experience with Unix/Linux systems with scripting experience in Shell, Perl or Python3+ years' experience with NoSQL implementation (Elasticsearch, Cassandra, etc. a plus)At least 4-5 years of experience with Unix/Linux systems with scripting experienceFamiliarity with Snowflake or OLAPFamiliarity with Kinesis, LambdaPrior experience in gaming/EsportsPrior experience in finance