Data Engineer

Data Engineer Portland, Los Angeles, Las Vegas, Denver, Vancouver, BC What You Will Do: Build new systems to provide real-time streaming analytics and event processing pipeline based on fast data architecture Build enterprise grade data lake to support both business analytical needs and next generation data infrastructure Building data integration toolkit for backend services Support our data science team in deploying new algorithms for matchmaking, fraud and cheat detection Find better ways to move massive amounts of data from a variety of sources to formats consumable by reporting systems and people Improve monitoring and alarms that impact data integrity replication lag Support our product development team in creating new events to measure/track What You Need: Basic Qualifications: At least 4-5 years of experience in Scala/Java or Python programming AWS data products (Data pipelines, Athena, Pinpoint, S3, etc) Experience deploying data infrastructure Experience with recognized industry patterns, methodologies, and techniques Nice to Haves: Familiarity with Agile engineering practices 2+ years of experience on Kubernetes, Helm chart 4+ years of experience with Spark, Scala and/or Akka 4+ years of experience with Spark Streaming, Storm, Flink, or other Stream Processing technologies 2+ years of experience working with Kafka or similar data pipeline backbone 4+ years of experience with Unix/Linux systems with scripting experience in Shell, Perl or Python 3+ years' experience with NoSQL implementation (Elasticsearch, Cassandra, etc. a plus) At least 4-5 years of experience with Unix/Linux systems with scripting experience Familiarity with Snowflake or OLAP Familiarity with Kinesis, Lambda Prior experience in gaming/Esports Prior experience in finance 1872 Consulting