Data Engineer

Data Engineer

Portland, Los Angeles, Las Vegas, Denver, Vancouver, BC

What You Will Do:

• Build new systems to provide real-time streaming analytics and event processing pipeline based on fast data architecture
• Build enterprise grade data lake to support both business analytical needs and next generation data infrastructure
• Building data integration toolkit for backend services
• Support our data science team in deploying new algorithms for matchmaking, fraud and cheat detection
• Find better ways to move massive amounts of data from a variety of sources to formats consumable by reporting systems and people
• Improve monitoring and alarms that impact data integrity replication lag
• Support our product development team in creating new events to measure/track

What You Need:

Basic Qualifications:

• At least 4-5 years of experience in Scala/Java or Python programming
• AWS data products (Data pipelines, Athena, Pinpoint, S3, etc)
• Experience deploying data infrastructure
• Experience with recognized industry patterns, methodologies, and techniques

Nice to Haves:

• Familiarity with Agile engineering practices
• 2+ years of experience on Kubernetes, Helm chart
• 4+ years of experience with Spark, Scala and/or Akka
• 4+ years of experience with Spark Streaming, Storm, Flink, or other Stream Processing technologies
• 2+ years of experience working with Kafka or similar data pipeline backbone
• 4+ years of experience with Unix/Linux systems with scripting experience in Shell, Perl or Python
• 3+ years' experience with NoSQL implementation (Elasticsearch, Cassandra, etc. a plus)
• At least 4-5 years of experience with Unix/Linux systems with scripting experience
• Familiarity with Snowflake or OLAP
• Familiarity with Kinesis, Lambda
• Prior experience in gaming/Esports
• Prior experience in finance