Data Engineer

Data Pipeline EngineerByteDance is a technology company operating a range of content platforms that inform, educate, entertain and inspire people across languages, cultures, and geographies. Dedicated to building global platforms of creation and interaction, ByteDance now has a portfolio of applications available in over 150 markets and 75 languages. For example, TikTok, Resso, Helo, Douyin, and Huoshan.Our group is in charge of developing industrial, commercialized, enterprise-level solutions and products, to meet business requirements in various scenarios, such as Network Infrastructure Construction, System and Application Management, Large-scale Asset Management, Front-desk Service, Audio/Video Broadcasting Service, Server/Conference Room Intelligent Operation, Enterprise Administration, etc.Taking advantage of cutting-edge big data and AI technologies, we are aiming at building a more automated and intelligent enterprise solution infrastructure.Preferred location: Mountain View, CA / Los Angeles, CA / Seattle, WAAnd, you are responsible for:Design, construct, test and maintain robust, reliable, and scalable data pipeline infrastructure;Investigate and integrate up-and-coming big data technologies into existing requirements;Recommend different ways to constantly improve data reliability and quality;Install/update system and component fault-tolerant procedures;Employ an array of technological tools to integrate with 3rd-party data systems;Collaborate team members (e.g., data architects, data scientists) on the project's goals.Qualifications:B.S. in Computer Science or equivalent experience, M.S./Ph. D. a plus.Strong programming skills, master one or several mainstream programming languages, such as Java, Python, Go.Familiar with streaming/batch data processing framework such as Kafka Streaming, Flink, Spark.Familiar with big data open-source tools such as Kafka, ElasticSearch, Redis, Hbase, Druid etc.Able to troubleshoot system-level integration and performance issues.Fast learner and eager to absorb new emerging technologies, and enjoy working with other team members with strong collaboration and communication skills.Experience with Cloud platforms such as GCP and AWS is a plus.Experience with Docker & Kubernetes ecosystems is a plus.ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We believe individuals shouldn't be disadvantaged because of their background or identity, but instead should be considered based on their strengths and experience. We are passionate about this and hope you are too.