ユニコーンIT企業でのデータエンジニア（Data Platform）の求人

【DESCRIPTION】
As a Data Engineer at our company, you will be focused on the design and implementation of components and systems that collect, transform, and enrich data from client applications (Android, iOS, web) and backend servers.

We leverage existing open source technologies like Kafka, Presto, Spark, and cloud services such as Google Cloud Platform and Amazon Web Services. As a member of our team, you will spend time designing and growing the infrastructure for facilitating data usage and analytics at our company.

●What the Data Platform team manages:
・Real-time streaming infrastructure: To enable teams to move quickly and minimize the time between data production and analytics, getting accurate data with minimal delay is a core focus.
・Data workflow management: A common system that enables users to schedule data-related workflows with a code-as-configuration model and web front end to simplify and standardize data-related development across the company.
・Machine learning infrastructure: Leveraging our data pipeline to facilitate the development of machine learning models for internal analytics and product improvement.
・Analytics SDK: A common SDK for Android, iOS and Web to track user events from the our client side, in order to drive improvements in the user experience.

●The work includes:
・Developing and automating large scale, high-performance data processing systems to drive our business growth and improve the user experience of our products.
・Designing models for optimal data storage and retrieval, and optimizing the data architecture to meet critical product and business requirements.

【REQUIREMENTS】
・3+ years relevant industry experience
・Ability to analyze large data sets, provide data insights, and drive effective product solutions
・Working knowledge of relational databases and query authoring (SQL)
・Experience designing and deploying high performance systems with robust monitoring and logging practices
・Excellent communication skills
・Love to use and develop open source technologies like Kafka, Hadoop, Hive, Presto, and Spark