Data Engineer

Mô tả công việc

• Handling data quality (cleaning, data mapping / transformation, standardization…) for delivering clear business insights from a variety of raw data sources.
• Follow up the data incident in order to guarantee the data quality.

Yêu cầu

• Experience in software development (web application) is a must, full-stack will be a big plus.
• Master the relational SQL (a must) and NoSQL databases.
• Working experience with at least one of these technologies: Scala, Python, Spark (a must)
• Experience with data pipeline and workflow management and big data tools: Hadoop, Hive, Airflow Oozie, Spark, Kafka, Pig, etc
• Experience with Cloudera or Hortonworks (optional)
• Experience in playing games is a plus