Data Engineer

Location: Singapore
Job Type: Temporary / Contract
Reference: JO-2105-11572

Responsibilities:

  • Understand business processes, applications and how data is stored and gathered.
  • Develop and manage streaming data pipelines at enterprise scale.
  • Build expertise on the data. Own data quality for various data flows.
  • Design, build and manage data marts to satisfy our growing data needs.
  • Support data marts to provide intuitive analytics for internal customers.
  • Design and build new framework and automation tools to enable teams to consume and understand data faster.
  • Use your expert coding skills across a number of languages like SQL, Python and Java to support data scientists.
  • Interface with internal customers to understand data needs.
  • Collaborate with multiple teams and own the solution end-to-end.
  • Maintain infrastructure for our data pipelines.
  • Perform any other ad-hoc duties.

Requirements:

  • Tertiary education in Computer Science or any related technical field. Master or PhD degree is a plus.
  • Minimum 2 years of AWS experience on data projects.
  • Minimum 2 years of advanced Python or Java development is required. Scala or Kotlin experience is a plus.
  • Minimum 2 years of SQL experience such as PostgreSQL, Oracle, AWS Redshift, or Hive is required. NoSQL experience is a plus.
  • Minimum 2 years' experience working with Linux OS. Knowledge of networks and cybersecurity is a plus.
  • Experiences with front end frameworks like ReactJS, Angular or VueJS.
  • Experience with modern MapReduce/workflow distributed systems, especially Apache Spark. Experience with Apache Kafka is a plus.
  • Experience working with infrastructure-as-code systems like AWS CloudFormation.
  • Experience in custom ETL pipeline design, implementation and maintenance.Experience working with visualization tools like Tableau or Apache Superset.
  • DevOps experience is an added advantage.
  • Ability in analyzing data to identify deliverables, gaps and inconsistencies.
  • Ability in managing and communicating data mart plans to internal customers