Senior/Lead Data Engineer - Singapore

Kpler is hiring!

About

Kpler is a rapidly growing data intelligence company providing transparency solutions in the energy markets. We develop data pipelines that enrich data from hundreds of sources in real-time, ranging from logistics (satellite images) to governmental and shipping databases. We then derive and forecast key informations for commodities traders and analysts.

Job Description

We are looking for a Senior Data Engineer to join our software engineering team in Singapore (4 in Singapore, 25 engineers in total) to work on our data pipelines (collect, manage, data lake storage), data algorithms (based on either business rules, constraint programming, ML, etc.) and be a technical referent in Python and/or Scala.

Our future team member will have a good understanding of data collection and management of complex B2B business rules. Also, you will take ownership of large features from technical design through completion.

At Kpler, the Senior Data Engineer is at the centre of our research delivery and will have a key role in defining architecture, helping identify and implement areas for improvement within our data methodologies and technologies used.

Based in Singapore, you will also interact with the engineering team in Paris; being able to communicate efficiently in English (mandatory, we have more than 15 nationalities at Kpler!) and work with distributed team members is key.

Also, you will:

  • Coach and work on code review with more junior engineers
  • Ensure integrity of data through creative, robust and sustainable quality control methods
  • Participate in operations/support of the real-time platforms
  • Participate in defining coding standards, specifications and development processes
  • Translating technical concepts to/from non-technical language

Preferred Experience

Requirements to be a good fit:

  • At least 5 years of experience in similar roles working Python and/or Scala and cloud infrastructure (Amazon AWS) on linux servers
  • Experience with SQL (PostgreSQL or equivalent)
  • Proficiency developing automated unit and integration tests and continuous integration
  • Ability to learn quickly and deliver high quality code in a fast-paced, dynamic team environment
  • Business sense to understand dataset and how to improve their use
  • Experience leading or managing a team

Nice to have:

  • Knowledge of SqlAlchemy, Scala Play2, ElasticSearch, Heroku
  • Experience of data management lifecycles (collection, cataloguing, ETL design)
  • Experience with geographic information systems (PostGIS for instance)
  • Experience of LEAN methodologies and approaches to process optimisation

Additional Information

  • Contract Type: Full-Time
  • Location: Singapore, Singapore (048623)
  • Experience: > 5 years