Senior/Lead Data Engineer - Singapore

Kpler is hiring!


Founded in 2014, Kpler is a technology and intelligence company providing transparency solutions in the energy markets. Our software aggregates data from hundreds of sources including radar and satellite imagery as well as logistics, governmental and shipping databases. By connecting the dots across fragmented information landscapes, we bring our clients - mostly oil and gas companies, trading houses, public utilities and shipping companies, financial institutions and hedge funds - unique, real-time understanding of supply and demand in the commodities market.

From a start-up, Kpler has become an international company with seven offices worldwide - Houston, New York, London, Paris, Brussels, Dubai, Singapore - and over 100 employees of various backgrounds, with diversified skill sets and international experiences. This *fast-paced growth *has been achieved only organically, without relying on any venture capital - a unique case in the data industry.

Job Description

We are looking for a Lead Data Engineer to join our software engineering team in Singapore (4 engineers out of 30 engineers globally).

You will be responsible for designing, building, improving and maintaining our data pipelines - scrapping, mining and ETL processing - and will also be managing a team of engineers - hiring, growing and empowering them to accomplish great things, energizing them and ensuring that best practices, standards, and processes are adhered to. You will roughly spend 80-90% of your time working as a tech lead/senior data engineer, and 10-20% of your time in people management and coaching.

The technical stack includes: Python, Hadoop, Spark, Reddis, Scrappy, PostSQL, AWS

This role has potential to evolve into an engineering manager/site lead role.

Preferred Experience

• You have at least 5 years of experience in similar roles working with Python and/or Scala and cloud infrastructure (Amazon AWS) on linux servers
• You have some experience with SQL (PostgreSQL or equivalent) and Hadoop and/or Spark
• You are able to learn quickly and deliver high quality code in a fast-paced, dynamic team environment
• You have a strong Business acumen to understand dataset and how to improve their use
• You have acted as a Tech lead in your previous role and have a experience developing & mentoring other team members

Nice to have:
• Knowledge of SqlAlchemy, Scala Play2, ElasticSearch, HerokuExperience of data management lifecycles (collection, cataloguing, ETL design)
• Knowledge of ES6/AngularJS/Vue.js
• Experience with geographic information systems (PostGIS for instance)
• Experience of LEAN methodologies and approaches to process optimisation
• Experience directly managing a team (recruiting, managing performance reviews, compensation, attendance, etc)

Additional Information

  • Contract Type: Full-Time
  • Location: Singapore, Singapore (048623)
  • Experience: > 5 years