Senior Data Engineer - Paris

Kpler is hiring!


Founded in 2014, Kpler is a technology and intelligence company providing transparency solutions in the energy markets. Our software aggregates data from hundreds of sources including radar and satellite imagery as well as logistics, governmental and shipping databases. By connecting the dots across fragmented information landscapes, we bring our clients - mostly oil and gas companies, trading houses, public utilities and shipping companies, financial institutions and hedge funds - unique, real-time understanding of supply and demand in the commodities market.

From a start-up, Kpler has become an international company with seven offices worldwide - Houston, New York, London, Paris, Brussels, Dubai, Singapore - and over 100 employees of various backgrounds, with diversified skill sets and international experiences. This *fast-paced growth *has been achieved only organically, without relying on any venture capital - a unique case in the data industry.

Job Description

Role Purpose

We are looking for a Senior Data Engineer to join our software engineering team in Paris (25 engineers currently) to work on our data pipelines (collect, manage, data lake storage), data algorithms (based on either business rules, constraint programming, ML, etc.) and be a technical referent in Python and/or Scala.

Our future team member will have a good understanding of data collection and management of complex B2B business rules. Also, you will take ownership of large features from technical design through completion.

At Kpler, the Senior Data Engineer is at the centre of our research delivery and will have a key role in defining architecture, helping identify and implement areas for improvement within our data methodologies and technologies used.

Based in Paris, you will also interact with the Singaporean engineering team; being able to communicate efficiently in English (mandatory, we have more than 15 nationalities at Kpler!) and work with remote team members is key.

Also, you will:

  • Coach and work on code review with more junior engineers
  • Ensure integrity of data through creative, robust and sustainable quality control methods
  • Participate in operations/support of the real-time platforms
  • Participate in defining coding standards, specifications and development processes
  • Translating technical concepts to/from non-technical language

Preferred Experience

Requirements to be a good fit:

  • At least 5 years of experience in similar roles working Python and/or Scala and cloud infrastructure (Amazon AWS) on linux servers
  • Experience with SQL (PostgreSQL or equivalent)
  • Proficiency developing automated unit and integration tests and continuous integration
  • Ability to learn quickly and deliver high quality code in a fast-paced, dynamic team environment

Nice to have:

  • Knowledge of SqlAlchemy, Scala Play2, ElasticSearch, Heroku
  • Experience of data management lifecycles (collection, cataloguing, ETL design)
  • Experience with geographic information systems (PostGIS for instance)
  • Experience of LEAN methodologies and approaches to process optimisation

Additional Information

  • Contract Type: Full-Time
  • Location: Paris, France (75002)
  • Education Level: No Diploma
  • Experience: > 5 years