Senior Data Engineer - Paris

Kpler is hiring!

About

Kpler is a rapidly growing data intelligence company providing transparency solutions in energy markets. We develop data pipelines that enrich data from hundreds of sources in real-time, ranging from logistics (satellite images) to governmental and shipping databases. We then derive and forecast key informations for commodities traders and analysts.

What you will do

Role Purpose

We are looking for a Senior Data Engineer to join our software engineering team in Paris (25 engineers currently) to work on our data pipelines (collect, manage, data lake storage), data algorithms (based on either business rules, constraint programming, ML, etc.) and be a technical referent in Python and/or Scala.

Our future team member will have a good understanding of data collection and management of complex B2B business rules. Also, you will take ownership of large features from technical design through completion.

At Kpler, the Senior Data Engineer is at the centre of our research delivery and will have a key role in defining architecture, helping identify and implement areas for improvement within our data methodologies and technologies used.

Based in Paris, you will also interact with the Singaporean engineering team; being able to communicate efficiently in English (mandatory, we have more than 15 nationalities at Kpler!) and work with remote team members is key.

Also, you will:

  • Coach and work on code review with more junior engineers
  • Ensure integrity of data through creative, robust and sustainable quality control methods
  • Participate in operations/support of the real-time platforms
  • Participate in defining coding standards, specifications and development processes
  • Translating technical concepts to/from non-technical language

What we are looking for

Requirements to be a good fit:

  • At least 5 years of experience in similar roles working Python and/or Scala and cloud infrastructure (Amazon AWS) on linux servers
  • Experience with SQL (PostgreSQL or equivalent)
  • Proficiency developing automated unit and integration tests and continuous integration
  • Ability to learn quickly and deliver high quality code in a fast-paced, dynamic team environment

Nice to have:

  • Knowledge of SqlAlchemy, Scala Play2, ElasticSearch, Heroku
  • Experience of data management lifecycles (collection, cataloguing, ETL design)
  • Experience with geographic information systems (PostGIS for instance)
  • Experience of LEAN methodologies and approaches to process optimisation

Recruitment Process

  1. 30min video call to discuss your experience and motivations
  2. Small test project assignment
  3. Technical discussion on site and HR interview
  4. Half day with the engineering team to assess the culture fit and help the candidate see our day to day

Additional Information

  • Contract type: Full-Time
  • Location: Paris, France (75002)
  • Education Level: No Diploma
  • Experience Level: > 5 years