Senior Data Engineer - Paris

Kpler is hiring!

About

Kpler is a rapidly growing data intelligence company providing transparency solutions in energy markets. We develop data pipelines that enrich data from hundreds of sources in real-time, ranging from logistics (satellite images) to governmental and shipping databases. We then derive and forecast key informations for commodities traders and analysts.

What you will do

Role Purpose

The role of the Senior Data Engineer is to work on the data pipeline (collect, manage, data lake storage), data algorithms (based on either rules, constraint programming, ML, etc.) and be a technical referent in python and/or scala.

The successful candidate will have a good understanding of data collection and management of complex B2B business rules, and will take ownership of large features from technical design through completion.

As an integral member of an open, dynamic and innovative team, the Senior Data Engineer is at the centre of our research delivery and will have a key role in defining architecture and helping identify and implement areas for improvement within our data methodologies and technologies used.

Based in our Paris software engineering team, you will also interact a with the Singaporean engineering team, being able to communicate efficiently in English and work with remote team members is key.

Main Responsibilities

Identify and implement complex features to derive insight from logistics data
Coach and work on code review with more junior engineers.
Participate in the architectural evolutions of the system.
Ensure integrity of data through creative, robust and sustainable quality control methods.
Participate in operations/support of the real-time platforms.
Participate in defining coding standards, specifications and development processes.
Translating technical concepts to/from non-technical language that can be understood by technology, business users and leadership teams.

What we are looking for

Knowledge & Experience

Must Have

  • Experience as data engineer, working Python and/or Scala.
  • Experience with SQL and NoSQL datastores
  • Experience working with cloud infrastructure (Amazon AWS) on linux servers
  • Experience with CI/CD (Ansible, CircleCI)
  • At least 5 years of experience in similar roles.
  • English proficiency (more than 15 nationalities at Kpler!)

Desirable

  • Knowledge of PostgreSQL server and ORM (SqlAlchemy)
  • Knowledge in Machine Learning and Operational Research
  • Experience with geographic information systems.
  • Knowledge of Scala Play2. ElasticSearch, Heroku
  • Experience of data management lifecycles (collection, cataloguing, ETL design).
  • Experience of LEAN methodologies and approaches to process optimisation.
  • Experience working in startup, in a fast paced environment.

Key Competencies

  • Able to work independently with demanding timescales.
  • Issue Identification, problem solving and analysis.
  • Building and maintaining good working relationships with team members.
  • Efficiency focused.
  • Planning, Implementation & Control.
  • Continuous improvement

Recruitment Process

  1. 30min skype/hangout to discuss your experience and motivations
  2. Technical discussion on site and HR interview
  3. Small test project assignment
  4. Half day with the engineering team to assess the culture fit and help the candidate see our day to day

Additional Information

  • Contract type: Full-Time
  • Location: Paris, France (75002)
  • Education Level: Master's Degree
  • Experience Level: > 5 years