Titel

Sr Lead Data Engineer

Organisatie

Hightech

Achtergrond opdracht

Job Mission

The SR. Lead Data engineer translates business demand in solution designs, leveraging the big data design patterns and architectural guiderails. The SR. lead data engineers aligns identifies dependencies and overlap with other business demand and ensures that the team executes according to business requirements.


Job Description

The Lead Data engineers manages his stakeholders by aligning on solution design challenges and choices made to address the business requirements. They collaborates with solution architects, competence, development team and business to ensure consistency in the overall big-data landscape.

During the development of solutions, the Sr. data engineers leads their team so that it adhering to the architectural guidance and that deviations are understood and accepted. 

Functie eisen

  • SQL background, understanding the concepts of OLAP/BI querying patterns, and has paratactical knowledge in creating these solutions to support this.
  • Data modelling experience, preferably on non-business process data domains (e.g. IOT, machine data)
  • 5+ years (hands-on) experience with designing and building robust solutions for storing very large quantities of raw data of different sizes in the proper technology solution (eg. Hbase, HDFS, Object Storage & Oracle)
  • 2+ years (hands-on) experience in designing and building both batch and streaming architectures based on SPARK (we have moved on from Spark?)
  • 2+ years (hands-on) experience with columnar storage formats, and backends (Kudu, Parquet, ORC)
  • Experienced integrating SQL engines into solutions (e.g. Impala, Drill)

2+ years (hands-on) experience with big data (hybrid) cloud concepts and implementations


Other:

  • Strong conceptual thinker, has the ability to think ahead and share the lessons learnt with both technology and business stakeholders.
  • Strong communicator, has the ability to effectively manage stakeholders within both Business and IT and can lead a team of data engineers.
  • Experience working with Agile Release trains.
  • Personal skills
  • Positive ‘Can-do’ attitude. Experienced in dealing with a broad spectrum of stakeholders when interest can be conflicting.
  • Designs solutions and also willing to get hands dirty to bring these solution to life.
  • Can work on his/her own, has the ability to find the right people for the right questions.

Opdracht informatie

Interested?

Please send us asap your recent CV + a motivation for this role, both in English, together with your availability/planned vacations and all-in hourly rate VAT (BTW) excluded.


Mail mij deze opdracht

Gerelateerde opdrachten

Voor IT Management & Support