Databricks Data Engineer

We are seeking a skilled Databricks Data Engineer to join our Project team in charge of implementing our Databricks platform. You will work under the supervision of a Project Lead and a Tech Lead / Data Architect.

The context:

We decided to set-up Databricks and Dataiku platforms on top of an AWS platform and started migration projects for different use cases implemented in various technologies (SAS, AWS Sagemaker, BW/HANA, etc.).

Your mission:

• Design, develop and maintain scalable data pipelines on the Databricks platform
• Manage data ingestion processes from various sources into the Databricks environment.
• Implement and optimize ETL (Extract, Transform, Load) processes to ensure efficient data transformation and integration.
• Ensure data quality, integrity, and security across all data pipelines.
• Monitor and troubleshoot data pipeline performance, implementing necessary maintenance and updates.
• Document data pipeline processes, technical specifications and best practices.
• Realize knowledge transfer towards the Data engineer team which will take over the responsibility to run the platform in the future

Your profile:

• Strong skills in SQL (and other relevant programming languages like Python) and in Datawarehouse / Lakehouse projects
• Proven expertise in Databricks and in with AWS services such as S3, Redshift, Lambda.
• Analytical mindset with attention to detail
• Strong communication and collaboration skills (within a Project team and with a Data engineer team)

Your qualifications:

• Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field.
• Minimum 3 years of experience in SQL and Data warehousing
• Minimum 2 years of experience with Databricks
• Fluent in either Dutch or French
• Fluent in English

Discover Contraste Europe

Contraste Europe is a key player in the IT sector and operates on an international scale. We are committed to supporting the growth of our customers in diverse sectors such as finance, healthcare, retail and the public sector. Our values, which include understanding customer needs, competence, independence, team spirit and social responsibility, are at the heart of every project we undertake.

Becoming a Contraster means joining a company where excellence is a mission. At Contraste, every member has the opportunity to express his or her talent in a variety of fields, from cloud solutions development to digital transformation and much more. It's a chance to contribute to innovative projects and shape your future in an environment that values your personal and professional development.

Ready for the challenge?

Apply now to join our team and become a pillar of digital transformation at Contraste.