Databricks Data Engineer

We are looking for a passionate and skilled Data Engineer to join our growing Data & Analytics team. In this role, you will work remotely in a customer-facing environment, collaborating closely with cross-functional teams to deliver impactful Business Intelligence, Big Data, and Analytics solutions.

• Create and maintain optimal data pipelines.
• Assemble large, complex data sets that meet functional / non-functional business requirements.
• Identify, design, and implement internal process improvements: automating manual processes, optimising data delivery, re-designing infrastructure for greater scalability, etc.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Microsoft technologies.
• Build analytics tools that utilise the data pipeline to provide actionable insights having in mind the key business performance metrics defined by the end customers.
• Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
• Work with data and analytics experts to strive for greater functionality in the data systems. 

• At least 3 years of experience as a Data Engineer.
• Solid experience with Azure Databricks.
• Experience with Azure cloud platform (certifications are nice-to-have, e.g. DP-203).
• Experience in data pipeline development and data integration.
• Strong proficiency in programming languages such as SQL and PySpark.
• Experience with big data technologies and distributed computing frameworks such as Spark.
• Expertise in data warehousing and ETL principles, familiarity with data modelling.
• Understanding of data governance and data security best practices.
• Strong analytical and problem-solving skills with a keen attention to detail.
• Excellent communication skills, both written and verbal e.g. being able to convey technical information to non-technical stakeholders.
• Proven experience in customer-facing role.
• Ability to work collaboratively in a team environment and manage multiple tasks simultaneously, as you could work on several projects in parallel.