Databricks Data Engineer

Chennai, Coimbatore
Data & AI

In your role as a Data Engineer you will be working remotely, in a customer-facing role, collaborating with colleagues on Business Intelligence, Big Data and Analytics projects. 

  • Create and maintain optimal data pipelines.
  • Assemble large, complex data sets that meet functional / non-functional business requirements.
  • Identify, design, and implement internal process improvements: automating manual processes, optimising data delivery, re-designing infrastructure for greater scalability, etc.
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Microsoft technologies.
  • Build analytics tools that utilise the data pipeline to provide actionable insights having in mind the key business performance metrics defined by the end customers.
  • Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
  • Work with data and analytics experts to strive for greater functionality in the data systems.

What you need to succeed:

  • At least 3 years of experience as a Data Engineer.
  • Solid experience with Azure Databricks.
  • Experience with Azure cloud platform (certifications are nice-to-have, e.g. DP-203).
  • Experience in data pipeline development and data integration.
  • Strong proficiency in programming languages such as SQL and PySpark.
  • Experience with big data technologies and distributed computing frameworks such as Spark.
  • Expertise in data warehousing and ETL principles, familiarity with data modelling.
  • Understanding of data governance and data security best practices.
  • Strong analytical and problem-solving skills with a keen attention to detail.
  • Excellent communication skills, both written and verbal e.g. being able to convey technical information to non-technical stakeholders.
  • Proven experience in customer-facing role.
  • Ability to align data insights with customer’s business objectives and strategies.
  • Ability to work collaboratively in a team environment and manage multiple tasks simultaneously, as you could work on several projects in parallel.  

What are we offering:

      Cegeka is an experienced player that delivers specialists within specific industries.

      Fabrice Wynants

      VP Security, Networking & Compliance

      Application flow

      Do you have any questions about this role?

      Let's connect.