Data Engineer

Data Engineer – Azure

A fast growing and innovative company are looking for a Data Engineer to join their team. They are a people focused company, who since 2021 have won 3 best place to work awards, representing a fantastic working environment.

Based in either Derby or London, the successful candidate will be joining a dynamic team that supports corporate and project governance, risk management, and audits across various stakeholders. As part of the Operations Directorate and reporting to the Chief Operating Officer, the candidate will play a crucial role in driving the company’s digital initiatives forward.

Key Responsibilities
As a Data Engineer, you will play a pivotal role in supporting the delivery and evolution of the company’s digital portfolio. Collaborating with a talented team, the candidate will oversee the management and maintenance of existing data pipelines, monitor workloads, conduct root cause analysis, ensure data quality, and escalate technical issues as necessary.

What you’ll be getting up to:

• Monitoring and recovery of Azure Data Factory and Databricks jobs
• Proactive monitoring of data quality
• Becoming a subject matter expert on the company’s data sources and ingestion methods.
• Assisting in developing and adhering to data governance policies and internal processes
• Collaborating with the wider team to understand business needs and improve data quality.
• Developing and maintaining data quality KPIs
• Maintaining and monitoring user-facing dashboards and internal digital products
• Updating and patching existing digital software products
• Documenting root cause analysis outputs

What you can bring to the role:

• Microsoft Azure experience
• Proficiency in Azure data components such as Azure Data Factory, Azure SQL DB, Azure Data Lake, etc.
• Strong Python and SQL skills for data manipulation
• Experience with Apache Spark and/or Databricks.
• Familiarity with BI visualization tools like Power BI
• Experience in managing end-to-end analytics pipelines (batch and streaming)
• Proficiency in root cause analysis and post-incident reporting in a production environment
• Excellent interpersonal skills
• Strong report writing, presentation, and record-keeping abilities.
• Exceptional communication and stakeholder management skills

Knowledge and Qualifications

• Relevant degree in Computer Science, Engineering, or related field
• Certifications such as Azure Data Engineer Associate are desirable.
• Knowledge of data ingestion methods for real-time and batch processing
• Proficiency in PySpark and debugging Apache Spark workloads.

What’s in it for you?

• Annual bonus scheme – up to 10%
• Excellent pension scheme
• Flexible working
• Enhanced family friendly policies
• Ongoing support with professional and personal development
• Adoption & Shared Parental Leave benefits
• Enhanced Armed Forces policies.
• Long service awards
• Company Star awards
• Life assurance
• Healthcare cash plan
• 25 days’ annual leave + Bank Holidays + option to buy and sell up to 5 days’ additional leave.
• Additional days annual leave for long service
• Season ticket loan.
• Cycle to work scheme.
• Free parking
• Should you be suitable for the role, the full benefits package will be discussed in more detail during your screening call.

Mirai believes in the power of diversity and the importance of an inclusive culture. We welcome applications from individuals of all backgrounds, understanding that a range of perspectives strengthens both our team and our partners’ teams. This is just one of the ways that we’re taking positive action to shaping a collaborative and diverse future in the workplace.