Senior Data Engineer – Fleet, Aviation

Published: 9 November 2022

Senior Data Engineer – Fleet, Aviation
Location: Europe, Remote Working 100%
Travel: 0%
Duration: 6 months +

Role Summary:
Our client, an Integrated Energy Company, requires a Senior Data Engineer to work within their Customers & Markets portfolio team. The customer is extracting data from core systems and storing it in an AWS data lake. They are then using this to improve business decisions and margins. They need a senior data engineer with AWS experience and good business knowledge to help understand and solve business issues using the AWS data lake.

Role Responsibilities:
  • Scope, review & deliver low-level data requirements for digital and data initiatives across bp analytical platforms incl. AWS working closely with stakeholders
  • Work with Business stakeholders to understand the business issues they are trying to resolve and help identify ways of solving this
  • Provide data strategy and guidance adhering to standards during the development phase and planning for long-term
  • Undertake database design & modelling
  • Create data Migration Strategy specifically from EnscribeDB and Oracle to Postgres
  • Manage and track delivery and KPIs within Azure DevOps (ADO)
  • Ensure data models are fit for purpose and data standards are implemented where available
  • Ensure end to end integration, data flow and ease of ongoing maintenance is optimal
  • Provides guidance for Database Security & Auditing standards
  • Provide query Analysis & optimization recommendations where needed
  • Manage stakeholder relationships and expectations
Required Skills:
  • 8+ years data engineering
  • Have good knowledge of AWS Cloud Data Migration & ETL strategies
  • Database Security & Auditing standards
  • Postgres (AWS Aurora) RDMS
  • Analytical mindset – data driven ability to problem solve and refine engineering requirements .
  • Be self-motivated and self-starting – able to work with little supervision and unfamiliar concepts quickly. Be confident in their judgement.
  • SQL skills for pipeline development and analysis
  • Python for pipeline development and analysis
  • Experience of big data engineering environment delivering data pipelines, and ETL concepts
  • Exposure to Iterative delivery methods
  • Mathematics, Computer science or numerical related degree
Desirable Skills
  • Experience of continuous integration/deployment and development techniques
  • Exposure to Scrum/Agile delivery methodologies
  • Experience in toolsets for agile delivery management and DevOps; for example Azure DevOps (ADO) or JIRA.

Apply Now