Filter by category

Filter by type

Senior Data Engineer (London) at AND Digital

go back to Developer Jobs
  • London
  • fulltime
  • -
  • Senior Data Engineer (London)

    AND Introduction

    At AND, we accelerate the development of digital capabilities. In practice, that means helping ambitious leaders and organisations build the teams, products, processes and even operational structures they need to close the digital skills gap within their organisation today, so that they thrive tomorrow.

    Clients rely on our experience, agility and craft skills across tech and business strategy, software development and product management to address some of the toughest challenges facing their businesses.

    We bring aboard thinkers, tinkerers, passionate software craftspeople and inspiring technologists to help us solve these challenges. Together, we’re united by a sense of pragmatism, purpose and a deeply-held belief that digital products and technology alone won’t transform a business or save the world: it’s the people that count.


    About You

    As a Senior Data Engineer, you will spend your time helping clients achieve their data engineering needs. Primarily the development, deployment and maintenance of data pipelines in a fast moving, Agile environment.

    You’ll also make a real impact by taking an active role in the team’s Agile Development practices, technical decision making and development, generating value and continuously striving to improve the quality and reliability of our data and processes.

    You will spend the majority of your time helping deliver client data engineering opportunities and supporting the growth of our junior-mid level technologists; both within AND and for our clients. This will include…

    Being able to:

    • Extract data from multiple data sources
    • Write code to ingest or transform new and existing data
    • Transform data in various ways to support data scientists and product analysts
    • Build and design a scalable and extensible data architecture
    • Conduct large scale batch and real-time processing from varying sources
    • Influence the client on how they approach data engineering issues
    • Collaborate with tech leads on system integrations

    Influencing technical direction:

    • Engaging actively with our Consultancy Data Strategy and Insight practice, to help define and materialise clients’ data strategies
    • Championing and upholding high technical quality standards


    To do that, it’s essential you bring the following:

    • Experience of using modern and traditional data technologies including: MongoDB, PostgreSQL, mySQL/mariaDB, Kafka, Splunk/ELK or other logging and monitoring tools, BI and Data Warehousing solutions and ETL and migration technologies
    • Good cloud-native data engineering skills e.g. AWS RDS, Redshift, Kinesis, Glue or Azure CosmosDB, DataFactory, SQL DB etc.
    • Good experience in quality assuring data programmes, including non-functional testing and performance tuning
    • At least 3 years experience writing Python, R, SQL or Scala
    • Experience in Dimensional modelling and Data Warehouse patterns
    • Good understanding and track record of delivering complex data solutions using Agile methods including Scrum, SAFe etc.
    • Hands-on experience of modern software delivery, including CI/CD and DevOps practices
    • Experience with Big data storage or Data Lakes
    • A keen understanding of industry best-practice around standards, quality and continuous improvement in the field of Data Engineering
    • Experience in the field of Data Engineering, Science or Analytics


    It’s helpful if you also have:

    • Consultancy or professional services experience across a number of sectors
    • Javascript / Typescript / NodeJS experience
    • Experience with Hadoop, Spark, Redshift or Parquet
    • Coaching and providing career progression to junior and mid-level developers, supporting developers create exciting and inspiring career ambitions


    Joining AND

    From the work we deliver, to the way we serve and support our people, we work hard to ensure that there’s nowhere quite like AND. But joining a company is a two-way street: the fit has to work on both sides. So before you apply, here’s three key things to understand about us:

    • We’re built for people - like, real humans. Not ‘resources’ or ‘staff’. That means happiness and wellbeing really do matter to us, and we hate unnecessary hierarchy and bureaucracy.
    • There’s no well-trodden path ahead: AND is growing fast and forging a new trail. That’s exciting, and gives us all the autonomy and opportunity we love - but bear in mind it also demands focus, patience and resilience.
    • Diversity is a priority. After all, to build great products that a wide variety of different people love to use, we need a wide variety of people to help us build them. So diversity is more than a policy or a word: it’s business critical for us.
    You need to be logged in to apply. Login or create an account.
    Is this job ad fake? Report it!   


    other jobs at AND Digital

    fulltime Senior Software Engineer (Halifax) at AND Digital in London
    04-06-2020
    fulltime Senior Product Analyst (Halifax) at AND Digital in London
    04-06-2020
    fulltime Senior Full-Stack Developer (Halifax) at AND Digital in London
    04-06-2020
    fulltime Software Engineer (Halifax) at AND Digital in London
    04-06-2020
    fulltime Tech Lead (Halifax) at AND Digital in London
    04-06-2020
    fulltime Cloud Engineer (Leeds) at AND Digital in London
    13-06-2020
    fulltime Cloud Engineer (Manchester) at AND Digital in London
    13-06-2020
    fulltime Cloud Lead (Leeds) at AND Digital in London
    31-07-2020
    fulltime Cloud Lead (Manchester) at AND Digital in London
    31-07-2020
    fulltime Software Engineer (Edinburgh) at AND Digital in London
    12-08-2020
    fulltime Senior Android Developer (London) at AND Digital in London
    25-08-2020
    fulltime Senior Product Analyst (Leeds) at AND Digital in London
    28-08-2020
    fulltime Cloud Architect (Leeds) at AND Digital in London
    03-09-2020
    fulltime Senior Front End Engineer (Manchester) at AND Digital in London
    03-09-2020
    fulltime Cloud Architect (Manchester) at AND Digital in London
    03-09-2020
    fulltime Front End Developer (Manchester) at AND Digital in London
    03-09-2020
    fulltime Graduate / Junior Cloud Engineer at AND Digital in London
    03-09-2020
    fulltime Graduate / Junior Cloud Engineer at AND Digital in London
    03-09-2020
    fulltime Senior Software Engineer (Leeds) at AND Digital in London
    04-09-2020
    fulltime DevOps Lead (London) at AND Digital in London
    22-09-2020
    fulltime Cloud Engagement Lead (Leeds or Manchester) at AND Digital in London
    23-09-2020
    fulltime User Researcher (Halifax) at AND Digital in London
    08-10-2020
    fulltime Tech Lead (Manchester) at AND Digital in London
    16-10-2020
    fulltime Principal Consultant - Data and Insight (Manchester) at AND Digital in London
    28-10-2020
    fulltime Principal Consultant - People (Manchester) at AND Digital in London
    28-10-2020
    fulltime Principal Consultant - Technology (Manchester) at AND Digital in London
    28-10-2020
    fulltime Senior Java Developer (Leeds) at AND Digital in London
    04-11-2020
    fulltime Senior Java Developer (London) at AND Digital in London
    15-11-2020
    fulltime Product Lead (London) at AND Digital in London
    15-11-2020
    fulltime Java Tech Lead (London) at AND Digital in London
    15-11-2020
    fulltime Senior Front End Engineer (London) at AND Digital in London
    15-11-2020
    fulltime Principal Engineer (London) at AND Digital in London
    16-11-2020
    fulltime Java Developer (London) at AND Digital in London
    16-11-2020
    fulltime Senior DevOps Engineer (London) at AND Digital in London
    16-11-2020
    fulltime Principal Consultant - Cloud (Manchester) at AND Digital in London
    17-11-2020
    fulltime Senior Node Engineer (London) at AND Digital in London
    01-12-2020
    fulltime Chief Engineer (London) at AND Digital in London
    01-12-2020
    fulltime Head of Engineering (London) at AND Digital in London
    01-12-2020
    fulltime Node Engineer (London) at AND Digital in London
    01-12-2020
    fulltime Tech Lead at AND Digital in London
    01-12-2020
    fulltime Senior Software Engineer (London) at AND Digital in London
    01-12-2020
    fulltime Senior Software Engineer (Manchester) at AND Digital in London
    01-12-2020
    fulltime Solution Architect (London) at AND Digital in London
    03-12-2020
    fulltime Senior Software Engineer (Reading) at AND Digital in London
    03-12-2020
    fulltime Product Analyst (Manchester) at AND Digital in London
    04-12-2020
    fulltime Senior Product Analyst at AND Digital in London
    04-12-2020
    fulltime Squad Lead (London) at AND Digital in London
    19-12-2020
    fulltime Senior Business Analyst (London) at AND Digital in London
    07-01-2021
    fulltime UX Lead (Halifax) at AND Digital in London
    07-01-2021
    fulltime Communications Lead at AND Digital in London
    13-01-2021
    fulltime Tech Lead (Leeds) at AND Digital in London
    20-01-2021
    fulltime Technical Architect (Leeds) at AND Digital in London
    20-01-2021
    fulltime Solutions Architect (Leeds) at AND Digital in London
    20-01-2021
    fulltime Front End Developer (Reading) at AND Digital in London
    22-01-2021
    fulltime Lead Mobile Engineer (Leeds) at AND Digital in London
    22-01-2021
    fulltime Principal Engineer (Leeds) at AND Digital in London
    22-01-2021
    fulltime AWS Engineer (Leeds) at AND Digital in London
    23-01-2021
    fulltime Platform Engineer (Leeds) at AND Digital in London
    23-01-2021
    fulltime Platform Engineer (Manchester) at AND Digital in London
    23-01-2021
    fulltime AWS Engineer (Manchester) at AND Digital in London
    23-01-2021
    fulltime Platform Engineer (Edinburgh) at AND Digital in London
    23-01-2021
    fulltime Senior Full Stack Developer (Reading) at AND Digital in London
    27-01-2021
    fulltime Service Delivery Manager (London) at AND Digital in London
    28-01-2021
    fulltime Operating Model Lead at AND Digital in London
    28-01-2021
    fulltime EU Market Maker at AND Digital in London
    28-01-2021
    fulltime Senior Android Developer (Leeds) at AND Digital in London
    30-01-2021
    fulltime Service Delivery Manager (Edinburgh) at AND Digital in London
    02-02-2021
    fulltime Squad Lead (Edinburgh) at AND Digital in London
    02-02-2021
    fulltime Product Principal (Manchester) at AND Digital in London
    04-02-2021
    fulltime .Net Software Engineer (Manchester) at AND Digital in London
    04-02-2021
    fulltime JavaScript Developer (Manchester) at AND Digital in London
    04-02-2021
    fulltime Graduate Developer at AND Digital in London
    05-02-2021
    fulltime Squad Lead (Reading) at AND Digital in London
    07-02-2021
    fulltime Cloud Lead (Reading) at AND Digital in London
    07-02-2021
    fulltime Principal Engineer (Manchester) at AND Digital in London
    09-02-2021
    fulltime Events Lead (UK) at AND Digital in London
    09-02-2021
    fulltime Senior Cloud Engineer (Reading) at AND Digital in London
    10-02-2021
    fulltime .Net Full Stack Engineer (Reading) at AND Digital in London
    10-02-2021
    fulltime Graduate Analyst at AND Digital in London
    10-02-2021
    fulltime Senior Data Engineer (Reading) at AND Digital in London
    10-02-2021
    fulltime Node Full Stack Engineer (Reading) at AND Digital in London
    10-02-2021
    fulltime Chief of Hub Operations (North, UK) at AND Digital in London
    12-02-2021
    fulltime Chief of Hub Operations (South, UK) at AND Digital in London
    12-02-2021
    fulltime Content Marketing Specialist (UK) at AND Digital in London
    12-02-2021
    fulltime Ruby Software Engineer (Manchester) at AND Digital in London
    12-02-2021
    fulltime Graduate Developer at AND Digital in London
    12-02-2021
    fulltime Graduate/Junior UI/UX Designer at AND Digital in London
    17-02-2021
    fulltime Graduate/Junior UI/UX Designer at AND Digital in London
    17-02-2021
    fulltime Senior Business Analyst (Edinburgh) at AND Digital in London
    18-02-2021
    fulltime Front End Engineer (Edinburgh) at AND Digital in London
    18-02-2021
    fulltime Business Analyst (Edinburgh) at AND Digital in London
    18-02-2021
    fulltime Senior Front End Engineer (Edinburgh) at AND Digital in London
    18-02-2021
    fulltime Business Analyst (Reading) at AND Digital in London
    18-02-2021
    fulltime Senior UX Designer (Reading) at AND Digital in London
    18-02-2021
    fulltime Junior Interaction Designer at AND Digital in London
    25-02-2021
    fulltime Junior Service Designer at AND Digital in London
    25-02-2021
    fulltime Junior Cloud Engineer at AND Digital in London
    27-02-2021
    fulltime Tech Recruiter - Glasgow (6 Month FTC) at AND Digital in London
    03-03-2021
    fulltime Senior Data Analyst (Reading) at AND Digital in London
    03-03-2021
    fulltime Junior User Researcher at AND Digital in London
    04-03-2021
    fulltime Squad Lead (Leeds) at AND Digital in London
    09-03-2021
    fulltime Tech Recruiter - Edinburgh (6 Month FTC) at AND Digital in London
    10-03-2021
    fulltime Digital Marketing Specialist at AND Digital in London
    13-03-2021
    fulltime Principal Data Engineer (London) at AND Digital in London
    19-03-2021
    fulltime Senior Data Analyst (London) at AND Digital in London
    19-03-2021
    fulltime Cloud Engagement Lead (London) at AND Digital in London
    19-03-2021
    fulltime Cloud Architect (London) at AND Digital in London
    19-03-2021
    fulltime Cloud Lead (London) at AND Digital in London
    19-03-2021
    fulltime Cloud Engineer (London) at AND Digital in London
    19-03-2021
    fulltime Senior Cloud Engineer (London) at AND Digital in London
    19-03-2021
    fulltime Events Planner (Leeds) at AND Digital in London
    19-03-2021
    fulltime UX Lead (London) at AND Digital in London
    24-03-2021
    fulltime React Native Engineer (London) at AND Digital in London
    24-03-2021
    fulltime Onboarding Coordinator (North) at AND Digital in London
    24-03-2021
    fulltime Graduate Developer at AND Digital in London
    25-03-2021
    fulltime Senior Full Stack Developer (London) at AND Digital in London
    25-03-2021
    fulltime Mobile Lead (London) at AND Digital in London
    25-03-2021
    fulltime Business Analyst (London) at AND Digital in London
    25-03-2021
    fulltime Front End Engineer at AND Digital in London
    25-03-2021
    fulltime .Net Software Engineer (London) at AND Digital in London
    25-03-2021
    fulltime .Net Tech Lead at AND Digital in London
    25-03-2021
    fulltime Full Stack Tech Lead (London) at AND Digital in London
    25-03-2021
    fulltime Cloud Recruiter (London) at AND Digital in London
    25-03-2021
    fulltime Javascript Tech Lead (London) at AND Digital in London
    25-03-2021
    fulltime Senior People & Organisation Strategy Consultant at AND Digital in London
    25-03-2021
    fulltime Senior iOS Developer (London) at AND Digital in London
    25-03-2021
    fulltime iOS Developer (London) at AND Digital in London
    25-03-2021
    fulltime Lead iOS Developer (London) at AND Digital in London
    25-03-2021
    fulltime Full Stack Developer (London) at AND Digital in London
    25-03-2021
    fulltime Data Analyst (London) at AND Digital in London
    25-03-2021
    fulltime Regional Marketing Manager (Scotland) at AND Digital in London
    26-03-2021
    fulltime Tech Recruiter (Manchester) at AND Digital in London
    26-03-2021
    fulltime Tech Recruiter (6 Month FTC) at AND Digital in London
    26-03-2021
    fulltime Recruiter (London) at AND Digital in London
    26-03-2021
    fulltime Cybersecurity Lead (London) at AND Digital in London
    27-03-2021
    fulltime Tech Lead (Edinburgh) at AND Digital in London
    27-03-2021
    fulltime iOS Squad Lead at AND Digital in London
    27-03-2021
    fulltime Corporate Development Analyst (London) at AND Digital in London
    27-03-2021
    fulltime Club Exec (Glasgow) at AND Digital in London
    27-03-2021
    fulltime People Lead (Glasgow) at AND Digital in London
    27-03-2021
    fulltime Senior Business Analyst (Glasgow) at AND Digital in London
    31-03-2021
    fulltime Senior Java Developer (Glasgow) at AND Digital in London
    31-03-2021
    fulltime Front End Developer (Glasgow) at AND Digital in London
    31-03-2021
    fulltime Java Developer (Glasgow) at AND Digital in London
    31-03-2021
    fulltime Senior Front End Developer (Glasgow) at AND Digital in London
    31-03-2021
    fulltime Business Analyst (Glasgow) at AND Digital in London
    31-03-2021
    fulltime Senior UX Designer (London) at AND Digital in London
    31-03-2021
    fulltime UI/UX Designer (London) at AND Digital in London
    31-03-2021
    fulltime Squad Lead (Glasgow) at AND Digital in London
    31-03-2021
    fulltime Senior Data Consultant at AND Digital in London
    02-04-2021
    fulltime Senior Insight Consultant at AND Digital in London
    02-04-2021
    fulltime Senior Data Analyst (London) at AND Digital in London
    03-04-2021
    fulltime Senior Data Engineer (London) at AND Digital in London
    03-04-2021
    fulltime Principal Data Engineer (London) at AND Digital in London
    03-04-2021
    fulltime Cloud Lead (London) at AND Digital in London
    03-04-2021
    fulltime Cloud Engagement Lead (London) at AND Digital in London
    03-04-2021
    fulltime Cloud Engineer (London) at AND Digital in London
    03-04-2021
    fulltime Senior Cloud Engineer (London) at AND Digital in London
    03-04-2021
    fulltime Cloud Architect (London) at AND Digital in London
    03-04-2021
    fulltime UI/UX Designer (Manchester) at AND Digital in London
    07-04-2021
    fulltime Software Engineer (Leeds) at AND Digital in London
    08-04-2021
    fulltime UX Lead (London) at AND Digital in London
    08-04-2021
    fulltime React Native Engineer (London) at AND Digital in London
    08-04-2021
    fulltime User Researcher (Manchester) at AND Digital in London
    08-04-2021
    fulltime Full-Stack Developer (Halifax) at AND Digital in London
    08-04-2021
    fulltime Full-Stack Developer (Leeds) at AND Digital in London
    08-04-2021
    fulltime Mobile Lead (London) at AND Digital in London
    09-04-2021
    fulltime .Net Tech Lead at AND Digital in London
    09-04-2021
    fulltime Cloud Recruiter (6 Month FTC) - London at AND Digital in London
    09-04-2021
    fulltime Senior iOS Developer (London) at AND Digital in London
    09-04-2021
    fulltime Data Analyst (London) at AND Digital in London
    09-04-2021
    fulltime iOS Developer (London) at AND Digital in London
    09-04-2021
    fulltime Javascript Tech Lead (London) at AND Digital in London
    09-04-2021
    fulltime Recruiter (London) at AND Digital in London
    10-04-2021
    fulltime Tech Recruiter (6 Month FTC) at AND Digital in London
    10-04-2021
    fulltime iOS Squad Lead at AND Digital in London
    11-04-2021
    fulltime Cybersecurity Lead (London) at AND Digital in London
    11-04-2021
    fulltime Principal Consultant - Product at AND Digital in London
    13-04-2021
    fulltime Events Coordinator (London) at AND Digital in London
    13-04-2021
    fulltime Cloud Architect (Edinburgh) at AND Digital in London
    13-04-2021
    fulltime Events Coordinator (Leeds) at AND Digital in London
    13-04-2021
    fulltime Service Delivery Lead (London) at AND Digital in London
    14-04-2021
    fulltime Junior Cloud Engineer at AND Digital in London
    15-04-2021
    fulltime Senior Business Analyst (Reading) at AND Digital in London
    15-04-2021
    fulltime Java Developer (Reading) at AND Digital in London
    15-04-2021
    fulltime Senior UX Designer (London) at AND Digital in London
    16-04-2021
    fulltime Events Planner (South) at AND Digital in London
    16-04-2021
    fulltime Principal Consultant - Technology (London) at AND Digital in London
    17-04-2021
    fulltime Front End Developer (React) at AND Digital in London
    21-04-2021
    fulltime Cloud Engineer (Reading) at AND Digital in London
    21-04-2021
    fulltime Senior Business Analyst (London) at AND Digital in London
    21-04-2021
    fulltime Tech Recruiter (Leeds) at AND Digital in London
    21-04-2021
    fulltime Service Delivery Manager (Reading) at AND Digital in London
    23-04-2021
    fulltime Graduate Developer (Leeds) at AND Digital in London
    27-04-2021
    fulltime Node Developer at AND Digital in London
    28-04-2021
    fulltime Junior Developer at AND Digital in London
    10-05-2021
    fulltime Delivery Principal at AND Digital in London
    10-05-2021
    fulltime Agile Delivery Lead (Leeds) at AND Digital in London
    10-05-2021
    fulltime Senior Java Developer (London) at AND Digital in London
    10-05-2021
    fulltime Agile Coach at AND Digital in London
    10-05-2021