Skip directly to search

Skip directly to content



Senior Data Engineer



Job Responsibilities:

  • Take part in all application development lifecycle phase;
  • Your main responsibilities will be to develop software systems;
  • You will participate in logical and physical design of the product and understand the business requirements;
  • You will solve complex technical problems that other team members may encounter, be an integral part of a Scrum team, review and enforce the quality of code written within your team, tutor junior developers;
  • You will be involved in a broad range of complex technical or professional work activities, in a variety of contexts;
  • You will work under general direction within a clear framework of accountability. Substantial personal responsibility and autonomy is required;



Qualifications and Experience


  • AWS solutions development and implement experience;
  • Experience with Apache Spark and Python programming;
  • Experience in developing data processing tasks using pySpark such as reading data from external sources, merge data, perform data enrichment and load in to target data destinations;
  • Strong background with SQL Databases;
  • SQL/HiveQL proficiency;
  • Good Database, SQL skills;
  • Good Linux skills;
  • Query and database tuning to improve performance;
  • Good client facing skills;
  • Good English language skills;
  • Experience in tackling performance tuning at physical/database level (database settings and options);
  • Knowledge principles of database design, data acquisition and data access analysis and design;
  • Knowledge of stored procedure writing, query optimization, and indexes;
  • In-depth analysis of query execution plan  Interest in career development and willingness to learn.

We are listening

How would you rate your experience with Endava so far?

We would appreciate talking to you about your feedback. Could you share with us your contact details?