Skip directly to search

Skip directly to content



Senior Data Engineer



  • Building and maintaining optimized and highly available data pipelines that facilitate deeper analysis and reporting by other teams
  • Building data processing frameworks that handle the business’s growing database
  • Continuously contribute to development of new and improved data engineering capabilities across the internal community, so as individually for junior data engineers’ growth
  • Participate in logical and physical data modelling
  • Develop and maintain data set processes
  • Support the translation of data needs into technical system requirements
  • Develop complex code, scripts and data pipelines to process structured and unstructured data near real-time
  • Combines the use of large data sets to address business issues
  • Find hidden patterns using data queries
  • Preparing raw data for manipulation by Data Scientists
  • Prepares procedures and automation scripts for testing data quality issues
  • Remaining up-to-date with industry standards and technological achievements


Qualifications and Experience

  • 5+ years’ experience within Data Development
  • Knowledge in PostgreSQL, MySQL, MS SQL Server, Oracle releases
  • Shell scripting, DB procedural and functional development (Pg/PS/SQL)
  • Strong analytic skills related to working with unstructured datasets
  • Build processes supporting data transformation, data structures, metadata, dependency, and workload management
  • Code versioning (git/mercurial)
  • Performance tuning
  • Great interpersonal skills and is experienced at dealing with clients
  • Capability to influence and argument a potential solution to technical and non-technical audience
  • Good spoken and written English


Additional Information

  • Big data tools: Hadoop, Spark, Kafka
  • Relational SQL and NoSQL, databases, including Postgres and Cassandra
  • AWS cloud services: EC2, EMR, RDS, Redshift, AWS Glue (ETL Service)
  • ML and Data Modeling and Data Evaluation
  • Stream-processing systems: Storm, Spark-Streaming, etc.
  • Python, Java, C++, Scala, etc.

We are listening

How would you rate your experience with Endava so far?

We would appreciate talking to you about your feedback. Could you share with us your contact details?