The client has built a "Data Platform" which comprises of a "Cloudera Hadoop based Data Lake (ARES)" for historical analytics/reporting purposes and a Kafka Streaming Data Platform (SDP) for real-time data processing.
Data ingestion for ARES is made via FTPS and SDP. For SDP, data is streamed from legacy data stores, real-time event processing applications and some other messaging technologies.
With new "Data Sourcing Industrialization" project, the wish is to industrialize data sourcing.
The scope includes:
• Data Onboarding: Data design & design artefacts, obtaining access approvals, data catalog & dictionary maintenance, tollgate evidences
• Data Ingestion, Configuration, & Interface: technical design, build, testing, project and release management, production support handover for SDP, Qlik Replicate and ARES.
• Data Consumption: project/function-specific data enrichment and visualization.
Technologies used in the project are Apache Kafka, Cloudera Hadoop, Java, Unix, Qlik replicate, RBDMS databases, Apache Spark.
Our new colleague will be offering maintenance for an application estate build by us, which will include incident management, change management, defect fixing and deployments of fixes.
On call is required (outside supporting hours 18-24 from Monday-Friday and on Saturday as well).
1. Confluent Kafka product -> medium
a. Familiar with Apache Kafka and Confluent services (Schema-Registry, Connect, KSQL, Kafka-Rest)
2. Java troubleshooting skills -> medium
a. Analyze java thread dumps
b. Analyze java heap dump
3. Shell/Python scripting -> medium
a. Create/modify shell/python scripts
b. Debugging expertise
4. Unix admin skills -> medium
a. Monitor processes
b. Analyze OS level metrics
c. Debugging expertise
Endava is reimagining the relationship between people and technology. For the past 20 years it has helped some of the world’s leading Finance, Insurance, Telecommunications, Media, Technology, and Retail companies accelerate their ability to take advantage of new business models and market opportunities. We have more than 6200 employees located in close to client locations in Denmark, Germany, Netherlands, United Kingdom, United States and nearshore delivery centers in the EU: Romania, Bulgaria; Central European Countries: North Macedonia, Moldova and Serbia; Latin America: Argentina, Colombia, Uruguay and Venezuela.
Our client is a leading global wealth manager with strong investment banking capabilities.
Headquartered in Zurich, Switzerland, operations have a global reach and extends to about 50 countries worldwide across mature and emerging markets with more than 45,000 employees from over 150 different nations.
It delivers holistic financial solutions to various clients, including innovative products and specially tailored advice, aligned to high ethical standards.
How would you rate your experience with Endava so far?
We would appreciate talking to you about your feedback. Could you share with us your contact details?