Richmond Square Consulting Ltd
Data Engineer
Hereford, Herefordshire (Hybrid – 3 days remote / wfh options per week)
Data Engineer required by a thriving cutting-edge next generation technology company within the Defence and Security sector. The Data Engineer will have strong experience of Apache NiFi, programming and scripting languages ( SQL, Linux, Python, Java), experience of working in a team / squad using Agile methodologies, DevOps and IaC tooling.
Benefits
As a Data Engineer for this awesome company you will benefit from:
Starting salary of £65,000 – £75,000
Discretionary Bonus scheme
28 days annual leave
Pension Plan, Life Assurance, Income Protection, Private Medical
Extensive Training & Development opportunities
Fantastic work environment and offices with onsite gym, swimming pool, squash courts, restaurant and cafe.
Great opportunity for career progression
What you will need
As a Data Engineer you will work in a fantastic company and have a diverse, challenging, interesting and rewarding position. Essential experience includes:
Knowledge of functionalities surrounding Apache NiFi. Development of custom processors and end to end data flow management.
Programming and scripting languages, SQL, Python, Linux, Java
Experience working closely in a team/squad/tribe using agile methodologies (Scrum and/or Kanban,), practicing DevOps and Continuous Integration / Delivery.
Experience in using Elastic stack products to ingest, manage and visualise data.
Data modelling and understanding of different data structures (structured and unstructured).
Experience in using IaC tooling ( Terraform, ARM, Pulumi) to deploy to Cloud environments.
Either holds or has recently held government security clearance already, or is suitable for and willing to go through the vetting process (suitability would include an absence of a serious criminal record, a right to work and live in UK and, preferably, a record of 5 years’ UK residency)
Nice to have
Experience with Hadoop Platform & Ecosystem at Enterprise scale would be nice to have.
Knowledge in administration of Big Data systems in a production / live environment
Experience deploying solutions on top of Microsoft Azure. ( Azure Event Hubs, Azure Data Factory, Azure DataBricks)
Knowledge of Apache Airflow
Understanding of Apache Kafka / Event-based architecture and design patterns
To apply for this job please visit uk.whatjobs.com.