Data Lake Dev-Ops Engineer

Tasks and responsibilities

As the Dev-Ops Engineer, this means that you control both the design phase and the actual development and testing of applications. You understand the entire stack and you can bring applications into production and resolve incidents. You can contribute to the completion of all activities in the backlog.

Your Day-to-Day

• Building and maintaining a large-scale data platform (including components from the wider BigData ecosystem) to support multiple business requests;
• Implementing new data platform functionalities including metadata frameworks, integrating and engineering new technologies;
• Install, maintain and administer containerized applications running on OpenShift clusters;
• Engineering a global deployment pipeline responsible for data platform build-release process;
• Enhancing a maintainable and scalable test automation strategy and implementing this together with the team with suitable tooling;
• Building out their data infrastructure, in terms of scalability and availability, with an additional focus on ensuring data integrity;
• Design and integrate new modules to continuously improve the services towards data owner parties;
• Work on the private and public cloud;
• Collaborate with feature engineers and architects in order to understand and challenge their architecture paradigms, contribute to services and components design;
• Explore and be open to learn and use new programming languages/novel technologies.

The following items are vital in this:

1. Contribute to the new way of working

• In the Tribe structure, you are part of an ambitious and highly motivated squad with an Agile way of working. You work together with colleagues from other areas of expertise and take initiative in expanding knowledge (both within and outside of your area of expertise) that is relevant for the Tribe in which you work. Where possible, you take on tasks/activities that contribute to the mission, even when they are not entirely within your area of expertise.

2. Engineering

• You have an up-to-date vision regarding IT expertise with a focus on data management;
• You are able to get all typical backlog items from 'to do' to 'done';
• You have mastered the full gamut of engineering skills:
• Problem Analysis and Solution Design;
• Knowledge of scripting on Unix systems and Python coding is a must;
• Experience with Release Automation and knowledge of Testing approaches;
• Good knowledge of SQL, good understanding of Data Warehouse concepts;
• Experience with IBM Infosphere suite (DataStage, Information Governance Catalogue) - is a plus;
• Basic understanding of metadata and data governance concepts;
• Knowledge of containerization products (Docker);
• Knowledge of container orchestration tools like Kubernetes or OpenShift;
• Knowledge of Hadoop and Data Streaming - is a plus;
• Continuous Delivery (Compile, Build, Package, Deploy);
• Test-Driven Development (TDD) and test automation (e.g. regression, functional and integration tests);
• Knowledge of Azure & Azure DevOps;
• Debugging and profiling;
• Experience with Monitoring applications (ELK, Grafana) is a plus;
• Risk and security awareness;
• You ensure that your squad and application fully contribute to partner's implementation of Service Transition and the Service Operations ITIL processes;
• You strive to become a T-shaped engineer.

What’s in it for you:

• Flexible working schedule, which usually includes two days of WFH, but they can adapt to any situation, they work fully remote for the moment;
• Extra vacation days, depending on your entire working experience;
• They encourage personal and professional development, so they invest in your learning by putting at your disposal a budget for training, workshops, and certifications;
• Because everybody is working from home and they really understand that is not always easy, they have built an online well-being programme that can help you manage this stressful period;
• They also have a cool community and your colleagues will help you to integrate fast;
• They support each other, and they share their work and passions on an online Tech Neighborhood;
• A relaxing environment will be waiting for you back at the office, with a flexible desk policy that allows you to work from an office desk, but also from a couch or from the terrace;
• And when you will need a break, you can have a tea from Teapigs and/or a coffee from Nespresso which you can enjoy while reading a book from Bookster;
• Even though they work fully remote this does not mean that you can`t enjoy your own monitor and chair from the office at home while our live DJ sets play you chillaxing music.