As a data engineer you will work in the Predictive Maintenance team consisting of data engineers, data scientists, front- and backend developers, testers, a system engineer and a product owner. You will participate in solution design discussion led by our product architect where your knowledge and input will be highly valued. You will collaboratively work with IT and business SMEs to ensure delivering high quality end-to-end data ingestion pipelines.
Your responsibilities:
- You will be developing, testing, documenting the data (collection and processing) pipelines for Predictive Maintenance. The data collection consists of (complex) data pipelines from (IoT) sensors and low/high level control components to our Data platform. When the data is in the cloud, it has to be processed and made available as data products to our data scientists.
· Align implementation efforts with other back-end developers across multiple development teams.
- You will develop scalable data pipelines to transform and aggregate data for business use, following software engineering best practices. For these data pipelines you will make use of the best frameworks available for data processing like Spark. We are continuously improving on the solutions we use and encourage you to keep challenging the status quo.
- You develop our data services for customer sites towards a product, using (test & deployment) automation, componentization, templates and standardization in order to reduce delivery time of our projects for customers. The product provides insights in the performance of our material handling systems at customers all around the globe.
- You will contribute to the design, build and improve a CI/CD pipeline, including (integration) test automation for data pipelines. In this process you strive for an ever-increasing degree of automation.