IT Industry News. Daily.
The purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the companies Data Architecture Roadmap, to advance technical thought leadership for the Enterprise, deliver fit for purpose data products, and support data initiatives.
In addition, Data Engineers enhance the data infrastructure of the company to enable advanced analytics, machine learning and artificial intelligence by providing clean, usable data to stakeholders. They also create data pipelines, Ingestion, provisioning, streaming, self-service, API and solutions around big data that support the company strategy to become a data driven organisation.Responsible for the day-to-day maintenance of data pipelines, providing support to the data squads including performing data related tasks in a Data Epic and assisting in basic data pipelines, data ingestion and supporting Data Engineers in their Epics. Data Infrastructure: Support and maintain the Data Infrastructure to ensure it is secure, available and reliable. Data Pipeline Build : Maintain data pipelines starting with Data Virtualisation, then progressing to Data Ingestion and finally to Data Provisioning. Ensure that data pipelines are monitored and run successfully and configure and support minor changes in data pipelines. Data Visualisation: Create virtual data bases and assist in creating data extracts for the business in response to business needs. Documentation and Data Analysis: Collaborate with the Data Analyst to perform data profiling, data validation, and data documentation in support of Epics. Our clients Data Warehouse Monitoring and Support: Monitor data pipelines and infrastructure to provide first line support, resolve issues and ensure that the warehouse meets its SLA timelines for data availability and warehouse reliability. Our clients Cloud Monitoring and Support Services: Ensure cloud processes are monitored and managed daily, to ensure that Cloud pipelines run successfully. Operations: Support and run daily operational reports to ensure that all jobs ran successfully, and that the data warehouse is maintained according to standard. Collaboration: Work collaboratively with business stakeholders to gain business knowledge, understand data extracts and improve and optimise business queries.Advanced Diplomas/National 1st DegreesCloud , DEVOPS or Data engineering certification. Any Data Science certification will be an added advantage, Coursera, Udemy, SAS Data Scientist certification, Microsoft Data Scientist.Type of experience: Result-driven, analytical creative thinker with demonstrated innovative problem-solving skills. Self-motivated, proactive and organised with the demonstrated ability to handle-multiple and simultaneous tasks meeting aggressive deadlines. Team player with demonstrated ability to stay calm and composed in the face of adversity.Databases Agile Delivery
Australia Latest News, Australia Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
Junior Software Engineer (C#, C++, Java, Python) (Remote)IT Industry News. Daily.
Read more »
Junior Software Engineer (C#, C++, Java, Python) (Remote) - Western Cape Cape TownIT Industry News. Daily.
Read more »
Data Engineer (Remote) - IT-OnlineIT Industry News. Daily.
Read more »
Data Engineer (Remote) - Western Cape Century CityIT Industry News. Daily.
Read more »
Mulesoft Integration Engineer - Remote RemoteIT Industry News. Daily.
Read more »
Senior Software Architect/ Senior Full Stack C# Developer (Remote, anywhere in South Africa) - Remote RemoteIT Industry News. Daily.
Read more »