Data Engineer - Gauteng Sandton

IT Industry News. Daily.

The role involves the design, development, and maintenance of the architecture that facilitates the efficient collection, storage, and processing of large datasets. This position collaborates closely with data scientists, analysts, and software engineers to ensure that data is accessible, reliable, and well-structured for analysis and business insights.

Identify technology strategic opportunities to meet business needs.Design, develop, and maintain data pipelines for processing large-scale datasets.Implement data models and database schemas to improve data efficiency.Data integration, develop ETL/ELT workflows to extract data from a variety of sources, including databases, APIs, and streaming services.Troubleshoot and monitor pipeline performance and data quality issues.Manage cloud-based storage solutions, including MS Azure and AWSEnsure privacy and security by implementing data stewardship policies .Formulate strategies for data retention, recovery, and backup Collaborate closely with data scientists to guarantee that the data is appropriately organized for machine learning models. Provide data analysts with well-organised and clean datasets for the purpose of reporting and visualization.Enhance data processing speed and efficiency by utilising big data technologies .Employ relevant scripting, SQL, or Python to automate repetitive duties.Respond to all data related loss notifications impacting businessBachelor’s in computer science, Information Technology, Data Engineering, or any related field.Advantageous – Cloud Professional Data Engineer, or Microsoft Azure Data Engineer.+5 years of experience in data engineering, database management, or software development.

We have summarized this news so that you can read it quickly. If you are interested in the news, you can read the full text here. Read more:

ITOnlineSA /  🏆 16. in ZA

Australia Latest News, Australia Headlines

Similar News:You can also read news stories similar to this one that we have collected from other news sources.

Data Scientist - Gauteng GautengIT Industry News. Daily.
Read more »

Field Support Engineer - Gauteng SandtonIT Industry News. Daily.
Read more »

Senior Network Engineer - Gauteng SandtonIT Industry News. Daily.
Read more »

Senior Machine Learning Engineer/Lead Data Scientist - Gauteng Johannesburg RegionIT Industry News. Daily.
Read more »

Data Analyst - Gauteng SandtonIT Industry News. Daily.
Read more »

Data Engineer - Gauteng RandburgIT Industry News. Daily.
Read more »