A Data Engineer is needed to drive the technical vision and planning for a client's organization. Responsibilities include translating business needs into technical strategies, understanding and working with data integration and transformation, designing and implementing data solutions, and pre-processing structured and unstructured data. The ideal candidate will have 5-8 years of experience, strong technical skills, and excellent communication and analytical abilities.
The Data Engineer will have a knack for data analysis, data manipulation and data modelling. The consultant will be responsible for understanding and driving the overall technical vision and planning of a client’s organisation and translating business needs into technical strategy.
Tertiary degree, diploma or certificate in a related field .5- 8 years’ working experience as a Data Engineer / Database Developer.Understanding and working experience in data integration and transformation.Working knowledge of data quality processes and master data management. Experience implementing design support systems using Database Management Systems such as SQL Server or Oracle. Proficiency in designing and implementing data integration and ETL solutions using SSIS, Azure Data Factory and / or SQL Server stored procedures. Understanding of several Big Data technologies like Hadoop, MapReduce and Spark as well as event processing or message ingestion services like Kafka, Event Hub and Stream Analytics.Some experience developing software solutions using Visual Basic, C++, C#, Java or Python.Experience implementing solutions using Azure SQL databases, Azure Synapse , Azure Storage Accounts and / or Databricks.Additional skills in the following will be taken into consideration: Tableau, Power BI, strong math skills , Scala, Python or R.Undertake preprocessing of structured and unstructured data.Data Modelling .Database Performance Tuning and Optimisation.Propose solutions and strategies to business challenges.An understanding and hands on experience on Hadoop/Spark based distributed storage and computing frameworks.Strong experience in architecting analytical applications in cloud environment such as Amazon Web Services and Microsoft Azure.Critical Thinking: Using logic and reasoning to identify the strengths and weaknesses of alternative solutions, conclusions or approaches to problems. Active Learning: Understanding the implications of new information for both current and future problem-solving and decision-making. Systems Analysis: Determining how a system should work and how changes in conditions, operations, and the environment will affect outcomes. Complex Problem Solving: Identifying complex problems and reviewing related information to develop and evaluate options and implement solutions. Deductive Reasoning: The ability to apply general rules to specific problems to produce answers that make sense. Inductive Reasoning: The ability to combine pieces of information to form general rules or conclusions . Excellent communication skills: Ability to engage with C-level stakeholders, both verbal and non-verbal and communicate a deep understanding of the business and a broad knowledge of technology and applications. Technical Literacy: Possess a high level of technical literacy, which helps them determine how a software solution fits into an organization’s current structure and assists in the development of specifications and requirements. Analytical Assessment: A high level of analysis to examine current systems and determine overall project needs and scope. Schedule Management: Extensive time management skills to determine development schedules and milestones and ensure that deliverables are completed on time for oneself and your team. Team Leadership: To oversee and direct development teams throughout the project development lifecycle, experience with team leadership and motivation is essential.Experience working on large project incorporating processes and procedures and standards.
DATA ENGINEERING BIGDATA CLOUD COMPUTING DATABASE MANAGEMENT SOFTWARE DEVELOPMENT
Australia Latest News, Australia Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
Senior Software Engineer Job OpeningA digital agency is looking for a Senior Software Engineer to join their team. The ideal candidate will have strong skills in Node.js, TypeScript, React, C / Java, and PostgresDB, as well as experience with AWS, Terraform & Docker.
Read more »
Data Engineer - Asset Management SoftwareA Data Engineer is needed to support Asset Management clients using software designed for research and investment. Responsibilities include 2nd tier support, understanding client data needs, developing and maintaining data architectures, integrating systems, and preparing data for predictive modelling. The ideal candidate will have a degree in computer science, IT, mathematics, applied mathematics, actuarial science, or engineering and up to 2 years of experience.
Read more »
Data Engineer - Western Cape Century CityIT Industry News. Daily.
Read more »
Data Engineer / Business Intelligence SpecialistWe are seeking a skilled Data Engineer/Business Intelligence Specialist to join our growing team. You will play a key role in transforming data into actionable insights, supporting our enterprise data warehouse, data marts, and business intelligence reporting environments. Responsibilities include collaborating with stakeholders, data engineers, and BI analysts, analyzing business requirements, designing and implementing data solutions, and optimizing data pipelines and infrastructure.
Read more »
Data Engineer - Financial Services - 12-Month Contract in SandtonPsybergate is looking for a skilled Data Engineer to join a financial services client in Sandton, Johannesburg, South Africa. This 12-month contract role requires extensive experience with Ab Initio and a strong understanding of data engineering principles.
Read more »
Data Engineer - Join Our Team and Build Secure, Scalable Data SolutionsWe are searching for an experienced Data Engineer to join our team. This role involves designing and implementing secure, scalable, and cost-effective data solutions using on-premises technologies and cloud platforms (Azure and AWS). You will collaborate with clients and various stakeholders to understand data requirements and deliver high-quality data solutions.
Read more »