Data Engineer
What you’ll be doing - Designing, implementing, and supporting key datasets that provide structured and timely access to actionable business information with the needs of the end customer always in view - Retrieving and analysing data using SQL, Excel, and other data management systems - Creating ETLs/ELTs to take data from various operational systems and craft a unified dimensional or star schema data model for analytics and reporting - Developing a deep understanding of vast data sources (existing on the cloud) and know exactly how, when, and which data to use to solve particular business problems - Creating data tools and web/digital/mobile applications for analytics and data scientist team members that assist them in building and optimising our analytics, including deployment into operations and client systems - Assembling large, complex data sets that meet functional / non-functional business requirements - Identifying, designing, and implementing internal process improvements: automating manual processes, optimising data delivery, re-designing infrastructure for greater scalability, etc. - Building the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, Azure and the continually emerging big data technologies - Embedding processes to ensure we regularly check and improve data quality of our core analytics data sources and warehouse - Assisting with data-related technical issues and support their data infrastructure needs - Creating and maintaining optimal data pipeline architecture and work with data and analytics experts to strive for greater functionality in our data systems - Building analytics tools that utilise the data pipeline to provide actionable insights into customer experience, operational efficiency and other key business performance metrics
What you’ll need - Minimum 5 years’ of experience in a Data Engineer role with detailed knowledge of data warehouse technical architectures, ETL/ ELT, reporting/analytic tool, data security, Onion, Repository, Builder, MVC, Faade, Factory or Singleton - Knowledge of ASP.Net, C#.NET, LINQ, JQuery, Java Script, Angular DataTables, Ajax, XML, Web Services and Web API - Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field - Experience leading and designing data warehousing and analytics project infrastructure, and integrating technical components including using Azure - Experience with production BI implementation in the Cloud - Exposure to reporting tools such as Qlikview or Power BI (Desirable) - Hands-on expertise with application design, software development and automated testing, preferably in a mobile/digital space - Ability to effectively interpret technical and business objectives and challenges, and articulate solutions - Experience building and optimising big data pipelines, architectures and data sets