114 Data Engineer jobs

Your new role   As a Data Engineer you will: Identify and engage with stakeholders to gather and formalise their requirements, program objectives, and benefits, particularly with regards to business intelligence and analytics platforms and services. Perform expert analysis activities across various departments using appropriate modelling, analysis techniques, tools, and standards to deliver successful business outcomes, and analytics and data sharing outcomes. Engineer processes to maximise the efficiency of people, data, process and technology elements of an organisation. What you'll need to succeed   Azure Cloud solutions experience including but not limited to Data Factory, DevOps, Databricks, Logic Apps. Working collaboratively and developing positive relationships with team members, vendors, stakeholders, and clients. Expertly applying ETL tools such as Datastage, Informatica, Talend, and SSIS. Scripting languages such...

The Client: Clicks IT Recruitment is currently working with a large public sector organisation that is based in Brisbane. They have recently reached an important phase of the project and require a Data Engineer The Role: They are looking for an experienced Data Engineer for a 9-month contract, ending June 2021. Responsibilities: Engage with numerous stakeholders to gather and formalise requirements, program objectives, and benefits Perform expert analysis activities using appropriate modelling, analysis techniques, tools, and standards. Assist in defining, scoping, and planning data, information, and analytics projects to meet clients' business requirements. Lead a technical development team and solution design Develop processes to maximise the efficiency of people, data, process, and technology elements. Selection Criteria: Ability to critically analyse and evaluate business requirements and recommend solutions to Executives....

Job Description Are you an experienced Data Engineer how has worked with large datasets? This client is in the Essential Services sector and can offer role stability. You will be working in a fast-paced environment. You will be responsible for data pipelines in AWS, DevOps CI/CD, and data preparation and manipulation for the data visualisation team.  You will be working with a high performing technical team. You will be an integral part of enhancing the data engineering capability. If you have exposure to snowflake and matillion this will be beneficial but not essential. Your Benefits: Immediate full-time role Melbourne CBD High performing team Cool Tech – AWS/Snowflake/Matillion Your Role: Building and maintaining the data pipelines for the business (ETL) in AWS Be responsible for best practice in legacy systems, SQL and # (transformation) Ensure the accuracy of code quality, logging, exception management, and performance....

About Us NE Digital  - Our Centre of Excellence for Data, Digitalisation and Technology was setup to lead the transformation of the NTUC Social Enterprises by leveraging digital technologies to become more nimble, adaptable and innovative in today’s digital age.  Our group of social enterprises aims to create a greater social force to do good by harnessing the capabilities of the social enterprises to meet pressing social needs in areas like health and eldercare, childcare, daily essentials, cooked food and financial services. Serving over two million customers, NE Digital together with our group of social enterprises will enable and empower all in Singapore to live better and more meaningful lives through our transformation journey.  The Team We believe that diversity is key to driving an innovative, cohesive, productive and fun workplace! Hence, at NE Digital our people join us from all around the world. Be sure to be soaked in an...

A great opportunity for an experienced Data Engineer who is seeking out a career in the banking industry. Mandatory Skill(s) Possess a Bachelor’s Degree, preferably in the field of Computer Science, Software or Computer Engineering, Statistics or any other related field; Has 5 to 7 years of relevant work experience; Experience in using the following platforms: Kubernetes, Dockers , GKE, Google Cloud; Has solid DevOps experience; Possess good hands-on experience and strong in coding on platforms such as Python and Teraform; Strong aptitude for numbers and comfortable handling large volumes of data; Meticulous and organized with good interpersonal and communication skills. Desirable Skill(s) Has additional certifications related to Data Engineering Responsibilities Work well with Engineering team to develop technical solutions, plans and configure in accordance to requirements from various teams...

Exciting Perth Startup - Now an international success story. Cutting edge technology stack. About Our Client Our client is an ASX listed tech startup that is experiencing a period of incredible growth and expansion. With offices around Australia/NZ and North America, this software company has a passion for ensuring the safety of its global customer base through innovative technology solutions. Job Description In this role you will be: Working with the software developers to continue the migration from AWS/Other Data platforms to Google Cloud Platform. Handling the ingestion of significant amounts of complex data every day. Work hand in hand with the analytics to order the data and create meaningful analytics. Working closely with stakeholders across the business to support the integration of the platform with the client's core product. Maintaining the core...

Key Role: Leverage expertise in structured and unstructured data to perform data engineering activities on some of the coolest cutting-edge projects in the industry and work with Big Data tools. Architect data systems, stand up data platforms, build-out ETL pipelines, write custom codes, interface with data stores, perform data ingestion, and build data models. Assess, design, build, and maintain scalable data platforms that use the latest and best in Big Data tools. Perform analytical exploration and examination of data from multiple sources of data. Work in a Scrum-based Agile environment with a multi-disciplinary team of analysts, data engineers, data scientists, developers, and data consumers pushing the envelope of bleeding-edge Big Data implementations. Basic Qualifications: -2+ years of experience within data science, data engineering, or software development role -1+ years of experience with machine learning or advanced analytics tools and methods...

Join our team dedicated to developing and executing innovative solutions in support of customer mission success. Job Description:  Do you want to work at the bleeding edge of technology? Novetta seeks driven software engineers to join our team working on the Joint Artificial Intelligence Center’s (JAIC) newest challenge. The JAIC program aims to “Increase combat effectiveness by accelerating military decision-making and operations.”  Successful candidates duties will include working with a top-flight software development team to; build and improve custom “Training Quality Data” (TQD) software systems and data pipelines, manage and exploit massive quantities of multimedia data and, incorporate the latest AI and Machine Learning (ML) algorithms and techniques into a fast-paced production workflow. This position is at the forefront of technology and your data engineering and software skills are needed to advance AI, Machine...

Our client is looking for a savvy Data Engineer to join their growing team of analytics experts. You will help to expand and optimize the data and data pipeline architecture, as well as optimizing data flow and collection for their digital projects! Mandatory Skill(s) Background in Computer Science/Computer Engineer/Data Science; At least 2 years of experience in data engineering; Working knowledge of programming languages such as Python, R and ETL frameworks; Able to write complex SQL queries; Familiar with big data streaming tools and database frameworks such as Apache NiFi, Storm, Spark, Hadoop, Tableau; Good writing, communication and presentation skills; Fast learner and ability to work independently. Desirable Skill(s) Exposure into cybersecurity or network infrastructure projects. Responsibilities Develop and maintain scalable data pipelines to transform, enrich and improve the efficiency of the data used; Design...

The Covid-19 pandemic is creating seismic challenges around the world. Our purpose, to build a better working world, has never been more important. Life at EY has been transformed dramatically but our strong culture of flexible and remote working has helped EY people navigate new ways of working and remain connected with each other and our clients. A better working world truly starts with the people at EY who are building it every day. Now more than ever we need talented people from diverse backgrounds to help our clients navigate the complexities of this Transformative Age: people with passion, curiosity, and drive to make things better. The opportunity Due to growth, we currently have an opportunity for a Senior Consultant / Manager level Data Engineer to join our Analytics team in Sydney. This role will be instrumental in designing, developing, and evolving the modern data warehousing solutions and data integration build-outs using cutting edge tools and...

The Covid-19 pandemic is creating seismic challenges around the world. Our purpose, to build a better working world, has never been more important. Life at EY has been transformed dramatically but our strong culture of flexible and remote working has helped EY people navigate new ways of working and remain connected with each other and our clients. A better working world truly starts with the people at EY who are building it every day. Now more than ever we need talented people from diverse backgrounds to help our clients navigate the complexities of this Transformative Age: people with the passion, curiosity and drive to make things better. The opportunity We are looking for a Senior Manager – Data Architect within the Technology Consulting – Data and Analytics team  in our Perth office. EY DnA is the data and advanced analytics capability within EY Asia-Pacific, with over 500 specialist employees working across multiple industry...

The Covid-19 pandemic is creating seismic challenges around the world. Our purpose, to build a better working world, has never been more important. Life at EY has been transformed dramatically but our strong culture of flexible and remote working has helped EY people navigate new ways of working and remain connected with each other and our clients. A better working world truly starts with the people at EY who are building it every day. Now more than ever we need talented people from diverse backgrounds to help our clients navigate the complexities of this Transformative Age: people with passion, curiosity, and drive to make things better. The opportunity We are looking for a Senior Consultant - Data Engineer within the Technology Consulting – Data and Analytics team in our Sydney/Melbourne office EY DnA is the data and advanced analytics capability within EY Asia-Pacific, with over 500 specialist employees working across multiple industry sectors....

The Covid-19 pandemic is creating seismic challenges around the world. Our purpose, to build a better working world, has never been more important. Life at EY has been transformed dramatically but our strong culture of flexible and remote working has helped EY people navigate new ways of working and remain connected with each other and our clients A better working world truly starts with the people at EY who are building it every day. Now more than ever we need talented people from diverse backgrounds to help our clients navigate the complexities of this Transformative Age: people with the passion, curiosity and drive to make things better. The opportunity We are seeking a Data Engineer to join our Data and Analytics team in our Canberra office. This role is offered on a flexible, full-time basis. EY DNA is the data and advanced analytics capability within EY Asia-Pacific, with over 500 specialist employees working across multiple industry sectors. We...

Job Description ETL Data Engineer Join a team that’s changing how Australia lives, works, plays, and grows We want you to be the best version of you Work with innovative teams and explore new technologies to help solve real-world problems. We can help you build the career you dream of. Our success relies on ensuring our people enjoy the inspiring challenges, exceptional experience, and flexibility they need to succeed at every stage of their careers. As a leading professional services company with more than 477,000 people working across 120 countries, your career can take many exciting paths spanning digital, strategy, consulting, technology, and operations. As part of a globally diverse workforce, you will help change how Australia lives, works, plays, and grows. Join us, learn from the best people and let challenging, interesting, and enjoyable work become part of daily life A typical day as a Data Engineer ETL / Big Data Engineering...

Job Description Gather, engineer, and prepare data for consumers to enable smarter decision making. Use a broad set of data curation and analytical tools and techniques to enable the development of quantitative and qualitative business insights. Working with partners as necessary, integrate systems and data quickly and effectively, regardless of technical challenges or business environments. Talent Segment: Analytics and Insights Your role includes some or all of the following key responsibilities. You should review these in conjunction with career level guidelines to gain a clear understanding of the expectations for your role.   Digital Data Engineering Drive the design and implementation of models and systems to harness the power of data and analytics that can be used to drive decision making Develops large scale business intelligence/data strategy for clients to achieve long-range goals May lead a...

Work with a global brand on a new product in a startup team Bring a product to life that will help those affected by Covid-19 Greenfields project funded by a global corporate and global eCommerce company WHAT YOU'LL BE RESPONSIBLE FOR: Play a key role in helping transform Product concepts into next-generation software that will help millions of people find their dream job and return to the workforce. Work with Product Owners to produce fully functional data mapping and engineering capabilities. Apply visual styles & interactions through various emerging technological trends, such as AWS Glue, Redshift, Athena, Dynamo, and PowerBI/Quicksights. The wider platform is built using REACT and AWS Lamda capabilities. Comfortable to bring in and discuss new trends/tools into a team, that will proactively helping the product stay ahead. Own the data strategy, including leveraging the potential thru internal and external engagement with...

Job Requisition: R-2020-9-0013 Get to know our Team : We are living in dynamic times. Technology is reshaping how we live, and we want to use it to redefine how financial services are offered. Grab is the leading technology company in Southeast Asia offering everyday services to the masses. Singtel is Asia’s leading communications group connecting millions of consumers and enterprises to essential digital services.  This is why we are coming together to unlock big dreams, and financial inclusion for people in our region is just one of them.  We want to build a digital bank with the right foundation - using data, technology and trust to solve problems and serve customers. If you have what it takes to help build this new Digibank with us, check out the open role below. Get to know the Role : Our Head, Data Engineering will be reporting into the Head of Technology, with a dotted line to our Head of Data. The role will...

Developing, enhancing & maintaining applications in the Financial Services space Latest Tech Stack - Major Greenfield Project A big piece of work - major integration Responsibilities: Essentially a Data all-rounder, someone who is capable of working as a Developer as well as a Tech BA/Data Analyst with a capability of working hand in hand with business stakeholders Contributing to the end to end design, including but not limited to, data identification, ingestion, and implementation of back end function, provide insightful analytics, and develop front end reporting screens and dashboards. Preparing insightful management information/dashboards for the business and other stakeholders to demonstrate the value of the function and highlight new/emerging risks identified by monitoring Conducting analysis of organizational needs and goals for the development and implementation of an application system What we need:...