65 Data Engineer jobs

*Expression of Interest* Work for one of the fastest growing tech start-ups in APAC About Our Client With high cultural standards and team-work based, and high collaborative structure, this business understands what tech superstars need to be successful. Gaining constant exposure to the latest tech and working with one of the most advanced AWS shops going around, you will get the opportunity to progress your career while also build your tech stack into a market-leading and cutting edge force. Job Description Reporting into the Head of Data Engineering, this role will suit a competent Data expert that has demonstrated experience working with wider non-technical business stakeholders. Ideally you come with a fresh mind and a strong use of initiative. This role will not suit single-skilled robotic coders, rather a team player that wants to be a part of the bigger picture. The Successful Applicant Tech Stack: Cloud platform experience Python DWH and Data Modelling - Snowflake What's on Offer Attractive, cutting-edge tech stack Unparalleled Technology exposure Tech start-up culture Central CBD location

Work for one of the fastest growing tech start-ups in APAC Play a critical role in cutting edge, market leading Cloud/Analytics projects About Our Client With high cultural standards and team-work based, and high collaborative structure, this business understands what tech superstars need to be successful. Gaining constant exposure to the latest tech and working with one of the most advanced AWS shops going around, you will get the opportunity to progress your career while also build your tech stack into a market-leading and cutting edge force. Job Description In this role, you will be at the coalface of what makes this business successful. You will play a major role in the what, why, and how the tech product comes to life. It is expected that you will be able to rely on previous experience with cloud and software engineering in order to influence the design and implementation of cloud-based solutions. The Successful Applicant Demonstrable success and passion for delivery of cloud-based data engineering solutions Experience leading talented teams driving collaboration You need to know AWS' core services as a minimum of your AWS knowledge Demonstrable understanding of DevOps, automation pipelines etc. Can you take a client on this journey? Can you give practical examples of what to do in the midst of blockers and external influences that come with large enterprises What's on Offer Attractive, cutting-edge tech stack Unparalleled Technology exposure Tech start-up culture with t-shirt and sneakers (BYO motorised scooter...) Central CBD location

Work for one of the fastest growing tech start-ups in APAC Play a critical role in cutting edge, market leading Cloud/Analytics projects About Our Client With high cultural standards and team-work based, and high collaborative structure, this business understands what tech superstars need to be successful. Gaining constant exposure to the latest tech and working with one of the most advanced AWS shops going around, you will get the opportunity to progress your career while also build your tech stack into a market-leading and cutting edge force. Job Description In this role, you will be at the coalface of what makes this business successful. You will play a major role in the what, why, and how the tech product comes to life. It is expected that you will be able to rely on previous experience with cloud and software engineering in order to influence the design and implementation of cloud-based solutions. The Successful Applicant Demonstratable success and passion for delivery of cloud-based data engineering solutions Experience leading talented teams driving collaboration You need to know AWS' core services as a minimum of your AWS knowledge Demonstratable understanding of DevOps, automation pipelines etc. Can you take a client on this journey? Can you give practical examples of what to do in the midst of blockers and external influences that come with large enterprises. What's on Offer Attractive, cutting-edge tech stack Unparalleled Technology exposure Tech start-up culture with t-shirt and sneakers (BYO motorised scooter...) Central CBD location

Successful Start-Up/SME environment CBD-based office About Our Client Join a succesful new player to the Digital/Cloud Transformation game. This organisation has successfully been through the initial high-risk startup phase and has consolidated its spot in the market as a key player in this competitive space. Modern offices, and flexible work options are consistent Melbourne's fast growing start-up culture. Work with industry leading execs that can offer career growth and up-skilling opportunities. Design and implement optimal data pipeline architectures Assemble large, complex data sets that meet business requirements Identify, design, and implement internal process improvements: including process automation, optimizing data delivery, etc. Design optimal ETL infrastructures from variety of data sources Incorporate governance processes and tools into the data landscape Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics. Work with executive, LOB, design and IT stakeholders on data-related technical issues and infrastructure needs Keep data separated and secure across national boundaries through replication and failover techniques Guide and mentor clients to become self-sufficient practitioners The Successful Applicant At least 5 years' relevant experience; Highly competent in a cloud integration environments (AWS or Azure) Strong experience with relational SQL and NoSQL databases, including DB2, Oracle, Postgres, Cassandra. Strong experience with big data tools: Hadoop, Spark, Kafka, etc. Demonstrable experience with data pipeline and workflow management tools: InfoSphere, Informatica, etc. A profound ability with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc. A passion and history for working in Agile teams; Exposure to leadership skills and project management What's on Offer Work for a successful start up Lucrative package Centrally located Lots of career progression opportunity

Lead a Data Engineering team at one of Australia's most well-known brands Impact the business driving growth and data maturity at enterprise level. About Our Client Join a large enterprise organisation with a strong presence across APAC. This business is well into it's technology transformation to become a modern, reliable and eventual leader across the market. You will be coming aboard into a technology function that is excited for change and ready to make the necessary steps to re-invent itself. Job Description * Driving the Data Engineering team to deliver customised solutions to customer * Building and running Cloud-based solutions * Building and incubating a "clean data" culture * Providing technical guidance in solution design, define standards, assist with research and design for architectural issues, assist with implementation of automated provisioning The Successful Applicant * Tertiary degree in a relevant field * Minimum of 3 years' people management experience * Excellent technical knowledge of Cloud Computing (AWS/Azure/GCP etc. non-specific), DWH, data modelling, ETL, software development practices and some knowledge of security principles * Strong understanding and experience with SQL, Python, Redshift, Lambda is the ideal tech stack. What's on Offer Based in a convenient inner Melbourne location, public transport is ample. Salary range for this role is on par with market expectations, if not higher. The biggest sell for this role is the potential for career progression and growth throughout the organisation.

Dell provides the technology that transforms the way we all work and live. But we are more than a technology company — we are a people company. We inspire, challenge and respect every one of our over 100,000 employees. We also provide them with unparalleled growth and development opportunities. We can’t wait for you to discover this for yourself as a graduate intern on our Data Engineering team in  Singapore. Transforming raw data into insight. Predicting the future through analysis. These are our core strengths as a groundbreaking organization changing the world through technology. Our Data Intelligence Engineering team applies science to data to predict and model future outcomes. Our engineers lead the way in developing new methods of generating meaning from data – developing new environments, methodologies, processes, tools and data governance structures. They also propose strategic or tactical plans based on business data and market trends. Key Responsibilities Partner with internal stakeholders to identify business problems and articulate Data Science and Engineering opportunities to apply statistics, machine learning, optimization, and/or simulation. See beyond the data to propose and build state-of-the-art solutions that will raise the bar for optimal decision making. Builds data pipelines focusing on data ingestion, integration, modeling, optimization, and quality for AI processing Explores data for pattern detection prior to algorithm development. Prepares and pre-processes data utilized in algorithms. Ensures data is formatted and cleansed for AI processing. Drives use and adoption of new data sources and data partnerships. Apply your expertise of research to develop statistical models, machine learning models, optimization models, and simulation models for inventing and expanding Data Science Engineering capabilities across all the business functions. Instrument the product, engineering, and business ecosystem by building analytical descriptive models and statistical predictive models to support and improve business decision making. Essential Requirements Be able to extract data from existing sources and build a data warehouse to perform analysis Familiar with MySQL, Python/R and PySpark. Knowledge of advanced statistical modeling, testing, data mining, and data science techniques Advanced Excel and PowerPoint skills required and Experience with Power BI and other data visualization is preferred Strong scientific approach to problem-solving and excellent organizational, analytical and problem-solving skills Ability to communicate complex results in a simple and concise manner at all levels within the organization Good communication skills Basic understanding of the B2B business model and marketing and sales activities would be a plus Benefits We offer highly competitive salaries, bonus programs, world-class benefits, and unparalleled growth and development opportunities — all to create a compelling and rewarding work environment. If you can analyze complex business problems and inform key decision-making, this is your opportunity to develop with Dell. Dell is committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment. All employment decisions at Dell are based on business needs, job requirements and individual qualifications, without regard to race, color, religion or belief, national, social or ethnic origin, sex (including pregnancy), age, physical, mental or sensory disability, HIV Status, sexual orientation, gender identity and/or expression, marital, civil union or domestic partnership status, past or present military service, family medical history or genetic information, family or parental status, or any other status protected by the laws or regulations in the locations where we operate. Dell will not tolerate discrimination or harassment based on any of these characteristics. Learn more about Diversity and Inclusion at Dell  here . Job Family:  Engineering Internships Job ID:  R046641

3 months initial contract Possibility to extension About Our Client Our client is a prominent NSW Government organisation responsible for the public safely located in Western Sydney. Job Description Engage with senior client stakeholders to understand their data and to define and derive valid and pragmatic data insights from multiple disparate data sources Showing initiative, self-drive to "make it work" and be result-orientated rather than process-orientated. Efficient / time-driven Transform asset data (inventory, condition, maintenance and financial) from the structures held within multiple service provider systems into a single unified (best-fit) structure for internal use. Design and build an automated process to facilitate initial load of data from multiple service provider systems into the unified structure, in order to facilitate follow up loads which may be on a regular basis. Ensure that the transformed data is accessible to the front end reporting and visualisation frameworks. Work with the project architects to develop and evolve data structures to iteratively improve design and usefulness. The Successful Applicant Strong automation and testing skills. Experience in data modelling techniques. Experience in ELT/ETL design and data processing mechanisms. Experience using multiple different technology stacks with a demonstrated flexibility and mental elasticity in order to solve complex data problems. Previous experience in Data Engineering / Modelling / Design roles Excellent verbal and written communication skills. Experience in working in a cross-functional collaborative team (Business Stakeholders, Architects, BAs and SMEs) Asset management knowledge (taxonomies, nomenclatures, data structures) would be a strong advantage. What's on Offer Contract with possibility to extension Experience with Prominent NSW Government organisation

Dell provides the technology that transforms the way we all work and live. But we are more than a technology company — we are a people company. We inspire, challenge and respect every one of our over 100,000 employees. We also provide them with unparalleled growth and development opportunities. We can’t wait for you to discover this for yourself as a Data Engineer on our Supply chain Data, Analytics and Automation team in Singapore. Data Science is all about breaking new ground to enable businesses to answer their most urgent questions. Pioneering massively parallel data-intensive analytic processing, our mission is to develop a whole new approach to generating meaning and value from petabyte-scale data sets and shape brand new methodologies, tools, statistical methods and models. What’s more, we are in collaboration with leading academics, industry experts and highly skilled engineers to equip our customers to generate sophisticated new insights from the biggest of big data. We are actively looking for talented and motivated individuals to join our Supply Chain Data Analytics and Automation team. If you are curious by nature and inspired by how data is changing the world, then we are interested in talking with you. You should excel and thrive in a fast paced, collaborative and iterative environment. You’re driven to show the world the power of data and applied analytics and loves learning, data, scale and agility as well as excel in making complex concepts simple and easy to understand by those around you. Key Responsibilities Provide Supply Chain Analytics to Dell Businesses globally. Work closely with business owners, who are geographically dispersed, to understand and document the problem statement. Identify appropriate source data structures, and gain understanding of data through probing interviews, inspection of documentation, and analytical discovery. Query, aggregate, prepare, transform and load data, ready for analysis by data scientists. Validate quality of data and explore data to uncover insights. Essential Requirements Two to four years of experience in data analysis, has developed data models and solutions, and has been exposed to data analytic/ business intelligence tools (eg. Excel, SQL, Teradata, Tableau, Power BI, R, Python, etc). Have excellent skills of SQL server for querying and transforming data to maximise performance, including stored procedures. Strong knowledge of relational database systems ( Eg. teradata, PostgreSQL, MS SQL server, etc.) and schema relationships. Experience in using ETL tools (eg, Microsoft SSIS, Python, etc). Designing optimal data structures. Able to communicate effectively to understand linkages between verifying business processes and the data structures. Experience in understanding complex business processes (e.g. procurement, manufacturing, etc)  Desirable Requirements:  If candidates have one or more of the following, this would be advantageous: Microsoft SQL server certification. Experience in using tableau or Power BI (certification preferred) . Containers such as kubernetes. Experience in handling OLAP cubes. Benefits We offer highly competitive salaries, bonus programs, world-class benefits, and unparalleled growth and development opportunities — all to create a compelling and rewarding work environment. If you share our passion for data and you’re keen to play a key role in driving progress, this is your opportunity to develop with Dell. Dell is committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment. All employment decisions at Dell are based on business needs, job requirements and individual qualifications, without regard to race, color, religion or belief, national, social or ethnic origin, sex (including pregnancy), age, physical, mental or sensory disability, HIV Status, sexual orientation, gender identity and/or expression, marital, civil union or domestic partnership status, past or present military service, family medical history or genetic information, family or parental status, or any other status protected by the laws or regulations in the locations where we operate. Dell will not tolerate discrimination or harassment based on any of these characteristics. Learn more about Diversity and Inclusion at Dell  here . Job Family:  Engineering Data-Science-&-Analytics Job ID:  R052970

Salary packaging - to suit your personal and financial circumstances   Technology discounts - from Apple, HP, Lenovo, to Windows   Flexible work arrangements - work in a way that suits you best  Do you want to work for one of the fastest growing data teams in Australia? Do you want to work on multiple data platforms and provide new solution offerings by leveraging cloud and big data technologies? About the team Big data, information and analytics. Three words that spark apprehension in most businesses. But our team of experts are constantly curious and excited about combining our wonderful array of technological expertise to transform data into our clients’ most valuable assets, making their work smarter. Our data consultants are supported with resources, training and tools they need to excel at their work, but also the freedom and power to create their own paths forward to make a difference. As a Senior Consultant – Big Data, you will work closely with the team and stakeholders to build and deliver a Cloud based vision for a next generation Big Data analytics platform. You will have a focus on data quality, data security and deliver the systems that process huge volumes of data. What will you typical day look like? You will play a pivotal role in - Designing and producing high performing and stable applications to perform complex processing of massive volumes of data in a new cloud based architecture; Building real-time data processing applications which are integrated with business systems to enable value from analytic models to drive rapid decision making; Designing data structures (including data storage, data ingestion, analytics layers, data output/input files) on a variety of technological solutions (e.g. RDBMS, Big Data, columnar, NoSQL or graph databases); Developing a component of a data solution; this could be a data mapping, a database, a migration/ingestion prototype or a solution roadmap ; Contributing to system architecture design for a data platform (including cloud-based structures both on and off premises, data warehouse components and data lakes); this could cover a range of technologies, various countries/locations and lines of business; Support data strategy or technology strategy definition programs, including technology stack definition and target operating model requirements Enough about us, let’s talk about you: You are someone with: Experience in building and implementing big data solutions using industry best practice tools, technologies and methods Use of ‘traditional’ data analytics tools and techniques (e.g. MSSQL, Oracle, MySQL) and ETL software (e.g. SSIS, Informatica, CloverETL) Working in large scale cloud data solutions using platforms such as AWS or Azure Experience in scripting or programming (e.g. Python, Java, Scala, C#) Excellent verbal and written communication skills to adapt to technical and non-technical audiences. Educated to degree level (or have equivalent experience) Why Deloitte?  At Deloitte, we create positively differentiated work experiences that enable our people to feel valued and achieve their full potential. We value difference, and embrace people with diverse backgrounds and thinking styles. Knowing that people work best in different ways, we are happy to discuss alternative arrangements if the working pattern you are looking for is not specifically indicated. Next Steps  Sound exactly like the sort of role for you? Apply now! If you’ve got any questions or wish to have a confidential conversation about this role, contact Vishal Wadhwani from the Talent Acquisition team. We’d love to hear from you.   

Salary packaging – to suit your personal and financial circumstances Flexible work arrangements – work in a way that suits you best Pathway to Partnership – receive support and mentoring to progress your career Does the idea of implementing next generation data platforms run in your veins? Are you an inspirational leader who provides guidance to your team in order to achieve better and higher? We are looking forward to having you as part of our diverse and collaborative team! About the team Big data, information and analytics. Three words that spark apprehension in most businesses. But our team of experts are constantly curious and excited about combining our wonderful array of technological expertise to transform data into our clients’ most valuable assets, making their work smarter. We primarily seek to improve the efficiency and effectiveness of organisations at all stages of the data transformation journey from designing the change required, to delivering and managing that change and providing assurance around change initiatives. As a Senior Data Engineer, you will be an integral part of one of the fastest growing teams in Australia and build best in class data frameworks. What will your typical day look like? As an integral part of our Data Engineering team, you will - Work with the leadership teams to identify areas for business development and turn them into success milestones; Work closely with your team to set their path for progression by leveraging your mentoring skills. Lead the development and delivery of data solutions for our clients – with strong focus on building cloud based big data platforms such as GCP; Direct and drive detailed technical solution designs to ensure that the business along with technical teams can access data from a single platform. Enough about us, let’s talk about you. You are someone with: Experience in relevant technology architecture consulting or industry experience to include Information delivery, Analytics and Business Intelligence based on data from hybrid of Hadoop Distributed File System (HDFS), non-relational (NoSQL, MongoDB, Cassandra) and relational Data Warehouses. Hands on experience with data lake implementations, core modernization and data ingestion. Hands on experience with Cloud using Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP) Hands on working experience with Big data technologies; MapReduce, Pig, Hive, HBase, Sqoop, Spark, Flume, YARN, Kafka, Storm etc. Experience working with commercial distributions of HDFS (Hortonworks, Cloudera, Pivotal HD, MapR) Hands on experience designing and implementing data ingestion techniques for real time and batch processes for video, voice, weblog, sensor, machine and social media data into Hadoop ecosystems and HDFS clusters. 1+ years of hands on experience with data integration products like Informatica Power Center Big Data Edition (BDE), IBM BigInsights, Talend etc. Bachelor’s Degree or 4 years equivalent professional experience Why Deloitte? At Deloitte, we create positively differentiated work experiences that enable our people to feel valued and achieve their full potential. We value difference, and embrace people with diverse backgrounds and thinking styles. Knowing that people work best in different ways, we are happy to discuss alternative arrangements if the working pattern you are looking for is not specifically indicated. Next Steps Sound like the sort of role for you? Apply now. By applying to this job you will be assessed against the Deloitte Global Talent Standards. We've designed these standards to provide our clients and candidates with a consistent & exceptional Deloitte experience globally .    

A chance to join an innovative and proactive company that will help you take the next step in your career. Your new company   You will be joining an up and coming organisation based in the Melbourne CBD. You will be working on exciting and innovative projects. Take your next step in an exciting career by joining an elite team who are focused on success and developing new initiatives. Your new role   Reporting through to the CTO as a Data Engineer, you will be designing, building and implementing new data builds, incorporating spatial data and point cloud scanning. You will be working on a greenfield project and will be a key decision maker from proof of concept through to phase three of this project and ongoing. What you'll need to succeed   To be successful you will require the following skills/ experience: Proven track record in consulting and identifying needs with a range of stakeholders, and in building and maintaining effective working relationships with these stakeholders. Have experience in building new programs and platforms for large amounts of data. Strong experience in data analytics using SAS, R, SPSS particularly with large data sets. Strong people management and mentoring skills. Strong analytical skills with the ability to collect, organise, analyse and disseminate significant amounts of information with attention to detail and accuracy and demonstrated ability to deliver analytical outcomes to the business that provide significant value add to the business. Demonstrated ability to provide value add data analysis and reporting services to external stakeholders where high degree of quality of data interpretation and presentation is required. Strong organisational and time management skills including an understanding of the project. Experience within the construction industry is highly regarded. What you'll get in return   You will get the chance to work with a well funded, disruptive organisation that will offer career progression and the ability to be a key decision maker in projects moving forward. 

Develop software systems building data pipelines, extracting data for high performance critical projects. Your new company   The glamorous tech company is based in Melbourne CBD- Market leader dealing with exciting projects developments. You will be working in a fast-paced environment with a team of strong professionals; researchers, statistical analysts and developers. You will become part of a company that values its people and is always working on training them to become the best at what they do. Excellent work culture and a good salary are on offer for the right candidate! Annual Bonus, Pool tables, Gym, Sauna, yoga classes and participate in events, this is a fun place to work where you don't just get to up-skill but you also work on your personal development Your new role   You will be working with all aspects of software development on performance critical projects from creating software systems from scratch to maintaining and upgrading multiple systems covering the full SDLC. In this role, there will be a strong focus on data pipeline engineering, extracting data from various sources, scheduling, testing, developing, managing failure. You need to love working, extracting, moving and organising highly critical data. What you'll need to succeed  : 5+ years of experience working with a any object-oriented programming language but you will be coding in C# .Net. Min 3 years of testing experience (minimum 1 year with automation testing) is a must. You need to have worked with GIT, Jira, Bugzilla etc for bug tracking. Data pipeline development experience. You need to explain how you Schedule, test and work with failure management. Experience with some of the following: Distributed stream processing, Apache Spark, NoSQL data storage, message queues, Unix. Experience with Parquet/ Cassandra/ elastic search. Experience with data structures, algorithms and software design. You need to have worked with numbers and calculations while dealing with data. Experience working with Thrift/JSON or XML. You need to be in Australia and have full work rights to be eligible for this role. Good communication skills.

ABOUT US   Build the Smarter Way to Shop!   ShopBack is a rapidly growing digital loyalty and discovery platform, with a clear mission to create a world of Smarter Shoppers. We are a passionate team that wants to drive innovation and build a product that we love and are all proud of!   At ShopBack, our engineering teams build scalable platforms and utilize leading-edge technologies to build a world-class product. You will join a diverse and talented team of aspiring engineers with great ambitions to impact the eCommerce landscape. We are seeking team members who strive to solve the hard problems, take pride in delivering world-class products and are strong team players.   What you’ll be doing:   At ShopBack our Data Engineering team acts as the bridge that ties everyone together through data. As data in ShopBack never stops growing, this team also never stops learning, innovating and expanding so that we can produce the best data solutions using relevant technology to ensure the company's continued success.   Manage and ensure the AWS platform are always available, fast and highly scalable to accommodate unprecedented demand Design, build, deploy and manage scalable and reliable ETL pipelines to ingest data from various data sources. Build a robust in-house platform to support analytics and data science Manage and process large amounts of data in near real-time to deliver up-to-date metrics.  Drive continuous improvements in the efficiency and flexibility of our platform and services requirements.  Keen on learning and implementing best practices on cloud computing technologies   Requirements: Minimum 2 years of experience working in a cloud platform, preferably AWS. Proven experience in building end to end platforms/solutions using both open source components and cloud vendor products Working knowledge of networking: TCP/IP addressing, DNS, routing Familiar with administration tools such as vagrant, puppet, chef, terraform Knowledge of implementing security on the cloud: firewalls, NACLs, VPNs

Seeking a DevOps engineer with strong production support background to build automation into Big Data delivery Your new company   This industry leading bank is looking for passionate DevOps Engineer candidate to join them in building a new cloud data lake. Your new role   Support and Incident Management. Diagnosing production issues and performing root cause analysis. Follow the Incident process, track and report on the incident status as it occurs. Participate on out of hours on-call support (rostered). Creation and maintenance of delivery pipeline tooling. Including build/deploy/CI/infrastructure scripts, monitoring, logging Building automated provisioning that can setup secure cloud environments Continually learning and researching best practices and tooling for Big Data delivery Automation is built in into every aspect of delivery as a core component, not an afterthought. What you'll need to succeed   Strong infrastructure production support experience. L1 and L2. Experience with monitoring tools (e.g. Cloudwatch, Splunk) AWS experience Deploying and managing Big Data solutions (Hadoop clusters, ETL processing, etc) Infrastructure provisioning automation (Terraform, Ansible) Jenkins/Hudson experience (or similar CI tools) Multiple roles available, both senior and junior. What you'll get in return   Your expertise will allow you to contribute to an exciting team within a market leader as well as obtaining a competitive market salary package. You will be entitled to all full time permanent position benefits and be working in a happy workplace where all employees are rewarded and recognised.

Your new company   Your new company are a highly-esteemed stat body within the Victorian State Government who are at the forefront of the IT space. They pride themselves on their cutting-edge technology, and hard-working, inclusive culture. They are renowned for their range of innovative projects, and collaborate with various departments across Victorian State Government. Your new role   You will be an integral resource as a Solution Architect, working closely with the Head of Architecture to lead the planning, development and execution of solution architecture and systems design for a range of transactions and functional services. You will produce detailed component specifications and designs for implementation using selected products. What you'll need to succeed   Extensive expertise in the specification and design of complex customer facing systems within complex multi-stakeholder and/or entity environment. Proven expertise in developing digital services using contemporary cloud based products, services, and architectures. Proven ability to conduct detailed technical analysis of solution design options and to provide influential and authoritative advice on preferred solution balancing functional, service quality, security and systems management requirements Proven ability to provide quality assurance over third party solution architecture and systems design deliverables to ensure fitness for purpose and compliance with standards within a complex, and highly regulated, environment. What you'll get in return   You will be working in convenient inner-Melbourne location, and will receive competitive daily rates. You will get a chance to invest in your technical skill-set and your career, working with a passionate and highly-skilled team. You will contribute significantly to a range of wide-reaching and important projects, and will have a real impact on the lives of all Victorians.

As a Data Engineer, you will be part of a data science team operationalising insights on a modern data platform. As an experienced Data Engineer, you will help us build the next generation of data analytics solutions within our Corporate Operations Group. You will join a cross-functional Agile team with a diverse range of skills which you'll be able to leverage to develop your own T-shaped skillset and grow your career. You’ll bring your in-depth knowledge of big data technologies best practice and a desire to work in a DevOps environment where you will have end-to-end ownership for developing, deploying and supporting your data assets. To be successful in this role you will have some of the following skills and experience: data Warehousing/ETL concepts or have worked on similar projects strong knowledge of Linux and Unix experience with AWS or equivalent other cloud environments - any or all of EC2, S3, RDS, Dynamo DB, EMR, Redshift, Glue, Athena, Apache Parquet distributed computer frameworks on Hadoop, Spark, distributed SQL, and/or noSQL query engines understanding of SQL/APIs experience in Python, R or Java working knowledge of Big Data querying tools like Hive or Presto exposure to, or an understanding of machine learning and self-serve analytics principles. The Corporate Operations Group brings together specialist support services in Digital Transformation & Data, Technology, Market Operations, Human Resources, Business Services, Business Improvement & Strategy, Brand & Marketing and the Macquarie Group Foundation. Macquarie understands the importance of diversity and inclusion - our long history of success has come from being different. At Macquarie we value the innovation and creativity that diversity of thought brings. The one thing we all have in common is our focus on high performance. If you're capable, motivated and can deliver, we want you on our team. We facilitate a range of flexible working arrangements within our teams. Talk to us about what flexibility may be available.  

Join a highly collaborative team and work with the latest technologies!  In this role, you’ll focus on delivering technology solutions for Macquarie Investment Management business. Utilising your stakeholder management skills, you’ll partner with the business to understand needs and objectives, acting as a liaison between the business and the technology team. In addition, you’ll be responsible for designing, developing and delivering next generation applications that leverage cutting edge technology practices.  Collaborating with vendors and technology firms, you’ll harness emerging technology trends, driving the adoption of next-generation applications to deliver superior results.  An ideal candidate for this role will have strong development and analytical skills with proven ability to manage a diverse client and stakeholder relationship. You’ll have proven ability delivering front office systems/tools, with an in-depth understanding of the DevOps development practices.  Your technical proficiencies can include:  solid experience in cloud technologies like AWS  Knowledge of Containerization related technologies (e.g. Docker, Kubernetes, ECR)  experience with data streaming frameworks (e.g. Spark, Flink) and/or Big Data technologies (Hadoop, NoSQL, Data Lakes)   strong proficiency with object-oriented programming that produces well organized, readable, maintainable code.  experience developing Service Oriented Architectures (SOA) and/or Microservices and messaging systems (e.g. - Solace, JMS)  knowledge of Python  The Corporate Operations Group brings together specialist support services in Digital Transformation & Data, Technology, Market Operations, Human Resources, Business Services, Business Improvement & Strategy, and the Macquarie Group Foundation. The Corporate Operations Group’s purpose is to power the entrepreneurial enterprise.  Macquarie understands the importance of diversity and inclusion - our long history of success has come from being different. At Macquarie we value the innovation and creativity that diversity of thought brings. The one thing we all have in common is our focus on high performance. If you're capable, motivated and can deliver, we want you on our team.  We recognise that flexibility comes in a variety of forms. Talk to us about what flexibility you need

Piper Companies is seeking a Data Engineer to join one of our top clients in Raleigh, NC! The Data Engineer will be responsible for assembling complex data sets to meet business requirements. This Engineer will be working on a growing team for a top Cyber Security client. Responsibilities of the Data Engineer: Data Engineer is responsible for building data pipelines and optimizing data Implementing ETL process Developing, maintaining, and testing infrastructure for data generation Technical Qualifications for the Data Engineer: 3-5+ years of experience in Data Engineering Experience with Python or Java (with a willingness to learn Python) Skilled with Big Data tools (i.e. Spark, Hadoop, Kafka, etc.) AWS or GCP experience Advanced knowledge of SQL is a must Kubernetes experience Bachelor’s Degree in a related field Compensation for the Data Engineer: $125,000-$145,000 based on relevant work experience Work-from-home potential Unlimited PTO Great work-life-balance