3052 senior data engineer jobs found

Senior Data Engineer Multiple Full-Time (35hpw) Temporary opportunities up to June 2027 Parramatta location with hybrid working Salary starts from $125,693 + superannuation The Information Management team sits within the Digital Analytics and Information Management team within Revenue NSW. In this role you will be delivering expert advice and services in the design of data products and data-related services to achieve business outcomes and strategic goals. The role will also drive the development of data processing frameworks and data architectural approaches scaled to current and future business demands. Key responsibilities: Act as a trusted partner collaborating with stakeholders to design, build, test and maintain complex data management systems Deliver automated, reliable and secure services that provide valuable insights to inform decision-making. Mentor and coach others to facilitate the development of a suite of robust and...

It starts with YES!   At Optus, we are fuelled by optimism, unwavering customer focus, and a team of amazing people. And that’s where we come in…. “the amazing people” part! We don’t sit back and wait for the future to happen, we are out there crafting our own path through new technology, innovation, and investment. We are truly a challenger brand, with challenger spirit. As our new Senior Data Engineer, you’ll be at the forefront of designing, building, and maintaining both batch and real-time data pipelines across on-premises and cloud platforms. You’ll integrate data from diverse source systems, transforming it into valuable assets that are ready for consumption by end-users and downstream applications. Your expertise will ensure data is efficiently stored and seamlessly integrated into our data models, all while adhering to strict Data Governance and Architecture principles. This ensures high-quality, consistent, and accessible data, driving key business outcomes and...

Join Leap in! as a Senior Data Engineer. Are you passionate about data and want to make a meaningful difference in the lives of people with disability? Leap in!, Australia’s leading NDIS plan manager, is looking for a talented Senior Data Engineer to join our dynamic and purpose-driven team. If you're ready to help shape the future of data management while contributing to a mission that matters, this is the opportunity for you! About Leap in! Leap in! is Australia’s leading NDIS plan manager, dedicated to helping people with disabilities live their best lives by supporting them in navigating the NDIS. With a purpose-driven approach, Leap in! offers uniquely differentiated plan management services that create meaningful connections and positive outcomes. What you'll do. In this role, you’ll play a key part in designing and implementing cutting-edge data systems that empower our teams and deliver valuable insights. Your responsibilities will include: •...

Center 2 (19050), United States of America, McLean, Virginia Senior Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One. What You’ll Do Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems Utilize programming languages like...

Job Description: Senior Data Engineer Location: Bentonville, AR (Onsite from Day 1) Duration: 12 Months Contract Responsibilities As a Senior Data Engineer, you will: Design and develop big data applications using cutting-edge open-source technologies. Build and optimize data pipelines using Apache Kafka, Hive, Spark, and Airflow. Develop logical and physical data models for big data platforms and RDBMS. Automate workflows and ensure seamless data processing across systems. Provide ongoing maintenance, enhancements, and rotational on-call support. Actively share knowledge about the business domain and technical infrastructure with the team. Lead daily standups, design reviews, and mentor junior engineers. Manage backlogs, groom priorities, and maintain documentation using JIRA and Confluence. Serve as the point of contact for assigned business domains. Requirements Technical Skills (Mandatory): Programming Languages : Proficiency in...

ROLE: Senior Data Engineer LOCATION: Sydney Experience: 7+ years Requirements: AWS (EMR, S3, Athena, SQL) experienced Data Engineers with ETL development experience using Spark, Scala. scheduling- autosys. Knowledge on Framework builds will be preferred. ETL lifecycle experience to run, debug, test/reconcile and deploy jobs to AWS environment. ETL jobs migration experience is preferred. About Us: We are Delivery Centric , a dynamic technology company that is transforming the delivery of cloud implementations and Cyber security. We are headquartered in Australia with a global presence. We are tenacious, future-thinking, and highly driven to achieve an ambitious vision to be the leading global provider of innovative technologies for companies that keep our world clean, safe, and secure. Our fast-paced and supportive environment will offer you lots of benefits, including a competitive salary, a friendly team, a healthy work environment, and...

Senior Data Engineer Talent Insights are currently on the lookout for a Senior Data Engineer to join one a mid sized Melbourne CBD business on a 12 month fixed term contract working with modern Azure tech stack. In this role as a Senior Data Engineer you will partner with the Senior Manager of Analytics and Engineering working on a range of new internal solutions. The role is for a hands on Senior Data Engineer with experience in Azure. You will be working alongside Data Engineers, BI Developers and Data Scientists while parenting with the Architecture team of data modelling and data warehousing uplift. This is a Hybrid working position in Melbourne CBD with 2-3 days in the office per week the ideal scenario. Technical skills: 4+ years experience in a Data Engineering type role End to end data processing on Azure with experience in Azure Data Factory, Databricks, Azure DevOps Data Modelling in data warehousing and/or Data Lake Advanced SQL...

Role: Senior Data Engineer Location: New York, NY / Iselin, NJ Duration: Full time Responsibilities: Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity. Design, develop, and deploy Spark program in databricks environment to process and analyze large volumes of data. Experience of Delta Lake, DWH, Data Integration, Cloud, Design and Data Modelling. Proficient in developing programs in Python and SQL Experience with Data warehouse Dimensional data modeling. Working with event based/streaming technologies to ingest and process data. Working with structured, semi structured and unstructured data. Optimize Databricks jobs for performance and scalability to handle big data workloads. Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks. Implement best practices for data management, security, and governance...

KMS Job ID 2445163 KGS is seeking qualified candidates for our open positions, but we will only extend an offer of employment after a candidate applies through the link in our job posting. If you receive a job offer via email only and have not been interviewed by the KGS hiring manager, feel free to contact KGSrecruiting@koniag-gs.com to verify its validity. Koniag Management Solutions, a Koniag Government Services company, is seeking a Senior Data Engineer/Data Analyst with a Secret clearance to support KMS and our government customer in Huntsville, AL. This position is a weekly hybrid schedule consisting of 3 days on-site and 2 days remote. We offer competitive compensation and an extraordinary benefits package including health, dental and vision insurance, 401K with company matching, flexible spending accounts, paid holidays, three weeks paid time off, and more. Under the guidance of the Program Manager, assists in achieving data analysis milestones...

Role: Senior Data Engineer with ML and Health Care domain experience Location: Remote Duration: Long term Rates: DOE Candidate must have Healthcare domain experience The individual will design, implement, and support data processing software and infrastructure. What you will do Build end-to-end data pipelines and infrastructure for ML models used by the Data Science team Understand the requirements of data processing and analysis pipelines and make appropriate technical design and interface decisions. Elucidating these requirements will require training, developing, and validating researcher-built or vendor provided machine learning algorithms on hospital data as well as working with other members of the data science team. Understand data flows among the client's applications and use this knowledge to make recommendations and design decisions for languages, tools, and platforms used in software and data projects....

KMS Job ID 2445163 KGS is seeking qualified candidates for our open positions, but we will only extend an offer of employment after a candidate applies through the link in our job posting. If you receive a job offer via email only and have not been interviewed by the KGS hiring manager, feel free to contact KGSrecruiting@koniag-gs.com to verify its validity. Koniag Management Solutions, a Koniag Government Services company, is seeking a Senior Data Engineer/Data Analyst with a Secret clearance to support KMS and our government customer in Huntsville, AL. This position is a weekly hybrid schedule consisting of 3 days on-site and 2 days remote. We offer competitive compensation and an extraordinary benefits package including health, dental and vision insurance, 401K with company matching, flexible spending accounts, paid holidays, three weeks paid time off, and more. Under the guidance of the Program Manager, assists in achieving data analysis milestones...

CoreWeave is the AI Hyperscaler™, delivering a cloud platform of cutting edge services powering the next wave of AI. Our technology provides enterprises and leading AI labs with the most performant, efficient and resilient solutions for accelerated computing. Since 2017, CoreWeave has operated a growing footprint of data centers covering every region of the US and across Europe. CoreWeave was ranked as one of the TIME100 most influential companies of 2024. As the leader in the industry, we thrive in an environment where adaptability and resilience are key. Our culture offers career-defining opportunities for those who excel amid change and challenge. If you’re someone who thrives in a dynamic environment, enjoys solving complex problems, and is eager to make a significant impact, CoreWeave is the place for you. Join us, and be part of a team solving some of the most exciting challenges in the industry. CoreWeave powers the creation and delivery of the intelligence that drives...

Job Description Job Description We are a proud work-from-office company. If you're ready to work on-site in a dynamic, global company, we d love to hear from you. Position Summary Do you have a passion for building data architectures that enable smooth and seamless product experiences? Are you an all-around data enthusiast with a knack for ETL? We're hiring Data Engineers to help build and optimize the foundational architecture of our product's data. We ve built a strong data engineering team to date, but have a lot of work ahead of us, including: Migrating from relational databases to a streaming and big data architecture, including a complete overhaul of our data feeds Defining streaming event data feeds required for real-time analytics and reporting Leveling up our platform, including enhancing our automation, test coverage, observability, alerting, and performance As a Senior Data Engineer, you will work with the development team to construct a data...

Bring YOUR energy to Alliant Energy! At Alliant Energy, our purpose is to serve customers and build stronger communities. We are passionate about powering beyond the market challenges of today, while powering what's next in energy. When our employees say "I am energy", it means they take pride in the work we do when disaster strikes, as well as all the days in between. We want you to be safe, happy and healthy. That's why we prioritize safety, offer volunteer opportunities and provide competitive pay, comprehensive health and retirement benefits, tuition reimbursement and paid time off. Alliant Energy is seeking a Senior Data Engineer (Snowflake/ Informatica) to play a crucial role in advancing the data and analytics practices within the organization. In this role, you will lead the design, development, implementation, enhancement, and maintenance of data pipelines across multiple technology platforms. Your expertise in Snowflake, Informatica, Python and modern data practices will...

KMS Job ID 2445163 KGS is seeking qualified candidates for our open positions, but we will only extend an offer of employment after a candidate applies through the link in our job posting. If you receive a job offer via email only and have not been interviewed by the KGS hiring manager, feel free to contact KGSrecruiting@koniag-gs.com to verify its validity. Koniag Management Solutions, a Koniag Government Services company, is seeking a Senior Data Engineer/Data Analyst with a Secret clearance to support KMS and our government customer in Huntsville, AL. This position is a weekly hybrid schedule consisting of 3 days on-site and 2 days remote. We offer competitive compensation and an extraordinary benefits package including health, dental and vision insurance, 401K with company matching, flexible spending accounts, paid holidays, three weeks paid time off, and more. Under the guidance of the Program Manager, assists in achieving data analysis milestones under an...

Job Type : 1 year renewable contract Senior Data Engineer ( Informatica and MS Fabric ) Job Requirement: Data Engineers with experience in Informatica , Microsoft Fabric typically have responsibilities centered around designing, implementing, and managing data pipelines and architectures that support data integration, transformation, and analytics within a cloud-based or hybrid environment. Design and implement ETL (Extract, Transform, Load) workflows using Informatica PowerCenter, Informatica Cloud, or Informatica Intelligent Cloud Services (IICS) Build and manage ETL and ELT data pipelines using Azure Data Factory (ADF) to orchestrate data movement and transformation across on-premises and cloud environments. Create and optimize Spark-based data pipelines in Databricks, using notebooks or jobs to ingest, clean, and transform large datasets for analytics and reporting. Work with Microsoft Fabric to integrate and manage dataflows, datasets, and...

KMS Job ID 2445163 KGS is seeking qualified candidates for our open positions, but we will only extend an offer of employment after a candidate applies through the link in our job posting. If you receive a job offer via email only and have not been interviewed by the KGS hiring manager, feel free to contact KGSrecruiting@koniag-gs.com to verify its validity. Koniag Management Solutions, a Koniag Government Services company, is seeking a Senior Data Engineer/Data Analyst with a Secret clearance to support KMS and our government customer in Huntsville, AL. This position is a weekly hybrid schedule consisting of 3 days on-site and 2 days remote. We offer competitive compensation and an extraordinary benefits package including health, dental and vision insurance, 401K with company matching, flexible spending accounts, paid holidays, three weeks paid time off, and more. Under the guidance of the Program Manager, assists in achieving data analysis milestones under an...

Senior Data Engineer Job No: 674030 Sydney - Inner Suburbs & CBD, Brisbane - Inner Suburbs & CBD, Melbourne - Inner Suburbs & CBD, Various Permanent Full Time IT Pay Band 5 Flexible Locations of Brisbane, Sydney, Melbourne Lead and mentor a high-performing team while advancing your technical expertise Collaborate with cutting-edge technologies such as Databricks, DBT and AWS Redshift Suncorp is looking for a talented Senior Data Engineer to join our Insurance & Enterprise Technology (IET) team and lead the development of automated data pipelines, integrating, transforming, and enriching data from diverse sources to deliver actionable insights and value to business stakeholders. What You'll Do As a Senior Data Engineer, you will: Develop data pipelines, engineering patterns, and end-to-end data solutions Translate complex business requirements into scalable data applications Design, implement, and optimise...

Hawksman Technology is working with an investment management firm who is heavily focused on investing in renewable technology. Role: Data Engineer We are currently looking to hire for a Senior Data Engineer to manage the onboarding of new data onto our clients Market Data Platform in order to provide help provide data solutions in key areas such as Data Analysis, P&L Reporting, Position Reporting, Weather Data Visualization, Systematic Trading, Market Making and support any innovative trading ideas emerging from our desks utilizing today’s most recent cloud technologies. Responsibilities: Collaborate with users to capture, clarify, implement, and test use cases and requirements Support traders and analysts on the Market Data Platform (Dremio, Databricks, Tableau, AWS) Manage the onboarding of new data into the Market Data Platform Automate and implement various internal and external models and applications Continuously improve data...

At Bayer we’re visionaries, driven to solve the world’s toughest challenges and striving for a world where 'Health for all Hunger for none’ is no longer a dream, but a real possibility. We’re doing it with energy, curiosity and sheer dedication, always learning from unique perspectives of those around us, expanding our thinking, growing our capabilities and redefining ‘impossible ’. There are so many reasons to join us. If you’re hungry to build a varied and meaningful career in a community of brilliant and diverse minds to make a real difference, there’s only one choice. Senior Data Engineer Your Tasks And Responsibilities As Bayer Crop Science's digital farming arm, we advance regenerative agriculture and technology breakthroughs using the latest agronomic science, data science, engineering, and real-world farming experience. With groundbreaking technologies like Climate FieldView and our ForGround regenerative agriculture platform, our team is a part of some of the most...

Who we are Samsara (NYSE: IOT) is the pioneer of the Connected Operations™ Cloud, which is a platform that enables organizations that depend on physical operations to harness Internet of Things (IoT) data to develop actionable insights and improve their operations. At Samsara, we are helping improve the safety, efficiency and sustainability of the physical operations that power our global economy. Representing more than 40% of global GDP, these industries are the infrastructure of our planet, including agriculture, construction, field services, transportation, and manufacturing — and we are excited to help digitally transform their operations at scale. Working at Samsara means you'll help define the future of physical operations and be on a team that's shaping an exciting array of product solutions, including Video-Based Safety, Vehicle Telematics, Apps and Driver Workflows, Equipment Monitoring, and Site Visibility. As part of a recently public company, you'll have the...

About Infosys: Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 56 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem. Visit www.infosys.com to see how Infosys (NYSE: INFY) can help your enterprise navigate your next. Role: Senior Data Engineer Location: Sydney Salary Range: 129,311- 142,018 AUD Annual Gross Please Note:- The above salary...

Flexible Locations of Brisbane, Sydney, Melbourne Lead and mentor a high-performing team while advancing your technical expertise Collaborate with cutting-edge technologies such as Databricks, DBT and AWS Redshift Suncorp is looking for a talented Senior Data Engineer to join our Insurance & Enterprise Technology (IET) team and lead the development of automated data pipelines, integrating, transforming, and enriching data from diverse sources to deliver actionable insights and value to business stakeholders. What You’ll Do As a Senior Data Engineer, you will: Develop data pipelines, engineering patterns, and end-to-end data solutions Translate complex business requirements into scalable data applications Design, implement, and optimise data models using DBT and Databricks Design and implement scalable Data Engineering patterns to load data into Datavault 2.0 and Kimball-modelled tables utilizing DBT. Maintain and enhance existing data engineering...

Flexible Locations of Brisbane, Sydney, Melbourne Lead and mentor a high-performing team while advancing your technical expertise Collaborate with cutting-edge technologies such as Databricks, DBT and AWS Redshift Suncorp is looking for a talented Senior Data Engineer to join our Insurance & Enterprise Technology (IET) team and lead the development of automated data pipelines, integrating, transforming, and enriching data from diverse sources to deliver actionable insights and value to business stakeholders. What You’ll Do As a Senior Data Engineer, you will: Develop data pipelines, engineering patterns, and end-to-end data solutions Translate complex business requirements into scalable data applications Design, implement, and optimise data models using DBT and Databricks Design and implement scalable Data Engineering patterns to load data into Datavault 2.0 and Kimball-modelled tables utilizing DBT. Maintain and enhance existing data...