2507 data engineer lead jobs found

Data Engineer/Lead 12+ months contract AZ/WA/CA/onsite 10+ years of Data engineer Databricks, Snowflake SQL, ETL, data warehousing spark, Scala, Hadoop strong AWS/AZURE/Google Cloud Platform experience Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity. Report this job Dice Id: 10123938 Position Id: 8566815

Data Engineer Lead in Celebration FL 34747 (Hybrid. Onsite 1 day a week. Subject to Change). Notes: This is a very large transition project; Relational data basis; Hit the ground running; Working with a customizable platform that is a primary reservation system. Job Description: Minimum 7 years of related work experience Advanced development skills in cross-platform coding languages such as SQL/TSQL, Python, Java, and VBA SQL and scripting expertise for data extraction, transformation, and building performant datasets, with a focus on automation Extensive experience with relational databases and NoSQL databases (e.g., Snowflake, SQL Server, Oracle, MongoDB,) Comfortable working in an agile environment, collaborating with cross-functional teams, and adapting to changing requirements KEY: Expert in MicroStrategy report and dashboard development, with a desire to further develop technical expertise in data engineering tools, methodologies, and emerging...

Our client, a prominent leader in the adult entertainment industry, is looking for a Lead Data Platform Engineer to join their dynamic team. In this key role, you will be the go-to expert for all things related to ETL processes, data warehousing, and data governance. You'll work with large-scale datasets, driving the evolution of the data infrastructure and making critical architectural decisions that will shape the company's data future. Primary Responsibilities: Oversee and manage Snowflake data infrastructure Take the lead in decisions around data security, governance, and performance optimization Required Qualifications: 5+ years of experience in a similar role Expertise in DBT, Snowflake, and Terraform Proven track record in managing large datasets Strong experience in designing and implementing ETL architecture Proficiency in SQL and data modeling techniques Deep knowledge of the Snowflake platform Education: Bachelor's degree...

Lead Data Engineer (Python/Scala, Spark, AWS)     Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,   inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs.  We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One. The Lead Data Engineer sits within the Card Data Organization & the Data Foundations group, our team works on the foundational capabilities of how data should be produced and consumed. These foundational capabilities include a variety of initiatives as well as AI Assist Tools to enable us to speed the production &...

As a Lead Data Engineer you will fill a new role Contract-to-hire role that sits on the data team in the technology organization. Your colleagues will include scrum masters and data analyst and fellow Data, AI, Governance, and QA professionals. Join our highly collaborative, innovative team. How you'll help move us forward: This role will leading a Jr team member and contractors * Partner with data architects, analysts, engineers, and stakeholders to understand data requirements and deliver solutions. * Design & build scalable products with robust security, quality and governance protocols. * Lead delivery of data engineering pipelines to enable Sales, Marketing, Advanced Analytics and CRM use-cases * Create low-level design artifacts, including mapping specifications. * Build scalable and reliable data pipelines to support data ingestions (batch and /or streaming) and transformation from multiple data sources using cloud based technologies. * Create unit/integration...

Join OrangePeople as a Lead Data Engineer for a leading entertainment organization and be at the forefront of data transformation! In this role, you will design and manage advanced reporting solutions, optimize data flow and storage, and leverage AI, ML, and automation to drive innovation. You'll analyze business needs, enhance data operations, and lead scalable projects while staying ahead of emerging technologies. If you're passionate about turning data into actionable insights and building systems that power exceptional user experiences, this opportunity is for you Role Responsibilities: Lead the design, construction, and management of reporting solutions to gather, manage, and use structured and unstructured data from various sources. Develop robust processes and structures to optimize data flow, routing, and storage, meticulously considering business and technical requirements, and deploying cloud and local storage solutions as necessary. Implement...

Job title: Lead Data Engineer Location: Celebration, FL (Onsite) Position: Contract Job Description: Experience: 12-15 years in data engineering with leadership experience (mandatory). Core Skills: Proficiency in SQL/TSQL, Python, Java, and VBA for data engineering and automation. Database Expertise: Extensive experience with relational (e.g., SQL Server, Oracle) and NoSQL databases (e.g., Snowflake, MongoDB). Big Data Frameworks: Expertise in Apache Spark, EMR, Glue, or Flink for data processing and automation tasks. Streaming & Queuing Technologies: Hands-on experience with Kafka, RabbitMQ, Redis, and AWS Kinesis for streaming and queueing. Cloud Proficiency: Advanced knowledge of AWS services (Lambda, Kinesis, DMS, AppFlow). Preferred Tools & Practices: Familiarity with MicroStrategy reporting, CI/CD tools (Jenkins, GitLab), and...

Lead Data Engineer (Python/Scala, Spark, AWS)     Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,   inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs.  We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One. The Lead Data Engineer sits within the Card Data Organization & the Data Foundations group, our team works on the foundational capabilities of how data should be produced and consumed. These foundational capabilities include a variety of initiatives as well as AI Assist Tools to enable us to speed the production &...

The Trade Desk is a global technology company with a mission to create a better, more open internet for everyone through principled, intelligent advertising Handling over 1 trillion queries per day, our platform operates at an unprecedented scale We have also built something even stronger and more valuable: an award-winning culture based on trust, ownership, empathy, and collaboration We value the unique experiences and perspectives that each person brings to The Trade Desk, and we are committed to fostering inclusive spaces where everyone can bring their authentic selves to work every day. Do you have a passion for solving hard problems at scale? Are you eager to join a dynamic, globally- connected team where your contributions will make a meaningful difference in building a better media ecosystem? Come and see why Fortune magazine consistently ranks The Trade Desk among the best small- to medium-sized workplaces globally. What we do Our Lead Senior Software Engineers...

Role: Lead Data Engineer (Snowflake, Python and Java) Chicago, IL(3 Days onsite/2 days remote) Long Term Contract Responsibilities: Strong background in data engineering, platform architecture, sound technical knowledge on full stack technologies Requires strong Snowflake skills with background of Python and Java Key Responsibilities Lead the development, design, development and deployment of data pipelines, storage solutions and analytic tools Ensure scalability, reliability and security of the platform to meet current and future demands. Oversee the implementation of data lakes, warehouses and ELT/ETL pipelines on azure and snowflake Develop and Review code and ensure adherence to development best practices and standards Foster a culture of collaboration, innovation and continous improvement within the team. Drive integration of real-time and batch data processing capabilities. Ensure compliance with data governance...

Job Title Lead Data Engineer Location: Block 23 What You'll Do As a Lead Data Engineer, you'll provide SME expertise in your respective domain as well as adjacent domains to ensure solutions are safe, secure, compliant and reliable. You'll identify development and support needs as well as take on large and complex design responsibilities supporting project tasks. You'll also engage with project and business sponsors refining requirements and objectives of targeted solutions. As a Principal Engineer I, you also facilitate dialogue and activities, and work to ensure team collaboration including teams outside of your domain. You'll develop effective presentations and narratives for IT audiences. In this role, you'll also develop the technical skills of one more junior engineers. You are also the lead engineer in a high-performing centralized team of data engineers, data analysts and QA engineers. The team builds solutions to satisfy the complete data lifecycle management...

Lead Data Engineer (Python/Scala, Spark, AWS)     Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs.  We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One.  The Lead Data Engineer sits within the Card Data Organization & the Data Foundations group, our team works on the foundational capabilities of how data should be produced and consumed. These foundational capabilities include a variety of initiatives as well as AI Assist Tools to enable us to speed the production & consumption of...

Lead Data Engineer (Python/Scala, Spark, AWS)     Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs.  We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One.  The Lead Data Engineer sits within the Card Data Organization & the Data Foundations group, our team works on the foundational capabilities of how data should be produced and consumed. These foundational capabilities include a variety of initiatives as well as AI Assist Tools to enable us to speed the production & consumption of...

The Trade Desk is a global technology company with a mission to create a better, more open internet for everyone through principled, intelligent advertising Handling over 1 trillion queries per day, our platform operates at an unprecedented scale We have also built something even stronger and more valuable: an award-winning culture based on trust, ownership, empathy, and collaboration We value the unique experiences and perspectives that each person brings to The Trade Desk, and we are committed to fostering inclusive spaces where everyone can bring their authentic selves to work every day. Do you have a passion for solving hard problems at scale? Are you eager to join a dynamic, globally- connected team where your contributions will make a meaningful difference in building a better media ecosystem? Come and see why Fortune magazine consistently ranks The Trade Desk among the best small- to medium-sized workplaces globally. What we do Our Lead Senior Software Engineers...

About About the Role: Grade Level (for internal use): 12 About The Role Title: Lead Data Engineer – Big Data The Team You will be an expert contributor and part of the Rating Organization’s Ingestion Pipelines Engineering Team. This team, who has a broad and expert knowledge on Ratings organization’s critical data domains, technology stacks and architectural patterns, fosters knowledge sharing and collaboration that results in a unified strategy. All Data Services team members provide leadership, innovation, timely delivery, and the ability to articulate business value. Be a part of a unique opportunity to build and evolve S&P Ratings next gen Ingestion pipelines platform. Responsibilities And Impact Design & Build ingestion pipelines using ELT and schema on read in Databricks delta lake Design & Develop “Transformations” aspects using ELT framework to modernize the Ingestion pipelines and build data transformations at scale Provide technical...

Lead Data Engineer (Python/Scala, Spark, AWS)     Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,   inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs.  We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One. The Lead Data Engineer sits within the Card Data Organization & the Data Foundations group, our team works on the foundational capabilities of how data should be produced and consumed. These foundational capabilities include a variety of initiatives as well as AI Assist Tools to enable us to speed the production &...

Azure Lead Data Engineer About the job SSV Technologies is seeking a Azure Lead Data Engineer and in this role, you will interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation, Application Architecture definition and Design. You will play an important role in creating the high-level design artifacts. You will also deliver high quality code deliverables for a module, lead validation for all types of testing and support activities related to implementation, transition and warranty. You will be part of a learning culture, where teamwork and collaboration are encouraged, excellence is rewarded, and diversity is respected and valued. Required Qualifications: Bachelor's degree or foreign equivalent required from an accredited institution 10+ years of experience in Information Technology 5+ years of Azure Datafactory, Azure Datalake, Azure Blob, Azure...

Job Classification: Technology - Engineering & Cloud Are you interested in building capabilities that enable the organization with innovation, speed, agility, scalability and efficiency? The Global Technology team takes great pride in our culture where digital transformation is built into our DNA! When you join our organization at Prudential, you’ll unlock an exciting and impactful career – all while growing your skills and advancing your profession at one of the world’s leading financial services institutions. Your Team As a Lead Software Engineer on/in Data Management & Governance you will partner with product owners, tech leads, designers, engineers and delivery professionals to improve Data Management and Governance services. You will code, test and debug new and existing applications as you implement capabilities to solve sophisticated business problems, deploy innovative products, services and experiences to delight our customers! In addition to advanced...

Lead Data Engineer (Python/Scala, Spark, AWS)     Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,   inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs.  We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One. The Lead Data Engineer sits within the Card Data Organization & the Data Foundations group, our team works on the foundational capabilities of how data should be produced and consumed. These foundational capabilities include a variety of initiatives as well as AI Assist Tools to enable us to speed the production &...

Hi, Our client is looking for a Lead Data Engineer (SQL) with a Long-Term Contract project in Bethlehem, PA (Hybrid) below is the detailed requirement. Position: Lead Data Engineer (SQL) Location: Bethlehem, PA (Hybrid) Contract Exp: 12+Yrs Job description: Lead the design, development, and implementation of data solutions using AWS and Snowflake. 10+ years of relevant experience in Data Engineering and delivery. 8+ years of relevant work experience in Big Data Concepts. Worked on cloud implementations. Strong experience with SQL, python and Pyspark Good understanding of Data ingestion and data processing frameworks Strong experience in Snowflake, SQL, AWS (glue, EMR, S3, Aurora, RDS, AWS architecture) Good aptitude, strong problem-solving abilities, analytical skills, and ability to take ownership as appropriate. Should be able to do coding, debugging, performance tuning, and deploying the apps to the...

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better. Join us and build an exceptional experience for yourself, and a better working world for all. The exceptional EY experience. It's yours to build. EY focuses on high-ethical standards and integrity among its employees and expects all candidates to demonstrate these qualities. CyberSecurity Data Engineering / SIEM Lead Engineer (Manager SDC) About The Job At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better. Join us and build an exceptional experience for yourself, and a better working world for all. The exceptional EY...

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better. Join us and build an exceptional experience for yourself, and a better working world for all. The exceptional EY experience. It's yours to build. EY focuses on high-ethical standards and integrity among its employees and expects all candidates to demonstrate these qualities. CyberSecurity Data Engineering / SIEM Lead Engineer (Manager SDC) About The Job At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better. Join us and build an exceptional experience for yourself, and a better working world for all. The exceptional EY...

A leading SaaS company driving innovation in the sustainability sector is seeking a Senior Data Engineer with expertise in Databricks and PySpark to design and scale data infrastructure. This role involves building high-performance ETL pipelines , optimizing large-scale data processing , and leading critical data initiatives. The ideal candidate has a strong Python background, excels in cloud-based data environments , and is comfortable taking ownership of projects from architecture to deployment. Required Skills & Experience: Bachelor's or Master's degree in Computer Science, Data Engineering, or related field . 5+ years of experience in data engineering , working with big data solutions . Hands-on expertise in Databricks and PySpark for data transformation and processing. Strong proficiency in Python for data engineering and automation. Deep experience with cloud data platforms (AWS, Azure, or Google Cloud Platform). Expertise in...

This position offers an exciting opportunity to participate in delivering a new Comprehensive Child Welfare Information System (CCWIS) with Child Welfare Digital Services (CWDS), a unique collaboration involving the California Health and Human Services Office of Technology and Solutions Integration (CalHHS OTSI), the California Department of Social Services (CDSS), and California's Counties and Tribes. Under the general direction of the CARES Data Infrastructure (CDI) Manager (ITM I), the CDI Lead Engineer (ITS II) serves a key state role on the California Automated Response and Engagement System (CWS-CARES) project. The CDI Lead Engineer (ITS II) will lead infrastructure, DevOps, and web development initiatives within the project. The Lead Engineer will take ownership and oversee of designing, defining, and implementing technical DevOps tasks to support the overall infrastructure needs of the unit. Additionally, the Lead Engineer will lead the team in the development and...