2111 cloud data engineer jobs found

Arthur Lawrence is looking to hire a Cloud Data Engineer for one of our clients in Arlington, TX. Please find the job description below and send us your updated resume, if interested: Must-Have: 5-7 years of experience as a Cloud Data Engineer Experienced with Snowflake, SQL, Matillion, and CI/CD pipelines Worked with data manipulation, AWS cloud services, and data processing Well-versed with cloud platforms, database technologies, and Python **TN visa sponsorship is available for successful candidates. About Us: Arthur Lawrence is a management and technology consulting firm providing enterprise-wide business transformation and business applications implementation services to Fortune 100 and Big 4 organizations. Our in-depth technical knowledge and broad experience in working with world-class companies enable organizations to leverage our capabilities in developing winning strategies and cost-effective solutions. We are a UN Women Empowerment...

Title: Cloud Data Engineer with Python Location: Iselin, NJ Responsibilities: Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity. Design, develop, and deploy Spark program in DataBricks environment to process and analyze large volumes of data. Experience of Delta Lake, DWH, Data Integration, Cloud, Design and Data Modelling. Proficient in developing programs in Python and SQL Experience with Data warehouse Dimensional data modeling. Working with event based/streaming technologies to ingest and process data. Working with structured, semi structured and unstructured data. Optimize Databricks jobs for performance and scalability to handle big data workloads. Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks. Implement best practices for data management, security, and governance within the...

Job Title: Google Cloud Platform Data Engineer Role Type: Contract, Onsite Location: Phoenix, AZ Contract Length: 12 Months + How to Apply: Please send your resume and contact information to recruiters at 4aitservices dot com Top Skills' Details 1.) 5+ years of experience with GitHub Enterprise/Cloud 2.) Strong API, scripting, and automation skills 3.) Google Cloud Platform Nice to Have: - Programming background (Java, Go, Python, NodeJS) - GitHub Actions - Kubernetes - Docker Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity. Report this job Dice Id: 91133258 Position Id: 8567960

Hi, This is Mahendra from Empower Professionals. We have a Google Cloud Platform Data Engineer position for one of my clients, so please share your updated resume if you are interested in the below role.   Role: Google Cloud Platform Data Engineer Location: Hybrid (Sunnyvale, CA) Duration: 12+ Months   Must Have: 4+ years of recent Google Cloud Platform experience Experience building data pipelines in Google Cloud Platform Google Cloud Platform DataProc, GCS & BigQuery experience   Requirements: Hands-on experience with developing data warehouse solutions and data products. 6+ years of hands-on experience developing a distributed data processing platform with Hadoop, Hive or Spark, Airflow or a workflow orchestration solution are required 5+ years of hands-on experience in modeling and designing schema for data lakes or for RDBMS platforms. Experience with programming languages: Python, Java, Scala, etc. Experience with...

HI All, Role: Google Cloud Platform Data Engineer Location: Bentonville, AR 12+ years Candidates Please look at the requirements below, let us know of your interest, and send us your updated resume to Google Cloud Platform Experience: 4+ years of recent Google Cloud Platform experience Experience building data pipelines in Google Cloud Platform Google Cloud Platform Dataproc, GCS & BIGQuery experience Thanks Vinod Bellamkonda Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity. Report this job Dice Id: 91109480 Position Id: 8567792

Role: Senior Google Cloud Platform Data Engineer (12+ Years) Location: Bentonville, AR Long Term Job Description: Must Have Skills Scrum Master: 10+ Years Data : 12+ Years Google Cloud Platform: 5+ Years Pyspark: 5+ Years Scala: 5+ Years Google Cloud Platform Experience 4+ years of recent Google Cloud Platform experience Experience building data pipelines in Google Cloud Platform Google Cloud Platform Dataproc, GCS & BIGQuery experience 12+ years of hands-on experience with developing data warehouse solutions and data products. 6+ years of hands-on experience developing a distributed data processing platform with Hadoop, Hive or Spark, Airflow or a workflow orchestration solution are required 5+ years of hands-on experience in modeling and designing schema for data lakes or for RDBMS platforms. Experience with programming languages: Python, Java, Scala, etc. Experience with scripting languages: Perl, Shell, etc. Employers have access to...

Job Description: Title: Senior Google Cloud Platform Data Engineer Location: Bentonville, AR (Day 1 onsite) & Sunnyvale, CA (Day 1 onsite) Duration: Long Term Must-Have Skills: Scrum Master: 10+ Years Data : 12+ Years Google Cloud Platform: 5+ Years Pyspark: 5+ Years Scala: 5+ Years Google Cloud Platform Experience: 4+ years of recent Google Cloud Platform experience Experience building data pipelines in Google Cloud Platform Google Cloud Platform Dataproc, GCS & BIGQuery experience Responsibilities: As a Senior Data Engineer, you will Design and develop big data applications using the latest open source technologies. Desired working in offshore model and Managed outcome Develop logical and physical data models for big data platforms. Automate workflows using Apache Airflow. Create data pipelines using Apache Hive, Apache Spark, Apache Kafka. Provide ongoing maintenance and enhancements...

Role: Google Cloud Platform DATA ENGINEER Duration: 12 Month Work location: Phoenix, AZ - (ONSITE) LinkedIn needed !! Glider test required !! Phoenix based consultants highly preferred but also Open for Relocation consultants. Google Cloud Platform DATA ENGINEER Senior hands-on Google Cloud Platform Data Engineer who can work independently across a variety of Google Cloud Platform Big Data services. - Working knowledge on Big Query - Good Experience on Bigtable - Hands on experience on Dataproc (Java/python programming language) This role is needed for Marketing Platforms initiative to integrate a new Campaign Management vendor application with existing Amex marketing systems to facilitate marketing campaign presentment, personalization and fulfillment, as well as analytics/reporting needs. Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The...

Job Title: Sr. Data Engineer Job Summary: We are seeking a highly skilled Program Manager with 8 to 12 years of experience to join our dynamic team. Spark, Python, ETL , Scheduler (Autosys, any scheduler works), Hadoop, Kafka (preferred and nice to have), Performance Tunning, Partitioning knowledge, target environment Google Cloud Platform (nice to have knowledge). The ideal candidate will have a strong technical background in Hadoop, Google Cloud Platform, Python, and Spark. This role involves managing complex projects, ensuring timely delivery, and collaborating with cross. Required Skills: Python, Spark, Google Cloud Platform, Hadoop Responsibilities: Spark, Python, ETL, Scheduler (Autosys, any scheduler works), Hadoop, Kafka (preferred and nice to have), Performance Tunning, Partitioning knowledge, target environment Google Cloud Platform (nice to have knowledge) - Lead and manage end-to-end program delivery, ensuring all project milestones are met on time. - Oversee the...

Who Are We? Taking care of our customers, our communities and each other. That's the Travelers Promise. By honoring this commitment, we have maintained our reputation as one of the best property casualty insurers in the industry for over 160 years. Join us to discover a culture that is rooted in innovation and thrives on collaboration. Imagine loving what you do and where you do it. Job Category Technology Compensation Overview The annual base salary range provided for this position is a nationwide market range and represents a broad range of salaries for this role across the country. The actual salary for this position will be determined by a number of factors, including the scope, complexity and location of the role; the skills, education, training, credentials and experience of the candidate; and other conditions of employment. As part of our comprehensive compensation and benefits program, employees are also eligible for performance-based cash incentive...

Job Title: Senior Data Engineer (Java, Python & Google Cloud Platform) Location: Toronto, ON ( Onsite ) Duration/Term: Long Term Contract Job Description: We are seeking a Senior Software Engineer with a strong background in data engineering to design and develop scalable, data-intensive applications. The ideal candidate will have expertise in Java and Python, as well as experience working in cloud environments like Google Cloud Platform (Google Cloud Platform). You will work on large-scale distributed systems, data pipelines, and cloud-native technologies to ensure the efficient operation of complex data systems. Key Responsibilities: Architecture & Design: Lead the design and architecture of complex, distributed systems with a focus on reliability, scalability, and performance. Data Engineering: Develop data pipelines and manage large-scale data processing using tools such as Apache Airflow, Spark, Kafka, and SQL/NoSQL databases....

We are looking for Senior Data Engineer with Google Cloud Platform for our client in Bentonville, AR Job Title: Senior Data Engineer with Google Cloud Platform Job Location: Bentonville, AR Job Type: Contract Job Description: Responsibilities: Design and develop big data applications using the latest open source technologies. Desired working in offshore model and Managed outcome. Develop logical and physical data models for big data platforms. Automate workflows using Apache Airflow. Create data pipelines using Apache Hive, Apache Spark, Apache Kafka. Provide ongoing maintenance and enhancements to existing systems and participate in rotational on-call support. Learn our business domain and technology infrastructure quickly and share candidate knowledge freely and actively with others in the team. Mentor junior engineers on the team. Lead daily standups and design reviews. Groom and prioritize backlog using...

Position Overview At PNC, our people are our greatest differentiator and competitive advantage in the markets we serve. We are all united in delivering the best experience for our customers. We work together each day to foster an inclusive workplace culture where all of our employees feel respected, valued and have an opportunity to contribute to the company's success. As a Data Engineer Senior within PNC's Data and Automation organization, you will be based in Pittsburgh-PA, Cleveland-OH, Strongsville-OH, Chicago-IL, Birmingham-AL or Dallas-TX. Skills -Deep functional understanding of big data development environments such as Hadoop/HDFS, Google Cloud, Azure, AWS and associated tools -Deep understanding of data architecture, data warehousing and data engineering subjects including Teradata, Oracle, Hive, Kubernetes, OpenShift, Trino, Impala, Pandas and Jupyter Hub -Extensive experience developing and optimizing code in various languages including Spark, PySpark, Python,...

Position Overview At PNC, our people are our greatest differentiator and competitive advantage in the markets we serve. We are all united in delivering the best experience for our customers. We work together each day to foster an inclusive workplace culture where all of our employees feel respected, valued and have an opportunity to contribute to the company's success. As a Data Engineer Senior within PNC's Data and Automation organization, you will be based in Pittsburgh-PA, Cleveland-OH, Strongsville-OH, Chicago-IL, Birmingham-AL or Dallas-TX. Skills -Deep functional understanding of big data development environments such as Hadoop/HDFS, Google Cloud, Azure, AWS and associated tools -Deep understanding of data architecture, data warehousing and data engineering subjects including Teradata, Oracle, Hive, Kubernetes, OpenShift, Trino, Impala, Pandas and Jupyter Hub -Extensive experience developing and optimizing code in various languages including Spark, PySpark, Python,...

Please, no third parties. Permanent residents only. This is a direct-hire or contract-to-hire opportunity. Main Duties & Responsibilities: - Design, construct, and fine-tune machine learning models using Python, Nvidia frameworks, and other relevant technologies to tackle diverse challenges such as risk evaluation and customer profiling. - Apply advanced techniques in feature engineering, hyperparameter tuning, and performance optimization to enhance model effectiveness. - Work alongside the team to establish CI/CD workflows for seamless deployment of ML models within Azure cloud infrastructure. - Manage the full model lifecycle, incorporating version control, containerization, and automated deployment methodologies. - Collaborate with Data Engineers to develop well-structured, high-quality data pipelines for model training and evaluation. - Utilize SQL and other database tools to preprocess, clean, and structure data sets for analysis. - Implement robust monitoring...

  Under the general direction of the Information Technology Supervisor II, the Cloud Data Engineer will be responsible for the analysis, design, implementation, administration, and optimization of our organization's cloud infrastructure on DIR's Google Cloud Platform (GCP). The incumbent will work on projects to ingest, store, process, analyze, explore, and visualize data on Google Cloud Platform and will work closely with other teams to ensure smooth operation, security and scalability of DIR's GCP Platform. The incumbent shall keep up to date with emerging trends and best practices in the technology and communications industries and evaluate their potential impact on the organization's IT strategy and implementation. This posting may be used to fill future vacancies in accordance with 2 CCR §249.3 To be considered for this Information Technology Specialist I job opportunity, applicants must be either reachable on an employment...

Description About the Role: Gartner is looking for passionate and motivated Data Engineers who are excited to foray into new technologies and help build / maintain data driven components for realizing business needs. This role is in Gartner Digital Product Technology (DPT). DPT Data Engineering teams are high velocity agile teams responsible for developing and maintaining components crucial to customer-facing channels, data science teams, and reporting & analysis. These components include but are not limited to Spark jobs, REST APIs, AI/ML model training & inference, MLOps / devops pipelines, data transformation & quality pipelines, data lake & data catalogs, data streams etc. What you will do: Should be able to interact and coordinate well with other developers / teams to resolve operational issues. Should be self-motivated and a fast learner to ramp up quickly with a fair amount of help from team members. Must be able to estimate development...

JOB SUMMARY PRINCIPAL DUTIES A solid experience and understanding of considerations for largescale solutioning and operationalization of data warehouses data lakes and analytics platforms on Google Cloud Platform is a must Monitors the Data Lake constantly and ensures that the appropriate support teams are engaged at the right times Design build and test scalable data ingestion pipelines perform end to end automation of ETL process for various datasets that are being ingested Determine best way to extract application telemetry data structure it send to proper tool for reporting Kafka Splunk Handson experience with data cataloging metadata management tools Collibra Dataplex Alation Create reports to monitor usage data for billing and SLA tracking Work with business and crossfunctional teams to gather and document requirements to meet business needs Provide support as required to ensure the availability and performance of ETLELT jobs Provide technical assistance and cross training...

Optus & AI At Optus, bandwagons aren’t really our thing. We’ve been using AI to improve the lives of our customers for almost ten years. From understanding the root cause of customer issues and proactively resolving them, to using it to inform our investment decisions, AI is embedded into what we do. With new cutting-edge tech at our fingertips, exciting partnerships under our belt and around every corner (Google and Samsung to name a couple), and a growing collective of talented people, we’re taking AI at Optus to the next level. We’re bringing together the most curious-minded people to solve real problems, connect Australians like never before, and help shape the future of Optus while we’re at it. And your future too. We’re already on our way, and ahead of lots of the competition. Now’s the time to go bigger than ever. This is no ‘quick win’ – we’re in this for the long haul because we know the positive impact it can make on our customers, communities and colleagues....

Company Description It all started in sunny San Diego, California in 2004 when a visionary engineer, Fred Luddy, saw the potential to transform how we work. Fast forward to today — ServiceNow stands as a global market leader, bringing innovative AI-enhanced technology to over 8,100 customers, including 85% of the Fortune 500®. Our intelligent cloud-based platform seamlessly connects people, systems, and processes to empower organizations to find smarter, faster, and better ways to work. But this is just the beginning of our journey. Join us as we pursue our purpose to make the world work better for everyone. Job Description What you get to do in this role: Build high-quality, clean, scalable and reusable code by enforcing best practices around software engineering architecture and processes (Code Reviews, Unit testing, etc.) Work with the product owners to understand detailed requirements and own your code from design, implementation, test automation and delivery of...

PagerDuty empowers teams of all kinds to do the critical work that moves business forward through the PagerDuty Operations Cloud. Visit our careers site to explore life at PagerDuty, discover opportunities, and sign-up for job alerts! Amid a rapidly evolving tech landscape, our AI group is boldly redefining the future of operations. We are on the hunt for a formidable Staff Machine Learning (ML) Engineer who is not only adept at architecting state-of-the-art AI initiatives but who is also ready to mentor and inspire a team composed of Machine Learning, Data Scientists, and Software Engineers. In this role, you will actively contribute to and lead AI-first innovation across our customers' Operations powered by ML and Agentic AI solutions. You will be instrumental in developing groundbreaking proofs of concept, contributing to our AI strategy, and pushing the boundaries of what's possible—all while addressing critical short and long-term team goals. In a world where...

As a Software Engineer on Tios Capital’s Tech Team, you will collaborate with others on various teams (Tech, Quant, and Trading) and support day-to-day energy trading operations by designing, implementing, and enhancing multiple software systems. You will be part of a software development team that executes the full cycle of agile software development. Your work will contribute to software systems that handle large amounts of data, support multiple markets, and provide trading insights. You will work with proprietary platforms, data formats, and APIs, leveraging various data stores and third-party tools. You will need to learn new technologies and domain concepts quickly. You will need to apply sound software engineering principles to help quickly deliver new tools and enhancements. As a software engineer, your solutions will tackle topics including quality, performance, availability, telemetry, and security. As a member of the Tios Capital Team, it is important that you are able...

At Johnson & Johnson, we believe health is everything. Our strength in healthcare innovation empowers us to build a world where complex diseases are prevented, treated, and cured, where treatments are smarter and less invasive, and solutions are personal. Through our expertise in Innovative Medicine and MedTech, we are uniquely positioned to innovate across the full spectrum of healthcare solutions today to deliver the breakthroughs of tomorrow, and profoundly impact health for humanity. Learn more at https://www.jnj.com Job Function: Data Analytics & Computational Sciences Job Sub Function: Data Engineering Job Category: Scientific/Technology All Job Posting Locations: Santa Clara, California, United States of America Job Description: Johnson & Johnson is hiring for a Sr. Principal Data Engineer - Shockwave Medical to join our team located in Santa Clara, CA . At Johnson & Johnson, we believe health is everything. Our strength in...

Our Company Changing the world through digital experiences is what Adobe’s all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences! We’re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies interact with customers across every screen. We’re on a mission to hire the very best and are committed to creating exceptional employee experiences where everyone is respected and has access to equal opportunity. We realize that new ideas can come from everywhere in the organization, and we know the next big idea could be yours! The Opportunity This role is part of Adobe’s Global Marketing Organization (GMO), specifically within the Growth Marketing and Insights organization (GMI). We are seeking a highly experienced Lead Machine Learning Engineer to design, develop, and deploy advanced causal Marketing Mix Models (MMM) for Adobe’s...