Insight Global
Waltham, MA, USA
Job Description The Lead Data Engineer will provide both hands-on development and technical leadership while guiding a team of data engineers while building, reviewing, and optimizing end-to-end data pipelines on Databricks (PySpark) within the AWS Enterprise Data Platform (EDP). This person will build and optimize data pipelines in Databricks, and ingest and transform data from ERP sources such as Salesforce, SAP, Oracle, and SQL Server. They will handle production deployments, ensuring data quality across AWS DWH environments like Redshift and Athena. They will collaborate within a multi-vendor Agile environment and participat3 in sprint planning through Jira. They will help to enforce DevOps/Data Ops standards using GitHub, ensuring that deliverables meet timelines and enterprise architecture frameworks. The Lead will be responsible for ensuring junior and mid-level engineers deliver effectively within each sprint cycle. We are a company committed to creating diverse and...

