Computer Task Group
Piscataway, NJ, USA
CTG is seeking to fill a Senior Data Engineer (Python / PySpark / Kafka) position for our client. Location: Piscataway, NJ Duration: 12 months Duties: Design and develop scalable data pipelines and data processing systems for enterprise analytics. Build distributed data workflows using Python and PySpark . Develop real-time data streaming solutions using Apache Kafka . Integrate data from multiple sources and ensure data quality, reliability, and performance . Collaborate with data scientists, analysts, and engineering teams to support analytics and machine learning initiatives. Monitor, troubleshoot, and optimize large-scale data processing environments . Skills: Strong hands-on experience with Python . Extensive experience with PySpark for distributed data processing . Proven experience with Kafka and real-time/stream processing architectures . Experience building ETL/ELT...

