Job description for ETL Dev Engineer at PT Nusatalenta Indonesia
We are seeking a skilled ETL Developer to design, develop, and maintain high-performance ETL pipelines on Tencent Cloud platforms, especially using WeData for data integration and orchestration, and DLC (Data Lake Compute) for SQL-based lake processing. The role requires strong hands-on experience in building, scheduling, and monitoring ETL data flows with Spark underneath.
Key Responsibilities :
Design, build, schedule, and monitor end-to-end ETL pipelines using Tencent Cloud WeData
Develop and optimize SQL-based ETL jobs on DLC (Data Lake Compute) with Spark engine
Perform data extraction, transformation, cleaning, and loading from various source systems into data lakehouse
Implement incremental loading, scheduling, orchestration, and real-time monitoring of pipelines
Troubleshoot pipeline failures and optimize performance (Spark tuning, SQL optimization)
Collaborate with data architects and business teams to understand data requirements and deliver reliable solutions
Person Specifications
Required Qualifications :
Minimum 3+ years of hands-on ETL development experience (build, schedule, and monitor pipelines)
Direct and proven experience with Tencent Cloud WeData (data integration, orchestration, scheduling)
Direct and proven experience with Tencent Cloud DLC (Data Lake Compute) – SQL-based lake processing
Strong proficiency in SQL and Spark (DLC uses Spark for backend ETL processing)
Bachelor's degree in Computer Science or related fields
Preferred Qualifications :
Experience with Hive, Hadoop, Iceberg, Lakehouse architecture
Previous experience with Ab Initio or other legacy ETL tools
Familiarity with other Tencent Cloud products: EMR, COS, TencentDB, CLS
Proficiency in Python or Scala scripting for ETL automation
Background in telecom, data warehouse, or large-scale data migration projects
Joining: Immediate joiners are highly preferable
