Deskripsi pekerjaan ETL Engineer (Developer / Development Engineer / Data Architect) PT Digital Tech Asia
Requirements
- Bachelor's Degree in Computer Science, Information Technology, Software Engineering, or related field.
- Minimum 3+ years of experience in ETL development. (For Data Architect, preferably 5+ years of experience in ETL architecture, migration, and technical leadership.)
- Strong experience in designing, developing, scheduling, monitoring, and optimizing end-to-end ETL pipelines.
- Hands-on experience with Tencent Cloud WeData for ETL development, orchestration, and scheduling.
- Strong knowledge of Apache Spark (Spark Core & Spark SQL) for batch ETL processing.
- Strong SQL skills for complex data transformation and optimization.
- Experience with workflow orchestration tools such as Apache Airflow.
- Experience implementing incremental loading, scheduling strategies, and pipeline performance optimization.
- Strong understanding of data warehouse concepts, lakehouse architecture, and large-scale data migration.
- Experience performing data validation, consistency verification, and ETL quality testing.
- Ability to troubleshoot and optimize ETL performance.
- Good understanding of coding standards and software development best practices.
- Strong English reading, writing, and communication skills.
Additional Requirements (Preferred)
- Experience with Tencent Cloud DLC (Data Lake Compute).
- Experience with Hive, Hadoop, Iceberg, Lakehouse Architecture.
- Experience with Python and/or Scala for ETL automation.
- Experience with Ab Initio or other legacy ETL platforms.
- Experience performing legacy ETL migration, source code analysis, and transformation pattern design.
- Experience leading ETL migration projects or providing technical guidance to development teams.
- Background in Telecommunication, Data Warehouse, or Large-scale ETL/Data Migration projects.
- Immediate availability is highly preferred.
