Deskripsi pekerjaan IT Data Engineer PT Prima Data Semesta
Tanggung Jawab
- Membangun pipeline modular dengan scheduling, error handling, retry logic
- Mendesain data model (star/snowflake) untuk warehouse
- Data profiling & monitoring pipeline
- Deploy pipeline ke production & menjelaskan kualitas data ke stakeholder
Kualifikasi
- Menguasai SQL & Python (atau Scala) untuk data processing
- Pemahaman dasar ETL/ELT & data warehousing
- Mampu mendokumentasikan data flow
- Teliti pada kualitas data
Nilai Tambah
- Pipeline modular (scheduling, error handling, retry)
- Desain data model (star/snowflake) & data warehousing
- Orchestration tool (Airflow, Prefect, Dagster)
- Spark/Flink & distributed processing
- dbt & data lakehouse (Delta Lake, Iceberg)
- Streaming (Kafka, Pulsar, Kinesis)
- Data quality tools (Great Expectations, Soda) & compliance (PDPA, GDPR)
