Deskripsi pekerjaan Senior Data Engineer (Project Based) GITS Indonesia
Requirements:
- Bachelor's degree in Computer Science, Information Technology, Statistics, or related field.
- 5+ years of data engineering experience in production environments, including at least one large-scale data consolidation or migration project.
- Deep expertise in PostgreSQL — advanced schema design, partitioning, indexing, query performance tuning, and referential integrity enforcement.
- Hands-on experience building and maintaining ETL/ELT pipelines for heterogeneous data sources.
- Proficiency in at least one ETL orchestration tool (Airflow, dbt, Prefect, or equivalent).
- Experience with data migration from legacy systems — including schema mapping, data cleansing, validation, and rollback planning.
- Proficiency in SQL across multiple dialects; experience with data sourced from various RDBMS (SQL Server, MySQL/MariaDB, PostgreSQL).
- Experience setting up and querying analytical data stores — ClickHouse, BigQuery, Redshift, or equivalent columnar/OLAP databases.
- Understanding of message broker integration (RabbitMQ, Kafka) for streaming data pipelines.
- Strong data modeling skills — entity-relationship design, normalization, slowly changing dimensions, and audit trail schema patterns.
- Familiarity with REST API consumption for data ingestion from external systems.
- Experience with data quality validation frameworks and reconciliation reporting post-migration.
- Comfortable working with Docker and running pipelines in containerized environments.
- Solid understanding of data governance principles — lineage, access control, sensitive data classification.
- Experience with PostGIS or spatial databases for geospatial data storage and querying. (Plus)
- Familiarity with geospatial data formats — Shapefile, GeoJSON, coordinate reference system transformations. (Plus)
- Experience integrating with government or inter-agency data systems and APIs. (Plus)
- Familiarity with Grafana, Prometheus, or equivalent for data pipeline observability. (Plus)
- Experience with object storage (MinIO/S3) for managing large file and document datasets. (Plus)
- Familiarity with frequency management, spectrum monitoring, or telecommunications domain. (Plus)
