Job description for Data Engineer at PT Sigma Global Teknologi
Full requirment Technical :
1. PSQL (postgres SQL) including writing Functions (Mandatory)
2. Basic Linux Shell Scripting (Mandatory)
3. ETL Tools Informatica/Datastage/Airflow etc (Mandatory)
4. Data Analysis/Mining skill to identify the Pattern in Data and investigate the issues
(Mandatory)
5. Database Postgres/Greenplum/mySQL knowledge (Advantage)
Functional
1. Working in Telco/Finance specially for reconciliation/Audit process (Advantage)
Full jobdesk:
1. Need to understand the current ecosystems of ETL
2. Need to document all the process executing and data stream coming from various
systems. Along with following details Source type, description, frequency, format, etc
3. Need to understand the existing data storage and applications and best practices we
follow
4. Develop Data Pipeline for up-stream and down-stream integration for data processing
applications both in real-time and batch.
5. Optimize the Pipeline developed or existing pipeline if required to ensure the process is
optimized
6. Enhance existing workflows to support the project task
7. Support Operation team in case there are bugs in the release and develop fixes
8. Automation of Report/Data feed delivery to business for tracking or reconciliation
process
9. Develop code which generate alarms in case the data is not in trend or not arrive on
time.






