Job description for Data Engineer Associate at PT Alto Network
Role Purpose
- Develop pipeline from several data sources to Datalake and Datawarehouse to help BI team develop dashboards and reports.
- Create dashboard for Internal Engineering or Data Engineering needs.
- Help prepare documentation and perform Data Quality checks for pipelines made by Senior Data Engineer.
- Deliverables / Outcomes
- Help Data Engineering & Reporting Unit Head assist Data Manager in project implementation and documentation activities.
- Act as Data Engineer to help BI team and internal Data Engineering in gathering data from all sources within ALTO.
- Act as Data Engineer to help Reporting in IT Engineering team.
- Act as BI Engineer to create dashboards for internal Data Engineering needs.
- Actively communicate with Dev to gain knowledge of data or new products.
- Actively look for newly released products.
- Develop pipelines to get data from several sources into Datalake and Datawarehouse in BigQuery.
- Develop dashboards for internal Data Engineering needs.
- Ensure Risk/Findings audit requirements are fulfilled.
- Ensure staff are informed and trained to support good corporate governance in their specific areas of work.
Qualifications
Knowledge
- Basic understanding of data architecture, data modeling, and ETL/ELT processes.
- Knowledge of data pipeline orchestration and workflow automation tools.
- Proficiency in relational databases.
- Knowledge of cloud-based big data tools (e.g., Google BigQuery, AWS Redshift, Azure Data Lake).
- Understanding of Python and SQL.
- Understanding of data quality, data security, compliance (GDPR, CCPA), and best practices.
- Experience with dashboard tools (e.g., Tableau, Looker, Metabase, etc.).
- Knowledge of how to create dashboards for operational or helicopter-view reporting for Unit Head.
Qualifications
- Bachelor's degree in Information Technology, Information System, Data Science, Computer Science, Mathematics, Statistics, or related fields.
- Experienced with data pipeline orchestrators/tools and experienced in coding from scratch to build pipelines.
- Proven experience in Data Engineering, Business Intelligence, or similar position with at least 1 year of experience or internship.
Non-Technical Skills
- Problem-Solving
- Communication
- Team Leadership
- Adaptability
- Detail-Oriented
Technical Skills
- Programming: Advanced in Python and expert in writing SQL queries.
- Data Pipelines: Experienced with ELT/ETL tools.
- Expert in cloud platforms and Big Data frameworks.
- Proficiency in CI/CD pipelines, containerization (Docker), and orchestration (Kubernetes).
- High knowledge of creating dashboards using dashboard tools.
