Job description for Big Data Engineer at PT Data Labs Analytics
Job Description:
- Manage the administration, configuration, and maintenance of Cloudera-based Big Data platforms.
- Handle Level 2 troubleshooting and conduct root cause analysis (RCA) for operational incidents.
- Execute deployment, patching, upgrades, and system configurations based on operational requirements.
- Support Big Data cluster implementation, performance tuning, and capacity management.
- Collaborate with L1, L3 support teams, and relevant stakeholders to resolve technical issues.
- Prepare technical documentation, Standard Operating Procedures (SOPs), and operational reports.
Requirements:
- Bachelor’s degree in Computer Science, Information Technology, Information Systems, or a related field.
- 1–3 years of experience as a Big Data Engineer, System Engineer, or in a similar role.
- Strong proficiency in Linux administration and command-line interfaces.
- Hands-on experience in maintaining microservices or backend services.
- Solid understanding of Big Data platforms, distributed systems, and data pipelines.
- Proven analytical skills and strong problem-solving capabilities.
- Hands-on experience in administering Cloudera platforms (CDP/CDH).
- Proficiency and practical experience with HDFS, Hive, Impala, Spark, Kafka, YARN, HBase, Phoenix, NiFi, and Cloudera Manager.
- Demonstrated experience in installation, configuration, upgrading, patching, and performance tuning for Big Data clusters.
- Ability to perform complex troubleshooting and root cause analysis (RCA).
- Ability to craft clear technical documentation and SOPs.
- Strong communication skills with a proven track record of cross-functional team collaboration.
