Senior Data Engineer
Confidential Company
Rekruter Glints membantu mengelola rekrutmen pekerjaan ini.
Dengan melamar ke pekerjaan ini, kamu bisa diproses dan direkrut lebih cepat.
Skills
Deskripsi Pekerjaan Senior Data Engineer
Duties and Responsibilities
- Create and maintain optimal data pipeline architecture
- Identify, design, and implement internal process improvements: automating manual processes, optimising data delivery, re designing infrastructure for greater scalability
- Build analytics tools that utilises the data pipeline to provide actionable insights into customer delivered data, operational efficiency and other key business performance metrics.
- Optimise and improve our existing data products.
Syarat Pekerjaan Senior Data Engineer
- 5 years of experience in data engineering, analytics or data science background.
- Strong programming skills in Java/Python, excellent SQL skills
- Experience with relational SQL and NoSQL databases.
- Expertise in AWS services EMR, RDS, Athena, S3,Data Pipeline, Redshift
- Experience with big data tools: Hadoop, Spark, Kafka
- Experience with data streaming systems like spark-streaming, storm.
- Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
- Experience with shell scripting
- Ability to quickly understand and appreciate underlying business context, problems and objectives of analytical projects
- Clear communication skills to run well defined analysis and produce reports
- Excellent time management skills
