Data Engineer
Quadrant.io
Skills
Deskripsi pekerjaan Data Engineer Quadrant.io
Duties and Responsibilities:
- Create and maintain optimal data pipeline architecture
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability
- Build analytics tools that utilises the data pipeline to provide actionable insights into customer delivered data, operational efficiency and other key business performance metrics.
- Optimize and improve our existing data products.
Persyaratan wajib menjadi Data Engineer di Quadrant.io
- 3 years of experience in data engineering, analytics or data science background.
- Strong programming skills in Java/Python, excellent SQL skills
- Experience with relational SQL and NoSQL databases.
- Expertise in AWS services EMR, RDS, Athena, S3,Data Pipeline, Redshift
- Experience with big data tools: Hadoop, Spark, Kafka
- Experience with data streaming systems like spark-streaming, storm.
- Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
- Experience with shell scripting
- Ability to quickly understand and appreciate underlying business context, problems and objectives of analytical projects
- Clear communication skills to run well defined analysis and produce reports
- Excellent time management skills
