Job description for Data Engineer at Công ty TNHH Diksha Technologies
Working Location: 89 Lang Ha, Hanoi
1. Job Description
Design, build, and operate data processing systems to support analytics, reporting, and data consumption.
Develop and optimize ETL/ELT pipelines to collect, transform, and integrate data from multiple sources.
Build, manage, and optimize Data Warehouses and Data Lakes according to the project's system architecture.
Develop batch and/or streaming data processing workflows, ensuring performance and scalability.
Optimize SQL queries, data processing performance, and system resources.
Check data quality and ensure data accuracy, integrity, and consistency.
Collaborate with Data Analysts, BI, BA, and development teams to meet business requirements.
Monitor and troubleshoot pipeline operations and prepare relevant technical documentation.
2. Requirements
At least 2 years of experience working as a Data Engineer or in an equivalent role.
A degree in Information Technology, Computer Science, Information Systems, or a related field.
Proficiency in SQL and programming experience with Python, Java, or Scala.
Experience building, deploying, and operating ETL/ELT processes.
Knowledge of relational databases, data modeling, and Data Warehousing.
Experience using one or more technologies such as Apache Spark, Kafka, Airflow, Hadoop, or equivalent data platforms.
Analytical thinking, problem-solving skills, and good teamwork.
Experience in banking, finance, or large-scale data systems is preferred.
Ability to read technical documentation in English.
