Trách nhiệm
Research, design and develop the data processing pipeline for real-time analytics dashboard and monitor our infrastructure and OTT services (FPT PLAY, FPT Camera,..)
Building toolsets/frameworks to manage, integrate with the various data sources, provide an efficient way for data science and business team exploring the data
Using Spark, SQL, Hadoop to manipulate data pipeline, improve and extend fault-tolerant pipelines to integrate large amounts of data from many diverse storage systems, databases
Build high performance data warehouse, BI platform for data analytics, handle high volume of streaming data (terabytes per day)
Evaluate and develop new technologies/solutions to make our infrastructure more reliable, high availability
Working with data scientist in the design of machine learning models, analysing our customer behavior, improve user experiences
Building toolsets/frameworks to manage, integrate with the various data sources, provide an efficient way for data science and business team exploring the data
Using Spark, SQL, Hadoop to manipulate data pipeline, improve and extend fault-tolerant pipelines to integrate large amounts of data from many diverse storage systems, databases
Build high performance data warehouse, BI platform for data analytics, handle high volume of streaming data (terabytes per day)
Evaluate and develop new technologies/solutions to make our infrastructure more reliable, high availability
Working with data scientist in the design of machine learning models, analysing our customer behavior, improve user experiences
Yêu cầu
Experience in software engineering and distributed system architecture design
Experience in large scale deployment and performance tuning
Having knowledge & experience of Hadoop Ecosystem (Spark, Hadoop, Druid, Clickhouse, ELK,..)
Strong experience in designing data-intensive systems with Lambda / Kappa Architecture
Strong at object-oriented analysis and design
Proficiency in programming languages: Java, Scala, Python,..
Strong experience with Networking & Linux system
Experience in project management, good time management, communication and teamwork skills
Experience in large scale deployment and performance tuning
Having knowledge & experience of Hadoop Ecosystem (Spark, Hadoop, Druid, Clickhouse, ELK,..)
Strong experience in designing data-intensive systems with Lambda / Kappa Architecture
Strong at object-oriented analysis and design
Proficiency in programming languages: Java, Scala, Python,..
Strong experience with Networking & Linux system
Experience in project management, good time management, communication and teamwork skills
Giới thiệu công ty
Gợi ý việc tương tự
Tuyển Data Engineer tại Thành Công (Tân Phú)
CÔNG TY CỔ PHẦN DỆT MAY- ĐẦU TƯ- THƯƠNG MẠI THÀNH CÔNG · Hồ Chí Minh
Thương lượngXem →
[R&D] Data Engineer
BOSCH AUTOMOTIVE R&D CENTER IN HCMC · Hồ Chí Minh
Thương lượngXem →
Data Engineer
HOME CREDIT VIETNAM - EXPLORE YOUR DREAM TEAM · Phú Thọ
Thương lượngXem →
(HN/HCM) Senior Data Engineer
NAVIGOS SEARCH'S CLIENT · Hà Nội
Thương lượngXem →
Data Engineer
40M-80M VND
