Kompetensi

Data Engineering

Using Hive and Impala with Hadoop

Through instructor led discussion and interactive, hands on exercises, participants will navigate the Hadoop ecosystem, learning topics such as

• The features that Hive and Impala offer for data acquisition, storage, and analysis
• The fundamentals of Apache Hadoop and data ETL ( transform, load), ingestion, and processing with Hadoop tools
• How Hive and Impala improve productivity for typical analysis tasks
• Joining diverse datasets to gain valuable business insight
• Performing real time, complex queries on datasets

Course Objective

1. Memahami ciri-ciri yang ditawarkan oleh Hive dan Impala untuk perolehan, penyimpanan dan analisis data;
2. Memahami asas-asas Apache Hadoop dan ETL data, pengambilan dan pemprosesan dengan tools Hadoop;
3. Memahami bagaimana Hive dan Impala dapat meningkatkan produktiviti dalam tugas-tugas analisis;
4. Menggabungkan pelbagai set data untuk mendapatkan insight yang bernilai; dan
5. Melaksanakan real-time dan kuiri yang kompleks pada set data.

Course Outline

1. Hadoop Fundamentals
2. Introduction to Hive and Impala
3. Querying with Hive and Impala
4. Data Management
5. Data Storage and Performance
6. Relational Data Analysis with Hive and Impala
7. Working with Impala 
8. Analyzing Text and Complex Data with Hive
9. Hive Optimization
10. Extending Hive