Course Outline
Introduction
Principles of Distributed Computing
- Apache Spark
- Hadoop
Principles of Data Serialization
- How data object is passed over the network
- Serialization of objects
- Serialization approaches
- Thrift
- Protocol Buffers
- Apache Avro
- data structure
- size, speed, format characteristics
- persistent data storage
- integration with dynamic languages
- dynamic typing
- schemas
- untagged data
- change management
Data Serialization and Distributed Computing
- Avro as a subproject of Hadoop
- Java serialization
- Hadoop serialization
- Avro serialization
Using Avro with
- Hive (AvroSerDe)
- Pig (AvroStorage)
Porting Existing RPC Frameworks
Summary and Conclusion
Requirements
- A general familiarity with distributed computing.
Testimonials (6)
Trainer's preparation & organization, and quality of materials provided on github.
Mateusz Rek - MicroStrategy Poland Sp. z o.o.
Course - Impala for Business Intelligence
I thought he did a great job of tailoring the experience to the audience. This class is mostly designed to cover data analysis with HIVE, but me and my co-worker are doing HIVE administration with no real data analytics responsibilities.
ian reif - Franchise Tax Board
Course - Data Analysis with Hive/HiveQL
I genuinely enjoyed the many hands-on sessions.
Jacek Pieczątka
Course - Administrator Training for Apache Hadoop
The VM I liked very much The Teacher was very knowledgeable regarding the topic as well as other topics, he was very nice and friendly I liked the facility in Dubai.
Safar Alqahtani - Elm Information Security
Course - Big Data Analytics in Health
The fact that all the data and software was ready to use on an already prepared VM, provided by the trainer in external disks.
vyzVoice
Course - Hadoop for Developers and Administrators
practical things of doing, also theory was served good by Ajay