Distributed computing and data processing frameworks

1. Distributed computing and data processing frameworks

2.

3. The big data challenge

4. The major hardware restrictions

• Processor time
• Memory
• Hard drive space
• Network bandwidth

5. Memory (RAM)

6. Hard drive space

7.

8.

9. Hadoop

10. MapReduce

11.

12. Resilient Distributed Datasets (RDDs)

13.

14. Storm framework

15. Discussion