Big Data Drupal with Cloudera, Hadoop, MapReduce, Nutch and Solr by niccolo http://groups.drupal.org/node/286763

1. Big Data Drupal
DEMOCRATIZING BIG DATA PROCESSES

2. Elements
Bonita
Cloudera
NutchSolr
Drupal

3. Bonita
JAVA/ECLIPSE-BASED COMMERCIAL OPEN-SOURCE BUSINESS
PROCESS AUTOMATION & MODELLING

4. Bonita Studio
Design business process models
Human or Service Tasks
Human Tasks have Forms
Service Tasks have Connectors

5. Bonita
Experience
Web-based admin & workflow

6. Bonita Forms

7. Shell Script Task
sudo -u hdfs hadoop jar
/opt/nutch/basil-apache-nutch-
1.6/build/apache-nutch-1.6.job
org.apache.nutch.crawl.Crawl
/user/nutch/demo-crawl/urls -dir
${dir} -depth ${depth} -topN 10 -
threads 50
Runs Nutch job for Hadoop

8. Cloudera
BIG DATA COMMERCIAL OPEN SOURCE

9. Cloudera
Cloudera Manager 4 (Free Edition)
Hbase
HDFS
Hive
Hue
Impala
Mapreduce
Oozie
Zookeeper

10. Nutch Job
Hadoop job started by Bonita Shell
connector

11. Apache
Foundation
Nutch
Solr
Hbase
HDFS
Hive
Impala
Mapreduce
Home to many of these projects

12. Nutch
Industrial strength general purpose
web-crawler
http://blog.csdn.net/hadoopstudy/article/details/1501123

13. Nutch
http://blog.csdn.net/hadoopstudy/article/details/1501123

14. Solr
Search & indexing

15. Drupal
PHP WEB APPLICATION FRAMEWORK

16. Aegir BOA

17. Drupal
Nutch & Solr modules
Integrate with search & views
Created at IAS
Sponsored by Acquia

18. Apache Solr
Module

19. Apache Solr
Examples
Module
http://drupal.org/project/apachesolr_examples

20. Nutch Mulisite

21. Drupal Search
Nutch crawl
Solr indexed
Drupal search & views

22. Nutch Solr
Sandbox

23. Big Data Drupal
DEMOCRATIZING BIG DATA PROCESSES

24. Big Data Drupal
Author

25. Big Data Drupal
Web www.BigDataDrupal.com
Email niccolo.roberts@gmail.com
Contact Nicholas Roberts