WordCount - Hadoop Wiki

WordCount Example in MapReduce, Pig and Hive

WordCount Example in Hadoop

http://wiki.apache.org/hadoop/WordCount



WordCount Example in Pig

http://salsahpc.indiana.edu/ScienceCloud/pig_word_count_tutorial.htm#IV._Cluster

input = load 'mary' as (line);

words = foreach input generate flatten(TOKENIZE(line)) as word;

grpd = group words by word;

cntd = foreach grpd generate group, COUNT(words);

dump cntd;



WordCount Example in Hive

http://www.amazon.com/Programming-Hive-Edward-Capriolo/dp/1449319335/ref=sr_1_2?s=books&ie=UTF8&qid=1387858046&sr=1-2&keywords=hive

CREATE TABLE docs (line STRING);

LOAD DATA INPATH 'docs' OVERWRITE INTO TABLE docs;

CREATE TABLE word_counts AS

SELECT word, count(1) AS count FROM

(SELECT explode(split(line, '\s')) AS word FROM docs) w

GROUP BY word

ORDER BY word;



from Google Plus RSS Feed for 101157854606139706613 http://wiki.apache.org/hadoop/WordCount

via LifeLong Community

No comments:

Post a Comment