Udacity: Real-Time Analytics with Apache Storm fieldsGrouping globalGrouping shuffleGrouping TopologyBuilder...

Please Visit: http://ift.tt/1ajReyV

Udacity: Real-Time Analytics with Apache Storm
fieldsGrouping
globalGrouping
shuffleGrouping
TopologyBuilder builder = new TopologyBuilder();
builder.setSpout("spout", new RandomSentence(), 5);
builder.setBolt("split", new SplitSentence(), 8).shuffleGrouping("spout");
builder.setBolt("count", new WordCount(), 12).fieldsGrouping("split", new Fields("word"));
StormSubmitter.submitTopologyWithProgressBar(args[0], conf, builder.createTopology());
localCluster.submitTopology("test", conf, builder.createTopology());

builder.setBolt("join", new SingleJoinBolt(new Fields("gender", "age"))).fieldsGrouping("gender", new Fields("id"))
.fieldsGrouping("age", new Fields("id"));

FeederSpout
_id = InprocMessaging.acquireNewPort();
InprocMessaging.sendMessage(_id, new Values(tuple, msgId));
List<Object> toEmit = (List<Object>) InprocMessaging.pollMessage(_id);

SingleJoinBolt
distributed RPC
http://ift.tt/1rPpKyk
ReachTopology
LinearDRPCTopologyBuilder builder = new LinearDRPCTopologyBuilder("reach");
builder.addBolt(new GetTweeters(), 4);
builder.addBolt(new GetFollowers(), 12).shuffleGrouping();
builder.addBolt(new PartialUniquer(), 6).fieldsGrouping(new Fields("id", "follower"));
builder.addBolt(new CountAggregator(), 3).fieldsGrouping(new Fields("id"));
PartialUniquer extends BaseBatchBolt

redis.publish("WordCountTopology", word + "|" + Long.toString(count));

http://ift.tt/1QQ1SVo
http://ift.tt/1KbdBNv
http://ift.tt/1QQ1SVq
http://ift.tt/1KbdAcs

http://ift.tt/1v0bgLM

Distributed RPC. The idea behind distributed RPC (DRPC) is to parallelize the computation of really intense functions on the fly using Storm. The Storm topology takes in as input a stream of function arguments, and it emits an output stream of the results for each of those function calls.

from Public RSS-Feed of Jeffery yuan. Created with the PIXELMECHANICS 'GPlusRSS-Webtool' at http://gplusrss.com http://ift.tt/1QQ1RAX
via LifeLong Community