Reshared post from Michael Panzer:

Please Visit: http://ift.tt/1ajReyV

Original Post from Michael Panzer:

Giving an old project to a new colleague...

05.05.15 - 1

from Public RSS-Feed of Jeffery yuan. Created with the PIXELMECHANICS 'GPlusRSS-Webtool' at http://gplusrss.com http://ift.tt/1AaxAIX
via LifeLong Community

Consensus Algorithm: Raft & Paxos Raft: Leader, followers, candidates Leader election, Log replication...

Please Visit: http://ift.tt/1ajReyV

Consensus Algorithm: Raft & Paxos
Raft:
Leader, followers, candidates
Leader election, 
Log replication, log compaction

Paxos is about theory
Raft wins on understandability, practicality, accessibility

Paxos
Proposer(Leader), Acceptor (Voters), Learner, Client

https://www.youtube.com/watch?v=YbZ3zDzDnrw
https://www.youtube.com/watch?v=JEpsBg0AO6o
http://ift.tt/1uROOrj
http://ift.tt/1hRGspg
http://ift.tt/1AaxAsm
http://ift.tt/17QXv7f
http://ift.tt/1Aaxykh
http://ift.tt/17QXxMu
http://ift.tt/KdZbss
http://ift.tt/1zSrCWs

Raft lecture (Raft user study)

from Public RSS-Feed of Jeffery yuan. Created with the PIXELMECHANICS 'GPlusRSS-Webtool' at http://gplusrss.com http://ift.tt/1AaxBfQ
via LifeLong Community

Udacity: Real-Time Analytics with Apache Storm fieldsGrouping globalGrouping shuffleGrouping TopologyBuilder...

Please Visit: http://ift.tt/1ajReyV

Udacity: Real-Time Analytics with Apache Storm
fieldsGrouping
globalGrouping
shuffleGrouping
TopologyBuilder builder = new TopologyBuilder();
builder.setSpout("spout", new RandomSentence(), 5);
builder.setBolt("split", new SplitSentence(), 8).shuffleGrouping("spout");
builder.setBolt("count", new WordCount(), 12).fieldsGrouping("split", new Fields("word"));
StormSubmitter.submitTopologyWithProgressBar(args[0], conf, builder.createTopology());
localCluster.submitTopology("test", conf, builder.createTopology());

builder.setBolt("join", new SingleJoinBolt(new Fields("gender", "age"))).fieldsGrouping("gender", new Fields("id"))
.fieldsGrouping("age", new Fields("id"));

FeederSpout
_id = InprocMessaging.acquireNewPort();
InprocMessaging.sendMessage(_id, new Values(tuple, msgId));
List<Object> toEmit = (List<Object>) InprocMessaging.pollMessage(_id);

SingleJoinBolt
distributed RPC
http://ift.tt/1rPpKyk
ReachTopology
LinearDRPCTopologyBuilder builder = new LinearDRPCTopologyBuilder("reach");
builder.addBolt(new GetTweeters(), 4);
builder.addBolt(new GetFollowers(), 12).shuffleGrouping();
builder.addBolt(new PartialUniquer(), 6).fieldsGrouping(new Fields("id", "follower"));
builder.addBolt(new CountAggregator(), 3).fieldsGrouping(new Fields("id"));
PartialUniquer extends BaseBatchBolt

redis.publish("WordCountTopology", word + "|" + Long.toString(count));

http://ift.tt/1QQ1SVo
http://ift.tt/1KbdBNv
http://ift.tt/1QQ1SVq
http://ift.tt/1KbdAcs

http://ift.tt/1v0bgLM

Distributed RPC. The idea behind distributed RPC (DRPC) is to parallelize the computation of really intense functions on the fly using Storm. The Storm topology takes in as input a stream of function arguments, and it emits an output stream of the results for each of those function calls.

from Public RSS-Feed of Jeffery yuan. Created with the PIXELMECHANICS 'GPlusRSS-Webtool' at http://gplusrss.com http://ift.tt/1QQ1RAX
via LifeLong Community

CP Database: Spanner && cockroachdb It uses the Paxos algorithm as part of its operation to shard data...

Please Visit: http://ift.tt/1ajReyV

CP Database: Spanner && cockroachdb
It uses the Paxos algorithm as part of its operation to shard data across hundreds of datacenters. It makes heavy use of hardware-assisted time synchronization using GPS clocks and atomic clocks to ensure global consistency.
http://ift.tt/1bQQtxT
https://www.youtube.com/watch?v=ndKj77VW2eM
http://ift.tt/1jf9Bzj
http://ift.tt/1nZcox1
http://cockroachdb.org/

Sebastian Kanthak overviews Spanner, covering details of how Spanner relies on GPS and atomic clocks to provide two of its most innovative features: Lock-free strong (current) reads and global snapshots that are consistent with external events.

from Public RSS-Feed of Jeffery yuan. Created with the PIXELMECHANICS 'GPlusRSS-Webtool' at http://gplusrss.com http://ift.tt/1d1FoCF
via LifeLong Community

coursera+udacity: Please Add search button in first page +Coursera +Udacity

Please Visit: http://ift.tt/1ajReyV

coursera+udacity: Please Add search button in first page
+Coursera +Udacity 

from Public RSS-Feed of Jeffery yuan. Created with the PIXELMECHANICS 'GPlusRSS-Webtool' at http://gplusrss.com http://ift.tt/1KQsLok
via LifeLong Community

Big Data: Moving Average Spark Way http://ift.tt/1IBpegl http://stack...

Please Visit: http://ift.tt/1ajReyV

Big Data: Moving Average

Spark Way
http://ift.tt/1IBpegl
http://ift.tt/1EJ36td

Hadoop Way
Composite Key – A Key that is a combination of the natural key and the natural value we want to sort by.
http://ift.tt/1BiOzqT
http://ift.tt/1EJ34l6

Small data: Using Array

from Public RSS-Feed of Jeffery yuan. Created with the PIXELMECHANICS 'GPlusRSS-Webtool' at http://gplusrss.com http://ift.tt/1IBpegn
via LifeLong Community

slideshare doesn't work on Chrome dev, works on Safari... Didn't install Chrome Stable, so not sure ...

Please Visit: http://ift.tt/1ajReyV

slideshare doesn't work on Chrome dev, works on Safari...
Didn't install Chrome Stable, so not sure whether it works

from Public RSS-Feed of Jeffery yuan. Created with the PIXELMECHANICS 'GPlusRSS-Webtool' at http://gplusrss.com http://ift.tt/1E7Qew2
via LifeLong Community

14.05.2015 08:32

Please Visit: http://ift.tt/1ajReyV

ETE 2012 - Nathan Marz on Storm

from Public RSS-Feed of Jeffery yuan. Created with the PIXELMECHANICS 'GPlusRSS-Webtool' at http://gplusrss.com http://ift.tt/1JfPMTv
via LifeLong Community

Youtube as a platform for other video sites Youtube provides best video experience: different video ...

Please Visit: http://ift.tt/1ajReyV

Youtube as a platform for other video sites
Youtube provides best video experience: different video QualifyingEventinformation, auto generated caption, remember last view position, great video player(shortcut keys), etc.

Coursera, SafribookOnline works ok on desktop, but really bad(slow, not work) on mobile. 
Other services Youtube can provide
Recommendation
Trend, Analytics

Business Mode
Ads?
Pay fee to youtube?
+YouTube +YouTube for Developers +Google Developers 

from Public RSS-Feed of Jeffery yuan. Created with the PIXELMECHANICS 'GPlusRSS-Webtool' at http://gplusrss.com http://ift.tt/1KLCBYB
via LifeLong Community

Interesting Big data algorithm && data structures Bloom filter(Counting) Merkle tree SkipLists(Maybe...

Please Visit: http://ift.tt/1ajReyV

Interesting Big data algorithm && data structures
Bloom filter(Counting)
Merkle tree
SkipLists(Maybe?)

Count Min Sketch
HyperLogLog(TODO)

Hashing
MinHash/SimHash to detect similar docs
http://ift.tt/1pPyGyl
Consistency hash, hash ring, virtual node

Failure Detection
http://ift.tt/sll1jX
http://ift.tt/1cthAHJ
TODO
blinkdb
Paxos

from Public RSS-Feed of Jeffery yuan. Created with the PIXELMECHANICS 'GPlusRSS-Webtool' at http://gplusrss.com http://ift.tt/1KLiael
via LifeLong Community

Matt's Blog: MinHash for dummies 1. Break down the document a set of shingles. 2. Calculate the hash...

Please Visit: http://ift.tt/1ajReyV

Matt's Blog: MinHash for dummies
1. Break down the document a set of shingles.
2. Calculate the hash value for every shingle.
3. Store the minimum hash value found in step 2.
4. Repeat steps 2 and 3 with different hash algorithms 199 more times to get a total of 200 min hash values.
you XOR the value returned by String.hashCode() with 199 random numbers to generate the 199 other hash code values. Just make sure that you are using the same 199 random numbers across all the documents.

LSH allows you to precompute a hash code that is then quickly and easily compared to another precomputed LSH hash code to determine if two objects should be compared in more detail or quickly discarded.

Any documents that share rows in any bands should be compared for their similarity. 
http://ift.tt/1pPyGyl
http://ift.tt/1Pkl2p4
http://ift.tt/OCbW2A
http://ift.tt/1Pkl2p6

Duplicate document detection is becoming increasingly important for businesses that have huge collections of email, web pages and documents with multiple copies that may or may not be kept up to date. MinHash is a fairly simp...

from Public RSS-Feed of Jeffery yuan. Created with the PIXELMECHANICS 'GPlusRSS-Webtool' at http://gplusrss.com http://ift.tt/1KLiaej
via LifeLong Community

Android Police: The Chrome For Android Team Is Doing An AMA On Reddit Today. http://ift.tt/1eUavJA...

Please Visit: http://ift.tt/1ajReyV

Android Police: The Chrome For Android Team Is Doing An AMA On Reddit Today. http://ift.tt/1KLi9XG

from Public RSS-Feed of Jeffery yuan. Created with the PIXELMECHANICS 'GPlusRSS-Webtool' at http://gplusrss.com http://ift.tt/1Pkl28K
via LifeLong Community

Company should make big discount on its own products for its employees && encourage employees use them...

Please Visit: http://ift.tt/1ajReyV

Company should make big discount on its own products for its employees && encourage employees use them!!!
Let employees use the products they are building/selling, make employees care about them, have strong feelings about them, gather info about what employees love, hate, what should be improved, what new features they want etc.

If the employees don't ever use your products, don't care them, it would be pretty bad for both sides.

from Public RSS-Feed of Jeffery yuan. Created with the PIXELMECHANICS 'GPlusRSS-Webtool' at http://gplusrss.com http://ift.tt/1H41fR5
via LifeLong Community

Chrome PDF Plugin: Integrate top toolbar function into the right bottom circle button https://code.google.com...

Please Visit: http://ift.tt/1ajReyV

Chrome PDF Plugin: Integrate top toolbar function into the right bottom circle button
http://ift.tt/1H41fR3
Chrome pdf plugin is great, but its top toolbar is kind of annoying, whenever we move the cursor, it will popup, then disappear.

When we read pdf, we don't want to be disturbed, also the screen space is precious.

We can integrate its function to the right bottom circle button: after click it: we can rotate, print, save, show bookmarks etc, it can also show current page/total pages: like: 3/10
Benefit: 
No intrusive, more space for user, don't disturb user.
+Google Chrome +Google Chrome Developers 

from Public RSS-Feed of Jeffery yuan. Created with the PIXELMECHANICS 'GPlusRSS-Webtool' at http://gplusrss.com http://ift.tt/1e22YPY
via LifeLong Community

Google+ Photos: Easier to +1 in full screen slideshow mode This can encourage user engagement: +1 to...

Please Visit: http://ift.tt/1ajReyV

Google+ Photos: Easier to +1 in full screen slideshow mode
This can encourage user engagement: +1 to other people's photo.
How: Just add +1 button along existing Play/Pause buttons.
+Google+ +Google+ Developers +Google Developers 

from Public RSS-Feed of Jeffery yuan. Created with the PIXELMECHANICS 'GPlusRSS-Webtool' at http://gplusrss.com http://ift.tt/1K5LCyR
via LifeLong Community

Google+: Photos Category in Community && SlideShow feature Pretty Cool && Useful https://plus.google.com...

Please Visit: http://ift.tt/1ajReyV

Google+: Photos Category in Community && SlideShow feature
Pretty Cool && Useful
http://ift.tt/1G5784n

from Public RSS-Feed of Jeffery yuan. Created with the PIXELMECHANICS 'GPlusRSS-Webtool' at http://gplusrss.com http://ift.tt/1PFU2eJ
via LifeLong Community

Youtube: Add language metadata to videos && allow users to filter by languages Most of users only knows...

Please Visit: http://ift.tt/1ajReyV

Youtube: Add language metadata to videos && allow users to filter by languages
Most of users only knows one or two languages, there is really no meaning to show videos in other languages to users who don't understand them at all:
-- bad user experience: waste their time: open the video, after several seconds, just find out totally don't understand what the speaker is talking.
-- In search result, Youtube can actually show more related videos that users wants to watch: in most case, users only check the first page.
How: When users upload videos, they can set the language; if it's not set(or not right), other users can set the language, and notify the author, he/she can change it if it's set to wrong language and then disallow other users to change it.

In preference, users can set what languages to search(prefer); or filter them during search
Business Benefit
Better user experience; more watch; more revenue
+YouTube +Google Developers +Google 

from Public RSS-Feed of Jeffery yuan. Created with the PIXELMECHANICS 'GPlusRSS-Webtool' at http://gplusrss.com http://ift.tt/1EC1AsO
via LifeLong Community

MIT 6.042J Mathematics for Computer Science, Fall 2010 https://www.youtube.com/playlist?list=PLB7540...

Please Visit: http://ift.tt/1ajReyV

MIT 6.042J Mathematics for Computer Science, Fall 2010
https://www.youtube.com/playlist?list=PLB7540DEDD482705B

MIT 6.042J Mathematics for Computer Science, Fall 2010 - YouTube

from Public RSS-Feed of Jeffery yuan. Created with the PIXELMECHANICS 'GPlusRSS-Webtool' at http://gplusrss.com http://ift.tt/1cLQXxB
via LifeLong Community

Youtube Ads: Able to forward skippable Ads && replay video ads Sometimes, we are curious about the ads...

Please Visit: http://ift.tt/1ajReyV

Youtube Ads: Able to forward skippable Ads && replay video ads
Sometimes, we are curious about the ads: what's the product it's really selling etc, but don't want to watch the full ads, so we just want to skip to last 5 or ten seconds(use ->), but we can't. So in most cases, we just click the skip ads to ignore it.

How to do it: User can forward or drag the bar till the last 5 seconds.

Sometimes, we watched some short good video ads, and want to replay it again. (This happened more than once to me: some public services)

Business Benefit
Happy users: Better UI experience, give user more control.
Happy Advertisers: they want users know the product they are selling.
Maybe more revenue for youtube, more video ads playtime: not sure whether the advertiser is charged based on how many times the video ads is playing.
+Google AdSense +YouTube +Google Ads Developers

from Public RSS-Feed of Jeffery yuan. Created with the PIXELMECHANICS 'GPlusRSS-Webtool' at http://gplusrss.com http://ift.tt/1EyxV3w
via LifeLong Community

UTF-8 vs UTF-16 Java class file format used Modified UTF-8 Java runtime uses UTF-16 for the internal...

Please Visit: http://ift.tt/1ajReyV

UTF-8 vs UTF-16
Java class file format used Modified UTF-8
Java runtime uses UTF-16 for the internal text representation
http://ift.tt/1QDpbBY
http://ift.tt/1QDpbSe
http://ift.tt/IC2A3q

I would imagine the reason was fast, array like access to the character at index, but some characters won't fit into 16 bits, so it wouldn't work... So if you have to handle special cases anyways,...

from Public RSS-Feed of Jeffery yuan. Created with the PIXELMECHANICS 'GPlusRSS-Webtool' at http://gplusrss.com http://ift.tt/1QDpbSm
via LifeLong Community

Google+ Mobile: Search Google for this image When we browse in google+ mobile, we may find some interesting...

Please Visit: http://ift.tt/1ajReyV

Google+ Mobile: Search Google for this image
When we browse in google+ mobile, we may find some interesting images and want to use google to search similar images.
-- Integrating other services into G+ to make it more useful. 
+Google+ +Google+ Developers +Google Developers 

from Public RSS-Feed of Jeffery yuan. Created with the PIXELMECHANICS 'GPlusRSS-Webtool' at http://gplusrss.com http://ift.tt/1IvWcwW
via LifeLong Community

11.05.2015 06:19

Please Visit: http://ift.tt/1ajReyV

Authentication & Authorization: OAuth - Udacity

from Public RSS-Feed of Jeffery yuan. Created with the PIXELMECHANICS 'GPlusRSS-Webtool' at http://gplusrss.com http://ift.tt/1PBnzpL
via LifeLong Community