Spark ETL with Scala: Using Either to handle invalid data http://ift.tt/2cQYFuJ...

Please Visit: http://ift.tt/1ajReyV

Spark ETL with Scala: Using Either to handle invalid data
http://ift.tt/2dN4EB1

Senario Usually when we use spark to import data from external system, we want to report to client how many rows we have imported successfully, how many invalid rows in the origin input. Solution: Using Scala Either When we...

from Public RSS-Feed of Jeffery yuan. Created with the PIXELMECHANICS 'GPlusRSS-Webtool' at http://gplusrss.com http://ift.tt/2dtOUAG
via LifeLong Community