Add option for parallelization to allow user specify the grain of parallelism they desire
Debug parallelization issue for very large dataset (over 4G)
Added option for parallelization to allow user specify the grain of parallelism they desire
Debugged parallelization issue for very large dataset (over 4G) and found the root cause is that pickle library can only serialize object lower than 4G.