Your verification ID is: guDlT7MCuIOFFHSbB3jPFN5QLaQ Big Computing: Which Parallel for R?

Wednesday, April 27, 2011

Which Parallel for R?

There are many Parallel backends for R/Foreach which includes DoRedis, DoNWS, DoMPI, DoSnow and the list goes on and on. Yesterday I even ran across an commerical HPC backend for R from a company called Zircon Computing along with the very solid ParallelR package from Revolution Analytics. I think it is great that there are some many options to improve R's performance. Options can be great, but they can also be daunting.

Amy Szczparnski did a nice presentation comparing some of the options for running Parallel processing in R at the Greater Boston useR Meetup, but this is an area where more comparisons of the pros and cons of different options and benchmarking of the various methods needs to be done.

Hadley Wickham was kind enough to send me a paper written in 2009  about the State of the Art in Parallel Computing in R (Markus Schmidberger, Martin Morgan, Dirk Eddelbuettel, Hao Yu, Luke Tierney, Ulrich Mansmann) which compares 16 packages that I had not seen before.