Your verification ID is: guDlT7MCuIOFFHSbB3jPFN5QLaQ Big Computing: r
Showing posts with label r. Show all posts
Showing posts with label r. Show all posts

Tuesday, January 8, 2013

Connecticut R User Group starts 2013

I can not believe the Connecticut R User Group is already in its second year. I started the group mostly because I did not want to have to go to all the way into New York or Boston just to connect with other R users. The group has been more successful than I had hope in its first year. We have had a host of great talks, the group has grown to over 70 members. If you are in Connecticut especially the New Haven area I hope to see you at our next meeting.

Wednesday, April 27, 2011

Which Parallel for R?

There are many Parallel backends for R/Foreach which includes DoRedis, DoNWS, DoMPI, DoSnow and the list goes on and on. Yesterday I even ran across an commerical HPC backend for R from a company called Zircon Computing along with the very solid ParallelR package from Revolution Analytics. I think it is great that there are some many options to improve R's performance. Options can be great, but they can also be daunting.

Amy Szczparnski did a nice presentation comparing some of the options for running Parallel processing in R at the Greater Boston useR Meetup, but this is an area where more comparisons of the pros and cons of different options and benchmarking of the various methods needs to be done.

Hadley Wickham was kind enough to send me a paper written in 2009  about the State of the Art in Parallel Computing in R (Markus Schmidberger, Martin Morgan, Dirk Eddelbuettel, Hao Yu, Luke Tierney, Ulrich Mansmann) which compares 16 packages that I had not seen before.

Monday, April 25, 2011

Newbie R

It is generally accepted that R has one of the steepest learning curves of all the statisitical platforms (SAS, SPSS, etc.). For a person new to the R environment or someone trying to get the lay of the land there are many ways to start. There are some online tuturials and books, I used R in a Nutshell myself. However, more needs be done for developing basic skills of new R users. I had seen comments that a good IDE or GUI like  RStudio can flatten out the learning curve. Another option is going to a training class offered by many different companies. There are also the many local area R user groups.

The R User Meetups are a great place to get started with R. Sometimes the presentations at the R meetups are directed more at the accomplished user than the Newbie. The Greater Boston Area useRs group has come up with a great idea on how to help the newer members to the R community.

At every meeting Jeffery Breen has been doing an opening talk that is directed at the new R user.  So far he has done:

Reshaping Data in R
Grouping & Summarizing Data in R
R plus 15 minutes = Hadoop Cluster

These talks and others like them are a critical piece and an important contribution to building a large competent user base of any open source tools. I am hopeful that other groups will give more of these basic talks and post them so that the R community can build a large repository of presentations on how to do the basics in R.

Saturday, April 16, 2011

doRedis: A parallel back end for R/foreach using Redis.

Bryan Lewis recently did a Vignette using RStudio to run some financial data using R/foreach and doRedis. Parallelizing R continues to become more important as users want to run computations on larger and larger quantities of data in reasonable amounts of time particularly on clusters or the cloud. doRedis includes the following features:

  • Support for dynamic pools of parallel workers during running computations.
  • Simple cross-platform parallel computing, including at least Windows, GNU/Linux and OS X.
  • Fault-tolerant 
doRedis Vignette

Redis

Thursday, April 7, 2011

What Operating Systems do R users use?

I went to the Greater Boston R meetup last night where the Rstudio guys did a presentation on their IDE. It was well attended, and Josh and JJ did a great job.

At the end of the talk JJ said that the breakdown of Operating Systems for the Rstudio downloads was roughly 60% windows, 30% mac and 10% linux. Frankly I was surprised by those numbers. I always felt that the majority of people who use open source R would run it on an open source Operating System. Rstudio's results would seem to strongly counter that thought. After the talk, I remembered a survey done by KDnuggets in September of 2007 on what Operating system did people use for their analytics work. It also showed about 60% Windows users but 30% linux and 10% Mac. I believe this suggests an increase in the number of people using Macs to do analytics in the last four years.

I am not sure the data from downloads of an IDE or a survey of Operating Systems by KDnuggets is a good indicator of what is the relative popularity of the various Operating Systems being used by the R community. I do believe it does show the importance of supporting Windows which is consistantly shown as the dominate platform among people surveyed and downloads at least Rstudio. It also showed that if you make an IDE that is not supported on the Mac you could be missing 30% of the potential users.

The recent KDnuggets survey on which R interfaces which was interesting. For example, I would not have expect so many people to respond that they use Tinn-R or R commander but they do.  I always enjoyed the KDnuggets surveys.

KDnuggets Operating System survey
KDnuggets R interface poll

Friday, March 18, 2011

How does beer relate to Scrapping Data?

Sometimes I find myself involved in projects as a result of having just one too many rounds of beer after a meetup. Such is the case with the beer predictor. In an overt attempt to ingratiate ourselves with the local craft brewers we thought it would be a good idea to write some analytics on craft beers to get noticed by those brewers so that they would in turn supply us with free beer. At least we had a reasonable goal in mind. I will update that project as we go along.  The first part of the project was to scrap the data from the Beer Advocate. I had not started doing this because it was St Paddy's day, and I felt the proper way to study beer on that day is consumption. Others wrote code, and finished that portion of the project. I did come across this blog post on scrapping data in R with XML versus in Python with Beautiful Soup which I thought was interesting.

http://thelogcabin.wordpress.com/2010/08/31/using-xml-package-vs-beautifulsoup/