Your verification ID is: guDlT7MCuIOFFHSbB3jPFN5QLaQ Big Computing: Bryan Lewis's Vignette on IRLBA for SVD in R

Tuesday, May 31, 2011

Bryan Lewis's Vignette on IRLBA for SVD in R

The Implicitly Restarted Lanczos Bidiagonalization Algorithm (IRLBA) of Jim Baglama and Lothar Reichel is a state of the art method for computing a few singular vectors and corresponding singular values of huge matrices.

The IRLBA package is the R language implementation of the method. With it, you can compute partial SVDs and principal component analyses of very large scale data. The package works well with sparse matrices and with other matrix classes like those provided by the Bigmemory package.

In Video Vignette Link I have inserted below Bryan with a new microphone goes through an example using this package on the Netflix Prize data set (480K row by 18K columns). Competitions like the Netflix Prize and the Kaggle.com competitions have really brought powerful tools like SVD into greater use.

Video Vignette or IRLBA using the Netflix Prize data set.
Posted by at
Labels: , , , , , , ,

21 comments:

  1. shrinivasJune 1, 2011 at 4:16 AM

    How much time it took to find eigenvector matrices & what k(rank) you used for the same ?

    ReplyDelete
  2. NPHardJune 1, 2011 at 8:39 AM

    It is on one of the slides. On an old AMD Opteron Server it took about 120sec with nu=5 nv=5.

    Here is the documentation:
    www.rforge.net/src/contrib/Documentation/irlba.pdf

    ReplyDelete
  3. Adam@Perlengkapan BayiMay 15, 2012 at 4:29 AM

    I enjoyed reading it. I require to study more on this topic. Thanks for sharing a nice info..Any way I'm going to subscribe for your feed and I hope you post again soon.

    ReplyDelete
  4. Tomy@Rumah DijualMay 15, 2012 at 10:45 PM

    Very nice post. I just stumbled upon your blog and wanted to mention that I've truly enjoyed browsing your blog posts.

    ReplyDelete
  5. Pest ControlDecember 19, 2014 at 12:00 AM

    Nice post
    Anti Rayap
    parfum
    San Diego Hills
    Kanopi

    ReplyDelete
  6. iklan baris gratisMarch 5, 2015 at 8:03 PM

    It's really informative and useful for me.
    iklan gratis

    ReplyDelete
  7. SEO MelbourneApril 7, 2015 at 3:17 AM

    Great blog indeed!



    USA Property Investment

    ReplyDelete
  8. Predictive analyticsJune 1, 2015 at 5:35 PM

    Hey, thanks for that link! Is the IRLBA still relevant? I stumbled across this while looking for information about algorithms in financial services analytics solutions. Any thoughts on how this could apply?

    ReplyDelete
  9. NPHardJune 1, 2015 at 5:40 PM

    Yes, it is still very much relevant. In fact I believe more people are using it now than when I first posted the link.

    ReplyDelete
  10. farnandasDecember 17, 2015 at 6:41 PM

    Good Post

    ReplyDelete
  11. G9December 22, 2015 at 11:35 PM

    I just wanted to say thank you for sharing a great information and useful. I've read a lot of blogs and visit but they made me feel boring. Your article made me feel strange and fascinating it attracted me. I wanted to share this information with my friends on the social network facebook.!
    G9 , Dora games , Kizi new , Huz 2 , Kizi 2 , Friv 4 School , 85 Play , 4223 Games , 85 Games

    ReplyDelete
  12. Gps TrackingMay 7, 2016 at 12:23 AM

    Thanks for the info. In case when you traveling, you might need a GPS for your car or boat and even knowing your own location.

    ReplyDelete
  13. Yoob JuegosMay 10, 2016 at 4:56 AM

    Kizi
    Pou Games
    Dora games | K7x | Toon Games | Y8 | K6x

    ReplyDelete
  14. frivSeptember 4, 2016 at 10:04 PM

    Hello everybody. Thank so much and I like this. Juegos de Twizl , Friv 2019 , Kizi , Yoob

    ReplyDelete
  15. Friv 1000September 15, 2016 at 5:58 AM

    Juegos de Twizl | Twizl Juegos | Twizl

    ReplyDelete
  16. UnknownOctober 17, 2016 at 3:07 AM


    I wanted to thank you for this excellent read!! I definitely loved every little bit of it.Cheers for the info!!!! & This is the perfect blog for anyone who wants to know about this topic
    baixar facebook , baixar facebook gratis , facebook baixar

    ReplyDelete
  17. UnknownOctober 17, 2016 at 3:08 AM

    Easily, the article is actually the best topic on this registry related issue. I fit in with your conclusions and will eagerly look forward to your next updates. Just saying thanks will not just be sufficient, for the fantasti c lucidity in your writing. I will instantly grab your rss feed to stay informed of any updates.
    baixar whatsapp. baixar whatsapp gratis. whatsapp baixar

    ReplyDelete
  18. Friv 1000October 20, 2016 at 10:10 PM

    Please visit include. Thank so much.
    Kizi , Yoob , Y8 , Twizl

    ReplyDelete
  19. ngocanhNovember 27, 2016 at 10:14 PM

    Very interesting blog. Alot of blogs I see these days don't really provide anything that I'm interested in, but I'm most definately interested in this one
    wings.io l wingsio l wings io l wingsio game l play wingsio

    ReplyDelete
  20. Piyush PradhanJuly 12, 2018 at 5:26 AM

    http://playersheadquarters.com/

    ReplyDelete

Subscribe to: Post Comments (Atom)