Your verification ID is: guDlT7MCuIOFFHSbB3jPFN5QLaQ Big Computing: Bryan Lewis's Vignette on IRLBA for SVD in R

Tuesday, May 31, 2011

Bryan Lewis's Vignette on IRLBA for SVD in R

The Implicitly Restarted Lanczos Bidiagonalization Algorithm (IRLBA) of Jim Baglama and Lothar Reichel is a state of the art method for computing a few singular vectors and corresponding singular values of huge matrices.

The IRLBA package is the R language implementation of the method. With it, you can compute partial SVDs and principal component analyses of very large scale data. The package works well with sparse matrices and with other matrix classes like those provided by the Bigmemory package.

In Video Vignette Link I have inserted below Bryan with a new microphone goes through an example using this package on the Netflix Prize data set (480K row by 18K columns). Competitions like the Netflix Prize and the Kaggle.com competitions have really brought powerful tools like SVD into greater use.

Video Vignette or IRLBA using the Netflix Prize data set.

30 comments:

  1. How much time it took to find eigenvector matrices & what k(rank) you used for the same ?

    ReplyDelete
  2. It is on one of the slides. On an old AMD Opteron Server it took about 120sec with nu=5 nv=5.

    Here is the documentation:
    www.rforge.net/src/contrib/Documentation/irlba.pdf

    ReplyDelete
  3. I enjoyed reading it. I require to study more on this topic. Thanks for sharing a nice info..Any way I'm going to subscribe for your feed and I hope you post again soon.

    ReplyDelete
  4. Very nice post. I just stumbled upon your blog and wanted to mention that I've truly enjoyed browsing your blog posts.

    ReplyDelete
  5. Hey, thanks for that link! Is the IRLBA still relevant? I stumbled across this while looking for information about algorithms in financial services analytics solutions. Any thoughts on how this could apply?

    ReplyDelete
  6. Yes, it is still very much relevant. In fact I believe more people are using it now than when I first posted the link.

    ReplyDelete
  7. I just wanted to say thank you for sharing a great information and useful. I've read a lot of blogs and visit but they made me feel boring. Your article made me feel strange and fascinating it attracted me. I wanted to share this information with my friends on the social network facebook.!
    G9 , Dora games , Kizi new , Huz 2 , Kizi 2 , Friv 4 School , 85 Play , 4223 Games , 85 Games

    ReplyDelete
  8. Thanks for the info. In case when you traveling, you might need a GPS for your car or boat and even knowing your own location.

    ReplyDelete
  9. The blog or and best that is extremely useful to keep I can share the ideas
    of the future as this is really what I was looking for, I am very comfortable and pleased to come here. Thank you very much.
    earn to die 3
    Hi! I’ve been reading your blog for a while now and finally got the
    courage to go ahead and give youu a shout out from
    earn to die 6
    Austin Texas! Just wanted to tell
    earn to die 5
    Hi! I’ve been reading your blog for a while now and finally got the
    happy wheels
    strike force heroes
    slitherio
    you keep up the fantastic work!my weblog
    earn to die 5
    good game empire
    tank trouble 2
    earn to die new

    ReplyDelete
  10. Hello everybody. Thank so much and I like this. Juegos de Twizl , Friv 2019 , Kizi , Yoob

    ReplyDelete

  11. I wanted to thank you for this excellent read!! I definitely loved every little bit of it.Cheers for the info!!!! & This is the perfect blog for anyone who wants to know about this topic
    baixar facebook , baixar facebook gratis , facebook baixar

    ReplyDelete
  12. Easily, the article is actually the best topic on this registry related issue. I fit in with your conclusions and will eagerly look forward to your next updates. Just saying thanks will not just be sufficient, for the fantasti c lucidity in your writing. I will instantly grab your rss feed to stay informed of any updates.
    baixar whatsapp. baixar whatsapp gratis. whatsapp baixar

    ReplyDelete
  13. I think what you say on here is the best thing. Looking forward for our lives become increasingly more beautiful
    return man 2 game , return man 2 , return man

    ReplyDelete
  14. Just remember your stab at this business, should you decide to end it, is not a failure but a training ground. You will take with you what has worked and learned from what has not in order to make the next business idea a success!
    subway surfers game , subway surfer , subway surfers

    ReplyDelete
  15. Life becomes more interesting and wonderful when you share your memorable moments with friends and family through unique photographs. You can create your own unique style impressed with image editing software.
    square quick , download square quick , square quick app

    ReplyDelete
  16. The article gives me a lot of interesting information. I still often share life experiences with friends. And I enjoyed the convenience and attractiveness of free messaging app
    whatsapp baixar , baixar whatsapp , baixar whatsapp gratis

    ReplyDelete
  17. Facebook has become a part of my life, not only helped me to connect with you but also where I can share every moment in life. I really like the convenience that it brings
    facebook baixar , baixar facebook , baixar facebook gratis

    ReplyDelete
  18. Please visit include. Thank so much.
    Kizi , Yoob , Y8 , Twizl

    ReplyDelete
  19. I like your all post. You have done really good work. Thank you for the information you provide, it helped me a lot. I hope to have many more entries or so from you.
    lucky patcher l download lucky patcher l lucky patcher app l lucky patcher download l lucky patcher apk

    ReplyDelete
  20. Very interesting blog. Alot of blogs I see these days don't really provide anything that I'm interested in, but I'm most definately interested in this one
    wings.io l wingsio l wings io l wingsio game l play wingsio

    ReplyDelete
  21. I think there are many people like and visit it regularly, including me.I actually appreciate your own position and I will be sure to come back here.
    baixar sonic dash l download sonic dash l sonic dash baixar l sonic dash game l sonic dash download

    ReplyDelete