4/04/2013

20x performance for the same HW price: GPGPU-based Machine Learning at Yandex

Russian search-engine Yandex has disclosed some details about their machine-learning framework, FML. The most interesting detail is that it runs on 80 TFLOPS cluster powered by GPGPU. This is quite unusual application for GPU, as ML algorithms are usually hard to be paralleled. However they have managed to adapt their decision tree algorithm for high-level of parallelism. As a result Yandex has achieved more than 20x speed-up for the same hardware price.
They are going to upgrade their cluster to 300 TFLOPS. Yandex expects its cluster to be in the list of top 100 most powerful supercomputers in the world after that upgrade.
Posted by at
Labels: , ,

2 comments:

  1. Unknown5/09/2013 05:06:00 AM

    Can you give out Difference's whats the benefit we will get for Complete Online Video Transcoding usign GPGPU hardware you are referring. Also

    ReplyDelete
    Replies
    1. Victor Haydin5/15/2013 11:04:00 AM

      Hi, Eric

      In general, you can get quite a good performance of video transcoding on GPGPU, sometimes much better than on CPU. But it all depends on details of your particular task: what kind of video do you want to transcode, what are the source and target codecs and so on. Should you provide us with more details I will be happy to answer all your questions. Please don't hesitate to contact me via e-mail: victor.haydin@eleks.com

      Thank you,
      Victor.

      Delete

Note: Only a member of this blog may post a comment.

Subscribe to: Post Comments (Atom)