You have stumbled on our little corner of the Internet - we have a so much time, so little to do - strike that, reverse it. Stick with us, and we'll make the future an awesome place to hang out. Learn more about Florida Creatives

Florida Creatives Happy Hour, 3rd Mondays @ Crooked Bayou
Likemind Orlando, 3rd Fridays @ Drunken Monkey

Hosted by Xentek
Created with Drupal

Computers can make pictures from your brain using YouTube

1 BookmarksLog in to bookmark

Reconstruction from brain activity

The left clip is a segment of a Hollywood movie trailed that the subject viewed while in the magnet. The right clip shows the reconstruction of this segment from brain activity measured using fMRI. The procedure is as follows:

  1. Record brain activity while the subject watches several hours of movie trailers.
  2. Build dictionaries (regression model) to translate between the shapes, edges and motion in the movies and measured brain activity. A separate dictionary is constructed for each of several thousand points in the brain at which brain activity was measured.
  3. Record brain activity to a new set of movie trailers that will be used to test the quality of the dictionaries and reconstructions.
  4. Build a random library of ~18,000,000 seconds of video downloaded at random from YouTube (that have no overlap with the movies subjects saw in the magnet). Put each of these clips through the dictionaries to generate predictions of brain activity. Select the 100 clips whose predicted activity is most similar to the observed brain activity. Average those clips together. This is the reconstruction.
For a related video see: http://www.youtube.com/watch?v=KMA23JJ1M1o
For the paper (Nishimoto et al., 2011, Current Biology) go to:http://dx.doi.org/10.1016/j.cub.2011.08.031
For more information about this work, please check our lab web site:http://gallantlab.org

 

 

Groups:
Syndicate content

Robotics, Microcontrollers and Makers

  • You must login in order to post into this group.

Group notifications

This group offers an RSS feed. Or subscribe to these personalized, sitewide feeds:

Paying the Server Bill