Multimedia

Motor cortical neuronal activity ( WMV | M4V )

This movie shows hand kinematics (both 3D translation and 1D rotation in the frontal plane) and spike times (audio) for a neuron in the primary motor cortex. The subject controlled the movement of the virtual cursor (orange) and performed a center-out with rotation task in a virtual reality simulator while the activity of this motor cortical neuron is being recorded with an intracortical microelectrode. This neuron demonstrates tuning to both hand translation and rotation; these two types of movements interact with each other non-linearly, where hand rotation direction modulates hand translational tuning curves in a gain field fashion.

MEG recording of cortical activity ( WMV | M4V )

This movie shows spatial and temopral pattern of cortical activity recorded with a whole-head 306-channel MEG (magnetoencephalography) system (Elekta Neuromag) during a simple wrist movement task. The visual cortex is activated first, followed by the parietal and motor areas.

ECoG recording of cortical activity #1 ( WMV | M4V )

This movie shows the spatiotemporal pattern of the high frequency band activity (60-120Hz) in ECoG (subdural electrocorticography) signals across an ECoG grid covering the frontal, temporal and part of parietal lobes while the subject performed a simple speech task (number counting). Both the mouth and Broca's area (bottom portion of the grid) show task-related activity.

ECoG recording of cortical activity #2 ( WMV | M4V )

This movie shows the spatiotemporal pattern of the high frequency band activity (60-120Hz) in ECoG signals across a grid covering the frontal, temporal and part of parietal lobes while the subject performed a simple hand movement task (squeezing a ball). Data were recorded from the same subject as the previous movie, but now the hand area of the motor cortex (top-right) shows task-related activity.

Mirror-neuron-like activity captured with ECoG ( WMV | M4V )

This movie shows mirror-neuron-like cortical activity captured by a high-density ECoG grid implanted over the premotor and motor cortical areas. The subject was either executing or observing grasping and pinching movements of the hand. The spatiotemporal patterns of cortical activity (60-120 Hz band activity) are very similar between action execution and action observation. The human mirror-neuron system plays a critical role in action understanding, motor learning, motor imitation, and social skills.

Brain-control of cursor movement using ECoG signals ( WMV | M4V )

This movie shows real-time control of a computer cursor (moving up and down) using one ECoG channel. The subject achieved reliable control of the cursor movement within the first brain-control training session (30 min). The left panels show the power spectrum of ECoG signals and the control signals derived from ECoG recording, while the right panel shows the corresponding cursor movement.

Offline brain-control of wheelchair movement using ECoG signals ( WMV | M4V )

This movie demonstrates the feasibility of using ECoG-based brain-computer interface devices to navigator a wheelchair in a virtual reality environment.

Playing Super Mario World using brain activity ( WMV | M4V )

A subject playing Super Mario World (Super Nintendo Entertainment System) using brain activity recorded from an ECoG electrode. Here, the subject commands the "jump" command using brain activity, while the left/right movement of the video game character is controlled by the experimenter.

Playing a custom flash game using brain activity ( WMV | M4V )

This subject was playing a simple custom-made flash game ("Birdboy") using brain activity recorded from an ECoG electrode. The subject was able to move the video game character up and down to avoid obstacles and collect rewards.