01-02-10
Machine Translates Thoughts Into Speech
A brain wave study presented at the 2009 annual meeting of the American Epilepsy Society shows that people with electrodes in their brains can “type” (input data into a computer) using just their minds. Neurologist Jerry Shih, M.D. Shih and other Mayo Clinic researchers worked with Dean Krusienski, Ph.D., from the University of North Florida in an experiment involving two patients with epilepsy. Both patients were already being monitored for seizure activity using electrocorticography (ECoG), in which a sheet of electrodes is laid directly on the surface of the brain. This procedure requires a craniotomy, a surgical incision into the skull. Dr. Shih and colleagues hypothesized that feedback from electrodes placed directly on the brain would be much more specific than data collected with EEG (electroencephalography) alone, in which electrodes are placed on the scalp. Most studies of mind-machine interaction have occurred with EEG. “There is a big difference in the quality of information you get from ECoG compared to EEG. The scalp and bony skull diffuses and distorts the signal, rather like how the Earth’s atmosphere blurs the light from stars,” says Dr. Shih. “That’s why progress to date on developing these kinds of mind interfaces has been slow.”
Dr. Shih’s patients at the Mayo Clinic were asked to look at a computer screen containing a 6-by-6 matrix with a single alphanumeric character inside each square. Every time the square with a certain letter flashed, the patient focused on it and a computer application recorded the brain’s response to the flashing letter. The computer software calibrated the system with the individual patient’s specific brain wave patterns. When the patient then focused on a letter, the letter appeared on the screen. “We were able to consistently predict the desired letters for our patients at or near 100 percent accuracy,” Shih explains. “While this is comparable to other researchers’ results with EEGs, this approach is more localized and can potentially provide a faster communication rate.”
In addition to the ability to “mind read” vowels, consonants, and individual letters, brain wave applications also include algorithms to turn brain waves into music and even “tweeting” (using the popular Twitter Internet application) by thought alone. Brain music therapy is a form of neurofeedback using EEG based on a variable ratio of fast and slow rhythms –- it can be used to turn a person’s brain waves into music notes using a computerized mathematical formula. Dr. Galina Mindlin, a neuropsychiatrist with the Brain Music Therapy Center in New York City brought this to the U.S. from Moscow in 2006 as a form of entrainment therapy. Interviewed on NBC’s Today Show, she said, “Brain waves are translated into music digitally with a special algorithm. Once the brain waves are converted into musical sounds, they are placed on a CD with a relaxing file and activating file and instructions on how to use them.” What does this mind-machine interface sound like? “It sounds like classical piano music,” says Dr. Mindlin. Here’s a video showing the use of an EEG mind-machine interface to control sampled sound clips on a piano:
Article From: By Thought Alone: Mind Over Keyboard via H+ Magazine