Aiding the Blind: Kinecthesia - Oct 2011 - YouTube

Two Students from the University of Pennsylvania have modified a Kinect to help the vision impaired to become more aware of their environment. The project is called Kinecthesia and functions as a radar-like device, but instead of using sound, the device uses the Kinect's cameras to map out the environment and translate it into a sensation the blind can understand.

Eric Berdinis and Jeff Kiske, juniors of the University of Pennsylvania majoring in Computer Engineering, has garnered attention in the 2011 Google's Zeitergeist Young Minds Conference with their application of the gaming peripheral. The project was born from both student's final project for Rahul Mangharam's embedded systems class. The resulting device can be likened to a high-tech walking cane.

The Kinect is a motion detecting gaming peripheral produced by Microsoft. The device is used for the Xbox 360 which can interpret specific gestures and track movement of individuals or objects. The device is composed of an RGB camera, an infrared sensor acting as a depth sensor and multiple-array microphone. It can perform facial recognition, voice recognition and gesture recognition.

Using the Kinect's multiple cameras, Berdinis and Kiske have made a harness that produces vibrations to notify the wearer of coming obstacles. The Kinect is connected to a BeagleBoard, a whole computer in a single board, and fitted in a waistband or belt. The device is ran in Linux and 16 AAA batteries. Since it was still in development the device is not made to run for hours. There are six vibrating motors to guide the user and weighs 1349g as of now.

There are already a number of people hacking their Kinect devices for other applications besides gaming like 3D modeling, controlling robots and using motion capture to automate devices, augment reality, and even produce a low-budget CGIs for amateur movies. Remember the movie Total Recall with the virtual wife? It would be a surprise if no one made one already. The Kinect has made motion capture reachable to consumers and they are very much willing to experiment.

It is great that people are experimenting and applying on technologies readily available for them. Will this open doors on new innovators? Does Microsoft see a new market for their devices?

The project's development can be tracked on their own website at kinecthesia.com. The website also contains the project source code, parts list and assembly instructions.

Disability Robotic Aid: Cyberdyne's HAL (Hybrid Assistive Limb)

At University of Tsukuba, Yoshiyuki Sankai, professor of Cybernics, unveils a robot suit entitled HAL (Hybrid Assistive Limb), with a 60kg anti radiation jacket, in Tsukuba city, Ibaraki prefecture.

HAL robot suits, developed by Cyberdyne, detect signals from the brain to assist in the wearer's movement, and were developed for disabled and handicaped people.

Picture: YOSHIKAZU TSUNO/AFP/Getty Images

Functional Description
"When a person attempts to move, nerve signals are sent from the brain to the muscles via motoneuron, moving the musculoskeletal system as a consequence.

At this moment, very weak bio-signals can be detected on the surface of the skin. "HAL" catches these signals through a sensor attached on the skin of the wearer.

Based on the signals obtained, the power unit is controlled to move the joint unitedly with the wearer's muscle movement, enabling to support the wearer's daily activities.

This is what we call a 'voluntary control system' that provides movement interpreting the wearer's intention from the biosignals in advance of the actual movement.

Not only a 'voluntary control system' "HAL" has, but also a 'robotic autonomous control system' that provides human-like movement based on a robotic system which integrally work together with the 'autonomous control system'.

"HAL" is the world's first cyborg-type robot controlled by this unique Hybrid System."

Watch the video below to see it in action.

"Bionic" leg anticipates the wearer's moves

It was not a good day for 16 year old Craig Hutto. On June 27, 2005, wading in crystal clear waters off a near-deserted beach 50 miles south of Panama City, Craig was attacked by an 8-foot bull shark and lost his right leg from above the knee.

Today Hutto is a 6-foot 4-inch 23 year old studying Nursing at Middle Tennessee State. Fortunately for him, Nashville is also the home of Vanderbilt University where its Center for Intelligent Mechatronics has for seven years been developing an advanced prosthetic limb. They also happened to need a Lab Assistant to help them test it.

Professor Michael Goldfarb and his team are on the seventh iteration of a limb that combines a low weight (9lbs / 4 kg) aluminum alloy construction with embedded processors and powerful motorized knee and ankle joints.

A rechargeable battery provides enough power for three days or 8 miles (14 km). A wide array of sensors monitor the leg's position and movement and the on-board software tries to anticipate the wearer's needs when sitting, standing, walking etc.

A "stumble" routine for instance will try to lift the leg high to clear the obstacle and then plant it for stability.

This anticipation means the leg operates much more like a real limb which allows the wearer to walk with a normal gait, even up and down stairs or across uneven terrain. See the video below.

"Going up and down slopes is one of the hardest things to do with a conventional leg," said Hutto.

"So I have to be conscious of where I go because I can get very tired walking up and down slopes. But that won't be a problem with the powered leg because it goes up and down slopes almost like a natural leg."

Getting the Assistant position at Vanderbilt helped Hutto to pay his way through college but also allowed him to contribute to the development of an intelligent prosthetic limb that will greatly help many people that find themselves in his predicament.

The Vanderbuilt University Center for Intelligent Mechatronics is also developing an anthropomorphic prosthetic arm project and an advanced exoskeleton to aid in physical therapy.

Why hearing aids fail

Hearing aids have improved greatly over recent years, but they continue to be a surprisingly frustrating experience for new wearers.

Clearly, today’s hearing aids are tiny, nearly invisible in fact, and they amplify sound and are able to present a higher range of frequencies, but they have not yet completely solved the problem of amplifying the peripheral sounds we just don’t want, or don't need to hear.

For new wearers the crumpling of a paper bag on the other side of a room can sound like a jackhammer.

This is a huge challenge for technology because it is dependent on how the brain perceives sound and how we have learned to filter peripheral sound out of normal hearing. Andrew J. Oxenham is a psychologist and hearing expert at the University of Minnesota and an expert in psychoacoustics.

Oxenham explains: The ear works by analysing sound and breaking it into different frequencies and with many forms of hearing impairment it’s this frequency selectivity that is impaired.

What that means is that the ear doesn’t filter as well as it did before. So instead of having very sharp tuning to filter out different frequencies the filtering becomes much broader and there is no real way of compensating for that.

You can’t sharpen the filters or you can’t pre-process sound so it’s sharp. It’s like a broken TV set. You can process the signal going into the TV as much as you like but you still won’t get a clear picture of the output.

Recent hearing aids have made a lot of progress, like being able to present frequencies of up to 6000 Hz as opposed to limited frequencies up to about 4000 Hz, by using digital signal processing, and a lot more computing power on a lot smaller chip.

Another big leap forward has been made with directional hearing. They can focus the microphones toward the front and filter out a lot of the sound coming from the side and back. And although that is a fairly simple technique, it involves signal processing that wasn’t possible with earlier hearing aids.

Ambient or peripheral sound is horribly distracting for hearing aid wearers. A paper bag being crumpled across a room sounds screechingly loud.

This is common complaint of people who recently start wearing a hearing aid. Their hearing has deteriorated, often without them being completely aware of it, over a period of time.

When they are suddenly fitted with a hearing aid, they hear sounds they’ve got used to not hearing. The sounds are suddenly annoying and distracting. It’s a contrast effect.

It’s more to do with perception i.e the brain’s ability to analyse and prioritise different sounds.

It’s a complex interaction between the ear and the brain. The ear sends signals up to the brain; the brain does an awful lot of processing on top of that; then sends signals back down to the ear. These signals change the way the ear accepts input.

This is partly why hearing aids are not perfect because the hearing aid is not part of that natural feedback loop. There’s no way with current aids that the brain can interface with a hearing aid directly to change its characteristics.

Hearing Loops
To deal with background noise there are things called “hearing loops.”

These are systems that are set up within places like concert halls and churches that interface directly with the hearing aid. It’s like sending a radio signal to the hearing device.

The idea is that this hearing loop picks up the sound directly from the microphone in front of a speaker.

If you are in a conference and the speaker is talking into a microphone. Normally we hear the sound acoustically through the airwaves.

If you are wearing a regular hearing aid the microphone will pick up the sounds on the airwaves but that is together with all the background noise and reverberation in the room.

With a hearing loop it sends the signal directly from the microphone to the ear and bypasses all the acoustics in the building itself. So the ear is getting a much better, clearer and cleaner signal of what’s coming into the microphone.

Two hearing aids better than One?
It’s only recently that people have routinely been fitted with two hearing aids. Often people only got one.

Directional hearing and the way we localise sound: To know where the sound is coming from the brain compares the signals coming into the two ears. So if it’s slightly louder on one side then the brain knows the sound is coming from that side.

More importantly it’s the time of arrival difference between the two ears. If you think about a sound coming from the right. The sound will reach your right ear a little bit before it reaches your left ear.

Although we are talking about millionths of seconds, your brain needs two ears to make a distinction. If you only have one you lose that ability to localise sound and tell which direction it is coming from.

It’s also an important part of filtering out sound and noise. The brain can determine if there is speech right in front and background noise in back of and to the side. The brain can use those differences in localisation to help to make the speech more intelligible.

So the biggest technical challenge is developing hearing aids that can focus on what we really need and want to listen to. This is the current problem.

The Solution
We are hoping through even more sophisticated signal processing schemes that we’ll be able to work on artificial source segregation; i.e. analysing the signal that is coming in and figuring out what is speech and what isn’t, and only presenting to the ear the wanted signal.

Distinguishing between speech and noise
The assumption is that what you really want to listen to is speech, and so there are certain acoustical aspects of speech that we can recognise and there are certain acoustical aspects of noise that are different from speech.

So, we need to establish a suitable algorithm to be able to distinguish between speech and noise that will help you towards filtering the unwanted signal.

A more complete solutiion could mean that brain-computer interface may be part of the hearing aid systems of the future. Where the hearing aid is tapping into brain responses to pick up the specific signal the person wants to pay attention to.

This is an ongoing process with incremental steps and we will continue to see improvements over the next 15 years.

Disabled Patients Thinking With Robots

Researchers have invented a new, noninvasive method for recording patterns of brain activity and using them to steer a robot.

Scientists hope the technology will give "locked in" patients—those too disabled to communicate with the outside world—the ability to interact with others and even give the illusion of being physically present, or "telepresent," with friends and family.

Previous brain-machine interface systems have made it possible for people to control robots, cursors, or prosthetics with conscious thought, but they often take a lot of effort and concentration, says José del R. Millán, a biomedical engineer at the École Polytechnique Fédérale de Lausanne (EPFL) in Switzerland who develops brain-machine interface systems that don't need to be implanted into the brain.

Millán's goal is to make control as easy as driving a car on a highway. A partially autonomous robot would allow a user to stop concentrating on tasks that he or she would normally do subconsciously, such as following a person or avoiding running into walls. But if the robot encounters an unexpected event and needs to make a split-second decision, the user's thoughts can override the robot's artificial intelligence.

To test their technology, Millán and colleagues created a telepresent robot by modifying a commercially available bot called Robotino. The robot looks a bit like a platform on three wheels, and it can avoid obstacles on its own using infrared sensors.

On top of the robot, the researchers placed a laptop running Skype, a voice and video Internet chat system, over a wireless Internet connection. This allowed the human controller to see where the robot was going, and, because the laptop also showed a video of the user, it allowed others to interact with the user as though the user were actually there.

The user also wore a cap of tiny electroencephalogram (EEG) electrodes, which measured his or her brain activity. This system translates the EEG signals into navigation instructions and transmits them in real time to the robot.

EEG patterns for movement and navigation are similar from person to person, and Millán's group has previously demonstrated that after a little practice, a healthy person can share control with the robot with very little effort. But would a bed-bound patient, who hasn't used his limbs for years, have the same pattern of brain waves and be able to control robots as effectively?

The researchers recruited two patients whose lower bodies were paralyzed and who had been bed bound for 6 or 7 years.

The researchers trained the patients to control the robot for 1 hour per week for 6 weeks. With the instructions being transmitted over a wireless connection, the patients didn't need to leave the hospital and were able to control the robot in Millán's lab at EPFL, 100 kilometers away.

At the end of the training period, the researchers instructed the subjects to drive the robot to various targets, such as furniture, people, and small objects, around the lab for 12 minutes.

The disabled patients performed just as well as healthy subjects, Millán and colleagues report this week at the IEEE Engineering in Medicine and Biology Society conference in Boston.

When the researchers turned the shared control off, forcing the subjects to constantly concentrate on controlling the robot, the subjects took considerably longer to navigate the maze than when they shared control.

Millán says he wasn't terribly surprised that disabled people could control the robot, as previous research using brain scans has shown that even patients who have been paralyzed since birth can still imagine moving their limbs. But he was surprised how fast they learned.

He is now hoping to involve more bed-bound patients, including locked-in patients in the study. He also sees future applications for the shared control brain-machine interface, such as modifying it to let a user control a prosthetic limb or a wheelchair. And the researchers may eventually add an arm to the current telepresent robot to allow it to grasp objects.

U.S soldiers in Afghanistan develop simple prosthetic leg using local resources

While we've covered many developments in the field of prosthetics, such high-tech advances are beyond the reach of those in the developing world where the rates of amputation due to war are highest.

Now U.S. Army soldiers stationed in Afghanistan have developed a simple prototype prosthetic leg that can be constructed using local resources to allow the victims of improvised explosive devices (IEDs) and land mines to get back on their feet quickly and cheaply.

Although he says he could have contacted a charity in the U.S. to get high-quality prosthetic limbs for a handful of victims near Forward Operating Base Pasab, Afghanistan, Dr. (Maj.) Brian Egloff, brigade surgeon, Headquarters and Headquarters Company, 3rd Brigade Combat Team, said it would only have been a temporary solution and so he and his colleagues set about finding an enduring design for a prosthetic leg.

The result was a prototype consisting of a simple cast attached to a metal rod with a flat hooked foot. The cast can be fitted in as little as a day and can be recast to accommodate the growth of the wearer. The metal rod and flat hook can be easily reproduced and allow the patient to walk more naturally.

An eight-year-old boy who lost both legs after stepping on a land mine and needed to be carried around on his father's back received the first prototype leg on June 26, 2011.

"It helped knowing that the leg was for a small 8-year-old boy who was happy all the time - despite his situation," said Warrant Officer Brian Terry, 710th Brigade Support Battalion, 3rd BCT, who constructed the prototype.

"This patient and people like him have no mobility whatsoever," added Egloff. "It's all about increasing mobility and allowing them to live a more productive lives."

Terry said the next step is for the Afghan doctors in this region to make their own prosthetics and to train them how to instruct victims on the use of the leg.

First Aid | Epilepsy Scotland

Simple Partial Seizures

A simple partial seizure could affect the person's movement, smell, taste, hearing, sight, breathing, heart beat, digestion or any mixture of these. They may experience, for example, twitching of an arm and nausea. The person does not lose consciousness and is fully aware of, but cannot control, what is happening.

What to do

• Stay with the person and offer reassurance until the seizure has passed
• Sometimes a simple partial seizure can act as a warning or 'aura' that a second seizure (usually a tonic-clonic or a complex partial seizure) will soon start.
• If this is the case, the person may need help in getting to a quiet and safe place.

Complex Partial Seizures

The person may experience strange or unusual feelings, lose their sense of time and appear distant from who and what is happening around them. This type of seizure can make someone behave in an odd, random or inappropriate way, such as lip smacking, plucking at clothes, moving aimlessly or compulsively around a room. Unlike simple partial seizures, there will be some loss or alteration of consciousness.

What to do

• Gently lead them from any source of danger
• Do not restrain or interfere unnecessarily with the person
• The seizure should be allowed to run its natural course
• Speaking softly and calmly may help
• Offer reassurance afterwards

Absence Seizures (previously known as petit mal)

Absence seizures consist of a brief loss of consciousness and are easily mistaken for daydreaming. The person (usually a child) stops what they are doing, remains motionless, blinks, and stares into space. Soon, the person will recover and may not be aware that a seizure has occurred.

What to do

• Absence seizures are usually very brief and often pass unnoticed
• If you witness an absence seizure stay with the person for a while to make sure they do not suffer any injury
• Tell the person what has happened
• If a child is in the classroom, repeat any information they have missed

Tonic-clonic seizures (previously known as grand mal)

The tonic-clonic seizure is the most widely recognised seizure. The person will lose consciousness and fall to the ground.


The person will stiffen (the tonic phase) and then jerk (the clonic phase).
Breathing may become irregular and as a result the person could turn slightly blue. The person may also make grunting noises, bite their tongue or cheek, or be incontinent.

After a couple of minutes the jerking normally stops and the person will slowly regain consciousness. They may feel groggy, sleepy and confused for some time afterwards and have a headache or aching limbs. How long it takes to feel ok again varies from one person to the next.

What to do

• Keep calm and note the time the seizure starts and how long it lasts
• Clear a space around the person and prevent people from crowding round
• Cushion the person's head with whatever is available
• Loosen any tight clothing round the neck and gently remove glasses (if worn)
• Watch the seizure carefully and if possible let it run its natural course
• Turn the person into the recovery position as soon as the jerking stops
• Be reassuring during the recovery period and tell the person about the seizure
• Stay, if possible, until the person is no longer confused

What not to do

• Do not try to lift or move the person while the seizure is happening unless there is an immediate danger (e.g. they are on a busy road, at the top of stairs, at the edge of water, near a fire or hot radiator)
• Do not try to stop the jerking or restrain the person
• Do not put anything in the person's mouth or between their teeth
• Do not offer the person something to drink until they are fully conscious
• Do not fuss around the person while they are recovering from the seizure

There is no need to call an ambulance unless:

• It is the person’s first seizure
• One seizure follows another without any recovery in between
• The convulsive or jerking part of the seizure lasts more than 5 minutes or longer than is usual for the person
• The person has been badly injured

First Aid | Epilepsy Scotland

Toyota develop Brain-Operated Wheelchair