Future computers will use five senses

Tony Mwai

As people continue to push the boundaries of technology, computers are not just starting to process data by learning from how the human brain solves problems. Soon, they will experience the world the way people do, by using the five senses.

During the next five years, computers will rely on smell, touch, taste, sight, and sound as context and data points for analysing problems, producing new insights that will help people make smarter decisions, improve sustainability and productivity, and break down barriers, whether of distance or language.

Sight: A pixel will be worth a thousand words: It is nearly impossible to navigate the massive amounts of digital visual information being created today. But that will change. Because computers will soon be able to extract information, meaning, and context from videos, photos, and other digital images by using pattern recognition and being taught what to look for.

These systems will sift through huge amounts of data to draw insights, even allowing people to interact with them by, for instance, asking questions to get further explanation of the systems are seeing. This will enable computers to analyse and compare digital files of MRIs, CT, and X-ray images in order to diagnose health conditions or look at data streaming in from millions of municipal cameras and even crowdsourced images to monitor for public safety.

Hearing: Computers will hear what matters: Mass broadcasting will be a thing of the past. People will soon be able to personalise their experiences at games or concerts through multiple announcement systems. These systems will track, make sense of, and describe events on the field or at a show using sensors, including cameras and microphones. Then, using directional audio technology that can project a beam of sound so narrow that only one person can hear it, these system will direct commentary to each individual based on their interests.

Smell: Computers will have a sense of smell: It is common today for sensor systems to monitor various environmental conditions, such as humidity and temperature, to ensure that operations are running well. Soon, the sense of smell will play a role as well within these kinds of systems, tracking everything from hygiene to potential diseases.

My company, for instance, is partnering with healthcare organisations to put sensors in patients’ rooms that will sniff out chemical compounds on objects and people to determine if the rooms have been cleaned properly or if employees are washing their hands properly.

Touch: You will be able to touch through your phone: One of the hardest senses to replicate in an online world is touch. Yet, a great amount of good will be possible when it is perfected, whether helping families to stay in touch or enabling a surgeon to operate virtually.

The foundation for these advances already exist. Technology that use the variable frequency patterns of vibrations associated with various physical situations are included today in mobile devices and gaming devices to recreate the feeling of rolling over a rough surface.

Taste: Digital taste buds will help you to eat smarter: Computers are making huge leaps forward, moving from simply solving problems through if/then computations to actually drawing conclusions based on the observations they make. Yet, are computers capable of taking the next step and becoming creative?

IBM researchers are probing this question by test of a system that experiences flavour. This system will begin by breaking ingredients down to their molecular level.

For example, who would ever imagine that roasted chestnuts would pair well with foods such as cooked beetroot, fresh caviar, and dry-cured ham? The system will also be optimised to cater for diners’ personal preferences such as their likes and dislikes, diet restrictions and any food allergies, as well as constraints such as what local food is currently in season.

Mr Mwai is the country general manager of IBM East Africa.

PAYE Tax Calculator

Note: The results are not exact but very close to the actual.