3D Mapping

I’m sure you all remember a scene from the movie- Avatar, where the marines are seen gathering around a giant 3D map of Pandora to plot their invasion? Thanks to Zebra Imaging Inc, this technology is no longer restricted to sci-fi movies anymore. The company makes holographic maps that, according to the company, have been “utilized by the US military overseas for visualization and defense planning applications.”  But Zebra doesn't just make maps to help the Army blow stuff up in real life. They're also widely used for forensic investigations of accident sites, as well as for designing urban infrastructure and architecture.

According to Zebra's co-founder, Michael Klug -is that the company can laser-encode any kind of 3D imaging data, using technology such as Computer-Aided Design (CAD) for example, into a thin sheet of plastic that'll display the full-color image in three dimensions from any angle, under normal lighting.  Zebra Imaging Inc. claims this technology is intuitive, rugged, and,  for a reasonable price of $3500 for a 2' x 3' print -- actually kind of a steal, at least compared to a giant table-sized computer (that wouldn't even display in 3D anyway).

Mobile Spatial Interaction, What?!?

In recent times, there has been emerging trends and progress made in the field of Mobile Spatial Interaction (MSI).  Technological advances in this arena is a culmination of successful research in topics such as, spatial sensing, geo-referenced digital content, 3D environment modeling, and more importantly human-computer interaction.  MSI allows users to interact with their physical, natural, and urban surroundings via the use of sensor-rich mobile devices. Even though there have been significant progress made in enabling MSI through improvements in gesture interface, remote sensing expertise, and enhancements in empirical knowledge on this topic, obstacles still remain on the path to mass commercial usage of this concept.  Mobile Spatial Interaction (MSI) has been evolving relatively faster than any other cutting edge technology that impacts human-computer interaction.  MSI in all its avatars possess certain strengths, weaknesses, and provide endless opportunities to push the innovation barrier further out.  MSI and the various mobile applications/devices that facilitate this concept/technology have endless possibilities.

Developers and mobile device manufacturers alike have recognized that the portability and web connectivity features on a mobile device provide MSI enablers (i.e. geo-referenced digital content, spatial sensing etc.) the means to function.  Currently, the various interaction paradigms that are available for functional use can be exemplified through technologies known as 1) Magic Wand, 2) Smart Lens, 3) Virtual Peephole, and 4) Sixth Sense (Peter Frohlich, 2011).  These technologies allow users to interact with the physical object they are curious about and the swaths of data about it, which are embedded in linked databases and wikis through their web-enabled mobile devices.  These technologies afford users the convenience of instant access to information about physical objects they are interested in without having to type a word or, a query prompt.  For example, one can click a picture of a historical monument, such as the Leaning tower of Pisa and without any further exertion; rely on an MSI technology, such as the Magic Wand to point a mobile device at a historical building and obtain information about it.  Ideally, MSI can reduce the need for any computing equipment that is bigger than the size of ones palm, but, still provide the same level of access to information a regular desk top with a fast CPU and internet connection can.

There are of course challenges to implementing these MSI enabled technologies and maintaining the back-end database that supports the front-end interface.  The information to be stored in a backend databases need to be continuously updated to provide accurate and detailed information about a target object.  In addition, the task of linking objects to pertinent information can be overwhelming due to the sheer number of physical objects that might draw a general user’s interest.  Storing information about the leaning tower of Pisa is one thing, and it is totally something else to research, gather and store information about one of the many gargoyles perched up on a steeple in Prague, Czech Republic!  A whole different set of challenges are around the mobile devices that are manufactured.  Not all mobile phones are created equal; the technology to swipe through the GUI on a device can enable an MSI technology better (think iPhone) than one that only offers a keypad (think Blackberry).

More importantly, as the concept and technology around mobile spatial interaction is further developed, advances in various aspects of human-computer interaction can be combined to enable mobile devices to accomplish far more tasks in terms of managing our tasks, email, and calendars.  We have already seen examples of applications in the market today that can assist us in typing documents using voice recognition software (e.g. Dragon Diction), and we have also seen applications that can extract information from pictures taken by our phone-cameras and convert to text.  These are all examples of interactions we have with our computers and the physical world every day.  If these technologies were combined, synthesized, and/or further developed into a standard method of interacting with both computer processors and physical objects around us, there would be less and less dependence on other resources within our organizations.  We could all then be an “army of one”; in the corporate jungle, of course!

Emotion Through Motion Detection

Today, more than anything else, the security apparatus of our nation is concerned over implementing impenetrable security measures at major airports to protect the flying public.  To that measure, government agencies, such as the TSA have implemented a variety of tools, mechanisms, and procedures to proactively detect threats, and mitigate any potential risks associated with mal-intent by rouge agents and terrorists.  To aid in that initiative, National Science Foundation (NSF) among other government and quasi-government organizations have dedicated intellectual resources to develop and/or leverage technology to deploy safeguards from such threats.  One such example is, NSF’s partnership with Christoph Bregler and his team of research fellows from New York University.  Chris Bregler and his team have been working on deploying the technology behind motion detection, primarily used in developing video games and animation, to detect human emotions.

Developers use special body suits with hundreds of embedded sensors in capturing body part movements to replicate them into character movements in developing video games.  Invisible to the human eye, ‘green dots’ disseminated from those motion detection sensors are read by programs give the video game characters a reference to reality.   Mr. Bregler and his team of scientists are using those ‘green dots’ to analyze the movement and intensity of facial expressions, jaw movement, the blinking and shifting of eyes and lips to interpret emotions.   The difference is that instead of relying on special body suits or technical appendages, Mr. Bregler and his team can use the program they have developed to apply it on to video footage to measure and translate facial expressions to correlate to human emotions.  To test this program out, they have taken video footage of past speeches from Fidel Castro, JFK, President Obama, and other world leaders to measure the intensity of their facial expressions and jaw line movement to relate it to their moods for those given circumstances.  Now, one might ask, why is this important in the fight against terrorism?  Actually, the answer is quite simple – this technology can assist and supplement existing mechanisms to proactively detect the most concealed weapon- intention to cause harm.  If law enforcement officials can scan individuals and their facial expressions and speech by analyzing a video footage to derive meaning, they are that much more capable of thwarting imminent threats.