Virtual 16-inch display projects into eye

The AirScouter wearable display from Brother is a prototype Retinal Imaging Display that mounts on a pair of glasses and projects fast-moving light that ‘paints’ an image directly onto the retina, making the viewer see a virtual 16-inch display with 800 by 600 resolution.

[The design does seem to beg the question of why not project a floating image on the glasses, rather than use glasses to project directly onto the eye?]

For the display, printer-maker Brother used optical system technologies developed for its laser and inkjet printers.

It will first be aimed at industrial uses in Japan, and later brought to consumer augmented reality.

The translated press release is here.

Skyhook adds location to Layar

Augmented reality browser platform Layar is improving its Android application’s  location results with Skyhook’s “Core Engine.”

Layar displays information on a phone’s display, overlaying the real-time camera view.

“Because the purpose of Layar is to only show content within a user’s immediate surroundings, precise location is critical for our app,” the company says. “The Skyhook SDK provided greatly improved accuracy and speed over the native Android platform.”

Skyhook says its geo-location technology fulfills “hundreds of millions of location requests every day across millions of handsets, netbooks and cameras.” Skyhook’s location system uses a combination of Wi-Fi, cellular and GPS readings to produce a single, accurate location quickly and in all environments.

Nokia developing 3D photo-realistic maps

Nokia’s Navteq mapping division in Finland is producing three-dimensional computer models for a full 3D rendering of locations and environments — one that it says will appear more realistic than Google’s current Street View.

Street View simulates a 3D experience from 2D photos. In Nokia’s system, 3D models are constructed with the radar-like laser system called lidar, over which photographs are projected. The result is a smoothly traversable 3D cityscape, New Scientist reports.

Panasonic Tabi Nabi — non-phone based mobile augmented reality

Panasonic's Tabi Navi delivers AR to pedestrians.

While most mobile augmented reality services are aimed at the camera phone — a display, processor, camera, and connectivity already in the user’s hand — Panasonic is attempting a stand-alone device aimed at tourists in Japan.

The CN-SG500 “Tabi Nabi” (“journey navigation”) is a handheld GPS unit with a 2 megapixel camera and a 5-inch touchscreen. Aim the camera at a landmark, and the screen displays the names of and distances to tourist spots and landmarks, and explains tourist spots.

The approximately $700 device will be available in Japan next month, targeted at travelers who are 50 and older and enjoy walking around towns.

Driving with Augmented Reality

An iPhone screen alerts drivers to on-road obstacles.

A new iPhone App for using augmented reality while driving detects obstacles in real time.

imaGinyze’s Augmented Driving uses the phone’s camera to view the road ahead, and then detect obstacles, warning the driver of any potential hazards with voice notifications.

“Are you often driving on highways or country roads?” the company asks. “Then you do not want to miss the impressive technology of Augmented Driving with real-time object detection with up to 10 frames per second.”

The $3 app offers augmented reality overlays for lanes and vehicles; lane detection and lane change warning; and vehicle detection and low distance information.

There are a lot of caveats here, however. First, the company admits. “the iPhone is a mobile phone, not specifically designed for this kind of application… So, some compromises regarding the final functionality had to be made due to the limited processing power.”

imaGinyze says in optimum conditions “accuracy is expected to be 10-15 percent for lane width, in-lane position and vehicle distance. However, due to the low frame-rate fast changes in the scene are only detected with a certain delay. Hence, the system is not suited for dynamic driving maneuvers. If your observed accuracy of the lane width is permanently significantly higher, you should re-check the mounting height and the orientation of your device.”

Spyglass AR app uses iPhone gyroscope

The Spyglass 3 app is billed as a “fun-to-use multi-function augmented reality tool and heads-up display” with compass, GPS, and other information overlaid atop the live feed from the built-in camera, “turning the iPhone into a location-aware viewfinder.”

The $2 app now works with the gyroscope in the iPhone 4.

Navigating with Spyglass has become easier, adds developer Happymagenta, with enlarged target pointers, constantly displayed distance to the current destination, and audible feedback that beeps upon moving closer to the target.

Located in Minsk, Belarus, Russia, Happymagenta is a privately-held company founded in 2006.

“Virtual dressing room” augments Seventeen.com

metaio adds new outfits to a webcam image.

An augmented reality online shopping application billed as a “virtual dressing room” lets teens “try on” clothes that automatically overlay their real-time video image through their webcam.

Hearst Magazines Digital Media and augmented reality application developer metaio say it is “the first instant online dressing room, where the fitting of the clothing happens automatically and within the live-video stream.”

Shoppers at the Seventeen.com website do not need a marker or an upload of a still image. They can try various outfits by pointing at the icons within the app to scan through the digital catalog of clothing pieces, enabled by motion capture technology.

The Flash-based system combines augmented reality, motion capture, social media, and eCommerce. It detects the shopper in front of her webcam at home. When she selects a piece of clothing, the tool overlays it on her onscreen image. With a simple wave of a hand, the companies say, shoppers can select, rate and share their top picks with friends via Facebook or email, and even purchase the items directly.

A video about “The Virtual Dressing Room” is here.

Founded in February 2003, metaio employs 60+ people; it is headquartered in Munich, with subsidiaries in San Francisco and Seoul.

Combining current and historic images

MIT outlines the process for "re-photography"

In our fast-changing world, it’s easy to forget what once stood at, say, the site of a new skyscraper, or what the neighborhood liked like before that new condo.

However, systems for superimposing a historic photo on a current photo can show just what has changed, providing valuable context — and some cool imaging tech.

At the Massachusetts Institute of Technology, new work in computational re-photography combines a laptop PC, camera, and software to do the superimposition in real time. The “visual homing” software compares the current view from the laptop-connected camera to an historical scene, and instructs how to adjust the camera’s position and zoom to best match the scene.

A historical photograph paired with a well-aligned modern “rephotograph” can serve as a compelling “then and now” visualization of the passage of time, writes one of the MIT researchers behind the technology. “However, the task of rephotography is tedious and often imprecise, because reproducing the viewpoint of the original photograph is challenging. The rephotographer must disambiguate between the six degrees of freedom of 3D translation and rotation, and the confounding similarity between the effects of camera zoom and dolly.”

To overcome those challenges, the MIT team developed “a real-time estimation and visualization technique for rephotography that helps users reach a desired viewpoint during capture. The in- put to our technique is a reference image taken from the desired viewpoint. The user moves through the scene with a camera and follows our visualization to reach the desired viewpoint. We employ computer vision techniques to compute the relative viewpoint difference. We guide 3D movement using two 2D arrows. We demonstrate the success of our technique by rephotographing historical images and conducting user studies.”

Full details are here: http://people.csail.mit.edu/soonmin/rephoto/rephoto.pdf

In Britain, a self-described “social movement” named We Are What We Do received funding from Google to build on Google Maps and Street View and develop “Historypin,” which it describes as “a digital time machine that provides a new way for the world to see and share history.”

Historypin is an online tool enabling people to upload images and ‘pin’ them to a particular location on Google Maps and Street View. Users layer their old images onto modern Street View scenes, revealing a series of windows into the past. “Individuals will be encouraged to include a date and story behind their image, and invite others to share images of similar historical moments to create a narrative,” the group says.

Users can upload, review, comment on and share images. Pictures are dated and geo-tagged before placed atop modern Street View photography. “The result is a fascinating snapshot of the changing face of local streets and well known landmarks… and provides a new perspective on historic moments,” the group says.

The site has ambitions to become the world’s largest user-generated archive of historic images and stories, “providing easy access to digitized history stretching from the invention of the camera to yesterday.”

Historypin launched in London in June, and will spread further “in the next few years.”

We Are What We Do is a not-for-profit founded in 2004.

Pin an historical photo atop its current counterpart.

metaio accesses iPhone camera API into AR

The Unifeye Mobile software development kit from metaio now take advantage of the new camera access API in the iPhone iOS 4 “to create image-based augmented reality experiences,” the company says. “The camera access is the next step towards an ever present and highly accurate information overlay on the real things around us.”

Metaio says developers were limited on the iPhone due to restricted access to the live camera data in the previous iPhone SDK. “The lack of image based recognition has led to a proliferation of augmented reality apps using GPS as the only tracking mechanism, which made certain experiences impossible.”

With iOS 4, Apple opened up more direct access to the phone’s camera. “Now, not only may the user obtain information on nearby points of interest like shops, restaurants or train stations, but also the camera’s eye is now able to identify objects and to “glue” object specific real-time, dynamic, social and 3D information onto the object itself,” metaio says. “Information may be called up based on places or objects around you. Multimedia experiences can be triggered by images, product packages, signs, posters, magazines or newspaper pages, or any other object around the user.”

metaio GmbH of Munich, Germany, says it offers the only software development kit for creating mobile augmented reality applications, supporting all major platforms: Android, Symbian, Windows Mobile, and now iPhone.

Total Immersion offers Flash-based AR

Total Immersion says the Adobe Flash Player version of its D’Fusion augmented reality lets users avoid the need for an AR specific plug-in download.

Total Immersion integrates real time interactive 3D graphics into a live video stream. The player uses existing 2D and 3D materials to directly recognize images printed on packaging or a product, and so does not require additional AR-specific markers to trigger the AR experience, the company says.

An online demo is here.

Qualcomm rocks, socks AR

Qualcomm has big plans for AR

The biggest radio chip vendor for mobile phones is moving into what we believe to be the most important upcoming use of mobile imaging: Augmented Reality, overlaying content atop live images viewed through camera phones.

San Diego-based Qualcomm says its augmented reality platform, initially available for Android devices, “will enable developers to build applications that merge reality and cyberspace.” The software development kit will be made available at no charge to developers for use in the development and distribution of commercial applications.

Vision-based augmented reality enables mobile applications that merge reality and cyberspace, giving consumers a compelling new interface to the world, Qualcomm says. The opportunities provided by augmented reality are opening new markets and extending others, including:

- Immersive reality gaming that allows 3D game experiences to occur on real world surfaces

- Innovative new media and marketing experiences that enable traditional print media and product packaging to come alive

- Informational applications that turn complicated instructions and diagrams into interactive tools for tasks such as setting up a new home entertainment system, assembling furniture or changing the oil in your car

• Toy maker Mattel used Qualcomm’s SDK to bring its “Rock ’Em Sock ’Em” game to life “in a whole new way,” the company says. Mattel’s proof-of-concept Rock ’Em Sock ’Em game using augmented reality technology “extends traditional play into the mobile environment, making it even more relevant to a new generation of technology-savvy consumers. We are always looking for technology solutions that complement and extended physical toys into new engaging experiences that are relevant to today’s kids — and this technology is ideal for this purpose.”

• Qualcomm says it is “challenging the industry’s most creative application developers to show their skills by creating the next generation of mobile applications based on augmented reality.”

The Augmented Reality Application Developer Challenge is an international competition to spotlight the best applications developed using Qualcomm’s augmented reality platform and software development kit. Awards totaling $200,000 are up for grabs and will be awarded to individuals or companies demonstrating the most effective, entertaining and functional new application products, the company says.

• Qualcomm joined with the Georgia Institute of Technology to establish the Qualcomm Augmented Reality Game Studio, a research and design center aimed at pioneering new advancements in mobile gaming and interactive media.

Located on Georgia Tech’s Atlanta campus, the game studio will build upon Qualcomm’s augmented reality platform and related graphics technologies to produce new application concepts and prototypes.

Georgia Tech operated its Augmented Environments Lab for more than 12 years, “researching ways to enhance a user’s senses by creating interactive computing environments,” the university says.

Qualcomm is the leading wireless chipmaker, selling about 1 in 4 of the radios used in mobile phones last year, according to Business Week.

YOUReality Ecommerce uses Augmented Reality

Use your phone to see what a new couch might look like in your living room.

YOUReality says its application answers the question, “What will this look like in my home?”

The company says online shoppers can see realistic 3D simulations overlayed “in their own spaces” with its Online Retail Visualization tool.

The “life-like 3D models in a photo of their own home environment” provide a realistic view of what the object will look like, the company says, with the ability to position the item (maintaining correct dimension and perspective) and change colors, styles, sizes and textures of the 3D object while viewing it in the photo.

“Retail Visualization takes the guesswork out of the visual aspects of shopping,” the company adds, “making the buying decision faster and easier.”

Demonstrations are here.

Layar lists AR content

“Augmented Reality is starting to behave like a true mass medium,” says leading AR developer Layar. “It is becoming scalable with the introduction of its own discovery mechanism. We know that real-time location-based content discovery drives frequent re-use of the Layar browser.”

Layar’s Reality Browser version 3.5 adds a list view of the most interesting content at their location is sorted by time, location, proximity, popularity and preferences – meaning, the company says, users will immediately see the most interesting content nearby whenever they open the Layar Reality Browser, without entering a search query or opening a specific layer.

Last week the published layer count passed 700, the company claims, and its there are more than 2 million users of its browser.

Layar B.V. is headquartered in Amsterdam, Netherlands

Layar now makes it easier to find AR content.

Museum of London overlays historic AR

Futuristic technology shows the past clearly: The Museum of London has developed an augmented reality application that overlays historic photographs atop real-time modern city streets as they are viewed with a phone’s camera and display.

London AR

Futuristic technology shows the past clearly...

The free StreetMuseum iPhone app is part of the Museum’s new Modern London exhibit, billed as five new galleries that “tell the story of London and its people from 1666 to the present day. 7,000 objects, show-stopping interactive, specially designed family areas, film and changing displays, transport you through the capital’s tumultuous history, rich with drama, triumph and near disaster.”

Microsoft takes out Tags

Using its mobile barcode technology, 1 billion tags have been printed by people and businesses all over the world, Microsoft says, and in the month of April alone, more than 20 million magazines with tags were in the hands of U.S. consumers.

In Amsterdam, for example, tours feature Tags on monuments, museums, restaurants, bars, and other landmarks.

“Today we can imagine a world where any physical object can become a gateway to a world of digital content and engagement,” Microsoft says. “Scan a product in a newspaper, get a personalized offer, buy it on the spot, or get directions to the store to buy it later. Or, scan a poster for a play, see a preview of the performance, invite friends, and buy tickets.”

Launched in beta eighteen months ago, the basic “Tags” service is now free of charge for anyone to generate and use Tags that link to standard scenarios, Microsoft says, such as linking directly to web pages. The reader application for most smart phones is available at no cost at Tag.Microsoft.com.

Microsoft says it plans to offer “the ability to create more powerful solutions through a variety of value-added services, such as advanced reporting and analytics and real-time location services.”

New partners to advance augmented reality

Canesta and YDreams are working together to “define next generation augmented reality and bring it to the broad market,” the companies say.

By using Canesta’s 3D vision sensors, YDreams applications can do real-time capture of any object in 3D, without the aid of any special markers or enhancements.   YDreams says this will “completely change the scope of where and how augmented reality can be used.”

“Augmented reality will change the way we market and use products, communicate and entertain ourselves,” says YDreams. “But, to date, implementing augmented reality solutions has only been possible with very specialized techniques.

Canesta’s single chip CMOS 3D sensors  are designed to use machine vision as an input and control for everyday consumer electronics.

YDreams works on “Natural User Interfaces,” and says its proprietary software combines computer vision, physics simulation, and artificial intelligence.

“One of the most difficult aspects of designing NUI applications has been to create a sense of real world interactions,” the company says. “We envision consumers naturally browsing through digital catalogs, adding to the user experience of ecommerce or being inside movies, delivered by IPTV platforms.”

A video demonstration is here on YouTube.

Poynt Offers iPhone Augmented Reality

Multiplied Media says its Poynt360 iPhone application overlays search results with the real-world environment as viewed through the iPhone’s camera, providing augmented local search.

Poynt is a free location-aware application that connects iPhone users to local businesses, people, restaurants and movie theaters.

With the new 360 degrees tab, users can point the iPhone camera at the ground to view compass-like arrows pointing them to what is nearby, or use a “heads-up display” where they can view the iPhone at eye level to view tags that are placed over locations around them.

From the tags, users can perform actions such as placing a call, browsing a website or mapping directions.

Multiplied Media is headquartered in Calgary, AB, Canada.

Personalized Augmented Reality

Iryss says its Tagwhat is the first mobile augmented reality distribution system “where anyone, not just developers, can create their own AR content and share with their friends anywhere in the world, in seconds, for free.”

Tagwhat fuses mobile augmented reality and location-based social networking services, the company says. The free application “aims to place users right inside their own personalized global canvas where they can discover, explore and share what matters with friends and followers.”

When peering through a phone’s camera view, geo-contextual tags from pre-selected friends and community members are visible. “Walk down the street and Tagwhat reveals a wealth of relevant information, discussions, and deals,” the company says, “such as a coupon for a nearby establishment, a discussion thread for a meet-up with friends, and a restaurant review about a sushi place around the corner.”

Users tag any location, place or thing for friends to discover. Each marker is an interactive social object, and can include links to email, phone, SMS, photos, URL’s, cross-posting to Twitter, Facebook, and more. As a result, the company says, “friends are able to easily interact and share information with one another with the added benefit of location and AR.”

Also, among the first “channels” of AR content is one that pops up relevant information from Wikipedia.

Businesses e-commerce and information delivery uses are also in the works.

Iryss is based in Boulder, Colorado.

Google’s Goggles Translate Text

Google combined its Goggles camera phone app with the engine behind its Google Translate web service to translate words on signs, menus, and more.

To use the app, Google says, “Point your phone at a word or phrase. Use the region of interest button to draw a box around specific words; press the shutter button – Goggles will recognize the text, and give you the option to translate; press the translation button to select the source and destination language.” [Google will even detect the source language.]

Current languages supported include English, French, Italian, German and Spanish.

An Android app, Goggles augmented reality/ visual search tool v1.1 adds a larger database of recognized objects, improved user interface, and the ability to initiate visual searches using images in your phone’s gallery, the company says. Point your phone at a building in Paris, for example, and you are connected to search results without typing or clicking.

Kopin: Tiny Displays Making Bigger Revenue

Micro-display maker Kopin reports first-quarter 2010 financial revenues up 18.5 percent year-over-year to $25.4 million.

The Taunton, Mass. company recently announced a $27 million follow-on order for LCD eyepieces for the Army’s Thermal Weapons Sight program, and says the order “reflects the continued strong momentum of our military display technology.”

Kopin also announced production of a new line of color VGA and WVGA displays measuring 0.35 and 0.44 inches diagonal, respectively. The “shrink” displays are about 40% smaller than the company’s conventional displays, it says. Shipments of the VGA display are already underway for Samsung Electronics’ NX10 hybrid DSLR-style camera and Vuzix Corporation’s Wrap 920 3D video eyewear, Kopin adds.

Kopin is also field testing its “Golden-I” platform, a hands-free system to access content through a near-eye virtual computer display. “With numerous applications already identified throughout the industrial, military and medical professional end markets, Golden-i is uniquely positioned to become a game-changing mobile content access platform,” the company says.