Mobilizy

As the name implies, an AR Browser is an application to browse content – in this case geographically relevant information presented on top of the phone’s video input. As the “browser” moniker implies, we’re possibly witnessing the beginning of a war similar to the desktop brower wars.

Up until now, Layar users only had access to six layers of information. Data such as local search (where do I find coffee?), realty from Funda, data from a health insurer (strangely) and similar. All of it Netherlands specific – clearly very limited. Wikitude was similarly limited to Wikipedia information and a few other sources. These layers were really there to prove the case. The real data that will make this technology useful has to come from the internet at large in order to be useful. This means both tapping into existing geo databases, getting users themselves to contribute information, and spreading the technology far and wide so that an ecosystem springs up, encouraging more data.

Both players are making steps in these directions. Wikitude.me (powered by Mobeedo) allows the community to add content directly to the layers the Wikitude delivers. This information is captured in the spirit of Wikipedia and has a similar Creative Commons license. This crowdsourcing could bring a bunch of useful data online over time. Both Layar and Wikitude now have an API, although neither are completely open yet. This means developers can embed the browsers into their own apps, driving innovation in the space. The APIs als mean that third parties can create, contribute, or host their own AR layers, compatible with these browsers. The addition of existing geo data into the mix will naturally come over time – either by being directly hosted by Wikitude or Layar, or by the browsers becoming capable of browsing layers sourced from anywhere.

This last option is the most exciting. We need an open interchange of AR data layers not connected to any single vendor, however open. Like the desktop browser war, once these apps mature, the fight will be fought on features. Being able to navigate to rich layers located anywhere on the web is likely to be an important feature.

Both products are currently available on Android, with iPhone (on the 3GS) coming soon. The (im)maturity of this market means the race between these two products is important. The one which becomes synonymous with AR in the minds of the public will thrive. Either way is great for the consumer though – wars drive innovation.

Layar

Wikitude

Engadget is running a piece about a new game from PlayStation that goes with their PS-Eye camera, called the EyePet. Essentially it’s an augmented reality tamagotchi – the little critter needs to be fed, loved, cleaned and so on, and walks around your living room. Be sure to check out the embedded video – this virtual pet is really realistic.

The great thing for toy developers is that they no longer have to be limited to what manufacturing (and costs) will allow in a physical toy. And for the kids (and adults) that play with it, its surprising how quickly we can bond with an inanimate object, and can be delighted by the advanced way it can react and grow over time.

“Inanimate” is the wrong word, because as you can see in the video, it can react to you, and the environment. So it’s this really weird hybrid situation where the pet feels more real than just staring at a traditional on-screen beast (because you can see it climbing over your very own coffee table), and yet at the same time, there’s a disconnect, because as you move your hands towards it, you’re still forced to stare at a T.V elsewhere in the room to appreciate its reaction.

Of course, as soon as we have non-intrusive AR data glasses, or retinal projection, that problem will go away.

You can bet your bottom dollar that a large number of parents will opt for giving their child a pet that doesn’t wreck the carpet, need walking, or ring up vet bills. And never needs a funeral. Whether removing our children from interacting with real animals is a Good Thing or not, we’ll have to see. But this hints at some of the human issues we’ll have to tackle as this technology evolves.

Expect the EyePet this holiday.

Bokeh implementation by MIT

It works by taking a camera lense out of focus (more details in the original paper). No special equipment is required. In theory even a cellphone camera works, although currently this is only true for short distances (under a few inches). Regular camera such as SLRs can capture the data from several tens of feet away.

So what impact will the Bokode have on augmented reality?

• The Bokode tracks better than traditional markers, particularly for angles. Consult the paper for details, but a graph of accuracy in comparison to ARtoolkit looks very promising. In other words, more accurate placement and movement of virtual objects, which should improve the somewhat jumpy experience we have now. Current markers are an inch or two square, the Bokode is a few millimeters circle, meaning a far less intrusive representation in reality.
• The Bokode is line of sight. This is in some ways a limitation (as compared to RFID), but also has an interesting property – privacy. Most people balk at the idea of having an RFID permanently on their person, and some even actively disable them. Having a line of sight marker means that applications such as Augmented ID by TAT may not be quite as scary, as you could easily turn off your virtual presence.
• Bokodes can carry a fair bit of data. Yes, QR codes could also do this, but it’s hard to imagine QR codes becoming ubiquitous -they’re just too big, too intrusive. Bokodes are almost invisible, so there could literally be a plethora of tagged objects in the environment. Because the data (such as a lat/long) is embedded in the object itself, no slow network lookups are required against a unique ID. By means of trite example, every time your portable computer spotted a Bokode attached to a shop, it could know exactly where you are, without the need for GPS, and simultaneously display the specials inside.

The potential applications for Bokodes are vast (consult the MIT paper for a good overview), but augmented reality should be a substantial benefactor.

According to MacRumors, Acrossair, developers of the AR app Nearest London Tube (shown below) have been told by Apple that access to the video APIs will be available for apps on the appstore from iPhone version 3.1 onwards. Previously, apps such as this could not be publicly released – perhaps the large outcry actually worked. This should result in the floodgates opening – expect to see a quite a few AR apps arriving on your iPhone 3GS post 3.1 (Note that a 3Gs is required for good AR as it is the only iPhone with a digital compass). AR browser Layar (also shown below on Android) will no doubt follow quickly. The iPhone 3.1 update should arrive sometime in September.

Onezerothrice have released a new Flash framework for developing augmented reality web apps. Artisan is “the fastest and easiest way from point A to point B in browser based augmented reality. With ARtisan, the developer needs no knowledge of the inner workings of augmented reality to create in-depth, interactive AR experiences.”

Previously, Flash developers would have to use the more complicated FLARToolkit. Onezerothrice have also bundled Papervision3d with it, to ease the creation of 3D objects, which are attached to the markers in augmented reality.

Find examples of what can be done here, or download the code directly from the Google Code project.

Development tools such as this are important in moving AR to the maintstream. Despite some inroads from Microsoft in the form of Silverlight, and the burgeoning threat of Html5, ubiquitous Flash still dominates the web space for interactivity. Open source (and free for commercial use) toolkits such as this should herald a wave of Flash based AR apps. Expect many of them to be marketing micro-sites for brands looking to appear on the cutting edge.

The HTC Hero is an important device for AR. Built on the Android platform, it looks like it should be the flagship device for this technology. Spec wise, it meets or exceeds the iPhone 3Gs, but it’s being on the Android platform makes all the difference. Android is open source, meaning developers (and API providers) don’t have to get Apple’s approval to innovate.

Perhaps it’s because it’s so advanced, that this particular phone seems to be having a lot of trouble getting out the door. Originally slated for an early July release, then today (July 21), it now appears the date has slipped to mid-August, apparently due to manufacturing issues. We really hope these are tiny niggles, and not an indication of larger underlying problems.

The phone will be available from Orange (in graphite or white) and T-Mobile on contract. Sim-free versions will be widely available for around £400. You can pre-order at
Amazon

UPDATE:

It appears Orange have pulled some strings -the phone is available in retail stores and online from today (22 July). Orange are the only carrier currently to have the phone in graphite.

Related articles

• The HTC Hero: The Best Android Phone to Date (mobilecrunch.com)

Still, it demonstrates to a wider audience how virtual social networks and reality can play together.

Note of course that even though this is on an iPhone, it cannot be released to the app store because Apple has not released the video APIs yet.

They are the first company to publicly release an API. Competitor SPRXMobile also have an augmented reality API (Android platform only), but availability is limited to 50 applicants at present.

The Wikitude API is completely open – just mail developers@wikitude.me to receive a copy. The package you receive contains a basic AR sample app demonstrating how to instantiate the system, and add a few points of interest. Wikitude must be installed on the phone for this to work.

This is a significant event. Having a freely available API to create AR applications means most developers can engage their creativity to create interesting AR applications, rather than having to re-invent the wheel.

I expect the Layar API will not stay closed for long – there may not be space for more than one dominant API in the market, and being in that position will be financially rewarding.