Fresh out of R&D from the Razorfish Emerging Experiences team is a product code-named “5D”. 5D started out as an idea to re-invent personal shopping. Our goal was to create a retail experience platform for both consumers and sales associates that enables multi-channel sales through immersive and connected digital devices in retail environments. And the only way to do it is to seamlessly integrate five key components – devices, content, experiences, analytics and CRM with a touch of digital magic!

The team announced 5D at the 2012 NRF Convention & Expo in New York City in partnership with NEC and Microsoft. Leveraging Windows Embedded, Microsoft Surface, MS Tag, Windows Phone and Kinect for Windows we created a prototype around a fictitious brand “Razorfashion” that demonstrates how various touch points along the customer journey can attract consumers into the store, drive product engagement and arm store associates with more contextualized digital tools.

You can read the full press release here

We recently partnered with London-based technology company, BodyMetrics, to develop a means for online shoppers to buy clothes from the comfort of their couch. Whattya mean big deal? Well, did we mention that the clothes are guaranteed to fit?

Yup, thanks to BodyMetrics’ 3D body-scanning technology, which is based off of the same PrimeSense scanners and camera tech as the Microsoft Kinect, shoppers are able to have their body dimensions scanned in and saved to an online profile. Just think of it like the transport room in Star Trek … if Scotty had a bit of an online shopping problem.

Once users have created their profile and saved their body data, they can virtually try on a wide range of clothing types such as jeans, dresses, skirts and tops from tons of partner retailers. As each piece of clothing is mapped to the on-screen avatar’s body, the user is able to see the exact fit of the item thanks to a visual overlay that depicts the tight spots of the garment. No more guessing games when you buy that pair of jeans online – you get the perfect fit, every time.

The icing on the cake – retailers get to benefit from a drastic drop in their store return rates since their customers can finally purchase with confidence. That, coupled with the exponential momentum and increased basket-size of eCommerce purchases means great things for apparel companies. Plus, you don’t have to listen to some phony sales associate squawking about how fabulous you look in those jeans – just take a look for yourself!

AT&T’s Small Business division asked the Emerging Experiences Group within Razorfish to create an in-store experience as part of a 30 store pilot program to create better awareness and engagement with customers as well as provide associates more powerful sales tools. The project has been a big success and you should be able to take a spin in a store near you soon.

The arrival of NFC technology promises to usher in a variety of new types of multi-channel customer experiences. While NFC technology is still in its infancy, our team has focused our efforts on research & development around experiences that can be enabled by this emerging platform. One of the many uses of NFC is activating mobile payment.

The Razorfish Digital Wallet is a mobile application we developed to demonstrate how customers can send and receive mobile payments over NFC. In the future, this type of consumer-to-consumer payment will become commonplace. For instance, you’ll pay your babysitter or settle a bet with a friend by simply tapping your mobile devices.

In the above video, we’ll showcase the consumer-to-consumer payment scenario along with a variety of other scenarios. NFC has arrived and we’re excited to integrate this technology in our experiences.

Check back soon as we will be posting a behind-the-scenes walkthru of the application.

In 2010, Microsoft released Kinect – a controller-free gaming and entertainment experience for the Xbox 360. Your body is the controller – joysticks and buttons are replaced with the users’ movements and gestures. It turns out Kinect has many uses beyond games and entertainment. Razorfish’s Emerging Experiences team created KinectShop to demonstrate the use of the Kinect platform in as a retail or at-home augmented reality shopping experience.

KinectShop allows shoppers to cycle through an assortment of products, in this case purses, and visualize the products as part of their outfit, thereby better informing the purchase decision. The natural interaction offered by the Kinect platform allows the shoppers to quickly develop a 1-to-1 connection with the product through the use of augmented reality. In augmented reality, shelf space is infinite, so while this concept experience is limited to purses it could host entire catalogs of products, such as clothing, hats, sunglasses, shoes, jewelry, makeup and more.

As an in-store experience, the retailer can bring catalog and online inventory into the store without actually having the inventory on hand. Further, it allows a shopper to still try on inventory not available in the store or out of stock, capturing a sale that might otherwise be lost. Ultimately, the shopper can decide that they like the product and add it to their shopping cart or wishlist.

Because the experience is virtual, it presents possibilities to become portable and even transcend beyond the store. With an experience like KinectShop, a shopper can easily scan a QR code or swipe their NFC smartphone to take their experience with them and use wayfinding tools to locate the product in-store. Additionally, shoppers could later retrieve their wishlist at home using the company’s web site, tablet, mobile experience or even an Xbox or PC version of the experience in their living room.

Shopping is inherently a social activity and the experience could not only support multiple users simultaneously but it also has the natural ability to leverage social tools. For instance, pictures taken with the virtual products can be shared through Facebook and Twitter to help solicit feedback from friends.

We plan on leveraging the Kinect platform to enhancing the experience further in future versions. For example, user recognition could help record and save preferences intuitively to your profile. Microphones can be used to employ voice commands – for example, saying “I love it” automatically adds the item to the wishlist. The experience will one day even offer recommendations of coordinating items based on the colors in the clothes that shoppers are wearing.

As you can see devices like Kinect clearly have uses beyond the gaming console. We are just scratching the surface on the types of experiences this technology will enable in the future.

Read more about it over at Fast Company.

One of the questions we constantly asked ourselves was how we could utilize Microsoft Surface as an easy and collaborative sharing platform. Surface is a product designed for social environments, attracting and engaging people to take a seat around the table and interact. As smartphones take over the mobile market, it’s important to recognize that people expect to have intuitive ways to connect their handsets and share pictures, information or other data. But we still haven’t seen a solution which leverages the whole Surface potential to create a compelling mobile sharing experience.

This is where our newly developed Amnesia Connect platform comes in. It demonstrates the most seamless and visual sharing opportunities a Surface table can probably provide. With support for any number of mobile devices, users can literally see-through their device and share content as easy and tactile as it can get. It is perfectly suited for sharing visual data like images and video, but works for any other type of content as well.

At the moment we support iPhone and iPad devices and are currently evaluating other platforms as well. But we can already tell that it’s heart-warming to see Microsoft’s and Apple’s devices playing so nicely together and we can’t wait to throw other players into the mix as well.

Read the full press release here.

The Consumer Electronics Show was back for 2011 and our team was on the ground in Las Vegas. We have a number of initiatives going on at CES this year.

First, our team was involved in the Microsoft Surface 2.0 launch. We’ve been working with the Surface team for a few months on the next generation of Surface. We’ve been porting our applications to run on the latest version. We can proudly announce that we are Surface 2.0 ready and we look forward to supporting the new platform and bringing the solution to our clients. The Microsoft Surface announcement caught the media by surprise – it’s been over 3 years since the original Surface was announced. The new device is faster, leaner and costs less than the previous version of Surface. We’ll have an in-detail analysis of Microsoft Surface 2.0 posted on the blog shortly.

Second, we were involved in the launch of another experience for one of our clients. We created a solution that will be experienced by millions of consumers in the market. Unfortunately our involvement must remain confidential so we can’t go into too many details. Let’s just say it was definitely one of those opportunities that we could not pass up!

We took the opportunity to explore the trade show floor in an effort to educate ourselves on the latest technology offerings. We hope to bring some of these technologies to our clients in 2011. Here are some of the technologies that we’ve got our eye on.

Tablets

2011 has been declared the “year of the tablet”. There were certainly no shortage of tablets at CES. In fact, about 80 new tablet form-factor devices were announced at CES this year.

From a hardware perspective, tablets are getting thinner, lighter and more powerful thanks to innovation around chip technology from companies like Intel, ARM, nVidia and Qualcomm. There are a variety of new form-factors hitting the market. The Eee Pad Transformer tablet can be docked in a base which transforms the device into a traditional laptop form-factor. The Dell Inspiron Duo tablet features a reversible screen to accomplish the same thing.

There were a variety of different screen sizes available. One of the interesting debates between amongst members of our team was around the usefulness of the small screen tablets. These “tweener” devices feature screens between the size of a typical phone and an iPad. The smaller size means they are more portable than an iPad, however they still can’t fit in your pocket and they can’t make phone calls.

One of the most impressive devices was the BlackBerry Playbook. The device features a brilliant user interface which makes use of NUI design principals – direct interaction of content through the use of gestures. In addition, the performance of the device was exceptional. We can’t wait to start developing for this platform.

For the first time, we had the opportunity to see the new Android Honeycomb tablet OS. The exerience is decidedly Android retaining much of the same design language. Improvements have been made to the user interface to take into account the additional tablet real-estate. In all honesty, we were slightly disappointed with the user interface. We were hoping for something game-changing from Google and instead, they delivered an experience that was transitional, not transformational.

One of the major disappointments was the lack of direction from Microsoft on tablet devices. We were crossing our fingers for an announcement around a tablet operating system that was lightweight and provided an exceptional user experience similar to what is being provided on Windows Phone 7 platform. And we wanted this platform soon.

Microsoft did acknowledge they are behind in the space. Right now, their story is positioning Windows 8 as the solution for tablets by supporting system-on-a-chip architecture. By supporting this hardware platform, Microsoft will be able to deliver Windows experiences on tablet devices while taking into account battery life and OS performance.

Unfortunately, no announcements were made around the Windows 8 user interface. Delivering an exceptional tablet UI will be essential to their strategy. It is likely Microsoft will adopt the “Metro” design language currently being used for Windows Phone 7 and Microsoft Surface 2.0.

Gesture Control and Natural Interaction

With the release and success of Xbox Kinect, the gesture control market is heating up. Much like the original iPhone brought touch interaction into the mainstream by putting millions of devices in the hands of consumers, Xbox Kinect will do the same for gesture control. The way we interact with computers is fundamentally changing and we are getting in on the ground floor.

We’ve taken the opportunity to develop for the Kinect platform, however we were looking for a commercial-grade solution to bring to our clients. Enter PrimeSense.

PrimeSense licenses their technology to Microsoft for use in the Xbox Kinect, therefore they seemed like the perfect partner to deliver the hardware and software to support commercialized gesture control solutions. We are actively working with PrimeSense to develop for their platform. Their OpenNI initiative hopes to create a framework for standardization of natural interface development across devices.

We see gesture control technology being used in an in-home setting and also in retail environments. This technology can be utilized to create at-home shopping experiences which combine natural interaction and augmented reality. Imagine being able to virtually try on clothes from the comfort of your own home. Or order a pizza with a flick of the wrist from the comfort of your couch.

We have been champions of the use of interactive experiences in the retail environment and we have the statistics to prove it. To date, the majority of our experiences have utilized touch. This technology provides a new user interaction paradigm and offers an entirely new world of possibilities in the retail space.

Touch Screens

Touch screen technology is evolving rapidly. Devices are becoming larger, cheaper and more reliable. Exciting new form-factors and multi-touch hardware will help us deliver new experiences to our clients in 2011.

3M Touch Systems has exciting new hardware and form-factors hitting the market which utilize their massively multi-touch projected capacitive technology. This technology provides extremely stable multi-touch that supports a large amount of touch points. 3M is brining 23” and 32” screen sizes to the market. In additional, the screens can be integrated into a multi-device array to build large size touch wall and table experiences.

We also had some hands-on time with systems from PQ Labs and Multitouch.fi. Both vendors offer touch solutions that are unique and exceptional. We look forward to working with these companies in the future.

Display Technology

Displays are getting thinner, lighter and more energy efficient. 3D technology is also evolving quickly. Much like last year, 3D display technology was everywhere. The most impressive innovation in the 3D TV space comes from LG. They demonstrated how their 3D technology has been standardized – every TV on display in their booth could utilize the same pair of glasses to deliver an exceptional 3D experience. They also demonstrated flicker-less 3D which produced a better 3D picture than we’ve seen on any other consumer device.

The glasses-less 3D technology was a disappointment. There isn’t enough discernable depth with the current iteration of the technology. Certainly this will change over time, however the promise of ditching the glasses has yet to be fulfilled. We wouldn’t be surprised if this changes in 2011.

In-Car Technology

Ford had the major innovations in the automotive space. The Ford Focus Electric vehicle was announced along with an update to the MyFord Touch interface. The interface features a number of enhancements including the ability to visualize your destination and alert the driver if there isn’t adequate charge in the vehicle’s battery. In addition, an efficiency coach monitors your driving habits to advise changes to your driving style and an “Emotive Display” visualizes butterflies when you are driving in a way that adds range to your vehicle.

MyFord Mobile was also announced. The app allows you to locate charging stations, unlock doors and find the location of the vehicle. In addition, the app goes social with driving behavior monitoring – achievements are awarded once certain milestones are met. These achievements can be shared on Facebook.

Mobile continues to demonstrate its growing importance with many different audiences. People are buying smartphones, texting like mad, and choosing the phone over the PC for web browsing at a surprising clip. All of this points to a need to take mobile ever more seriously. At the same time, the possibilities of mobile display advertising continue to evolve, most recently with mobile rich media formats bursting onto the scene. We’ve gathered some of the best examples of mobile rich media across a wide variety of platforms, networks, and 3rd party specialists – including the Razorfish-built iAd for JCPenney. Check it out.

Our team was asked to help launch the Microsoft Windows Phone 7 project at Mobile World Congress 2010. The project was a whirlwind experience – starting with 5 weeks of design/development and 11 days of deployment and support that spanned 2 continents and countless late nights. It was all worth it when Steve Ballmer made the introduction and we were all a part of history as the next generation in mobile experiences was announced to the 50k MWC attendees and a larger worldwide audience.  The people lucky enough to be in attendance couldn’t wait to get their hands on the experience we built.

We setup 10 touchscreens in 2 locations and the experiences were in constant use. Microsoft has since taken the touchscreens to countless other events including MIX10, SXSW 2010, CES, CTIA and many many more.

In addition to the touchscreen experiences, we also worked with our Seattle team to produce a microsite experience that would allow those not in attendance to get a taste of the phone.

The Razorfish team in Germany partnered with Realtime Technology AG to build configuration experiences for the Audi A1 world premiere at the international motor show in Geneva. They are designed to attract and engage young people and to demonstrate the wide range of customization possibilities of the new Audi.

The first experience is located on the main stage, featuring a 24″ Multi-Touch display allowing users to interact with the car configuration and an additional 65″ display with synchronized high-definition 3d-rendering in real-time to garner even more attention. The complex configuration scenario is wrapped in a simple and easy-to-use interface. The application is based on Windows 7 and the Razorfish Touch Framework.

The second configurator runs on Microsoft Surface and is based on the Audi A4 configurator. The multi-user environment allows individuals to place physical tokens on the table and configure their favorite A1 in a collaborative way. The extravagant competition kit adds exciting new possibilities to spice up the user’s virtual car.

Both configurators can be seen live at Geneva Motor Show until March 14, 2010.