Joe Johnston: Design for Sensors, not Screens

so yeah as he was saying I am Joe Johnston from a design agency called Universal Mind which is here in Grand Rapids we’re headquartered at Denver Colorado so this is interesting they not many people that do know Universal Mind know that we’re actually headquartered out of Denver Colorado we have an office there roughly about 40 people and in our office here in Grand Rapids there’s about 40 of us right above Sanchez so if you ever stop by in that area right cross the whole way from the co factory so if you ever in one of those events appear in a little glass window you’ll see a bunch of people in there it’s wave hello we’re a bunch of nice people so you come into hello to us too there’s about 160 of us that’s the other thing people don’t quite know is we’re a lot bigger than probably people realize we have what’s called a distributed network of individuals that work all over the United States and in Canada even not going to discount the ones from Canada but you know the a lot of those are developers as well as user experience designers digital strategist project managers and even some of our executives work out of their home so we’re more of a unique distributed model that people are trying to get to and we’ve been doing it since roughly about 2003 so here in office in Grand Rapids we’re primarily user experience designers some digital strategist some project managers but we get to do a lot of fun interactive projects we do have some local clients here you may know some of the meijer Gordon food service work with them here as well as some of the furniture and individuals but we also get a chance to work with national companies international companies as well so FedEx t-mobile Verizon even some DNA sequencing companies called Complete Genomics so very interesting applications across the board with enterprise and consumer we did some work with our friends at Sony before the hack that was the Jimi Hendrix Experience that was a fun six months of my life so if you want to know any information about Jimi Hendrix or Janie for instance catch and sameer was great but I digress we’ll get into the presentation here so today I’m going to talk about designed for sensors not screens and some people may take that too literal than others but we talk about user experience or focus on that user experience side of things so design for sensor is not screens primarily around you know this sensor as if you are your own sensor right from the standpoint of I am giving out context as well as all these great you know many computers we have in our pockets and in our cars nowadays but I want to take a step back our friends at Forrester and Gardner have all said you know 2014 even 2013 even this year 2015 they’re kind of saying this is the year of the customer everybody talks about probably heard of when you guys are working on applications it’s all about our customer experience right your kind of create a better customer experience which is true but I think they they started to pinpoint that a little bit too narrow and they started talk about that as well as this idea of mobile first strategy i’m sure you probably have seen this pop-up you know several years in the past as well as more and more large enterprises starting to move forward with a mobile first strategy well that’s good and i think it needed a name to something but i think it may have been a little bit you know nearsighted as well so how I like to take that mobile first strategy and twist it a little bit and say its context first especially as we start talking about sensors we have so many things that we’ve come in contact today to give us information as well as now we can give back information with you know things we wearing our wrists and different types of devices that we can project our health and project our location so now we can start building a context-aware experience around that so whenever anybody says mobile first strategy make sure you say oh we should probably rethink this think of it a little bit bigger from a context first so it isn’t so point it as a mobile first strategy so I like the coin 2015 is the year of the experienced one that I don’t deliberately put customer in front of it and I don’t put the word employee in front of it either because it means both I think we’re coming to the year now that we finally have started to create these great customer experiences with all these you know native applications that we can build for all these devices both inside of you know from cars to inside of even on refrigerators now we can build these experiences for the employees so the the fact that we can create these very dynamic employee experiences are going to affect all those great customer experiences so now enterprises are starting to balance that out a lot of times the employee experience tends to be at the bottom of the priority so I’m coining this year the year of the experience into going that a little bit more how many people have been to Disney World or Disneyland in the last year or two you probably have went through this great experience that they created two years in the making the Disney Magic Band so that’s just that’s as device right there which is just an RFID NFC band that they created a wearable band that you wear to replace everything you needed to do in the park so anything from scanning your door locks to paying for food doing the fast passes have ever been Disney fast fast is the thing to do even all the way down to everything you

could actually do at the park can be used with that band so no no longer do you have to take that wallet with you and go on those water rides and destroy your all your stuff even down to the point now Disney is starting to expand this program across all the Disney parks and themes so now when you go on the boats and the cruises when you go to different Disney theme parks across the world they’re expanding that and just to give you context took two years and a billion dollars to build this platform so it was a very extensive obviously Disney they make quite a bit of money they’re not hurting but a billion dollars for a company that probably makes hundreds of billions of dollars is still quite an investment so there’s a great article on fasco that i can tweet out after this that talks about the front end design of this particular experience which is all great when you actually attend the park and you get a chance to use it there’s also what’s called the digital transformation article which is the what really happened so a company frog design if you have heard of those actually worked with the Imagineers there was a huge battle between them the Imagineers said oh this is Disney World you can’t put technology in Fairyland we live in Fairyland you can’t have technology here so they even to the point where the Imagineers when they were testing out devices that frog would create they would try to cover them up going through the Rises try to make them not work so it was a great digital transformation article that talks about the real world battles that happen which projects like this but wanted to talk about is this this particular picture here it this is actually the be our guest I don’t know if II had a chance that this was open yet when I went it wasn’t open yet this is the be our guest dinner that is directly built around the wearable device so what happens is you can actually you know set up your entire trip to Disney World be our guest is a restaurant you can select the food that you want there and you set up a particular time to show up you don’t really get seated there you can just walk in sit down this NFC device has a sensor in the table that then broadcast who you are all the individuals and your names and information what you want to eat goes back sends the platform probably a wearable device or a tablet device for the employees to come out and now they can serve you the food and talk to you by name but you never met that person before a little creepy right but yet it’s a very great experience it’s like as if they knew who I was so that that tide experience is what is starting to see you know obviously they live in the walled garden of Disney so they can get away with all of this great technology we’re starting to realize that people want that experience so how can companies start creating those and that gets into this whole idea and you probably may have heard this term may be termed a little bit differently but it’s the friction free or what’s called friction less experience so it’s a basically what that means is is a way to take these sensors like that wearable device and that be our guest experience and not really have anything in between the technology can then take the data from the individual pass it on to the employee and now you have this great like a point earlier now if you have a great employee experience now you have that great customer experience so they’re tied in the same so these great friction-free frictionless experiences is really going to be what we’re starting to see as more and more of these enterprises and large organizations start to utilize all these tremendous sensors there have availability to do so the challenge though to create these frictionless friction-free experiences there’s a obviously you probably heard of the Goldilocks principle is kind of like earth is here right we’re in the right place right time all that fun stuff well that’s the same thing goes for experiences a lot of work that goes into trying to get your experience right there so it’s that just right experience for that just right time so to do that that’s where you start figuring out how when you run projects to do all that great user research to do the testing you do the prototyping you validate you come back you reiterate there’s a lot of different work that go into that so this is gives a perspective of kind of where we want to sit on that our constrain of that frictionless experience so as we can say is the interesting thing we start talking about all these different devices and all these different wearable you know obviously this big coin was with the Apple watch right is it going to replace my phone is it what is it going to do right so as people started to use it but the big thing was it was all about it was all about the fact that you know to create the best experience is actually starting to understand how to strip away that feature and functionality too many times I’m sure you’re in meetings like okay well features are we going to add what features we’re going to add turns into that you know that feature is for Frankenstein application that has all these different kind of features plopped on so we like rhyme or reason to have those so it’s all about when you get into the house meetings starting to understand what can we take away from that experience that make could be offset by you know maybe the location on your phone maybe by the context of what they’re trying to do maybe the you know different types of sensors you can utilize inside of your experience if that happens to be the case so you can start to remove some of that you know tons of different features that are added there and replace those with different types of context-aware sensors

and devices so throughout this presentation have some stats near that will kind of pinpoint and talk about a little bit so 221 times a day and this is I’m not sure if anybody has actually tried to record the number of times they look at their phone i know i’m way over that number i don’t know how many how many people would be over that number as well but that’s the average smartphone user looks at their phone 221 times a day it’s a lot and I the number that I would really love to know is what’s the duration of time of those 221 times obviously I would love to know the average is that a second is that two minutes is that four minutes and that brings an interesting talk around no the smart watches that we’re starting to see what the androids and the pebbles and you know the Apple watches you know that they specifically try to target some of these 221 times granted we can offset that now with a glance on our watch to see if we want to take care of it but reduce the amount of time on our phone if you guys start wearing smartwatches or don’t know if anybody here has one or an Android or a pebble whatever the interesting thing you start to have a dynamic of is not only the you know that the convenience of the notifications but you actually use your phone just as much but you don’t use it as long anymore because you’re you can actually focus those you know moments that you’re working on something you can quickly glance check it out what it was and you’re not on your phone the interesting thing is used to pull out your phone check the notification then what do you do all you go through this you go to the next thing go into facebook go to Instagram all of a sudden you’re sucked into your phone and you can’t take away your focus so I think that’s an interesting dynamic we’re starting to see as these smart watches start to kind of invade us a little bit more and more it’s a decade delicate balance people are still trying to understand exactly how people going to use them it’s going to be interesting to see if that number changes is all up it goes up but what’s the duration of time they’re going to be kind of using so I’m going to get into some sections here and this one’s around the invisible interface there’s been a lot of talk a lot of articles around what this is and what it’s going to be like in the future but this one kind of puts it into perspective with a particular car app that some of you may have seen or experienced but obviously the idea of the interview invisible interface is to remove the screens in front of you so you can have a you know frictionless experience right so you’re starting to utilize sensors and environment and context around you to serve up that experience so there was this great app that it came out for the iphone and android as well it’s a BMW app to replace you know the key fob in your car this would be a good one for you so it was all it was marketed as hey you know it no locks the car door starts the AC and it can do much much more but if you break down the steps needed to actually unlock your car so really all you want to do let’s say the the use cases I want to unlock my car using my phone or just all like my car in general what are the steps well they broke down all the steps nooope I can tell the number of steps based on how small the first one is so you walk up to your car you pull the phone out of your pocket and then you turn on your phone and then you unlock your phone because all of us have unlock it even using the thumbprint or slide to unlock then you never leave off just on your home screen your app so you’re actually in another app so you double tap out of that you may be in a folder so then you get out of that so you’re now you search for the BMW app which you’re not really using all the time so you don’t know what it really looks like and then you get to actually tap on the unlock button on the app to unlock your door then you wait right because it’s got to hit all the signals to make sure you’re within vicinity of the car and find it and then it finds the map and then it loads the map and you wait some more and then you actually find the unlock feature inside of the app which probably isn’t identified two wells many apps probably don’t do and then you actually slide I think there’s a slide to unlock so actually do a gesture to unlock the car and then you actually can physically unlock your car so there’s 13 steps right there to actually unlock your car so in reality what did you want to do if you were to break the use case you want to build the right way to do it is a driver approaches her car she opens the car door now there shouldn’t be any interference between me touching any piece of glass or anything it should just automatically happen so the idea is to avoid an interface in screen that you don’t necessarily have to use so when you start building these experiences think about are there things here that we can again remove based on giving me context of what i have now I’m sure there’s a million-in-one use cases that come into play with a lot of these different things if it works here fallbacks but if you start there you can at least think bigger than just hey let’s put a button on here to unlock the car okay that sounds great but in context but what about the use case of that entirety 13 steps to get there so this is also another one sorry if I’m in your way here I’m not sure alibaba you guys probably know what the whole thing is there I’m not sure he has seen his little key know that he did but he got up on stage and the way they actually purchase content was he actually shown shown a facial recognition which obviously was selfie style is what they marketed as to actually purchase content so is authentication with your facial

recognition that seems kind of creepy right because what are they doing a lot of facial recognition what are they doing with all the stuff but think about it my 11 year old daughter all she does wants to take selfies so to her that might be like yeah no that’s like the smartest thing in the world I can just use this to unlock all the so and it’s just me so no one can you know mimic my facial features and take advantage of it and this leads us to this particular kind of statement is that no matter how often were kind of creeped out by technology like that be our guest how do people know who I am or this selfie kind of recognition we’re always you know willing to accept it a little bit faster if it serves up the experience before we even know we need it and to that point I got some other stats around that as well but the interesting stat here talking about voice inside of voice recognition and voice text to speech inside the phone one of the things we tend to lack is the sensory phone is the ability to talk to it we don’t really use that as a design sensor at all so here’s some stats around you know forty percent use it for location seems pretty relevant right a lot of us use it for location thirty-nine text to speech to do text messages we’re going to find that probably go up even more because the smart watches and not having a keyboard to interact with them it’s like a car that will go up to make a phone call that’ll probably go up as well but the interesting thing here is as the people they interviewed twenty-three percent said they use it while cooking why would why would they do with voice to text or voice to communicate to their device to go find something while they’re cooking well obviously yeah they got their hands inside of whatever they’re cooking and they don’t want to touch that screen so they have to figure out a different way an input method to actually communicate with that device so context again knowing that there may be cooking or wine to cook there’s a lot of different types of you know data there to support maybe there’s a way to take advantage of something here that utilizes audio to capture some stuff because I don’t to use their hands so think about the full context of how they’re using it in inside of the application so i wanted to show like four interesting and I mean to me one of the creepiest one’s kind of platforms in technology as well as experiences that we we have I want to start with the one that I think is probably the creepiest and it’s this one you guys know what this one is at the Amazon echo if I’ve heard of it right personally I mean it’s cool but what it does it sits there and it’s like an ambient speaker tied to amazon so not only amazon collect every single piece of information you’re buying on amazon and searching and looking but now they can just listen ambient ly to just about anything that you’re saying in your house so now you can start serving up content so the great thing is they’ll be able to capture information in the house as well as you can it’s an assistant so you can tell it hey forget the name they use I think you can make sure you name it your own alexia you can actually tell it to do music and different to our purchase content or added to your shopping list but it’s ambient listening to what you’re saying now people say the phones are doing the same thing which some are some are who knows but it’s collecting all of that data now to start serving up what those Amazon ads are like wow this thing knows what I want before I want it right so that’s how they’re collecting that information that’s why that one creeps me out because your friends can come over if you know you have one sit next to that thing and start rattling off all the weird of stuffing possibly think of who knows or show up in their mailbox next day so that one that one to me is a little little little bit scary out of all the technology things this one here is motion savvy this is kind of interesting this is a case that goes around a tablet that actually translate gestures sign language into text so you can actually start teaching and communicating through sign language so it’s kind of very interesting now we’re doing motion gesture-based just doing the recognition of the fingers to actually the same similar to you know leap motion and other types of technologies but they put it inside of a case I think this will be interesting as we start seeing this maybe this type of technology be integrated in just about anything from the camera on our computers to just about anything which is coming not sure if you guys read start garden they’re doing a whole health posture workout thing is that star garden the other night for the TechCrunch meet up they’re actually building whole platform to actually do this for health care and helping with people with injuries and such it’s kind of interesting with that I don’t think so but you know I think it’s more of the understanding of what it is as well as i’m sure there’s how do I learn how to do sign language so i’m sure there’s like oh do this move and then it knows if you did it or not translate the text right so probably not the best form of communication because you just usually type if you’re you know hearing impaired so yeah I think that’s more of a learning apparatus than

anything else so this one is pretty interesting this not really the picture doesn’t represent it well but the this is one of the Mercedes vehicles that actually has a sensor in the gas pedal so it’s a hybrid vehicle so it goes from gas to electric well inside the sensor in the pedal when you’re when you it detects when you’re switching from electric to your gasoline it’ll actually tell you in the vibration of your pedal so actually you’re getting feedback while you’re driving whether or not it’s using the hybrid approach of the vehicle so i think we’ll start seeing a lot more of these so they’re trying to obviously reduce when you’re driving you don’t want to put although there was an example that was this Nabi system that actually was a hologram on top of your screen so they went the reverse way of actually throwing more contact contact on the screen which for self-driving cars might be interesting which it shouldn’t be autonomous cars it should be what is it Elon must likes to say they’re autopilot like a like an airplane some obviously airplane pretty much why I’m Celtics over the landing and taking off harder parts that’s what he kids to autonomous they’re not self-driving there’s more autopilot and then this one is the holo lens so that you’ve probably seen all the marketing crap on this one but the and I think it’s pretty cool but I think that they’re over doing the marketing because I from what I’ve heard it doesn’t actually look like this it’s actually a small little win out if anybody’s tried one on it or not but it’s a little more like a window inside here that you get the virtual reality but this in itself which I’ll talk about little bit more about virtual reality as weirded is as it is or a rvr I think there’s going to be tons of opportunity for this space it’s just a little bit of head of its time and I think people are going to find some really interesting ways to use that that I think will be really fasting so it’s you where and it basically overlays you know weird stuff like this foreign assistance kind of goofy you can see people love recipes and cooking I can tell you that and just all the examples it’s really fascinating but I’m not sure if it’s totally there just yet but the other point is too it’s still a big giant thing you wear in your head and I know Google glass everyone thought it was really awkward and weird which it was I wore it it was weird but that thing’s even bigger and weirder so I don’t know how that got away with it but anyway and that’s that’s that so I wanted to talk a little bit of this gets into a little bit more than kind of these new business models they’re starting to be generated by all these sensors and different types of applications and i like to call them instruct gratification economy some people call them crowd economies or other types of names to them but obviously it’s it’s you know obviously the first when it comes to mind is uber right is the great you know it’s i like to say they’re not a taxi company they are logistics company this happen to deliver people right now so mark my words are going to do a whole lot of hell of a lot more stuff than just people which is going to be fascinating but they’re going to disrupt a lot of businesses but anywhere from like this door dash obviously food deliveries huge not here yet but it will be slowly but obviously New York California it’s all people do is eat out so they have it delivered of the homes and then there’s this one one which I think just got purchased actually think and obviously amazon while they’re instant delivery services but it’s these you know Instagram vacation economies I push a button something happens right we’re all used to that Amazon one click you know changed our lives right we hit a button automatically something happen now uber I push a button on my phone and text it comes to me it’s a that type of system but the interesting thing why do you think all these service I mean they could have technically maybe have started a little bit sooner but I think one of the things that happened was oh this is the Amazon sorry I’m jumping ahead so one of the things with Amazon was this idea of what we talked about earlier was the focus on time to satisfaction which was that you know take all this great data and serve up that experience before I even know I want it well the interesting thing amazon has a anticipatory shipment patent which you know i did a little research on it not I’ve actually saw a couple people actually starting to receive these if anybody’s Amazon Prime member what it is it basically takes all of that huge data like that Amazon echo thing and starts to collect it all and it basically says okay we know you’re going to order this so we’re just going to order it for you and it’s going to ship it to your house without you doing anything so that part is a little creepy it’s starting to happen with certain people on it seen it a couple of times people are little creeped out about stuff showing up it’s like oh yeah I needed this paper towel already ran how did they know I needed that paper towel before I even knew knew I wanted you get creeped out but in its convenience right its value and time to satisfaction I’m okay with it you forget that all the privacy stuff that’s happening behind the scenes so this one will be interesting to see how this starts to evolve into other things and see how people are actually okay with it the big privacy question is going to be huge one if we start designing for how do we make sure people are comfortable with what they’re doing so the idea was earlier round that whole uber why did

ober all of a sudden take off huge all over the place right even here in small grand rapids it’s actually here right well you may think well it’s because we have mobile right everybody that wants a tasking taxa can hit their phone and their mobile it is mobile but it’s not really that way it’s actually because all the workers now have the smartphones so now they can just take the logistics if I go we’re going to go start uber somewhere what do we need oh we just need workers that have the smartphone ship the smartphones outside some paperwork make sure we’re legal and then kind of and then you take the fleet of cars you want maybe start uberx first could use your own cars but now you create a whole network because consumers can just download the app but now you can give all your workers the phones and now you can have this instant crowd-sourced crowdfunded type of you know economy driven by each other I have workers that drive cars I have people that want to deliver places so it’s this whole idea of having smartphones that employees now this gets back to that employee experience ubers app is great as an employee experience because the consumer is just as good as the employees so it’s an interesting model we’re in here that it now the employees have the smartphones just as much as the customers do and that gets back to employee experience so like I said earlier there’s a direct correlation between if you have a great employee experience you will have a great customer experience consumer experience on the other end they happen in tandem and I think people are just starting to realize if hey about how many times you been on a call center phone and you wait oh hang out i got transfer you hang a transfer you hang I transfer you oh whoops you lost him like I get back on phone again horrible right well how much do you bet that person sitting in front of that screen has a bunch of crap all over the place she doesn’t know who to talk to this or I don’t know how to find that person employee directory is all screwed up so that part of it is she’s looking at a screen that’s probably who knows how old and that whole platform is probably screwed up at seven different systems trying to talk to it doesn’t work very well so at you guys on our end of the phone and women have to deal with that particular experience so I think you’ll start to see employee experiences today start to equal out and some of us create those which is going to be really interesting so back to this be our guest the the great thing is is that they had you know this great customer experience you get to go there you sit down food just coming and then the people talk to you is like hey how’s it going Joe nice to meet just how do you know who I am I never seen in my life oh yeah so the little creep factor there but it’s definitely well worth it because you’re having a great experience the value is there but the one thing that happened with the magic bands and it’s called magic plus mymagic+ is the whole platform edge bands the band it allowed employees being Disney right they want to have happiest place on earth they want to have a great always have a great experience there well remove that hey here’s my ticket transaction type of experience into now much more of an interactive personal experience that I can give them which Disney always want but now you can take this model and use it for your own business and companies that’s what we’re going to start to have here is we’re going to remove that transaction barrier behind the phone hey hang on a minute more of a personal transaction cuz we’re going to be able to start collect that contextual information and serve up that just right goldilocks experience that’s what they’re trying to do in Disney people are trying to package that up and I’ll take that outside the walls and create their own company it’s very difficult because now you have to deal with all of the logistics of everything not just with inside of Disney so wearables though the fun stuff so first if this is the gardener hype cycle you guys seen this before maybe on the web somewhere so yeah we’re right there right now we’re probably gradually moving down a little bit but I mean this is part about a year old but obviously is a very cool things in here some stuff I have no idea what they are but they’re sound pretty cool the so we’re at the hype of you know Internet of Things and wearables obviously even consumer 3d printing down farther than where price should but it’s just the fact that it’s up there and you know we have everybody and their brother building something on Kickstarter that has to deal with some sort of wearable again to Internet of Things to in a second it’s it’s definitely going to be a long wave we’re going to ride and we’re still yet to know exactly how you know these things are going to work i mean if you’ve used one of these and even the batter for about a month now and it’s still interesting how it works in your daily life you use it just like a watch which people are like oh should replace your phone no it doesn’t it’s a watch let it be a watch so i think we’ll see how that works but this there’s a lot of different classified as wearables and I obviously don’t have enough an hour-long talk isn’t nearly enough to talk about all of them this is cited pull out some of the interesting ones some we already talked about this one here if you guys seen ism it’s a my oh it’s called it’s an armband and the only reason I think it’s kind of weird that you wear it up there I actually have one it’s going to bring it but battery’s dead that’s the nuance of these things you gotta plug middle google glass same thing although i would only last 10 minutes but the my arm band actually

detects the electrical impulses in your arm so you move a gesture in your hand it can map that and you can control so i could control this whole presentation although i’d have to go like this all the time which defeats make so some of these things are kind of intuitive because you get fatigued but the interesting thing is there’s the idea of being able to listen to the electrical impulses in your arm imagine now that I have this watch and my hands are full and I want to apply to this message just came in I can actually do a gesture with my hand they say I want to do reply with one it would know based on electrical impulses with the band to know they respond to one so now I can actually control my watch using that so there’s there’s actually a I think an Android wear attachment that actually goes I saw the video today actually put it on your android wear watch and it actually detects electrical impulse so you can actually can do gestures with your hand to control your watch so little weird but I think the idea of capturing that just like the facial selfie thing is going to be something we’re going to be okay with just like this thing capturing all my health information right now which is great but also creepy the obviously the pebble that’s going to interesting the pebble if you guys don’t know it’s still on kickstart hasn’t came out yet I don’t think the band which I’m surprised Apple hasn’t jumped on board that I think they probably will by the sounds of it the bands are actually going to be sensors themselves so you’ll buy the pebble watch and then the bands instead of just being like Apple and costing six hundred dollars just for the steal one it’s actually have a sensor in it too and you can actually the linkages actually in the pebble are going to have different types of sensors so if you want a glucose monitor you want a you know I don’t know different types of alcohol level whatever you want it in the bands you can actually set a buying only watch to do the sensor the bands would have the sensor so I think that’s where you’re going to go the modularity of the bands are really going to be key granted fashion too but I think it’s also going to be pretty interesting how the pebble competes directly with Android wear and the Apple watch and you know Fitbit which I’ll get into a second this is the nyam band this is actually detects your heart rate and they’re doing the same thing kind of a selfie was the heart rate was a locket computer so detects your heart rate just like your heart rate has a pattern just like your fingerprint they say that now you can actually walk up to your computer I like a computer and start working although I think you can actually do it with some apps on the Apple watch now too once they release the heart rate monitoring this is the misfit if you guys seen this this is actually a little disk directionally about that big it’s magnetic there’s a bunch of different ways you can wear it they’re almost like a fashion necklace to a little wristband and it tracks all of your steps it doesn’t do heart rate but it kind of calculates this pedometer it’s basically but it does track a lot of things the interesting thing this whole thing is magnetic right so you have to sync it with your phone but it’s metal and it’s magnetic so Bluetooth range pretty much goes to nil so the way the way the app actually has to work at a video in here used to for presentation you actually had to physically set it on the phone to actually do the sinking they created a great UI for it you actually drop it on it looks like it’s absorbing the data made it fun to watch but they had to get around that hole you know magnetic metal you know feat to be able to sync with the phone so interesting one there here’s the oculus rift and the holo lens a little different oculus rift similar a rvr and then obviously the Apple watch be if you guys seen the google cardboard at all i heard of that so that one right there I don’t have a picture of it I just saw a video I don’t know how I haven’t seen earlier the scad program the Savannah College of Art and Design they actually sent out to all of their recruits that they were have coming in to the program they sent out google cardboard branded savannah or scad and actually in told them to download an either iphone or android app slide their phone inside the go-kart i was actually a vr their campus so they actually could get them entice to come to their school based on so i think you’re going to start seeing these very interesting branded VR experiences with google cardboard being a cheap and expensive one of these but then rely on the lenses and the apps to kind of do that no be as in-depth as these but you’ll start to be able to have some pretty fun branded experiences that you can push out with apps to be very interesting so based on the fitbit so anybody here have a Fitbit or fitbit surge or used to have one I should coin that with did you have one and now it’s at home in your drawer like six months because that’s like the window so there are some stats around you know they say that 51 this is before the Apple watch came out so it’s a lot of its around you know the usability of the pedometer type of style so it’s about hey I want to change my habits but I can’t change my have until I know what my habit is well the problem with that is once you know what your habit is you don’t need to be told what it is anymore six months is the window so 51-percent you know people reported well this is a privacy one sorry privacy was the main concern around a wearable device so a lot of people don’t want to wear you know something attached to their body

although think Apple flip that coin because it’s had so many you know intriguing sales at this point but one-third of Americans who owned this was the own the wearable device the Fitbit for instance or the jaw bone or a Nike FuelBand which doesn’t exist anymore they don’t they got rid of it after the first six months they used it because it’s that window of learning habits changing habits yeah I know when I don’t hit my my goals so I’m going to be okay with that then you forget it one day and I know I don’t need it anymore so when it sits but the interesting and hence why the FuelBand is around 1 minus that Apple bought a lot of or acquired a lot of the FuelBand employees the half of the American so if you put in perspective all those fitbit’s first gens and jaw bones that were out there they don’t even have Marty be used anymore so you can imagine the amount of you know uselessness that those have know when smartwatches came out added a layer of a little bit more depth to those from an experience level because now it’s it’s a watch but it’s also starting to have more and more sensors to it the notifications started to balance there and obviously a pebble was first on the scene with a lot of those interactions so that’s all the downside of those wearables so now what’s the uptick now this gets into the we always talk about wearables and even enter things to the point where it’s consumer-generated or consumers want to use them us going to the store buying them from apple and usually the enterprise and employees usually are the second ones to come in the wave and as probably well no that’s the much bigger wave when you got a lot more large companies building whole platforms to you know target that misfit that misfit here interesting story there’s an insurance company called Oscar insurance they actually give all of their members in one of these and they wear them they wear them and then they start tracking all of their health information they give them premiums back based on how much they work out or how much they walk so we’re actually starting to use these to give benefits from a health perspective as well as you know companies are to start leveraging these de wearable devices to give up and if just like the automatic or the but progressive insurance little car thing you put in your car drive good to get your money back we’re going to do the same thing with our human bodies so that’s what’s going to eventually going to happen so back to the wearables from you know this is a sales this is from Salesforce so take these numbers with a grain of salt the so 79 so this is from a business perspective so they interviewed I think a couple thousand people from a business perspective asking them what they thought about wearables in the business world so obviously you know they’re from us for a strategic standpoint they do think they need wearable from a strategic perspective and they say that you know of the people that already had them some of them people interview didn’t have them 76 76 percent improved their performance which makes sense right from a performance standpoint depending on what the device was doing and then they’re increasing the vessel eighty-six percent are going to spend more money basically they’re going to spend a lot more money on what they need to do to encourage or to utilize the devices and the platforms here’s no this one’s weird I don’t know why they’d enjoy this way but the real key here is obviously device integration as we obviously build things that tap into tons of different api’s and services and all that fun stuff that’s even going to be more important as these device integrations the next one down loyalty rewards programs we’re seeing more and more companies starting to leverage the Sega talk by the Oscar insurance trying to leverage loyalty programs take advantage of giving people money back by wearing these wearable devices from an employee and customer or a business perspective point of sale obviously the Apple pay is kind of said a great way but interesting thing with Apple pay not only is it more convenient if you ever been to a red wings game or Comerica Park if everybody used one of those how fast those lines would be that’s really the benefit of that is the speed by which you can pay that’s going to be huge and then obviously some of these other locations sensing technology immersive experiences that’s where we get into that year of the experience people want these experiences to build context around that both employee and customer side of things so I think you’re going to see a huge amount of influx from the business side taking advantage of these wearable device as well as other types of devices as well so I OT internet things again another area works is going to explode and even this charts a little bit old because I’m sure this is probably even bigger now because of all the things that are starting to bubble up to the surface but you can see it put it in perspective but we just talked about wearables I mean this is where that I mean basically Internet of Things anything it can be connect to the internet or anything will write so anything from our toasters to our coolers tour I mean anything it’s ridiculous again with the Kickstarter

you can go in there just find tons of very interesting Internet of Things connected devices and even businesses like whirlpool which you think would be all over this before it blew up are trying to figure out ways and that’s the problem with some of these larger organizations very difficult to move fast and that’s what you’re going to find that’s why it’s going to eventually grow if you guys heard of the site called quirky so those quirky as an Internet of Things kind of like Kickstarter but it’s actually has a whole group in New York City that actually will take your ideas they’ll select them they’ll go through a vetting process if your idea gets selected they’ll actually do all the industrial engineering be all the backend energy engineering and you basically can almost like this is my product they sell it they do all the stuff for you so the great way just to peruse all these great Internet of Things ideas actually partnered with GE so there’s a lot of products that are tied to GE but some interesting ones is a piggy bank that’s excuse to get to the Internet has a app it goes off if you flip it upside down and try to empty it so don’t send notifications so if you try to steal your kids money then notify and stuff but actually keeps check it keeps the amount so it knows what coins going through the slot so it actually can just rack up so the kick in at home but how much money do I have unless instead of dumping it out counting them all which is still should be done it’s fun but they just made a little pig out of it and it makes noise and stuff it’s pretty funny and obviously you got to have a carton that knows how many eggs you have right so the all these little sensors tied your phone it knows you know when the eggs are out because you’re always at store saying oh how many eggs do I have well not all of us but it’s a good idea I guess yeah exactly the one that’s probably the most interesting it obviously there’s people have central air and then there’s a bunch of people that have window air conditioners rather in their apartments or they just have multiple window air conditioned central air they decide to build their own window air conditioner and then have it be connected to the local internet Wi-Fi and actually it’s almost like a nest thermostat except for its an air conditioned control it wherever you want throughout your house again multiple so it’s a great way to have almost like central air or a nest but it’s with this particular unit this is actually partnered with GE and this one I think forget the guy he was from New Jersey but I think he had the idea and they worked with him I created the whole whole platform program and then this one is actually created by one of our employees at Universal Mind this is actually a pool chemical detector so it’s for larger pools or a consumer pool you drop it in well you sync it all together you drop it in and there’s a light on top but it detects them out of chlorine or imbalances pH levels so instead of you dripping this in drifting trying to figure out what it is it’ll actually collected over time and to send you notifications when it’s out of whack and tell you what to put in it so that one’s actually getting created now so it’s all a little inside track from her so she’s been doing working on that on the side so it’s pretty fun bunch of pictures that went out there too she went out to New York and got to do a bunch of fun stuff in their lab it was pretty cool so if you ever will get an idea go to Corky and see how that process works and obviously beacons right so pi heard of ibeacons and just beacons in general we have G low here in town they’re doing a lot of stuff these are estimate and gimble and different types of beacons so it’s a little low Bluetooth energy beacon it’s like a radio signal and it’s for micro geolocation so I don’t know the thing is I don’t know where that is in the world but if I come within a proximity of it I know that it exists so is if I know how close I am down to the meter distance so it’s great for you know right now they’re using it for a lot of you know these things which is I think the worst thing to use it for but advertisements pushing people advertisements but more of context around what’s around you and giving the information great that I know that I’m close to something but do something more than send me a 20-percent discount on a hot dog or whatever it might be but I think there’s some great installations of these types of micro geo locations another part of the context you want to have information around and you can build some great experiences around them I don’t forget as have been there’s the urban institute of art as they had a program natural law called the dis art festival so what it was was artists were all disabled creating art pieces inside of the UIC a as well as the they encouraged the amount of members ago so obviously art museums are more than just about us as normal people but anybody that can enjoy the art so it’s really focused around pushing it around disabilities so they approached us we approach them had a great conversation it’s like if it sounds like a great event happen to be started in the UK its first time in the United States here they wanted an application to utilize they really wanted a nap first to kind of showcase the content I go well we can put beacons in here to kind of offset

that to give a little more micro geolocation for the artists and information a great thing what we did here is this whole app is great because we don’t get the chance to do this as a priority was all about accessibility so how many apps have you built that have been focused just on accessibility a lot of times like all we’re going to make sure it’s accessible but not really the main focus so the great thing is you can actually use Siri to drive this whole thing by by voice and it’s limited touch so what we did with the beacons was we didn’t really put it in your face type of experience this is one way to offset that kind of push me a notification or change my experience you’ll see these little outfit outlines that’s actually the heart logo a little bit but as I’m getting closer and closer to individuals artists this will actually glow darker or lighter and also if I’m say I’m in a wheelchair or I can’t quite touch my maybe I don’t have the motor control to touch my phone once you start it you can actually roll through the entire experience and there’s a setting in there it’ll auto scroll so if you don’t touch it for ten seconds it’ll actually auto scroll with the you know the least up the top so your highest ones right in the middle so you can get good gauge of where you’re at so you have to touch the screen so i actually use it in the aid of navigation a little bit and then you can actually tap in to get more information about the artist so walk around so this is a way to aid you know using beacons in a sense where it was a little bit not as much in your face as what most others so this is I think we’ll start to see more experiences aiding into rather than trying to push content based on how close you are to something but there’s challenges with beacons and you know you’ve probably heard of some of them but obviously most of them wouldn’t say all of them most of them run on some sort of battery whether it’s a watch battery whether it’s a double a weather whatever but if you think about that let’s say I’m a huge enterprise organization i want to i have 400 stores and i need a thousand of them per store and management and that stuff and your employees going to manage that so the management of that is going to be pretty crazy so they’re starting to create more more beacons at power you can just plug them in obviously a little smarter but you’re still going to manage them so there’s a whole management process to that but with any battery and any radio signal decreases over time there’s already a variance because it’s just a radio signal but it will decrease over time if you’re using batteries obviously like I said support and maintenance being with it now some have their own API you can utilize estimate does and a lot of people do sometimes it’s good sometimes that’s bad some that it gets in the way of what you really want to do you can use beacons right at the box with no most of them you can without any SDK integration this is the big one so we took two weeks we actually built the the application and we we blocked out two weeks just for the testing of variants inside of the actual physical location of the usca you have you ever been in its a giant cement building so and they have Wi-Fi in there so thankfully they had Wi-Fi built into the building otherwise that have been a disaster but they did have the Wi-Fi network inside of it and you want you hop on that Wi-Fi network the content it’s all a cloud-based type of serving up content was no locally stored content but to figure out the ranges of each beacon the best way to do beacons is actually above most of the smartphones the best way to get the best signal is actually on the front face of your phone so if I have one on that wall over there and I’m like this looking at it you’re not getting the best signal because you’re coming through here because obviously if cases you have all this crazy stuff happening here so the best way is to do there so the higher you can mount them to the ceiling the better signal strength you’re going to get but you do have the way this was the two weeks worth we had a lot of overlap so you can change all the sensors based on their meat arranged inside the phone so I’m standing here I know the meter range is X versus that one over there so there’s a lot of overlap because we’re all just obviously it’s a radio signal right so it’s circular or you know it encompasses other signal ranges so the interference was a big challenge and even people so if we had a bunch of people so if we did have the beacon on this wall here and we had a bunch of people standing between me and that beak and it would block that interference because us as humans are interference as well so interferes is the big one so if you ever do a beacon project allow a big gap of time to work on your variances because and they work awesome in here you go take it to your client it’s not going to work for so just warn you there as I said large variances of signals a lot of the beacons will be tested what will happen is it’s just like a radio wave so as I stand here I may get five feet I may get six feet and make it eight fee to make it six feet so you have to write in a variance algorithm kind of balance that out over a period of time to make sure you’re within a certain range most of them have those already built in you can write your own customized it for what you need to do and then you’re going to get delayed response so beacons work when the phone is totally off so I have the app installed I could walk around and that can be pushed information without even having to a pond or my phone up the challenge is is based on the refresh cycle of the phone depending on where it

is in its cycle it’s going to my phone could take you know four minutes to pick it up someone else’s phone could take a second so there’s always that variance depending on where that phone is in its refresh cycle when it’s off you may not know exactly when it so that it’s not an instant response everyone’s like all beacons are great instantly get that now doesn’t quite happen instantly there’s always a variance of people getting that information at a certain times and then obviously bluetooths the big one got having a smartphone that active Bluetooth either turned on or actually has bluetooth now there are some which I just found out there’s a company called signal 360 they make a Bluetooth beacon but they also have an audio version so they combine the two together so let’s say I have a smartphone it doesn’t have bluetooth they actually use audio frequency to actually trigger notifications so think like Shazam but it’s always on not to go and launch the app and stuff so it works just like a bluetooth beacon but it works with sound so think about it from a sporting event horn goes off because you scored a goal now everybody can have that experience because it just happened right so there’s a some interesting things you can do a sound that I you know previously didn’t think you could do but actually some really interesting things so signal 36 actually do the University of Michigan and a couple other stadiums are into sports so it’s pretty interesting read you guys should check out so sensing so sensing in the sense that design sensing not as a sensor sensing something how I define it is it’s it’s basically the collection of large data sets in real time to predictably serve up the best intended experience so like we talked about earlier that just right experience collecting all that data and doing that huge analytics on that information and serving up that data great examples you know obviously the nest thermostat and its network of platform of what it combines with the smoke detectors you know now they’re starting to have the August lock here is basically put it on your door and you can unlock your your house using your phone the Dropcam they purchased and then there are integrations with mercedes-benz and being able to turn on your home turn it up turn it down based on how far you away as well as other types of so this is an alarm clock Aurora alarm clock we are looking but it’s a light somehow the lights make you wake up better or something I don’t know how it works but it’s a ambient light alarm clock tied in with nest thermostat and smoke detector and feel two light bulbs and then there’s also a whirlpool i think is another partner so they take all this information all these partners that are part of it that aren’t really nest get to leverage that information as well so now if I’m whirlpool I know what you’re doing with the nest thermostat so there’s this great trade in the data that’s happening so now not sure what they would do that but now they can serve up something some sort of experience or product to them but they would want without them knowing it because they’re looking at its other information so I think we’re starting to see that huge sensing platform evolve even more as people open up their AP is another great example example is uber partnering with more and more hotels to know both pieces of information so the star hotel would preferred guest that you start with hotels you can actually hook up your account to Ober and now Ober knows when you book hotels and Starwood knows when you take it over so they can cross-reference each other and serve up no maybe not going to say they’re going to serve ads but they’re going to serve up an experience that may benefit you more than not so now they can start leveraging that information so i think we’re going to have this weird you know dynamic of all these different types of sensors information starting to boil out and obviously once Apple releases all their health information you can tap into that’ll be great it’s just when will they do it who knows but I think we’ll be able to leverage a lot of those great experiences so I just got a couple examples and I’ll wrap up anybody here have kids age of like under well younger kids i should say like probably one and under but or used to you’ll be able to late this if you have kids in general there’s a thing called sprout lling and it actually is a wearable device for baby you put it around their leg and it basically detects know if anybody’s seen ish and I don’t want to hopefully have nobody asked it and it has an app that will tell you based on the movement as well as the heart rate and how long they slept it doesn’t algorithm and says oh the baby’s going to wake up really pissed off or the baby’s going to wake up really happy so but it’s really fascinating eight they created this a great video so I’m going to play this video and it’s it’s hilarious this is you this is your baby you are a fully-formed even dare we say skilled human being your baby isn’t you’ve matched belts with shoes gotten to work on time at least eighty-three percent of the time and emerged from the human mating ritual

with someone you actually love to be honest your baby hasn’t really done anything that impressive yeah so why are you so afraid of your baby look you’ve got this sure sleep is like maybe not ever happening again you’re wiping things you never thought you’d wipe off another human being and it’s not exactly like your love life is firing on all cylinders these days maybe all you need is a little help this is a job you not only can do but can home with the help of the Spratling baby monitor it works with your phone so say your baby is sleeping you just want to know if it’s tiny little heart is beating it’s perfectly normal you’re a parent well we can help with that or you’d like to know if he’s happy or cranky when he gets up you got it maybe you’re doing something insane like socializing and you just want to know if it’s getting a little loud in the baby’s room it can actually do that or you’d like to have an idea of when he’s going to wake up so you can say get reacquainted with a person used to know before all this yep done you can even charge it on 0.0 hours of sleep these are just little things but they can help you a ton be confident be strong your life living sleep having baby raising badass so the other charger is a wireless conductive charger and this speaker sound so that’s how they can detect there’s loud sounds there so the baby wearable mark is going to grow obviously but that was probably the best friend seen thus far I have yet the chin trained that one but it’s definitely interesting this one I’m not going to show all of any question you have any question so Google glass this was a manufacturing warehouse example they did a bunch of testing with it limited but you guys see how this could scale exponentially with the anybody’s feeling with the pick and pack kind of assembly in a manufacturing or assembly plant grab the right thing put it in the right box move on pace and all that fun stuff they actually you know increased speed which is a challenge for some because you want pace but but in the big thing is they improved you know the air reducer error rates was the big thing and they did a little video not quite you know pointed on what Google glass can do it isn’t a VR some of the VR stuff in there but you get the idea I will play all of it cuz it’s really pretty long but they kind of overlay these things inside of a warehouse they actually overlay directions and a lot of different times there’s one part in here for support and maintenance when they when they get to the point of actually having a problem with one of these machines you can have an overlay of a help or assistant tell you where to put things next change so you can think about you know auto mechanics at home could become a very interesting incoming pic exists for customer 22 items piece comfor confirms so again hands-free accusing audio to confirms pickups and deliveries telling where to go as one the sites for item one is 30 x 25 firefight in the white of point five kilograms it’s this is a little little bit of marketing here can’t quite do that Google glass holo lens maybe if it wasn’t so small in the middle right at this point but but I think we’ll get to this point of it as we see you know improvements inside of you know Google glass or holo lens or different types of AR I think it will serve a pretty big part inside the business if you have a whole safety part in your so you got running into each other it did a good job of kind of explaining so the biggest challenge is with picking and packing is the accuracy you want to be a hundred percent so obviously if you have visual verification right now that I use a combination of lights and and different types of things to validate so here they’re using you know visual verification obviously the cost has to come down to $1,500 for employee might be a little

just little much so here’s what the alp I stop it after this but he had a problem with the maintenance or a problem with the machines we have to go over for maintenance this part here I think is pretty interesting where I think how many people fix your own vehicles or want to fix something this whole process I think could be a really something too we could see so he’s actually overlaying where things need to go and what needs to be read and I’m just doing a benign video voice what’s that no it’s no definitely no definitely not this is over in the UK too so I think they have I ever rode but yeah so that’s kind of it goes down for the way I can definitely send out the article if you guys want to see the rest of it but it’s definitely interesting how they started to build in the whole business side of it to verify with with VR or I’m sorry are so some of the takeaways from the presentation obviously year of the experience ask those questions versus you know that mobile first strategy ask that context first strategy idea again think of how you can strip away as much as you can versus add as much as you can from a feature you know challenge some of your teammates to do that and particular projects and again if people say they’re not going to you know do that technology use that technology well if it serves a value and time to satisfaction they’ll actually use that technology if it gives them something in value before they want it and then again based on that BMW example make sure you think about all those steps beyond just your interface on your phone or on your application think about the context by which they have to interact with it so that 13 steps really should only be two again focus on time to satisfaction for the customer whether that’s great thing that’s happened or is that customer service because they had a bad experience what is the time to satisfaction to fix that so there’s two ways to look at that time to satisfaction and again a great employee experience ultimately means a great customer experience and then the whole idea of you know predictably serving up that great experience is involved with all of that analytical real-time assessment and providing that just in time Goldilocks experience so that’s it that I have for you today