An overview of Windows Analytics: New tools to help improve Windows experiences

>> Hello everybody My name is Raji Rajagopalan, and I’m an Engineering Manager in Windows and Devices Group My team builds this amazing tool called Windows Analytics which we are about to talk about today And this is my colleague Raymond >> Hey, my name is Raymond Ononiuw I’m a Software Engineer in the Windows and Devices Group >> Raymond, do you remember what you were doing 19 years ago? >> I think I was in junior high I believe I was in junior high at the time >> Well, Eddie Leonard knows what he was doing 19 years ago Eddie is a customer of ours The first time I met Eddie was in Ignite This is a large IT Pro Conference on Microsoft IT Pro Conference He came up to me, to my booth, and he shared with me his experiences being a Windows Analytics customer So, 19 years ago, Eddie just started working for his company It’s a large financial institution And Eddie at the time, was helping his team upgrade from Windows 95 to Windows 2000 The world you see was very different back then Only four percent of the world was connected to the Internet And Eddie had to do a lot of manual things See, Eddie was in the world of Classic IT So what is Classic IT? Classic IT is a world where every user has a single device A lot of the applications in the device itself is owned by the business and there’s a lot of corporate network and legacy apps in your environment And many things that IT pros like Eddie did was manual, reactive, and very high-touch So what we want IT pros to be in is the world of Modern IT In Modern IT, a single user has multiple devices and the apps and the device are both owned by the business and the user together There’s a lot of cloud-managed apps, there’s a lot of web apps, and there’s a lot of software as a service app And the things that an IT pro is supposed to do are proactive and automated, and there is a lot of self-service in play And in order to empower a Modern IT world, data-driven insights are a core part of Modern IT, and this is where Microsoft 365 comes into play Microsoft 365 is a complete intelligent and secure solution that is a combination of Windows 10 Office ProPlus and Enterprise and Mobility suite And in a Microsoft 365 powered device, you have intelligence security built in A Microsoft 365 device is easy to deploy and manage and is always kept up-to-date How do you do that? You need tools, right? And this is where Windows Analytics comes into play So, Windows Analytics, what is it? Windows Analytics is a combination of three solutions, Upgrade Analytics, Update Compliance, and Device Health These are all solutions that surface important data-driven insights to our IT pro customers Upgrade Analytics is the solution that you would use to upgrade your machines from Windows 7 to Windows 10 Update Compliance is the solution that you would use to stay current on Windows 10, make sure that you are compliant with all feature updates and security updates And Device Health is the solution that you would use to make sure that your devices are running healthy, that they are not crashing, they are not hanging, they are healthy So this is what Windows Analytics is, and I will be demoing Windows Analytics a little bit later But before we go into the demo, let’s look at the high level data flow in Windows Analytics As you see, there is an IT admin, and it all starts with the IT admin The IT admin has complete control of what the telemetry flow looks like He sets his telemetry level And once this telemetry level is set, data starts flowing to the Microsoft Cloud And from there, it goes into our OMS Log Analytics backend And from there, the visualizations that empower Windows Analytics are built So this is the high level workflow And then let’s quickly switch into our demo In order to sign up for Windows Analytics, please go to http// It’s a free service The website will walk you through exactly what you need to do in order to sign up for the service So, once you sign up, you end up on a dashboard like this And on the dashboard, you need to do a couple of things to set up the workspace rate So, for doing that, click on this gear icon over there, and you’ll see a page like this Step number one is, you need to install solutions So, click on solutions Here you’ll see four solutions already installed And if you don’t see any solutions installed, click the “Visit the Gallery” link and you search for the solution that you want install In this case, you want to search for Upgrade Readiness, or Update Compliance, Device Health, and you install those solutions After you install the solutions,

click on “Connected Sources” And the first thing you want to do there is go to “Windows Telemetry” tab And here, you see the “How to enable telemetry” button You click on the “How to enable telemetry” button It walks you through a series of steps on how to properly enable telemetry for using Windows Analytics It also walks you through documentation on what exact events are being collected This could be very important for getting through your compliance reviews and in a very, very transparent, what exactly, what events are being collected So you want to look at that The second thing of note here is the commercial ID key You see this is a good that you see in the screen You want to copy that You want to stamp it on all your devices across your enterprise, and you do that using group policy You do that using SCCM, whatever is your tool of choice So now, Windows Analytics workspace is ready to use So let’s go back to the dashboard and click on the “Upgrade Readiness” here And you see a dashboard like this In this case, this is a demo enterprise with 6,000 computers And you see, these are blades that you can just scroll through one after another So the first one is Spectrum Meltdown We’ll talk about that little bit But then, after that, it’s step one; identify important apps, step two; resolve issues, step three; deploy, and so on So what are these steps? Let’s see what a typical upgrade project looks like Remember, Upgrade Readiness is the solution that you would use to upgrade from Windows 7 to Windows 10 In a typical upgrade project, we got these steps by talking to a number of our IT pro customers, in a typical upgrade project, there are four steps Step number one, you identify the important apps in your enterprise Step number two, you figure out what the issues are with those apps in moving to Windows 10 or any other target build and you resolve those issues Step number three, you deploy Windows 10 on those devices And once you have deployed, step number four, you monitor the health of your ecosystem So this is typically what IT admins do when they do an upgrade project And let’s see how Windows Analytics helps with those steps, step one, two, three, and four, in these visualizations So, as you can see here, step number, one identify important apps So, in the past, when Eddie was in the world of Classic IT, he did all of these manually He would go from department to department, person to person gathering all the important apps because there was not a lot of ways for Eddie to collect this information, what are exactly the applications and drivers that are installed in his enterprise in an automated fashion So he was in Classic IT, a lot of manual steps With Windows Analytics, this happens very quickly So what happens is that once you’re on board to Windows Analytics and you complete the on boarding, the setting steps,, it automatically inventories the applications and drivers in your ecosystem So, in the case of this demo enterprise, you see that there are 21,000 applications Imagine how painful it would be to collect 21,000 applications, inventory them manually spreadsheet after spreadsheet and merge them, very painful, right? So, with Windows Analytics, this is automated You see it, 21,000 applications But not just that, what I want to point out here is that you get a little bit more intelligence than just the 21,000 applications As you can see, there are 781 applications that are in need of review 21,000 total applications, only 781 that are in need of review What happened there? So you see there is a low install count bucket that I have circled And the low install count bucket is 19,700 applications These are applications that our tool found on only less than two percent of your enterprise These are all applications that are very widely used So if you were to take the approach of I want to prioritize my testing appropriately in an effective manner, these are low risk applications So you can prioritize them low and in fact not test them And in fact, that is what Microsoft recommends that you do Really focus your testing and your effort on things that are going to be very, very important for your enterprise So once you click on that low install count line, you get to a view like this So there are a few things I want to point out here Number one, you see that there are all the applications What are the applications that are installed in your enterprise? You immediately get the names of them, the publisher, the version, and so on But not just that, you get what are the total installs, how many devices that particular application is installed on across your enterprise, what is the monthly active usage Some applications are installed but not really used So here, you get the intelligence of not just how many machines that application is installed on, but how many is it actually being used on

So that is the thing number two, that are the insight number two that I want to point out But there is also a query language that you see up there This is a very powerful thing that you get with Windows Analytics Once you learn this query language, you can design your own heuristics and you can bulk update a number of your applications to whatever state you want So, as I said in Windows Analytics, the IT admin has a lot of control So, even though we have bucketed some applications as low install count, you don’t have to take our word for it You can go and say some applications are super, super important to your enterprise So you can go and mark them as this is important business critical So it is not yet ready for upgrade By default, all low install count applications are going to be marked as ready for upgrade So the other insight that you see up on the screen is this thing called Ready For Windows My colleague Raymond will talk about Ready For Windows in a bit, but this is the insight that you never used to get in the past without Windows Analytics In the past, you knew what was happening in your enterprise But now, you also get, for every application that you have on your enterprise, what is happening in the wider commercial ecosystem So here, you can see there are some applications that are marked as adopted That means that these applications are adopted in the commercial ecosystem outside your enterprise More than a certain level of installs, we mark them as adopted So that is what you see on this screen That is step number one So moving onto step number two So Microsoft test a number of applications, thousands of applications internally that are very popular in the ecosystem, every release that we have Right? So we want to make sure that as we release new versions of the operating system, the operating system is compatible and robust So we test thousands of applications And we sometimes find issues, compatibility issues In the past, we never had a way to surface this information, to share this information out to the wider world to our IT Pro customers With Windows Analytics, we have the opportunity to do that So what you see in step number two in this blade is, we have tested a number of applications, 96 of which intersect with this demo enterprises application list and 96 applications actually have known issues that are known to Microsoft Right? But not just that we just don’t tell you there are issues that we have found with 96 of your applications, we also give you guidance on how to fix those applications So in this screen, you see that there is guidance provided Right? For this particular application, the issue is that the app is removed during upgrade, but no action is needed to proceed So this is the kind of guidance that you want to know that application is going to be removed during upgrade so you don’t want to find out after you upgrade that the application is gone So this insight is very powerful to have In that particular step, the step number two to resolve issues, we also give you some more additional informational insights Like here, you see that there are 41 low-risk applications in need of review We marked them as low-risk because, we see that these apps already have an ISP support statement Or these apps through telemetry, we find that they are highly adopted or adapted The same thing, we see, we surface that information for drivers as well So let’s move onto step number three So, you have inventoried your applications You have identified issues and those applications and you have resolved them You have marked a number of your devices as ready for upgrade So now you’re ready for step number three Step number three is where you get Windows 10 bits deployed on your devices How do you do that using Windows Analytics? There are a couple of different ways You can, as you see in the blade here, a number of devices have already been marked ready for upgrade Now, you can go and export them into Excel and you can import them into a management tool of choice like SCCM and you can kick off the deployment there You can also do that using Computer Groups, where you have defined a collection of computers in your SCCM, and that becomes visible in OMS in your Windows Analytics dashboard And you can use Computer Groups to go ahead and deploy as well So once you have deployed, you want to monitor So let’s move onto step number four So now you have a number of machines that have Windows 10 bits on them You have kicked off the deployment And in this step, what you see is that you actually see deployment errors and deployments success Beware of what are the computers where the deployment has been successful And once you see deployment errors, you can drill down into them to see what where the deployment errors Right? The other thing that you see is the driver issues So once you have Windows 10 on a machine and some driver doesn’t startup or some driver doesn’t load, you did not have the insight in the past But now with this blade, you can see what are the drivers that did not start?

What are the drivers that are not install? What are the drivers that did not load? So that is the information that you get in this blade Before we move onto the next topic, there is a couple of other things that are very interesting in Windows Analytics to note This is the User Feedback blade User Feedback is when a user uses a Windows 10 computer, he or she can give feedback to Microsoft It goes through our Feedback Hub Tool and it comes to Microsoft and Microsoft takes action on it So now, with Windows Analytics, you can scoop that feedback to just your enterprise so you can see what is the experience of your users in your enterprise So here as you see there are eight pieces of feedback that your users have given, and you can click on the “Apps and Games”, the link there, and you get to a page like this In this case, I want to highlight two pieces of feedback that that this Demo Workspace has gotten Number one, ever since my computer got the last update, Edge has been loading pages much faster Now that is awesome Right? But the next piece of feedback is not so awesome Joining Web X meeting is taking much longer than usual So then the feedback is, well, this is not so awesome But the thing that you notice there is that there are five total upvotes for that feedback So this is not just an isolated incident Right? This is this is not just an isolated experience Many people in your enterprise are experiencing this But also, you notice there that Microsoft response is that we have received your feedback and we are looking into this So this is an entire feedback loop.Your user has Windows 10 He or she experiences a problem They log a piece of feedback It goes to Microsoft but you’re in the middle You’re connected You know what exactly is going on So this is very powerful information for you to have The other piece of information, this is informational insight and Windows Analytics, is the top Office ad-ins So we know that a number of our IT customers use Office ad-ins; and in the past, once again, you did not have a way for you to inventory all the Office ad-ins in your enterprise With the Windows Analytics, you have this information In this case, you see that there are 412 unique Office ad-ins So now, you can use this information to say what are the office items you want to test, what are the office that you want to make sure really, really works Lastly, sites Web Apps are also super important in an enterprise So here, you see an inventory of what are the active sites in your enterprise What are the compatibility modes for these sites So compatibility modes are important in order to understand how do you want to prioritize testing app, testing these sites as well So this information is available to you handy now So with that, let me hand off to my colleague Raymond for Ready For Windows demo, >> User expectations are set by device centric experiences Complete product cycles need to be measured in months and not in years Additionally, new releases must be made available on a continual basis And must be deployable with minimal impact on users We’ve designed Windows 10 to meet these requirements Windows as a Service is our innovative approach to the development and the delivery of Windows The key to enabling a significantly shorter product cycle, while maintaining very high quality, is an innovative community centric approach to testing that we have implemented for Windows 10 Some of you might know this community They’re called Windows Insiders And they comprise of millions of users around the world When Windows Insiders opt into the community, they get to test many builds over the course of a product cycle And they provide feedback to us through an iterative methodology called “Flighting” Builds distributed as Flights provide that Windows engineering team with significant data, regarding how well builds are performing and actual use Leveraging telemetry data, along with Windows Analytics and our Insiders are a few of the ways that we ensure that our desktop apps or websites, Modern Apps, Hardware and drivers are all compatible with Windows From engaging with our commercial customers, we’ve heard that application compatibility is a key pain point during the Windows and Office deployment process And what the Ready For Windows Website does, is it addresses this by Listing software solutions that are supported and in use on the windows 10 commercial devices and office 365 applications It’s intended for I.T managers at companies and organizations worldwide, who are considering the latest version of Windows 10 and office 365 It provides you the ability to search through the Ready For Windows directory, to check if software solutions deployed in your organization are either supported by their software providers or if they’re in use in

the Windows 10 and Office 365 commercial Eco- system Now, let’s have a look at the Ready For Windows website In order to get to it, you go to and we can see in the directory what applications are supported on Windows 10 The first thing we want to look at on this website is the bottom section, where we’ve listed software categories and you can see, for example, in the VPN category if you wanted to find a VPN solution that you know is adopted on Windows 10 and is supported, you can easily see a plethora of options here, across the various versions of Windows 10 One more thing that this website enables you to do, is search the directory Let’s go ahead and look for” Citrix Receiver” in here As you can see, Citrix Receiver is supported on Windows 10 And if we drill in, we’re able to see the various versions of Citrix receiver and the support statements for Windows 10 We can also see, we can also filter by the different versions of Windows 10 to determine what the support statement is for that specific application With all this talk of data, is there one more thing that we want to talk about? >> Yes of course. Privacy Privacy is very important Why is that important? It’s important to you, it’s important to us And we take it very seriously How do we take it seriously? We have a number of privacy principles we abide by Number one. All communication is secure We talked a lot about data going to Microsoft Cloud, going to OMS But all of this is secure and encrypted. Number two I’ve been reiterating this throughout my talk today, control You have, IT admin has complete control of what is the telemetry level? What is the data being sent? So that is very important and it is by design, we have built it in Number three, they are very, very, very transparent We have all the events that we that the Windows Analytics tool set sends to the Cloud All of that is documented Its living documentation We keep it updated, but not just that There is the Telemetry Viewer tool which you can download, and you can run it on your enterprise to see what exact events are being transmitted in real-time So privacy is very important to us But let’s wrap up. So what did we learn Windows Analytics is the best tool to stay current, healthy, and productive on Windows 10 Number two, you need to use data to elevate your game In the world of modern IT, data is very important Use data to elevate your game. Number 3 Upgrade to Windows 10 using Ready For Windows and Windows Analytics Become a Windows Insider super important become a Windows Insider And please please declare app support If you’re a developer for Windows as a Service. So thank you very much There are some resources that are going to be available Windows Analytics, Ready For Windows All of that is up on the slide Thank you. It was wonderful talking today >>This was fun >>Yes