Computer Vision White Paper
Computer Vision White Paper
Computer Vision White Paper
01/
INTRODUCTION
02/
FOUR BENEFITS OF DRIVING AI AND COMPUTER VISION ADOPTION
05/
INDUSTRY SCENARIOS POWERED BY AI AND COMPUTER VISION
09/
CONSIDERATIONS WHEN CHOOSING AI AND VISION SOLUTIONS
13/
EXPLORING ADVANCED SOLUTIONS FROM OUR PARTNERS
Introduction
From improving the accuracy of medical diagnoses to protecting African elephants from poachers, Internet of Things
(IoT) technology is tying more of the digital and physical worlds together and solving more challenges every day.
In the pursuit of creating this connected environment, 83% of surveyed IoT adopters are developing or
implementing an artificial intelligence (AI) strategy, according to the Microsoft IoT Signals.
83%
Among the capabilities that AI and advanced technologies enable
are image recognition and interpretation, language recognition
and processing, predictive and prescriptive maintenance, and
enhanced experiences for employees and customers. Adding the of surveyed adopters
collection and analysis of these differing forms of data allows IoT are developing or
solutions to address complex challenges in new ways. implementing an
AI strategy
9 Why collecting data without AI capabilities limits 9 Real-world solutions that successfully implement
the potential of IoT technology—and the steps to AI, computer vision, and related capabilities for a
take to increase technology benefits variety of industry-specific scenarios
9 Four benefits that are driving the adoption of AI 9 Intel and Microsoft hardware, platforms, and
and computer vision in IoT solutions tools to consider when selecting advanced
technologies that will maximize return on
investment for various use cases
Download the
white paper 1
Four benefits driving AI and
computer vision adoption
The worldwide amount of data collected by IoT devices is quickly climbing to more than 79 zettabytes by 2025,1
with one zettabyte equaling 1 billion terabytes. But raw data needs analysis or context to effectively guide either
automated or human decisions and actions.
AI-driven data analytics and machine learning algorithms can rapidly and accurately make sense out of
voluminous data points and map out trends. They also can learn how to identify deviations in data, sounds,
or images that could be missed even if the data were scrutinized manually in painstaking fashion. And as the
technology becomes more affordable, enterprises are embracing these devices and solutions that can easily
collect and process images, audio, and data.
2
Among the benefits that can be realized with AI and What are Metaverse apps?
computer vision as part of an IoT solution:
1
As enterprises create more connected
environments, the physical and digital
Enhance common IoT-enabled tasks worlds are converging and opening a new
Combining AI and computer vision can enhance common world of opportunity and transformative
IoT-enabled tasks such as remote monitoring. Automated solutions. We think of these solutions as
analysis of multiple video streams can detect movement or metaverse apps. It is the culmination of
other anomalies and send instant notifications when they the intelligent cloud and intelligent edge
occur. Adding computer vision to telemedicine can enable working together, and at the foundation of
capabilities like remote monitoring of patients. Microphones these applications is digital twins.
also can collect sound from factory equipment, which can
be analyzed for deviations from normal operating sounds By creating live, data-rich digital replicas
to determine if equipment is operating at optimum levels. of physical environments, users can apply
Additionally, small changes in machinery noise can indicate analytics, simulations, autonomous controls,
how soon maintenance may be required.While remote and other interactions in mixed reality to
monitoring and predictive maintenance are among the most- achieve previously impossible benefits.
established uses for IoT solutions, advanced technologies Each layer of the technology stack used for
present opportunities to perform these tasks better. metaverse apps can accomplish much on its
2
own, but together they have the power to
transform how computing is done.
Boost care, safety, and service Read more about Metaverse apps.
Pairing computer vision with AI’s deep learning
abilities also helps keep people safer or better
Microsoft Metaverse technology stack
served in a variety of scenarios. For example, to help medical
technicians scan unprecedented numbers of medical
Microsoft Mesh and Hololens
images, computer vision and AI can automatically look for
abnormalities and let medical personnel know if certain Microsoft Power Platform
images require further examination. Using AI and machine
learning algorithms with video streams can monitor employee Azure AI and Autonomous Systems
on-site safety, including social distancing protocols, and alert
them when there’s a potential danger. In retail stores, a similar Azure Synapse Analytics
system can limit customer numbers in a crowded space.
Computer vision also can monitor inventory and predict when Azure Maps
items need to be ordered. In some of these scenarios where
privacy is a concern, processing data at the edge creates less Azure Digital Twins
complication. Computer vision and AI, however, are central to
Azure IoT
achieving these health, safety, and service uses.
33
3 Accelerate development and time to deployment
More powerful processors, sophisticated IoT vision and acoustic devices, and AI work in ways that
automate problem-solving. These technologies can assist employees in a variety of environments to
improve productivity or deliver better service to customers. As IoT devices advance and become more essential in
a more connected world, technology providers are focused on keeping them from becoming dizzyingly complex.
Intel and Microsoft, for example, are both encouraging developers to design IoT Plug and Play compatible
devices and offer toolkits, such as the Intel® Distribution of OpenVINO™ toolkit, that connect quickly and speed
up deployment of sophisticated capabilities. This allows technicians or other employees without deep coding
experience to deploy devices and applications, in addition to making devices and systems more understandable to
those who use them.
Ninety-six percent of those companies integrating AI also indicate overall satisfaction with IoT technology, compared
to 87% among IoT adopters. They’re also more likely to view IoT as critical to the success of their business— leading
to more IoT investment and use—than overall IoT customers (95% vs. 82%).
“Speed and agility are critical to any manufacturer. Having the ability to capture real-
time data streams and apply analytics as close as possible to the manufacturing
operations—i.e., an intelligent edge—empowers manufacturers to be able to respond
to live operational events with actionable and optimized insights. This continual digital
feedback, from the edge to the cloud, gives any business deeper and real-time insights
into their operations, product development, and product usage.”
– Çağlayan Arkan
VP of Manufacturing Industry at Microsoft
Predictive Maintenance
Predictive maintenance incorporates machine learning software that analyzes data to predict outcomes and
automate actions. Predictive capabilities allow service providers to move beyond the traditional reactive and
scheduled maintenance business model to using data and analysis to identify issues before they become critical,
allowing technicians to intervene before customers even realize there’s a problem.
55
Enabling safer spaces and faster transportation
Computer vision and AI technology could routinely guide autonomous vehicles one day, but they’re already
improving commuting and traffic. Driven by Intel and Microsoft Azure technology and services, Hitachi Smart Spaces
enabled by Lumada Video Insights are some of several smart transportation solutions that analyze and optimize
transit flows and safety for customers like RTC Southern Nevada, while improving security in stations and other
public spaces.
Other smart transportation and smart city uses are numerous, especially as many municipalities already have street-
level camera networks. The Innodep Vurix platform, as one example, integrates input from up to 10,000 cameras
with help from an Azure-based video management system and Intel processors. When used with AI technology, it is
helping city leaders establish transportation policies and business-development zones.
Anheuser-Busch InBev, the Belgium-based global brewing business, is harnessing Microsoft Azure AI services to track
bottles of its products from their origins in wheat and barley fields all the way through manufacturing,
6
distribution, and sale promotion. To do that, the company has created a complete digital twin of its breweries and
supply chain to track and make adjustments when needed to their operations. Through the use of mixed reality with the
digital twin, employees can even remotely assist different locations.
Meanwhile, Linker Vision AI, powered by Azure Stack Edge and Intel® Xeon® processors, utilizes video cameras and
intelligent auto-labeling algorithms to protect workers in hazardous job sites. The system can detect whether people
are wearing the correct protective equipment, following standard procedures, or entering restricted or dangerous areas
of a workplace. When an incident occurs, it automatically alerts on-site supervisors.
Remote Monitoring
Monitor almost any kind of asset—including heavy machinery, vehicles, and even livestock—almost anywhere, either
continuously or at regular intervals. By tracking location, performance, condition, or environmental factors, the
insights you gain from IoT connected things can help solve your business problems using your own data.
Additionally, predictive analytics can help hospitals accurately forecast patients’ length of stay and re-admission
rates based on their conditions. Having that information can reduce operational experiences, tailor care for better
patient outcomes, and potentially avoid penalties. The same vision and edge AI technology that can monitor retail
inventory powers the StockView for Healthcare solution, which uses Intel and Microsoft Azure services to automate the
management of medical supply closets and predict which supplies and medicines are likely to run out first.
8
Considerations when choosing AI
and vision solutions
Choosing, building, and deploying the right advanced technologies for your desired business outcome isn’t easy.
Among the considerations that can guide what technology you use when selecting advanced IoT capabilities:
• What type of devices and how many will your solution include? Handling video streams or countless still
images from a number of vision devices requires high-performance processors and vision processing units to avoid
slowdowns.
• What are your needs for edge processing and storage versus cloud processing and storage? If real-time
analysis without latency or on-site storage of images and data are crucial, then having AI-capable processors and
high-capacity storage at the edge is necessary. Alternatively, hybrid solutions that process images and data at the
edge and then store them in the cloud provide flexibility.
• How scalable does your solution need to be? If you plan to expand your IoT use or your business, does the
technology you’re considering easily allow for growth? The answer to this also can guide your choices between
on-site edge hardware, cloud-based services, or both.
• What is your deployment timeline and technical expertise? If you have knowledgeable technical employees
with IoT experience and a long timeline, you’re in a good position to design your own solution and choose the
right technology. If that’s not the case, Intel and Microsoft offer pre-built cloud service applications and many tools
and templates to create targeted solutions that use advanced technologies without requiring significant technical
knowledge.
Explore the table below to learn more about these technologies and to read about examples of their real-world
uses.
Processors and hardware Business scenario or benefit Customer story or use case
11th Gen Intel® Core™ Enhanced specifically for IoT applications such as AI GE Healthcare: AI helps improve
processors and computer vision with minimal latency patient experience
3rd Gen Intel® Xeon® The only data center CPU with built-in AI Kingsoft Cloud speeds
Scalable processors acceleration, end-to-end data science tools, and an up content delivery
ecosystem of smart solutions response times
9
Platforms and Services Business scenario or benefit Customer story or use case
Intel FPGAs and SoCs AI-optimized FPGAs for high-bandwidth, low- VelociData uses Intel FPGAs in
latency AI acceleration for applications such as delivering cohesive data solution to
natural language processing network provider
Intel Optane™ SSDs Optane SSDs improve AI outcomes and efficiency Fujifilm improves CT
by moving data at high throughout across diagnostic imaging
variable access patterns with low latency
Intel® Movidius™ Intel’s first VPU to feature the Neural Compute Autonomous robots sanitize against
Myriad™ X Engine, a dedicated hardware accelerator for COVID-19
Vision Processing Unit deep neural network inference for AI and
computer vision applications
Microsoft Azure Stack Purpose-built hardware that brings compute, Peregrine revs up for speedier service
Edge storage, and intelligence to the edge with Azure Stack Edge
Intel® Edge Software One-stop software resource for streamlining How to start intelligent edge solutions
Hub development of AI at the edge
Azure IoT Edge Fully managed service built on Azure IoT Hub to Lufthansa CityLine streamlines aircraft
deploy AI and vision services and applications turnaround, reduces flight delays
to IoT edge devices via standard containers
Azure Video Analyzer Platform designed for building intelligent video Dow uses Azure vision AI
applications that span the edge and the cloud at the edge to boost employee safety
using Azure IoT Edge and other Azure services
Computer Vision, part of AI service that uses visual data processing to label Carnegie Mellon University lab thrives
Azure Cognitive Services content, detect text, generate image descriptions, on the edge of computing innovation
and understand movement without requiring
machine learning expertise
Azure Percept A comprehensive and easy-to-use end-to-end Telstra deploys AI video solutions with
platform with added security for creating edge Azure Stack Edge and Azure Percept
AI solutions. Go from prototype to production in
minutes with hardware accelerators that integrate
seamlessly with Azure AI and IoT services
10
Intel Solutions Optimized for Edge
Requirement Technology Full Stack Solution
Software
Interoperability
Figure 1 – Intel processor and software options designed for IoT edge solutions
Azure IoT Edge for Linux on Enables customers to deploy Linux IoT Edge General availability of Azure
Windows (EFLOW) modules onto devices running on Windows IoT IoT Edge for Linux on
Windows
Custom Vision and An AI service and end-to-end platform for Bringing your Vision AI
VisionOnEdge applying computer vision to your specific scenario project at the edge is now
simple
Intel® Distribution of Toolkit enables users to optimize, tune, and to DC Water streamlines pipe
OpenVino™ toolkit run comprehensive AI inferencing using its model inspection and AI video
optimizer and runtime development tools analysis
Azure Percept Dev Kit and A pilot-ready development kit containing a Azure Percept enables simple
Azure Percept Studio carrier board, mounting tools, and Azure Percept AI and computing on the
Vision camera-enabled SoM and extendable with edge
Percept Audio. The Azure Percept studio offers a
single launch point for creating edge AI models
and solutions
11
Microsoft supports broad security portfolio
Azure IoT Hub & DPS Azure Device Update Azure IoT Edge Azure IoT SDKs
Enable highly secure and reliable Deploy over-the-air updates (OTA) Ensure devices have the right software Enable you to build apps that run
communication between your IoT to your IoT devices and that only authorized edge devices on IoT devices to send telemetry,
application and devices it manages can communicate with one another receive messages, job, method, or
twin updates from your IoT Hub
Azure Defender for IoT Azure Sentinal Azure RTOs Windows IoT Enterprise
Agentless asset discovery, Intelligent security analytics for your Real-time O/S kernel with leading Enterprise-class power, security,
vulnerability management, and threat entire enterprise with industry’s first multithreading and middleware to and manageability for the
detection for all your IoT/OT devices cloud-native SIEM/SOAR enable embedded developers Internet of Things
to build real-time apps for
Cloud Edge resource-constrained devices
Devices
Azure Sphere Azure Sphere Guardian Azure Percept Edge Secured-Core Certified
Comprehensive IoT security Increase brownfield security posture Comprehensive easy-to-use Devices meet security requirements
solution—including hardware, OS, paired with existing equipment to platform with added security for for device identity, secure boot,
and cloud components enable secured connectivity creating edge AI solutions O/S hardening, updates, data
protection, vulnerability disclosures,
and security agents
Figure 2 – How Microsoft IoT platforms and services integrate security protections
5G
Azure Sphere Azure IoT Azure Edge Zones Azure Space Azure IoT
Azure RTOS Azure Percept Azure Stack Family Azure for Operators (IoT Central, IoT Hub
Windows IoT Windows Server Azure Digital Twins,
SQL Server Azure Maps)
Figure 3 — Microsoft Azure IoT components from the edge to the cloud
12
Exploring advanced solutions
from our partners
Intel, Microsoft, and their partners offer a range of market-ready solutions that incorporate advanced capabilities to
address a long list of potential uses while also improving return on investment.
Especially when adding AI and computer vision capabilities, businesses can cut the time and expertise needed to
move from proof of concept to deployment by adopting market-ready solutions. And using a combination of edge
and cloud technology allows for flexible model training, processing, and data storage options that can quickly adjust
to changing business conditions while offering high data security for images and data.
IoT solution builders and developers are finding new ways to employ AI, computer vision, and other advanced
technologies in edge devices. Find the device you’re looking for through the Azure Certified Device program, which
has many new IoT Plug and Play devices compatible through certification to speed up time to market..
To learn more about IoT solutions that integrate AI, deep learning,
or computer vision, visit www.theintelligentedge.com
Intel, the Intel logo, and other Intel marks are trademarks of Intel Corporation or its subsidiaries.
Intel and Microsoft are committed to respecting human rights and avoiding complicity in human rights abuses. See Intel’s Global Human Rights Principles and Microsoft’s Human
Rights Statement. Intel and Microsoft products and software are intended only to be used in applications that do not cause or contribute to a violation of an internationally
recognized human right.
13
1 Statista (2020), ‘Data volume of IoT connected devices worldwide 2019 and 2025,’ available at https://www.statista.
com/statistics/1017863/worldwide-iot-connected-devices-data-size/#:~:text=Data%20volume%20of%20IoT%20
connected%20devices%20worldwide%202019%20and%202025&text=The%20statistic%20shows%20the%20over-
all,reach%2079.4%20zettabytes%20(ZBs) (accessed 26th May, 2021).
2 IoT for All (2019), ‘What is Computer Vision? Evolution and Applications in IoT,’ available at https://www.iotforall.
com/computer-vision-iot (accessed 13th May, 2021).
3 Markets and Markets (2019), ‘Computer Vision Market worth $17.4 billion by 2023 growing with a CAGR of 7.8%,’
available at https://www.marketsandmarkets.com/PressReleases/computer-vision.asp (accessed 13th May, 2021).
4 Markets and Markets (2019), ‘AI in IoT Market worth $16.2 billion by 2024,’ available at https://www.prnews-
wire.com/news-releases/ai-in-iot-market-worth-16-2-billion-by-2024--exclusive-report-by-marketsandmar-
kets-300833706.html (accessed 13th May, 2021).
5 Honeywell (2020), ‘Honeywell Teams Up With Microsoft To Reshape The Industrial Workplace,’ available at https://
www.honeywell.com/us/en/press/2020/10/honeywell-teams-up-with-microsoft-to-reshape-the-industrial-workplace
(accessed 29th June, 2021).
6 Morgan Stanley (2019), ‘Investing in the Second Machine Age – Picking the Winners,’ available at https://advisor.
morganstanley.com/the-breakwater-group/documents/field/b/br/breakwater-group/Investing%20in%20the%20Sec-
ond%20Machine%20Age.pdf (accessed 10th June, 2021).
7 Enterprise IoT Insights (2018), ‘How Intel is using IoT edge computing to reduce factory downtime by 300%,’ avail-
able at https://enterpriseiotinsights.com/20180724/channels/use-cases/how-intel-is-using-iiot-edge-computing-to-
reduce-downtime-tag40-tag99 (accessed 29th June, 2021).
8 Intel (2020), ‘,DC Water: Streamlined Sewer Pipe Inspection Analysis’ available at https://www.intel.com/content/
www/us/en/customer-spotlight/stories/dc-water-customer-story.html (accessed 16th May, 2021).
9 Intel (2020), ‘Intel® Helps Audi Achieve Precision Manufacturing & Industrial Automation,’ available at https://www.
intel.com/content/www/us/en/customer-spotlight/stories/audi-automated-factory.html (accessed 27th May, 2021).
10 Edge AI and Vision Alliance (2020), ‘Intel AI Powers Samsung Medison’s Fetal Ultrasound Smart Workflow,’ avail-
able at https://www.edge-ai-vision.com/2020/09/intel-ai-powers-samsung-medisons-fetal-ultrasound-smart-work-
flow/ (accessed 13th May, 2021).
14