A technology poised to transform the physical security market is deep learning, which is a neural network approach to machine learning, differentiated by an ability to train using large data sets for greater accuracy. In effect, the system “learns” by looking at lots of data to achieve artificial intelligence (AI).

Phases of deep learning

I heard a lot about AI, including how it can transform the physical security marketplace, when I attended NVIDIA’s GPU Technology Conference (GTC) in San Jose recently.  

Recognising images, including video images, is a big focus of AI. In the past, you needed programmers to spend months telling a computer how to recognise an image. In deep learning, instead of programming the computer, you just show it many different images and it "learns" to distinguish the differences. This is the "training" phase. After the neural network learns about the data, it can then use "inference" to interpret new data based on what it has learned. In effect, if it has seen enough cats before, it will know when a new image is a cat.

Factors enabling AI

Deep learning and AI are fast-growing areas for a wide range of uses – physical security is just one. It is all made possible by the coming together of three factors. One is the availability of lots of data. This is the “big data” we have been hearing about; in effect, a proliferation of sensors (including video cameras) has produced a large enough mass of data to enable systems to be trained effectively. The second factor is the development of new algorithms to train neural networks faster, and the third is the availability of computer hardware (specifically GPUs, graphics processing units), that is capable of rapidly completing the involved calculations. NVIDIA manufactures those GPUs and sponsors the annual GTC conference, all about how they can be used more effectively.

“Deep learning is about teaching technology to understand the world around us in a way that is similar to how we understand it”

Deep learning and neural network computing is everywhere. It is now widely available in on-premises computers, in systems embedded in edge devices, and even in the cloud. The edge is particularly important in the video surveillance market, enabling systems to function despite any bandwidth or latency issues that would limit the effectiveness of a central server-based system. Edge-based functionality also limits concerns about the privacy of information, and eliminates dependence on the availability of 3G connectivity.

NVIDIA AI City initiative

Video analytics applications fall under NVIDIA's “AI City” initiative, which they describe as a combination of "safe cities" (video surveillance, law enforcement, forensics) and "smart cities" (traffic management, retail analytics, resource optimisation). Depending on the application, AI City technology must function in the cloud, on premises and/or at the edge. NVIDIA’s new Metropolis initiative offers AI at every system level, from the Jetson TX2 "embedded supercomputer" available at the edge, to on-premises servers (using NVIDIA’s Tesla and Quadro) to cloud systems (using NVIDIA’s DGX).

“AI City applications need an edge-to-cloud architecture,” says Jesse Clayton, Senior Manager, Product Management, Intelligent Machines, at NVIDIA. “Some applications, such as body cameras and parking entrance applications, have to have AI at the edge. But for other problems, you need to aggregate multiple sources of information, such as using AI on an on-premises server for hundreds of video cameras.”

The sheer volume of installed cameras in the world makes video an AI problem – more than 1 billion cameras worldwide by 2020 will provide 30 billion frames of video per day. The existing limitations of current video systems to adapt and function well in real-world conditions point to a need for better technology, as do the traditional shortcomings of video analytics systems. Video systems can achieve "super-human" results, identifying and classifying images using artificial intelligence.

NVIDIA’s Quadro GPU system enables Avigilon network video recorders (NVRs) to search simultaneously across hundreds of cameras to find images that are similar in appearance
NVIDIA’s GPU Technology Conference offered a chance for Avigilon to interact with others focused on AI

AI in video surveillance

AI is steadily making its way into video surveillance. Multiple security industry partners are using NVIDIA GPUs to boost the effectiveness of their systems. Many companies highlighted their initiatives at ISC West in April and again at NVIDIA’s GPU Technology Conference. Among them are Avigilon’s Appearance Search and BriefCam’s real-time video synopsis system. Hikvision uses the technology for a six-fold improvement detecting pedestrians in the rain, while Dahua is speeding up its licence plate recognition system by five times. Other companies using the technology are UNV Uniview (vehicle classification), SeeQuestor (investigations), Xjera Labs (people and attribute detection) and Sensetime (object detection).

NVIDIA’s Quadro GPU system enables Avigilon network video recorders (NVRs) to search simultaneously across hundreds of cameras to find images that are similar in appearance, such as faces that match an example. The GPU’s fast and efficient processing power, available in a small and affordable form factor, provides a system that is scalable and cost-effective but can run complex algorithms to provide rapid results.

Beyond recognising objects, the
system can also learn about how
objects interact in the environment,
and look for anomalies

“Deep learning is about teaching technology to understand the world around us in a way that is similar to how we understand it,” says Willem Ryan, Senior Director, Global Marketing at Avigilon. “What seem simple to us in terms of how we perceive the world is complex for a machine to do, but a machine learns faster. Deep learning allows you to teach a machine how to make connections that we make every day. Using GPUs, a system can make assumptions and calculations instantaneously.”

Beyond recognising objects, the system can also learn about how objects interact in the environment, and look for anomalies or non-typical events. For example, if the system sees a car go onto a pavement, it could provide an alert.

How will AI develop?

NVIDIA’s GTC conference offered a chance for Avigilon to interact with others focused on AI, and to share Avigilon’s knowledge of the unique AI challenges of the video surveillance market. “This is the heart of the development of AI and deep learning,” said Ryan at the GTC conference. “To be involved and part of this is exciting to Avigilon, and we can expose people here to how AI can be used in a way they may not be familiar with. We have talked to people who didn’t realise how video surveillance happens currently, and how AI is changing it. “

“We want to continue to support the idea of GPU processing and how using it can make video surveillance solutions more effective, and change how people interact with video,” he added. “That’s where we see the impact. There have been challenges we have struggled to overcome in the security industry, and these are the breakthroughs that will help us overcome those challenges. So, we want to be at the forefront and involved in those discussions.”

The impact of AI and deep learning on the physical security industry is only beginning. The full realisation of that impact over the next few years will be fascinating to watch.

Share with LinkedIn Share with Twitter Share with Facebook Share with Facebook
Download PDF version Download PDF version

Author profile

Larry Anderson Editor, SecurityInformed.com & SourceSecurity.com

An experienced journalist and long-time presence in the US security industry, Larry is SourceSecurity.com's eyes and ears in the fast-changing security marketplace, attending industry and corporate events, interviewing security leaders and contributing original editorial content to the site. He leads SourceSecurity.com's team of dedicated editorial and content professionals, guiding the "editorial roadmap" to ensure the site provides the most relevant content for security professionals.

In case you missed it

What are the challenges and benefits of mobile access control?
What are the challenges and benefits of mobile access control?

There is a broad appeal to the idea of using a smartphone or wearable device as a credential for physical access control systems. Smartphones already perform a range of tasks that extend beyond making a phone call. Shouldn’t opening the door at a workplace be among them? It’s a simple idea, but there are obstacles for the industry to get there from here. We asked this week’s Expert Panel Roundtable: What are the challenges and benefits of mobile access control solutions? 

Securing a sustainable future
Securing a sustainable future

The UK Government has set out an ambitious ten-point plan, known as the green industrial revolution, with an aim “to forge ahead with eradicating its contribution to climate change by 2050.” This makes our government the first major economy to embrace such a legal obligation. Green recovery Acknowledging climate change and meeting net-zero is a demanding challenge especially for those affected by the pandemic. But the UK Government, with the launch of its aspiring strategy, is investing everything in its power to promote a ‘green recovery.’ Here, Reece Paprotny, Commercial Manager and Sustainability Champion at Amthal, highlights how the fire and security industry has an opportunity to use the current recovery period to explore its own sustainable journey and embrace the significance of environment, economic and social collaboration, transparency, and accountability. Employing sustainable technologies Pressure is mounting on construction to find ways to reduce emissions and help meet net-zero targets The perception is that COVID-19 presents a once-in-a-lifetime opportunity to re-write the existing rulebook. This is riding on the significance of changing public support for more environmentally friendly living opportunities, with associated cost savings, efficiencies, and cleaner industries. Innovative sustainable technologies are the key to kickstart this route to success.  Nowhere can this be seen more than in the built environment, which currently contributes to 40% of the UK's carbon footprint. Pressure is mounting on construction to find ways to reduce emissions and help meet net-zero targets. This is through the entire life cycle of a building, to reduce their impact on the environment from planning stages, through build and demolition. Building the right environment By creating the right policy environment, incentives for innovation and infrastructure, the Government can encourage companies to seize the sustainable opportunities of new technologies and value chains linked to green sectors. They can accelerate the shift of current carbon-intensive economic and industrial structures onto greener trajectories, enabling the UK to meet global climate and development goals under the Paris Agreement on climate change and the 2030 Agenda for Sustainable Development. Transparent working practices Each industry sector is expected to engage and pledge its support to achieve the significant deadlines. Every company can make a difference, even with small steps towards a sustainable future. So whilst elements such as safety and security represent just one component of building the right sustainable environment, it paves the way to opening up our sector to greater efficiencies, transparent working practices, and encourages collaborative use of resources. Sustainability in security The security sector has a significant opportunity to incorporate ‘going green’ into its practices In fact, the security sector has a significant opportunity to incorporate ‘going green’ into their processes, and practices. This is right from product lifecycles to more environmentally friendly work practices when it comes to maintenance and monitoring services. When integrating environmentally friendly practices, starts with the manufacturing and production of the wide variety of systems in operation for the security sector. And some certifications and guidelines can be achieved, such as the ISO 14000 which looks into eliminating hazardous materials being used which in turn will reduce carbon footprint.  Upgrading supply chain process Observing the complete supply chain and working with partners to reduce unnecessary travel, shipments, and transportation of products, can all contribute and create sustainable processes.  In the maintenance and monitoring of products, it is essential installers and security specialists consider their own environmental impacts. Simple changes such as switching company vehicles to electric options for site visits can make a significant difference to climate change and improving air quality. Presenting sustainable ways of disposing of products at the end of their natural lifecycle is key to change in our sector. This is especially in the security industry where many customers will need a complete overhaul of outdated solutions or need systems upgrading due to changing threat levels. Sustainable evolution Progress is being made, specifically in the fire and security industry, in its sustainable evolution. Businesses are trying to develop a reputation for “sustainability” or “good corporate citizenship.” And it has gone well beyond the theory to the practical, where companies recognise activities have an impact on the environment and are also reviewing the social and economic influences. Three pillars of sustainability In a recent interview, Inge Huijbrechts, the Global Senior Vice President for safety and security and Responsible Business at Radisson Hotel Groups sees her vision to combine safety, security, and sustainability. Inge focuses on three pillars, namely, Think People, Think Community, and Think Planet. Think People means that we “always care for the people in our hotels and our supply chain.” So, in outwards communications, safety and security were always part of the Think People focus area. Think Community is caring and contributing in a meaningful way to communities where we operate. Finally, Think Planet makes sure that “our footprint on the environment is as light as it can be in terms of energy, water, waste, and carbon, and making sure that we incorporate sustainability into our value proposition.” Moving forward Apprenticeship schemes are integral to ‘think people’ and have a role to play in the social impact on the security industry There are immediate actions that can be taken by companies in the security industry to support sustainable development, working right from within a company to supporting industry-wide initiatives. From a social perspective, at a foundation level, “Think People’ can see the Living Wage Foundation as an example of a commitment to a team.  This is for businesses that choose to go further and pay a real Living wage based on the cost of living, not just the Government minimum. Apprenticeship schemes are also integral to ‘think people’ and have a pivotal role to play on the social impact on the security industry.  It addresses the sector-wide issue of finding employees with the right mix of skills to collaborate and meet discerning consumer demands for increasingly smart security solutions for homes and businesses. Impact of the full lifecycle of products From an environmental view, or ‘think planet,’ we need to collectively look at all elements of our industry, with a desire to analyse the impact of ingredients used, supply chain, or manufacturing alone, and also consider the full lifecycle of our selected products from creation to end of life. As Jamie Allam, CEO Amthal summarises, “This is a long-term, sustainable investment in our people, our products, and our business based on our values.” “When put together, a social team which feels empowers and operates in environmental optimum working conditions is in a position to provide a great experience to our customers, creating an economic positive difference. It forms the basis of a sustainable sector vision for the security industry-wide to adopt.” Taking action Amthal is taking action based on the ready-made universally agreed UN 17 Sustainable Development Goals. Also known as Global Goals, these are at the heart of the 2030 Agenda for Sustainable Development, adopted by all United Nations Member states. This agenda is a plan of action for people, the planet, and prosperity. By being an early adopter, we believe we can engage with customers, partners, and suppliers on these issues and generate opportunities to innovate for mutual and industry sector benefit. Together, we can contribute to building a more sustainable security sector and future, and contribute to the UK Government’s green industrial revolution.

What is the impact of privacy concerns on physical security?
What is the impact of privacy concerns on physical security?

Adoption of General Data Protection Regulation (GDPR) by the European Union in 2016 set a new standard for data privacy. But adherence to GDPR is only one element, among many privacy concerns sweeping the global security community and leaving almost no product category untouched, from access control to video to biometrics. Because privacy concerns are more prevalent than ever, we asked this week’s Expert Panel Roundtable: What is the impact on the physical security market?