A growing emphasis on the impact of data – storing it, analysing it, and getting more value from it – was a common theme at this year’s IFSEC. Throughout the three days of the show at London’s ExCeL exhibition centre last week, there were many conversations about the growing benefits of the data generated by today’s physical security systems.

  • Industry embraces deep learning & artificial intelligence
  • Video analytics increasingly critical
  • Access control provides business intelligence
  • The move towards edge-based storage

Deep learning and video analytics

Video data was one key focus; especially how tools such as artificial intelligence and deep learning will create more value. However, Bjørn Skou Eilertsen, Chief Technology Officer of Milestone, warns that some companies may be adopting the deep learning buzzwords prematurely for marketing purposes. “I am surprised that so many companies at IFSEC have picked up on deep learning without having meat on the bone,” he says. The real challenge is to drive the deep learning value proposition, and truly deliver on the innovations to customers. Not surprisingly, he sees Milestone’s “open system community” approach as the best way forward.

Embracing deep learning and artificial intelligence will change the dynamics of video analytics and could lead to a renaissance in the market, says Eilertsen. Historically, video analytics have been rules-based and “you have to know what you’re looking for,” says Eilertsen. The approach has limited ideas about what analytics can do, while issues such as ownership of patents have made companies hesitant to enter the fray. The deep learning approach both breaks through the confines and makes patents covering rules-based analytics irrelevant.

Milestone Systems were talking about deep learning at IFSEC 2017
Deep learning and artificial intelligence will change the dynamics of video analytics, says Milestone Systems' Bjørn Skou Eilertsen

“It’s changing the dynamics of the analytics market and inviting new players to engage,” says Eilertsen. “Deep learning and neural networks are not managed the same way, they are easier to engage, and more people are engaging.”

Growing camera counts and multiplying data streams

More and better video analytics are a necessity as camera counts grow and video data streams multiply. Video analytics add a critical automation aspect to video systems, enabling systems to process video and provide needed information without requiring operators to view hours of video to find a needed detail – the proverbial needle in the haystack. Using neural networks to analyse video offers a clear advantage over the process of monitoring 10,000 cameras, for example.

The extra processing power for deep learning comes from graphics processing unit (GPU) hardware, which provides faster, parallelised computing and enables neural networks. “It changes the way the industry looks at analytics,” says Eilertsen. He sees coming innovation around more predictive modeling and systems that change over time to solve a shifting array of problems. Milestone’s future lies in supplying a deep learning element operating alongside the video management system, providing a platform onto which innovators from the Milestone “community” can solve new problems that leverage the value of tons of video.

Milestone has extended its VMS ecosystem to even the industry’s smallest customers. Milestone has released a free video management system (VMS) product for use with up to eight channels. The approach allows a small business to embrace video surveillance on a small scale and low cost, and then grow the system over time, hopefully eventually becoming a customer of Milestone’s XProtect corporate-level product. The transition path only involves upgrading the licence as the system grows. A basic, eight-channel system is built using the same binary code as the larger products.

AI education at IFSEC

NVIDIA, the GPU manufacturer that provides hardware for the industry’s transition to artificial intelligence and deep learning, exhibited at IFSEC as part of its continuing awareness push in the physical security market.

NVIDIA GPU Conference in San Jose
NVIDIA also raised awareness of AI and deep learning at its GPU technology conference in San Jose

Eddie Seymour, European Technical Director of NVIDIA, acknowledged a mission of “evangelism” at IFSEC. “We’re not here to sell you anything, it’s more of an education,” he said. NVIDIA is working with partners to incorporate GPUs, including Jetson “embedded” systems, into various technologies.

To illustrate the sheer power of AI platforms, a flat screen monitor at NVIDIA’s stand displayed video analytics working simultaneously on 30 high-definition video streams, illustrating the fast processing capabilities as the system identified anomalies on each stream as a rapid pace.

Seymour said they have had a lot of conversations with end users at IFSEC about how they might use the technology. NVIDIA can then act as “matchmaker” to pair up end users’ needs with various partners that are working in those specific areas. City-wide projects are a focus for NVIDIA, and Europe is another place where cities are embracing newer intelligent systems. Seymour says the market is more fragmented in Europe than in the U.S., and there are more startups playing in this arena.

Leveraging access control data

Data is driving innovation in the area of access control, too. More customers are looking for ways they can leverage access control databases for information about buildings, people, movements, and behaviour in the corporate environment. Combined with information from IT systems, access control can provide a holistic view of a business. “You can see the trends and statistics, can predict some issue about a certain door,” says Raf Schrijvers, Project Marketing Manager EMEA, Tyco Security Products. “You can discover anomalies in terms of business users, for employees and for subcontractors and visitors. In the case of subcontractors, you can verify how long they were on the premises. Access control becomes a tool to track work time.”

Tyco Security Products spoke about data at IFSEC 2017
Tyco's customers want to capture access control data as useful information

Being at IFSEC (in a meeting room at the back of the hall), Tyco had a chance to hear the voice of customers. “They want to use access control systems in a good way, capturing data and doing something with that data as useful information,” says Schrijvers. “We can go into complex reports and make them easy to read for management. They can evaluate building uses and energy costs, or calculate cost savings over time. Access control becomes a real tool for them, and they can even make the company money over time.”

In addition to listening to customers, Tyco’s meeting room also provided a forum to discuss the corporate roadmap and strategic vision with select customers. Product enhancements include embedded visitor management, dual-factor authentication and enhanced security. Mobile apps are another area of focus, offering new ways for users to interface with their access control systems. Users can provide “I am safe” messages in an emergency, for example, or pop-up alarms can be communicated easily from the central system.

Optimising storage for video surveillance

Storage is another aspect of data in the physical security market that was well covered at IFSEC 2017. Western Digital (WD) focused at the show on their broadening range of storage products, now including in-camera flash (SD) storage as a result of WD’s acquisition of San Disk. Resonating with the market trend toward more edge-based storage, San Disk products offer high endurance, which is needed for video surveillance applications where they might need to last for five years or more. A mistake integrators make is using consumer-grade SD chips, which have not been optimised for video surveillance applications, says Ziv Pax, Director, MCS Industrial Channel Business, San Disk (a WD brand).

WD also unveiled its Gold storage platform for larger enterprise uses (550 terabytes per year in workload) as well as the Purple product, which accommodates 180 terabytes per year in workload and now offers up to 10 terabytes of storage (new at the show).

In addition to better security, an emerging byproduct of our industry’s products and systems is a steady flow of data that can be translated into useful information for customers. It was one of several hopeful signs revealed in our discussions at IFSEC. The industry is clearly moving in new directions, with new vibrancy and towards renewed prosperity. 

 
Download PDF version

In case you missed it

Has the gap closed between security fiction and security reality?
Has the gap closed between security fiction and security reality?

Among its many uses and benefits, technology is a handy tool in the fantasy world of movie and television thrillers. We all know the scene: a vital plot point depends on having just the right super-duper gadget to locate a suspect or to get past a locked door. In movies and TV, face recognition is more a super power than a technical function. Video footage can be magically enhanced to provide a perfect image of a license plate number. We have all shaken our heads in disbelief, and yet, our industry’s technical capabilities are improving every day. Are we approaching a day when the “enhanced” view of technology in movies and TV is closer to the truth? We asked this week’s Expert Panel Roundtable: How much has the gap closed between the reality of security system capabilities and what you see on TV (or at the movies)?

How moving to Security as a Service benefits both providers and end users
How moving to Security as a Service benefits both providers and end users

The way we purchase services and products is changing. The traditional concept of buying and owning a product is giving way to the idea that it is possible to purchase the services it offers instead. This approach has come from the consumer realisation that it is the outcome that is important rather than the tools to achieve it. For example, this approach is evident with the rise of music streaming services as opposed to downloads or physical products.   With the physical security industry becoming ever more integrated – and truly open systems now a reality – there is every reason to assume this service-lead trend will come to dominate the way our industry interacts with its clients as well. Interest in service-based security There is a significant change of mindset that the security industry needs to embrace before a large-scale move to Security as a Service can take place. Like many technology sectors in the past, security providers have focussed on ‘shifting boxes’ as their definitive sales model. This approach was especially prevalent when proprietary systems were the mainstay of the security industry. Essentially, if the customer wanted more services they simply bought a new product. This was a straightforward and economic sales approach for manufacturers and installers alike.The security industry needs to embrace a change of mindset before a move to SaaS can take place The flexibility of integrated and open technology has changed the way consumers view their purchase, so it shouldn’t be any surprise that there is increased interest in a service-based approach. Customer choice equates to a change of focus and interest, with physical products being eclipsed by the benefits of the overall solution. We have already seen these changes in other technology areas, notably with smart devices and general IT systems. Cloud-based services put the onus on the result rather than which device the user chooses. This approach is even starting to manifest in areas that couldn’t have been predicted in the past, such as the car industry for example. Consumers are focusing more on the overall costs and convenience of buying a car over the specific specification of the vehicle. Equally, urban dwellers don’t necessarily want the hassle and expense of owning and parking their own vehicle anymore. If you don’t use it every day, it can make more sense to rent a vehicle only when you travel beyond public transport. For these consumers the car has become a service item for a specific journey. Benefits for end users At the heart of this approach is the simple equation that consumers have a need and suppliers need to provide the most cost-effective, and easiest, solution. At the same time, the security operator may not necessarily want to know (or care) what specification the system has, they just want it to perform the task as required.   By discussing with consumers, we can ensure we work even more closely with them to provide the expert support they need and deserve Most security buyers will identify the specific business needs and their budget to achieve this. This is where a service approach really comes into its own. Customers need expert advice on a solution for their requirements which takes away the stress of finding the right products/systems. In the past there was always a risk of purchasing an unsuitable solution, which could potentially be disastrous. The other issue was having to budget for a big capital expenditure for a large installation and then having to find further resources once an upgrade was due when systems went end of life. Most businesses find it far easier to pay a sensible monthly or annual fee that is predictable and can easily be budgeted for. A service model makes this far easier to achieve. Benefits of a service sales model As well as the benefits for end users, there are considerable benefits for security providers too. Rather than simply ‘shifting boxes’ and enduring the inevitable sales peaks and toughs this creates; a service sales model allows manufacturers and installers to enjoy a more stable business model. You don’t have to win new business with every product, but rather sell ongoing services for a set period. Its highly likely that the whole security industry will start to take this approach over the next few years. Manufacturers are already well aware of this shift in customer expectations and are changing their approach to meet demands.There are major opportunities on offer in return for a change of perspective in the security industry With the service and leasing approach already firmly entrenched in other industries, this is well proven in a consumer market. The airline industry is a great example. Manufacturers understand that airlines need flexibility to upscale and downscale operations and therefore whole aircraft and even individual key components (such as engines or seating) can be leased as required. Using this approach, airlines can concentrate on what customers demand and not worry about the logistics of doing this. Manufacturers and leasing businesses provide assurances and guarantees of service time for aircraft and engines, taking care of the servicing and maintenance to ensure this delivery. This approach is just as well suited for the provision of security systems. Servicing the future security market Undoubtedly there are major opportunities on offer in return for a change of perspective in the security industry. However, this will involve substantial changes in some quarters to ensure the business model is aligned with the market. Overall, the security industry needs to not only develop the right systems for the market, but also to deliver them in the right way as well. This will ensure we work even more closely with customers to provide the expert support they need and deserve.

Intelligent video surveillance and deep learning dominate MIPS 2018 agenda
Intelligent video surveillance and deep learning dominate MIPS 2018 agenda

Milestone Systems is embracing artificial intelligence and deep learning in a big way at this week's yearly Milestone Community Days (MIPS 2018) in Las Vegas. The Danish company's theme is "Creating an Intelligent World," and Milestone's stated goal is to make "the Milestone community part of every surveillance installation in the world."    Science fiction becomes reality In a presentation on opening day, Milestone CSMO Kenneth Hune Petersen pointed to the 2002 movie The Minority Report as highlighting a variety of gadgets and systems that seemed futuristic at the time but are now perfectly possible, and in some cases outdated. Films have previously highlighted gadgets and systems that were futuristic, but are now perfectly possible, or outdated "If we dare to dream together we can make this a better world," says Petersen. "Through AI and machine learning, we can help define tomorrow. There's no doubt about it: There is a massive business opportunity for us in artificial intelligence." Despite all the talk about artificial intelligence, only about 0.5 percent of all the data in the world has currently been analysed or used, says Peterson. "Our open platform technology is the foundation for intelligent video systems and our partners have the expertise and infrastructure needed to reach the next frontier in intelligent video solutions," said Bjørn Skou Eilertsen, Milestone Systems CTO. "Together, we can provide unlimited solutions for our customers." Deeper integration and broader coverage Expanding the Milestone community this year has included the addition of 1,000 new models of supported hardware devices; there are currently more than 7,000 models supported. Milestone is also pursuing broader coverage of installations through their partners, with deeper integration of functionality, and by deepening existing relationships with customers. ‘Creating an intelligent world’ includes deep learning and lots of video systems, says Milestone at their annual conference Under new agreements, hardware partners such as Dell EMC and BCDVideo now provide XProtect Essential+ software pre-loaded on servers they sell. The focus at MIPS 2018 on AI included a presentation by Tanmay Bakshi, the "world's youngest IBM coder" and TED Talk speaker, at 14 years old. The prodigy, who has been coding since the age of 4, has worked with IBM and other companies on a variety of AI-related projects. Using deep learning with video is currently limited because so much video is unlabelled and unstructured In his MIPS 2018 keynote speech, Bakshi traced the development of AI through high-profile events, such as IBM's development of the "Watson" computer, which successfully competed on Jeopardy!, and Google's development of AlphaGo, a program that successfully plays the complex ancient board game, Go. Data demands deep-learning Bakshi focused on security and healthcare as two disciplines where deep learning can potentially have a big impact. Using deep learning with video is currently limited because so much video is unlabeled and unstructured. Still, projections are that there will be a billion cameras worldwide by 2020, providing an over-abundance of data that demands the use of deep learning to make sense of it all. "There is a misconception that AI is meant to replace us, to make humans obsolete. AI is not replacing us. It is created by humans to amplify human skills. AI can reduce information overload to enable humans to work with the data more efficiently," said Bakshi. He suggested that AI is equivalent to IA; Bakshi's abbreviation meaning "intelligence augmented." AI can reduce information overload to enable humans to work with the data more efficiently The ability to scale AI applications using "distributed deep learning" and graphics processing unit (GPU) hardware is paving the way for greater use of deep learning in video applications. Adam Scraba, Global Business Development Lead at NVIDIA, outlined the trends that are making the current "Big Bang" of deep learning possible. He said it is "the most exciting time in tech history," with "software that can write its own software" now among the tools that make previously unsolvable problems now solvable. AI-driven intelligent video analytics can now achieve "super-human" results, he said. An intelligent world to combat crime Instead of sitting for hours staking out a suspected drug dealer alone, entire investigations now take hours instead of days A success story about the game-changing capabilities of video data was supplied by Hartford, Conn.'s Capital City Crime Center (C4). The Hartford police department uses video data in a "predictive policing" approach. They have created an "intelligent world with smart policing to combat drug trafficking," according to C4 Supervisor Johnmichael O'Hare of the Hartford Police Department. Instead of sitting for hours staking out a suspected drug dealer, for example, video of a site can be analysed to determine areas with higher levels of foot traffic that indicate drug buys. The result is investigations that take hours instead of days. Hartford incorporates several technologies, including ShotSpotter gunshot detection, Briefcam video synopsis and other systems, all tied together using the Milestone platform. More than 700 attendees make MIPS 2018 the largest such event ever, and exhibits by around 60 Milestone partner companies attest to the continuing expansion of the Milestone community. [Main image: Tanmay Bakshi (left) and Johnmichael O’Hare of the Hartford Police Department (right) discuss key security issues of the modern day]