Nowadays, there is a lot of hype around data and its utility for almost any industry – from security and law enforcement to business operations and retail. While we are inundated with information about data and its significance to business success, technological development and fulfilling the promise of the Internet of Things, we don’t always get practical feedback as to how to obtain this valuable data from the resources available to us.

Security teams feel this challenge acutely. As an industry that depends on accurate intelligence and real-time information, data is vital for preventing breaches, reacting to threats, and maintaining public safety.

Obstacles in video surveillance monitoring

One of the primary resources at the disposal of security teams is video, yet extracting insights from this medium has never been particularly efficient. Monitoring video feeds takes time and – even if security teams have sufficient resources – after twenty minutes of reviewing surveillance footage, 95% percent of incidents are likely to be missed and 98% of recorded video is never even watched (source: Accenture.

New developments in video analytics are revolutionising this reality. Video analytics based on Video Synopsis technology makes it possible to review hours of video in minutes and easily extract actionable data from video, enabling immediate and effective response. To fully understand how this works and how to retrieve these insights, we need to break down what actionable data means, how it is extracted from video and how to interpret the data output and results.

 Video Synopsis technology

Simply put, actionable data is information that can be easily and effectively utilised. Regardless of the business sector or market, actionable video data refers to information about who and what is being viewed, as well as quantitative statistics about these elements, enabling the detection of anomalous behaviour.

Using the who and what data, viewers now have statistical data about the video content

Video Synopsis technology analyses the video and determines all the objects in the video. It then classifies this data to make it easier for the viewer to understand who is in the video. Objects are evaluated and indexed based on factors such as size and appearance, enabling the technology to filter them into categories, such as person or vehicle. Smart Video Synopsis can deliver rich classification, drilling down to categories such as gender and vehicle type, from buses to bicycles and everything in between.

The technology also determines what the objects are doing: where and how fast they are moving, – noting any lack of movement, as well – and how long the behaviour persists. Using the who and what data, viewers now have statistical data about the video content. Having these statistics is key for understanding the baseline of activity in a video feed. Once normative behaviour has been analysed and established, the viewer can be alerted in the case of abnormal behaviour, which, for instance, could be used to indicate a security threat.

Extracting of actionable data

Ironically enough, the only way to extract actionable data is possessing plenty of video data. Today, there are various video analytics technologies that can extract and identify objects with deep learning techniques, using deep neural networks (DNNs) that imitate the way humans are taught and learn. Processing multiple videos and through deep learning techniques, these technologies can detect, classify, and recognise features and objects in video better and faster.

Video analytics and data in a retail application
Using video data, retail businesses can decide where to display expensive products, prevent shop lifting, and enhance the overall customer experience

By processing more video and aggregating more metadata, the right system becomes increasingly efficient at searching, tracking, and understanding object behaviour in videos. It can be used to learn and monitor activity, closely analyse complex scenes, and present object behaviours in a detailed and organised fashion that makes it easier to evaluate. For example, increased scene coverage for occupancy, crowd and queue control, cross camera search and, recently, metadata aggregation over time trending.

Metadata is also easier to store and save than the actual video footage, because it takes up less bandwidth. Effective video analytics solutions can extract information from video in the form of metadata, quickly and cost-effectively upload the metadata to the cloud and aggregate it to generate reports and identify developing trends.

Interpretation of video data results

Metadata is the key for further unlocking the potential of video analytics, but, for the data to be useful, it must be presented to the user in conducive ways: Each vertical has its own requirements for ingesting and applying data from video, and video analytics offers solutions for the varying needs of every business type.

For law enforcement and safety organisations, for instance, the ability to review large volumes of video quickly is important. Video analytics based on Video Synopsis enables security teams to watch hours of video in minutes, by simultaneously presenting objects that appeared at different times in the original video. This helps investigators quickly identify threats and find targets in recorded video.

Video analytics based on Video Synopsis enables security teams to watch
hours of video in minutes

Uses for data in retail applications

Enterprise businesses, such as retailers, have different needs and are more reliant on statistical data derived from video than from watching the actual video footage. Video data can be presented in easily readable dashboards, and reports and business intelligence can effectively be disseminated throughout the organisation. As a result, businesses can understand where customers tend to linger in stores and which displays are most popular: Information which can then be used to decide where to display expensive products, how to optimise staffing, convert wavering shoppers, prevent shop lifting, and enhance the overall customer experience by understanding and meeting their preferences, habits and needs.

From security teams to corporate businesses to municipal bodies, having actionable data helps all organisations streamline their operations, recognise inefficient work flows and understand which behaviours and activities are most effective. The technology is developing in a direction where business intelligence offered by video analytics is becoming predictive, opening doors to more efficient business practices, from enabling faster response to prevent terror to validating investment in video across verticals and use cases.

Share with LinkedIn Share with Twitter Share with Facebook Share with Facebook
Download PDF version

Author profile

In case you missed it

Managing security during unprecedented times of home working
Managing security during unprecedented times of home working

Companies are following government guidance and getting as many people as possible working from home. Some companies will have resisted home working in the past, but I’m certain that the sceptics will find that people can be productive with the right tools no matter where they are. A temporary solution will become permanent. But getting it right means managing risk. Access is king In a typical office with an on-premise data centre, the IT department has complete control over network access, internal networks, data, and applications. The remote worker, on the other hand, is mobile. He or she can work from anywhere using a VPN. Until just recently this will have been from somewhere like a local coffee shop, possibly using a wireless network to access the company network and essential applications. CV-19 means that huge numbers of people are getting access to the same desktop and files, and collaborative communication toolsBut as we know, CV-19 means that huge numbers of people are getting access to the same desktop and files, applications and collaborative communication tools that they do on a regular basis from the office or on the train. Indeed, the new generation of video conferencing technologies come very close to providing an “almost there” feeling. Hackers lie in wait Hackers are waiting for a wrong move amongst the panic, and they will look for ways to compromise critical servers. Less than a month ago, we emerged from a period of chaos. For months hackers had been exploiting a vulnerability in VPN products from Pulse Secure, Fortinet, Palo Alto Networks, and Citrix. Patches were provided by vendors, and either companies applied the patch or withdrew remote access. As a result, the problem of attacks died back.  But as companies race to get people working from home, they must ensure special care is taken to ensure the patches are done before switching VPNs on. That’s because remote desktop protocol (RDP) has been for the most part of 2019, and continues to be, the most important attack vector for ransomware. Managing a ransomware attack on top of everything else would certainly give you sleepless nights. As companies race to get people working from home, they must ensure special care is taken to ensure the patches are done before switching VPNs on Hackers are waiting for a wrong move amongst the panic, and they will look for ways to compromise critical serversExposing new services makes them also susceptible to denial of service attacks. Such attacks create large volumes of fake traffic to saturate the available capacity of the internet connection. They can also be used to attack the intricacies of the VPN protocol. A flow as little as 1Mbps can perturbate the VPN service and knock it offline. CIOs, therefore, need to acknowledge that introducing or extending home working broadens the attack surface. So now more than ever it’s vital to adapt risk models. You can’t roll out new services with an emphasis on access and usability and not consider security. You simply won’t survive otherwise. Social engineering Aside from securing VPNs, what else should CIO and CTOs be doing to ensure security? The first thing to do is to look at employee behaviour, starting with passwords. It’s highly recommended that strong password hygiene or some form of multi-factor authentication (MFA) is imposed. Best practice would be to get all employees to reset their passwords as they connect remotely and force them to choose a new password that complies with strong password complexity guidelines.  As we know, people have a habit of reusing their passwords for one or more online services – services that might have fallen victim to a breach. Hackers will happily It’s highly recommended that strong password hygiene or some form of multi-factor authentication (MFA) is imposedleverage these breaches because it is such easy and rich pickings. Secondly, the inherent fear of the virus makes for perfect conditions for hackers. Sadly, a lot of phishing campaigns are already luring people in with the promise of important or breaking information on COVID-19. In the UK alone, coronavirus scams cost victims over £800,000 in February 2020. A staggering number that can only go up. That’s why CIOs need to remind everyone in the company of the risks of clickbait and comment spamming - the most popular and obvious bot techniques for infiltrating a network. Notorious hacking attempts And as any security specialist will tell you, some people have no ethics and will exploit the horrendous repercussions of CV-19. In January we saw just how unscrupulous hackers are when they started leveraging public fear of the virus to spread the notorious Emotet malware. Emotet, first detected in 2014, is a banking trojan that primarily spreads through ‘malspam’ and attempts to sneak into computers to steal sensitive and private information. In addition, in early February the Maze ransomware crippled more than 230 workstations of the New Jersey Medical Diagnostics Lab and when they refused to pay, the vicious attackers leaked 9.5GB or research data in an attempt to force negotiations. And in March, an elite hacking group tried to breach the World Health Organization (WHO). It was just one of the many attempts on WHO and healthcare organisations in general since the pandemic broke. We’ll see lots more opportunist attacks like this in the coming months.   More speed less haste In March, an elite hacking group tried to breach the World Health Organization (WHO). It was just one of the many attempts on WHOFinally, we also have bots to contend with. We’ve yet to see reports of fake news content generated by machines, but we know there’s a high probability it will happen. Spambots are already creating pharmaceutical spam campaigns thriving on the buying behaviour of people in times of fear from infection. Using comment spamming – where comments are tactically placed in the comments following an update or news story - the bots take advantage of the popularity of the Google search term ‘Coronavirus’ to increase the visibility and ranking of sites and products in search results. There is clearly much for CIOs to think about, but it is possible to secure a network by applying some well thought through tactics. I believe it comes down to having a ‘more speed, less haste’ approach to rolling out, scaling up and integrating technologies for home working, but above all, it should be mixed with an employee education programme. As in reality, great technology and a coherent security strategy will never work if it is undermined by the poor practices of employees.

How does audio enhance security system performance?
How does audio enhance security system performance?

Video is widely embraced as an essential element of physical security systems. However, surveillance footage is often recorded without sound, even though many cameras are capable of capturing audio as well as video. Beyond the capabilities of cameras, there is a range of other audio products on the market that can improve system performance and/or expand capabilities (e.g., gunshot detection.) We asked this week’s Expert Panel Roundtable: How does audio enhance the performance of security and/or video systems? 

How have standards changed the security market?
How have standards changed the security market?

A standard is a document that establishes uniform engineering or technical criteria, methods, processes, and/or practices. Standards surround every aspect of our business. For example, the physical security marketplace is impacted by industry standards, national and international standards, quality standards, building codes and even environmental standards, to name just a few. We asked this week’s Expert Panel Roundtable: How have standards changed the security market as we know it?