If you have been to any of the many security industry tradeshows this year you will undoubtedly have seen and heard the phrase ‘next generation video analytics’. Is it just a catchy marketing phrase or is there more substance behind it? Video analytics as a technology has been with us for many years, but there has always been an air of confusion and mystery around it, in large part created by Hollywood movies, where every camera is connected, an operator can search the network and locate the villain in a matter of seconds.

In many ways, I am pleased to say that in many respects fact has caught up with fiction, with the newest video analytics solutions that are now on the market focusing on search and specifically real-time search. These solutions have been tried, tested and proven to help reduce search time from hours to minutes and even seconds.

Real-time search analytics

Real-time search analytics addresses one of the most important control room tasks - locating a person of interest. Put simply, by reducing the search time you significantly improve the chances of a favourable outcome. Whether it is working in real-time to reunite a lost child with their parents, aiding in the apprehension of a terror suspect, or working with the authorities following a major incident, every second counts.

Knowing where a person of interest
is at the current moment is vital, but
in certain situations you may also
want to know when and where
they entered the estate

However, the technology goes one-step further than pinpointing where on the CCTV network that person currently is. Yes, knowing where a person of interest is at the current moment is vital, but in certain situations you may also want to know when and where they entered the estate, the precise route they took, who they were with and what they did before arriving at their current location.

FAQ of real-time search analytics

With the introduction of any new technology there will always be some confusion around what it is, what it can do and whether you have the infrastructure in place to consider deploying it. With that in mind here are the top ten questions I have been asked many times about real-time search analytics…

  1. Who can I search for? Any person of interest
  2. What is the search based on? Full body image, textures, colours and unique characteristics
  3. What can I use as a reference? Upload photo, video image or human composite
  4. Does it require mega-pixel cameras? Suspect Search is camera type agnostic. Images need to be in colour CIF-Full HD resolution and a frame rate of QRT or higher
  5. How does it help me reduce my search time? It filters out 95% of irrelevant images
  6. How can I learn the suspect’s locations and movements? The suspect’s route is displayed on a map
  7. What is the recommended environment? The technology can be used indoor or outdoor
  8. Does it work in real-time? Yes, real-time search can be initiated in seconds
  9. What are the common use cases? Intruder search, lost child, unattended bag owner, locating a witness
  10. Where is the technology currently in use? Transport hubs, airports, city centres, hospitals, government facilities and sporting events
    The movie-makers of tomorrow are going to have to up their game in a big way, if they want to impress or maybe even inspire the security industry
    Next-generation video analytics is very much in the here and now

Practical application

So, how can it be used in day-to-day security operations? To best explain how it works in practice here is an example…

It is a Saturday afternoon and a family are attending a sporting event. The stadium holds 60,000 people and the concourses surrounding the entry gates are getting very crowded, with 30 minutes before the match is due to start. The family queue to go through the turnstiles and upon entering the stadium they soon get separated from their six-year-old son. Panicked, they ask the nearest steward for help, who arranges for an announcement to be made over the public-address system and, also notifies the control room.

The steward gives the control room operator a description of the young boy (short blonde hair, a light blue jacket and a small yellow backpack). He quickly enters this information in to the system by creating a human composite (otherwise known as an avatar) and in less than five seconds he is looking at a series of images where a person matching the description appeared on a surveillance camera. The rapid speed of the search is made possible because the system is capturing, indexing and storing data in real-time, from every camera located in and around the stadium complex.

The rapid speed of the search
is made possible because the
system is capturing, indexing
and storing data in real-time

Upon confirming that it is the boy in question the operator selects the camera feed of his last known location and the real-time feed shows him clearly at concession stands looking distressed. The nearest steward is notified and he waits with the boy until he is reunited with his parents. All of the information relating to this incident and others is logged both for training and to help the stadium staff make improvements to reduce the likelihood of incidents recurring.

This is a common scenario at a sporting event or shopping complex, but the same process can be applied to estates with hundreds or thousands of cameras across single or multiple sites, such as a sea or airport transportation hub or medical facility. What is more, the sports stadium in this example did not require any expensive camera upgrades in order to deploy real-time search analytics, as it worked with the infrastructure already in place.

Next-generation video analytics at present

Next-generation video analytics is very much in the here and now - in fact it is in real-time! What is more, it isn’t just for handling rare incidents but also daily occurrences that can absorb a lot of the control room operators’ time, and I make the point again that time is the number one critical factor when handling any incident.

The movie-makers of tomorrow are going to have to up their game in a big way, if they want to impress or maybe even inspire the security industry.

Share with LinkedIn Share with Twitter Share with Facebook Share with Facebook
Download PDF version

Author profile

Erez Goldstein Marketing Director, Qognify

In case you missed it

Managing security during unprecedented times of home working
Managing security during unprecedented times of home working

Companies are following government guidance and getting as many people as possible working from home. Some companies will have resisted home working in the past, but I’m certain that the sceptics will find that people can be productive with the right tools no matter where they are. A temporary solution will become permanent. But getting it right means managing risk. Access is king In a typical office with an on-premise data centre, the IT department has complete control over network access, internal networks, data, and applications. The remote worker, on the other hand, is mobile. He or she can work from anywhere using a VPN. Until just recently this will have been from somewhere like a local coffee shop, possibly using a wireless network to access the company network and essential applications. CV-19 means that huge numbers of people are getting access to the same desktop and files, and collaborative communication toolsBut as we know, CV-19 means that huge numbers of people are getting access to the same desktop and files, applications and collaborative communication tools that they do on a regular basis from the office or on the train. Indeed, the new generation of video conferencing technologies come very close to providing an “almost there” feeling. Hackers lie in wait Hackers are waiting for a wrong move amongst the panic, and they will look for ways to compromise critical servers. Less than a month ago, we emerged from a period of chaos. For months hackers had been exploiting a vulnerability in VPN products from Pulse Secure, Fortinet, Palo Alto Networks, and Citrix. Patches were provided by vendors, and either companies applied the patch or withdrew remote access. As a result, the problem of attacks died back.  But as companies race to get people working from home, they must ensure special care is taken to ensure the patches are done before switching VPNs on. That’s because remote desktop protocol (RDP) has been for the most part of 2019, and continues to be, the most important attack vector for ransomware. Managing a ransomware attack on top of everything else would certainly give you sleepless nights. As companies race to get people working from home, they must ensure special care is taken to ensure the patches are done before switching VPNs on Hackers are waiting for a wrong move amongst the panic, and they will look for ways to compromise critical serversExposing new services makes them also susceptible to denial of service attacks. Such attacks create large volumes of fake traffic to saturate the available capacity of the internet connection. They can also be used to attack the intricacies of the VPN protocol. A flow as little as 1Mbps can perturbate the VPN service and knock it offline. CIOs, therefore, need to acknowledge that introducing or extending home working broadens the attack surface. So now more than ever it’s vital to adapt risk models. You can’t roll out new services with an emphasis on access and usability and not consider security. You simply won’t survive otherwise. Social engineering Aside from securing VPNs, what else should CIO and CTOs be doing to ensure security? The first thing to do is to look at employee behaviour, starting with passwords. It’s highly recommended that strong password hygiene or some form of multi-factor authentication (MFA) is imposed. Best practice would be to get all employees to reset their passwords as they connect remotely and force them to choose a new password that complies with strong password complexity guidelines.  As we know, people have a habit of reusing their passwords for one or more online services – services that might have fallen victim to a breach. Hackers will happily It’s highly recommended that strong password hygiene or some form of multi-factor authentication (MFA) is imposedleverage these breaches because it is such easy and rich pickings. Secondly, the inherent fear of the virus makes for perfect conditions for hackers. Sadly, a lot of phishing campaigns are already luring people in with the promise of important or breaking information on COVID-19. In the UK alone, coronavirus scams cost victims over £800,000 in February 2020. A staggering number that can only go up. That’s why CIOs need to remind everyone in the company of the risks of clickbait and comment spamming - the most popular and obvious bot techniques for infiltrating a network. Notorious hacking attempts And as any security specialist will tell you, some people have no ethics and will exploit the horrendous repercussions of CV-19. In January we saw just how unscrupulous hackers are when they started leveraging public fear of the virus to spread the notorious Emotet malware. Emotet, first detected in 2014, is a banking trojan that primarily spreads through ‘malspam’ and attempts to sneak into computers to steal sensitive and private information. In addition, in early February the Maze ransomware crippled more than 230 workstations of the New Jersey Medical Diagnostics Lab and when they refused to pay, the vicious attackers leaked 9.5GB or research data in an attempt to force negotiations. And in March, an elite hacking group tried to breach the World Health Organization (WHO). It was just one of the many attempts on WHO and healthcare organisations in general since the pandemic broke. We’ll see lots more opportunist attacks like this in the coming months.   More speed less haste In March, an elite hacking group tried to breach the World Health Organization (WHO). It was just one of the many attempts on WHOFinally, we also have bots to contend with. We’ve yet to see reports of fake news content generated by machines, but we know there’s a high probability it will happen. Spambots are already creating pharmaceutical spam campaigns thriving on the buying behaviour of people in times of fear from infection. Using comment spamming – where comments are tactically placed in the comments following an update or news story - the bots take advantage of the popularity of the Google search term ‘Coronavirus’ to increase the visibility and ranking of sites and products in search results. There is clearly much for CIOs to think about, but it is possible to secure a network by applying some well thought through tactics. I believe it comes down to having a ‘more speed, less haste’ approach to rolling out, scaling up and integrating technologies for home working, but above all, it should be mixed with an employee education programme. As in reality, great technology and a coherent security strategy will never work if it is undermined by the poor practices of employees.

How does audio enhance security system performance?
How does audio enhance security system performance?

Video is widely embraced as an essential element of physical security systems. However, surveillance footage is often recorded without sound, even though many cameras are capable of capturing audio as well as video. Beyond the capabilities of cameras, there is a range of other audio products on the market that can improve system performance and/or expand capabilities (e.g., gunshot detection.) We asked this week’s Expert Panel Roundtable: How does audio enhance the performance of security and/or video systems? 

How have standards changed the security market?
How have standards changed the security market?

A standard is a document that establishes uniform engineering or technical criteria, methods, processes, and/or practices. Standards surround every aspect of our business. For example, the physical security marketplace is impacted by industry standards, national and international standards, quality standards, building codes and even environmental standards, to name just a few. We asked this week’s Expert Panel Roundtable: How have standards changed the security market as we know it?