Recent advances in VMS leverage surveillance video data for both loss and fraud prevention, as well customer insights
It is more complicated to search through video compared to text-based data

Since the launch of Google’s search engine in 1998, Internet search has grown and expanded from desktops to mobile devices, generating over 3.5 billion searches of text, images and videos per day. One likely reason for this popularity is the search engine’s ability to immediately produce relevant results based on search criteria.

The security industry, in contrast, has not always taken advantage of such innovations in search. The right search technology exists to help loss prevention and fraud investigators find security video evidence of criminal activity. Yet today, most investigators are watching endless hours of video instead of leveraging specific criteria to pinpoint the moment an event of interest occurs. Why can’t security video search perform like Google?

Challenges with searching relevant video footages

Consider a large bank with locations around the globe and 150,000 cameras monitoring these locations. With just one hour of recorded video per day per camera, the bank is generating over 50 million hours of video per year. Yet the fraud team staff is comprised of only 10 full time reviewers. With 2000 work hours per year, this team is only capable of reviewing 20,000 hours of video per year, or just .04 percent of what is being captured.

This example illustrates a common problem in security today. Most investigators conduct linear timeline searches, meaning they either watch live feeds of specific cameras or recorded video from a specific day when an event occurred. This often requires downloading the entire day’s video from a central storage server and then watching countless hours of video to find events of interest. As in the global bank example, there is simply too much video to watch for this approach to be successful. Not to mention the toll this can take on the corporate network, with bandwidth heavy video downloads interfering with critical application performance.

"Businesses can leverage video
data to learn about customer
behaviour, improve operations
and enhance other important
data sources"

Although video is the fastest growing type of big data today, it is more complicated to search video compared to text-based data. Keywords and descriptions of videos must be either automated or entered manually in contrast to text-based data that inherently includes keywords. Visual data such as video is complex, with layers of information and context about how people behave and interact. Software can deliver an unbiased analysis of this behaviour whereas humans will naturally insert bias when searching and viewing video. All of these factors make it more challenging to efficiently search video footage.

VMS for effective and efficient video search

Today’s explosive growth in the amount of video data is driving demand for more effective and efficient video search. Recent advances in video management systems (VMS) are now making it possible to leverage surveillance video data for both loss and fraud prevention, as well customer insights, such as in-store buying habits and trends. Leading VMS solutions include the basic store and record functionality plus a plug-in framework for analytics, enterprise search and case management, all in one system. A more effective search capability allows investigators to quickly search vast volumes of video and find relevant evidence in minutes by using specific criteria such as facial surveillance, license plate recognition and object tracking analytics.

Many VMS products also include context integrations that can correlate video footage with Access Control, ATM or POS transaction data. Leading businesses are now taking advantage of this same technology to analyse video data to better understand customer behaviour and operational metrics. Analytics such as people counting, dwell patterns, demographics and directional heat maps can be used to improve the customer experience, optimise staffing levels, increase conversion rates and analyse performance across locations.

Forensic search capability

In one example, a commercial parking firm had been relying on cameras recording the number of cars parked in their facilities to ensure this matched the tickets issued at the entry gate. Even with this video recorded, employees were still required to walk the garages every night to manually record every car by colour and license plate to accurately charge those cars that were left overnight. 

Once the facility switched to a newer VMS that included a more efficient search capability and license plate recognition analytic, the system was able to automatically capture all license plates that entered the garage. So if a customer loses their ticket, they can simply provide their license plate number so customer service reps can run a search and verify how long the car has been in the lot. This enables the company to accurately charge customers, preserve revenue, and save countless employee hours of walking the garages every night.

Newer VMS solutions reduce investigation time as well as helping businesses achieve quick ROI
A more effective search capability allows investigators to quickly search vast volumes of video and find relevant evidence in minutes

This type of forensic search capability has also helped to reduce employee theft and shoplifting investigation times for a major retailer. The company had a team of five loss prevention managers working at maximum capacity to investigate activity at over 1200 stores. By implementing a more effective video search solution, they were able to reduce investigation times from one week to 20 minutes and reduce shrink by 60%.  The newer VMS solutions are also so cost effective that this company achieved a return on investment in less than 10 months.

Simplifying business administration via analytics

In addition to improvements in security, businesses can leverage this same video data to learn about customer behaviour, improve operations and enhance other important data sources such as POS or ATM and teller transaction data. Retail stores are leveraging video analytics to more accurately measure in-store traffic, analyse associated traffic patterns (including demographics) and conversion rates to improve product placement and compare store performance across locations.

Queue management analytics can help businesses improve store operations with more efficient staff planning. Merchandising management can also benefit from a better understanding of accurate conversions based upon day and time to manage inventories and product placement.

For businesses that are ready to consider an upgrade to their security and surveillance system, and take advantage of these new capabilities to improve loss investigations and better understand customer behaviour, be sure to evaluate different solutions using the following VMS checklist:

  • Handle the basics of store and record
  • Deliver LP and BI leveraging one platform
  • Enterprise scale and capabilities
  • Analytics and context integration platform
  • Advanced search architecture
  • Multiple deployment options (hardware, software, on-premise, cloud)
  • Easily configured and administered

By choosing a VMS that meets these criteria, businesses can experience video search that parallels the Google experience.

Share with LinkedIn Share with Twitter Share with Facebook Share with Facebook
Download PDF version

In case you missed it

COVID-19 worries boost prospects of touchless biometric systems
COVID-19 worries boost prospects of touchless biometric systems

Spread of the novel coronavirus has jolted awareness of hygiene as it relates to touching surfaces such as keypads. No longer in favour are contact-based modalities including use of personal identification numbers (PINs) and keypads, and the shift has been sudden and long-term. Both customers and manufacturers were taken by surprise by this aspect of the virus’s impact and are therefore scrambling for solutions. Immediate impact of the change includes suspension of time and attendance systems that are touch-based. Some two-factor authentication systems are being downgraded to RFID-only, abandoning the keypad and/or biometric components that contributed to higher security, but are now unacceptable because they involve touching. Touchless biometric systems in demand The trend has translated into a sharp decline in purchase of touch modality and a sharp increase in the demand for touchless systems, says Alex Zarrabi, President of Touchless Biometrics Systems (TBS). Biometrics solutions are being affected unequally, depending on whether they involve touch sensing, he says. Spread of the novel coronavirus has jolted awareness of hygiene as it relates to touching surfaces such as keypads “Users do not want to touch anything anymore,” says Zarrabi. “From our company’s experience, we see it as a huge catalyst for touchless suppliers. We have projects being accelerated for touchless demand and have closed a number of large contracts very fast. I’m sure it’s true for anyone who is supplying touchless solutions.” Biometric systems are also seeing the addition of thermal sensors to measure body temperature in addition to the other sensors driving the system. Fingerscans and hybrid face systems TBS offers 2D and 3D systems, including both fingerscans and hybrid face/iris systems to provide touchless identification at access control points. Contactless and hygienic, the 2D Eye system is a hybrid system that combines the convenience of facial technology with the higher security of iris recognition. The system recognises the face and then detects the iris from the face image and zeros in to scan the iris. The user experiences the system as any other face recognition system. The facial aspect quickens the process, and the iris scan heightens accuracy. TBS also offers the 2D Eye Thermo system that combines face, iris and temperature measurement using a thermal sensor module. TBS's 2D Eye Thermo system combines face, iris and temperature measurement using a thermal sensor module Another TBS system is a 3D Touchless Fingerscan system that provides accuracy and tolerance, anti-spoofing, and is resilient to water, oil, dust and dirt. The 2D+ Multispectral for fingerprints combines 2D sensing with “multispectral” subsurface identification, which is resilient to contaminants and can read fingerprints that are oily, wet, dry or damaged – or even through a latex glove. In addition, the 3D+ system by TBS provides frictionless, no-contact readings even for people going through the system in a queue. The system fills the market gap for consent-based true on-the-fly systems, says Zarrabi. The system captures properties of the hand and has applications in the COVID environment, he says. The higher accuracy and security ratings are suitable for critical infrastructure applications, and there is no contact; the system is fully hygienic. Integration with access control systems Integration of TBS biometrics with a variety of third-party access control systems is easy. A “middleware” subsystem is connected to the network. Readers are connected to the subsystem and also to the corporate access control system. An interface with the TBS subsystem coordinates with the access control system. For example, a thermal camera used as part of the biometric reader can override the green light of the access control system if a high temperature (suggesting COVID-19 infection, for example) is detected. The enrollment process is convenient and flexible and can occur at an enrollment station or at an administration desk. Remote enrollment can also be accomplished using images from a CCTV camera. All templates are encrypted. Remotely enrolled employees can have access to any location they need within minutes. The 3D+ system by TBS provides frictionless, no-contact readings even for people going through the system in a queue Although there are other touchless technologies available, they cannot effectively replace biometrics, says Zarrabi. For example, a centrally managed system that uses a Bluetooth signal from a smart phone could provide convenience, is “touchless,” and could suffice for some sites. However, the system only confirms the presence and “identity” of a smart phone – not the person who should be carrying it. “There has been a lot of curiosity about touchless, but this change is strong, and there is fear of a possible second wave of COVID-19 or a return in two or three years,” says Zarrabi. “We really are seeing customers seriously shifting to touchless.”

How to maximise your body temperature detection systems
How to maximise your body temperature detection systems

There are many companies jumping into selling temperature detection systems to the state, local governments, hospitals, airports and local businesses, but do they know how to drive one? Anyone can get behind a car and drive it into a wall by accident. The same can happen with a temperature detection system.  The first thing you should ask is “does my firm have a certified thermographer?”. If not, the firm are at risk of getting a low quality system that is being resold to make quick cash. Businesses that are doing this do not know how to operate it properly. Asking the right questions Secondly, you should ask whether the system is NDAA compliant. NDAA compliance means that your temperature detection equipment is protected by U.S. law. Does your system have a HSRP device (blackbody)? HSRP (Heat Source Reference Point) is a device that will allow the camera to detect the correct temperature a distance. Even if the room temperature does change throughout the day, treat it as a reference point for the camera to know the temperature at that distance. Can your system scan mutliple people at once? Can your system scan mutliple people at once? This is a bad question but often asked since most systems will say yes. For ease, everyone wants to scan many people at once, but the best practice according to FDA and CDC guidelines is to run one person at a time for best accuracy. Why? The HSRP (blackbody) device tells the camera what the correct temperature is at a given distance away from the camera. Every foot you are away from the HSRP device will be off by 0.1 degrees roughly. If you are in a room full of people, let's say 6, in view of the camera, every person that is not next to the HSRP device (5) will be given an inaccurate reading. Hence why it is so important to run the system correctly with just one person at a time. You will also need to follow the 6 feet rule. If you take that into consideration, one at a time at 6 feet apart, the device should tell you how you need to run the system. Sensitivity of thermal imaging Is your system’s sensor accurate enough? The FDA recommends an error of ±0.5°C or better. When looking for a system, make sure it is better than what they recommend. I would recommend ±0.3°C or better. Do not purchase a system over ±-.5°C degrees as you are doing yourself and your customers or employees an injustice.  Another thing to look at is how many pixels it can determine the temperature from. Some cameras can only tell the temperature of 6 points on the screen, whilst others can take a temperature reading from each pixel. Take a 384x288 camera, for example, which would be over 110,000 points of temperature taking on a single image.      Thermal cameras are very sensitive, so there are a lot of do’s and don’ts. For example, the system cannot see through glasses or hats. On the below image you can see a person with the visual camera on the right, whilst on the left side is through a thermal camera.  Both are pointing at the same area. It is clear the person on the left side is “invisible” to the thermal imaging camera. Demonstrating the sensitivity of thermal imaging If you are a company who wants to detect the temperature of customers or employees though the front door, window or a car window, the answer would be no. You need a clear line of sight without any interference to scan for temperatures. Other things you need to look out for is wind and distance away from the HSRP (blackbody) device. Air and distance away from the HSRP device will make the system less and less accurate the more space between the device. Air and distance away from the HSRP device will make the system less and less accurate Thermal imaging and COVID-19 If you have a clear line of sight, is there anything I need to know? The answer is yes. Reflective materials such as metal can interfere with your temperature readings. Reflective materials are easily picked up from the thermal side so pointing at a medal, glass or anything reflective can cause inaccuracies within the system. In the age of COVID-19, temperature detection systems are more important than ever. Organisations must get a system in place to help scan for high temperatures in order to reduce the spread of the virus.

What are the security challenges of the oil and gas market?
What are the security challenges of the oil and gas market?

Protecting the oil and gas market is key to a thriving economy. The list of security challenges for oil and gas requires the best technology solutions our industry has to offer, from physical barriers to video systems to cybersecurity. We asked this week’s Expert Panel Roundtable: what are the security challenges of the oil and gas market?