Security analysts IMS Research have charted a 65% annual compound growth in the video analytics market since 2004 and predict that the sector will be worth £215 million in 2009.  Here, Chris Gomersall, Chief Executive Officer of London-based analytics provider Ipsotek, outlines the technology, describes on-site challenges and considers likely developments.

Referred to variously as "intelligent video surveillance" or "intelligent scene analysis", video analytics employs algorithms and vector partitioning to detect unexpected movement or unusual behaviour that may pose a threat to people, property and infrastructure.  The software filters and interprets data captured by CCTV cameras in circumstances where a human observer would struggle to assess developments as they arise.  The analysis can be performed in real-time or retrospectively in playback for evidential purposes.  Real-time messages on potential risks or situations requiring attention can take the form of audible and visual alarms, on-screen alerts, SMS messaging and direct communication with emergency services.

Audio and video analytics can now be combinedCommon scenarios observed by analytics suites include border security, abnormal pedestrian or vehicular motion, suspect packages, platform suicide and many forms of street crime or deviation from social norms.  Such deviation can cover prostitution, kerb crawling, drug dealing and trackside intrusion.

Scene analysis providers have built up a flexible core of behavioural algorithms to create numerous generic and client-specific alarm triggers.  These can cover complex needs or be as simple as surveillance of a sterile zone.  In addition to the scenarios described above, usage can include prevention of ATM surfing, graffiti, vandalism, tailgating, loitering, theft of museum artefacts, station or stadium overcrowding and platform suicide.

Combating operator fatigue

A principal benefit of video analytics is that it removes the problem of operator fatigue.  Estimates vary but published figures indicate that after 20 minutes the ability of even a well-motivated security guard to concentrate on a monitor screen drops by 90%.  Mechanised observation not only eliminates human error but also requires a low ratio of monitors to cameras with attention being focused on known "hotspots" and previously identified issues.  The technology also produces savings in review processes since less time is spent observing eventless footage and false alarms are minimised.  Expenditure on human resources is reduced dramatically since the numbers of cameras to operator (typically more than 1:100) is high.

Distinguishing horse play from true aggressionA video analytics software suite can be "taught" to discriminate between movement that is meaningful and motion such as a swaying tree that is an integral part of the environment and not a threat.  Thus, swaying foliage which might need to be masked out of the scene when using cruder systems can be distinguished from salient movement such as an intruder penetrating a location from the same piece of wind-effected woodland.

A sophisticated video analytics suite can overcome occasional picture break-up and interference (known to video engineers as "noise") without producing nuisance alarms.  Low levels of ambient light and varying weather conditions can also be accommodated by an analytics system that has been carefully configured.  Leading analytics solutions use object tracking to evaluate individual objects and follow their movement.  The technology's ability to chart the movement of a single suspect in a crowded scene through vector analysis is perhaps the crucial development that is making analytics a viable approach in public spaces.

Combining audio with video analysis

A crucial step forward for the analytics sector has been the use of audio analysis in tandem with video analysis.  Audio analysis can cover detection of gunshots and airplanes as well as the sound of abnormal mechanical processes such as a car engine malfunctioning.

A common inner-city application is detection of shouting or screaming consistent with assault or rape.  Effective audio analysis frequently allows security officers to intervene before an incident escalates and the analysis can be invaluable for evidential purposes.  Sterile zones and unusual vehicular behaviourThere is also much scope for applications within transport infrastructure and recent audio analysis at Schipol Airport in the Netherlands revealed that a significant proportion of the noise cited by residents as emanating from aircraft was in fact produced by vehicles on an adjacent motorway.  

As with video analysis, false alarms in the audio field are an anathema to the end-user and damage the credibility of the technology.  Thus, the ability to categorise and separate sounds, making distinctions between, say, rowdy but non-threatening behaviour outside a night-spot and audio signals that indicate a genuine problem becomes an all-important feature.

Distinguishing aggression using audio analytics

It is in social deviance that video analytics holds out massive potential for central and local government.  For many years the CCTV sector's ability to provide security officers with almost limitless video footage has far outstripped the ability of operators to interpret that footage.  High quality, intelligent video analytics has changed this, and a gamut of situations indicating undesirable social behaviour can be assimilated by the software to create alarms.

Body language and pattern of movement in video analysis

Kerb-crawling and prostitutes working from cars are examples where pattern of movement can be used to cue an alarm.  Posture and movement are also relevant to car theft and a correctly configured analytics device in a parking lot will be able to distinguish between the legitimate behaviour of a driver walking straight to his car and unlocking it with the contrasting behaviour of a criminal hovering near a succession of vehicles and assessing them before attempting a break-in. 

Loitering consistent with ATM pin surfingPublic concern over street security, particularly anti-social behaviour, continues to escalate across Europe but video analytics now offers viable solutions for reducing social disturbance.  Intelligent scene analysis is about to bring massive benefits to civil servants and law enforcement bodies who are sufficiently far-sighted to recognise the potential of the technology in this area.

Research and development

Analytics suppliers are currently addressing myriad scenarios in both the commercial and public sectors.  If the software is to continue to keep pace with the variety of tracking demanded by end-users, algorithms and behavioural analysis must develop continually since the type of deviation from normal behaviour against which clients wish to discriminate is infinite.  Some user needs verge on the bizarre and Ipsotek recently received a request from a client who wished to use audio analytics to detect sectarian chanting at football matches.

Multi-platform capability and human resources saving

One of the principal benefits of video analytics is that it can be installed to work with legacy CCTV systems and analogue cameras.  Providing video footage is transmitted to a suitable digital video recorder or network video recorder there is no necessity for IP-addressable cameras though network-addressable systems are of course becoming increasingly common. 

Trackside intrusion and inappropriate behaviourThe financial savings on manned guarding and control room staff are enormous and in a recent development, an Ipsotek client in the estate management sector has expanded its use of video analytics at a cost of €35,000 when a comparable increase in manned guarding would have cost in excess of €56,000 with the surveillance being performed at a demonstrably inferior level.

As analytics continues to improve and the leading providers respond resourcefully to a broad range of user demands, scene analysis will gain wider acceptance in both government and commercial spheres.  The scenarios detected will become increasingly subtle, allowing innovative end-users to improve public safety by employing this exciting technology.

Chris Gomersall, Chief Executive Officer, Ipsotek Ltd

Chris Gomersall
Chief Executive Officer
Ipsotek Ltd.

Download PDF version

In case you missed it

4K analogue cameras are still an ideal solution for video surveillance systems
4K analogue cameras are still an ideal solution for video surveillance systems

One of the toughest business decisions companies need to make is when selecting a new video surveillance system, as it’s a rigorous process to compare camera offerings and technologies, and to evaluate price structures. With its proven performance over the last several years, IP surveillance systems have become the defacto standard for most professionals. Those experts typically cite the numerous benefits that IP cameras offer, including higher image resolution, ease of installation, scalability, and analytics as rationale – which are all valid. However, the biggest drawback is the high price tag when considering making the switch from an analogue to a dedicated IP surveillance system. In reality, many end users don’t need networked IP cameras in every location throughout their facility, as the additional features and benefits IP cameras typically provide may not be necessary in every location. Ultimately, the decision to stick with analogue or move to IP needs to be based on your surveillance objectives and future needs. Advantages of 4K Consider this – you’re managing an analogue surveillance system and your primary goal is to increase image resolution; 4K analogue cameras may be your ideal solution. Advanced 4K analogue surveillance cameras deliver a myriad of advantages, including: Superior resolution Lower cost and easy installation. Picture clarity even under changing or difficult lighting conditions Models with 2 and 4 megapixel resolution, such as Dahua’s HDCVI 4K cameras with scalable HD-over-coax technology, provide security professionals with greater situational awareness and are available in multiple form factors to provide exceptional quality video & audio for a wide range of surveillance applications.Since 4K analogue cameras are not connected to an IP network, they do not present the cybersecurity risks that are typically associated with IP cameras Greater distance, greater definition Another benefit of 4K analogue cameras is that their higher number of pixels provides increased digital zoom performance without pixilation versus traditional HD or 2K cameras. This allows security operators to see further into the distance with greater definition. The added resolution is especially important for popular applications that require higher levels of detail, such as face and licence plate recognition or object analysis, as well as emerging video analytics and artificial intelligence applications for future system enhancements. 4K analogue applications 4K analogue cameras are also ideally suited to cover large fields of view such as in sports stadiums or airports with great detail and accurate colour reproduction. Their superior digital zoom capabilities can allow 4K analogue cameras to do the work of two cameras – one for a wide view and another for close-up – without sacrificing quality or compromising security. This can also help dramatically reduce hardware and installation cost, and simplify video monitoring. Finally, since 4K analogue cameras are not connected to an IP network, they do not present the cybersecurity risks that are typically associated with IP cameras. With the ever-increasing amount of sensitive and personal information stored on networked drives at businesses of all types, the value of removing one more potential network entry point cannot be understated. Overall, with 4K analogue cameras, security professionals can take advantage of higher resolution video on an existing, cost-effective platform that’s safe from network intruders with isolated and limited installation downtime and exceptional cost-efficiencies.

How new video surveillance technology boosts airport security and operations
How new video surveillance technology boosts airport security and operations

The air travel industry has evolved from one commercial passenger on the first commercial flight in 1914 to an estimated 100,000 flights per day. According to The International Air Transport Association (IATA), the total number of passengers who flew in 2017 is expected to reach 3.7 billion.   But it’s not just people who fly. Each day, more than $18.6 billion of goods travel by air, which represents one-third of all world trade, by value. Meanwhile, the aviation industry supports more than 63 million jobs and generates $2.2 trillion in economic activity. According to the IATA, 3.5% of the global economy relies on aviation. Evolving airport security for today’s demands Airport security continues to evolve as well, as security personnel strive to keep ahead of increasing threats and the compliance issues enacted to help address them. It’s taken nearly 40 years to progress from the first widespread use of X-ray scans and metal detectors to today’s full-body imaging and video surveillance solutions to mitigate security breaches and other critical security challenges. Employing airport security solutions is a complex situation with myriad government, state and local rules and regulations that need to be addressed while ensuring the comfort needs of passengers. Airport security is further challenged with improving and increasing operational efficiencies, as budgets are always an issue. As an example, security and operational data must be easily shared with other airport departments and local agencies such as police, customs, emergency response and airport operations to drive a more proactive approach across the organisation. New surveillance technologies To manage these and other issues facing the aviation industry, airport security management is increasingly looking to leverage new surveillance technologies to help streamline operations and to build stronger security programs. New and enhanced surveillance technologies such as powerful open platform Video Management Systems (VMS), HD panoramic cameras, and highly specialised video analytics are at the heart of today’s advanced networked surveillance solutions for airports and aviation facilities. Airport perimeters are quite extensive in size, irregular in shape, and subject to compromised visibility due to poor lighting Protecting the perimeter As an example, many airport perimeters are quite extensive in size, irregular in shape, and subject to compromised visibility due to poor lighting. Compounding the security challenge, these perimeters are often protected only by simple fences that can be easily scaled or broken through, and areas outside the fences may include wild forests in rural areas or residential and commercial buildings in more populous regions. All of these factors make it all the more difficult – and all the more important – to keep watch on perimeter areas. Analytics boosts effectiveness Camera coverage is the first step for monitoring the perimeter, but to improve the monitoring of these areas, airports can automate much of the monitoring, threat identification and notification needed to keep the entire premises safe by implementing video analytics. Market-leading offerings now include cameras with built-in analytic functions to make it easier and more effective to implement improved detection. For example, some of the more commonly available functions now include perimeter crossing, intrusion detection, object left behind, object missing, and wrong direction.Surveillance technologies allow the creation of virtual fences which can send a security team proactive notices of suspicious activity With these functions already built in, today’s high-performance security cameras not only capture clear video but can also employ analytics to monitor the field of view. In the case of an airport perimeter, analytics can be set up to automatically monitor a fence line to detect breaches or potential breaches while filtering out false alarms from small animals or blowing debris and alert authorities quickly when action is needed. Surveillance cameras can also be easily deployed over a perimeter to quickly detect and identify causes of perimeter breaches, and provide instant alerts to notify personnel where the breach is occurring, reducing the need for security personnel to physically monitor miles of perimeter fencing. In fact, surveillance technologies allow the creation of virtual fences which can send a security team proactive notices of suspicious activity. VMS Systems control with confidence All perimeter surveillance solutions can be integrated with an airport’s VMS, providing users with an easy-to-manage centralised hub to monitor and manage airport security. Overall, a perimeter security solution can help keep unauthorised individuals away from runways, taxiways, aircraft and other airport infrastructure in all types of weather conditions and environments. Within other restricted areas of an airport, such as parking lots, garages and secured areas, surveillance solutions are available to reduce risk and improve security. In a parking garage, IP cameras and a VMS can integrate third-party analytics to quickly identify and alert personnel when unauthorised vehicles have entered a restricted area, including vehicles with license plates on watch lists. When an alert is detected, data from third-party vehicle tracking software can be accessed via the VMS to monitor and track the vehicles activity while security personnel get into position to investigate further. Preventing theft in airports On the tarmac and inside baggage handling areas, loss or theft of luggage and other high-ticket items not only cause brand damage to an airport or airline, but complaints from travellers. A CNN analysis of passenger property loss claims filed with the TSA from 2010 to 2014 shows 30,621 claims of missing valuables, mostly packed in checked luggage. The rest occurred at security checkpoints. Total property loss claimed is estimated at $2.5 million. Loss or theft of luggage and other high-ticket items not only cause brand damage to an airport or airline, but complaints from travellers Security technology can mitigate the issue with IP cameras and VMS integrated with a Baggage Handling Systems (BHS) to automatically validate system operation and abnormal behaviours. This allows security and operations management to see where and why alarms are triggered so they can quickly respond and mitigate the problem. Monitoring crowds and foot traffic Inside an airport, VMS solutions with analytics capabilities can monitor crowd movements and anticipate and proactively respond to choke points, crowd patterns and foot traffic flow to reduce risk and improve security. The solutions can quickly and efficiently locate a person of interest, such as a lost child, for example, and search for shirt colour, estimated height to facial features, and more. With the ability to track via recorded and live video, security personnel can start their search from the moment the child was last seen and track their movement throughout the entire airport. Murtala Muhammed Airport Terminal Two (MMA2), Nigeria’s preeminent air terminal, is one example of an airport that is benefitting from a security technology upgrade to mitigate security threats. The airport is using an open platform VideoXpert™ Video Management System (VMS) in addition to a combination of low-light cameras and high-resolution dome cameras to secure its parking structure, perimeter, baggage claim points, cargo area and other parts of the airport.With the ability to track via recorded and live video, security personnel can track a person’s movement throughout the entire airport The security cameras are providing airport security with high-quality images, motion detection, advanced tracking capabilities, and on-board analytics, while the VMS is unifying operational and security data via a single user interface and allowing airport security to be more proactive in its incident response. People counting and ANPR In the U.S., a large cargo airport has employed 1,100 IP video cameras with a new Video Management System (VMS) solution to address the entire airport’s needs, including security and surveillance. The solution not only features crystal clear images, but also can archive video for 30 days at 30 images per second. A VMS manages the system and provides valuable analytics, including people-counting and number plate capture. It will soon add an enterprise security solution to improve access control system management and integration with the VMS. Airports around the world are increasingly realising the benefits of advanced surveillance solutions to drive operational intelligence and provide comprehensive situational awareness. As the transportation industry continues to expand, so will their use of more advanced surveillance systems on the enterprise level that incorporate even higher levels of system control and management, wide area coverage imaging solutions, and intelligence to keep passengers safe and operations running smoothly.

The new alliance of humans and robotics in security solutions in 2018
The new alliance of humans and robotics in security solutions in 2018

  The past year has proved to be a year full of many changes both within our industry and for Robotic Assistance Devices (RAD). While we have experienced increased adoption of artificial intelligence-based solutions, the industry has been challenged with an ever-evolving technology landscape. Protecting enterprise organisations from both cyber and physical security threats will be an ongoing challenge the industry must grapple with. Greater adoption of robotic solutions To address the physical security challenges, we saw a greater adoption of robotic solutions across the board. Our massive industry started to make the change: Shifting from an uneducated view of this advanced technology to increased interest about artificial intelligence across multiple markets including guarding companies, integrators and, most importantly, end-users. In 2017 there was a greater adoption of robotic solutions across the board With security-guard robots, security directors now have access to additional tools to meet their performance and budget goals. Currently, we see a great adoption with progressive guarding companies, which are signing up to have RAD as their robotic guarding partner. RAD deployed its first robot this year, and we look forward to deploying many more as we work with our customers to customise our robotic solution to their needs. Human collaboration with robotics I believe our industry is at the beginning stages of what could be a serious paradigm shift in how we rely on a combination of humans and technology to do a job. We've seen that in video analytics and the wide variety of solutions available on the market today. The trend has progressed beyond video analytics and into robotics, and that will continue to evolve into 2018 and beyond. As we continue to build on the success of our security guard robot solution, we look forward to expanding our product offerings to meet the security needs of our customers.