Security analysts IMS Research have charted a 65% annual compound growth in the video analytics market since 2004 and predict that the sector will be worth £215 million in 2009.  Here, Chris Gomersall, Chief Executive Officer of London-based analytics provider Ipsotek, outlines the technology, describes on-site challenges and considers likely developments.

Referred to variously as "intelligent video surveillance" or "intelligent scene analysis", video analytics employs algorithms and vector partitioning to detect unexpected movement or unusual behaviour that may pose a threat to people, property and infrastructure.  The software filters and interprets data captured by CCTV cameras in circumstances where a human observer would struggle to assess developments as they arise.  The analysis can be performed in real-time or retrospectively in playback for evidential purposes.  Real-time messages on potential risks or situations requiring attention can take the form of audible and visual alarms, on-screen alerts, SMS messaging and direct communication with emergency services.

Audio and video analytics can now be combinedCommon scenarios observed by analytics suites include border security, abnormal pedestrian or vehicular motion, suspect packages, platform suicide and many forms of street crime or deviation from social norms.  Such deviation can cover prostitution, kerb crawling, drug dealing and trackside intrusion.

Scene analysis providers have built up a flexible core of behavioural algorithms to create numerous generic and client-specific alarm triggers.  These can cover complex needs or be as simple as surveillance of a sterile zone.  In addition to the scenarios described above, usage can include prevention of ATM surfing, graffiti, vandalism, tailgating, loitering, theft of museum artefacts, station or stadium overcrowding and platform suicide.

Combating operator fatigue

A principal benefit of video analytics is that it removes the problem of operator fatigue.  Estimates vary but published figures indicate that after 20 minutes the ability of even a well-motivated security guard to concentrate on a monitor screen drops by 90%.  Mechanised observation not only eliminates human error but also requires a low ratio of monitors to cameras with attention being focused on known "hotspots" and previously identified issues.  The technology also produces savings in review processes since less time is spent observing eventless footage and false alarms are minimised.  Expenditure on human resources is reduced dramatically since the numbers of cameras to operator (typically more than 1:100) is high.

Distinguishing horse play from true aggressionA video analytics software suite can be "taught" to discriminate between movement that is meaningful and motion such as a swaying tree that is an integral part of the environment and not a threat.  Thus, swaying foliage which might need to be masked out of the scene when using cruder systems can be distinguished from salient movement such as an intruder penetrating a location from the same piece of wind-effected woodland.

A sophisticated video analytics suite can overcome occasional picture break-up and interference (known to video engineers as "noise") without producing nuisance alarms.  Low levels of ambient light and varying weather conditions can also be accommodated by an analytics system that has been carefully configured.  Leading analytics solutions use object tracking to evaluate individual objects and follow their movement.  The technology's ability to chart the movement of a single suspect in a crowded scene through vector analysis is perhaps the crucial development that is making analytics a viable approach in public spaces.

Combining audio with video analysis

A crucial step forward for the analytics sector has been the use of audio analysis in tandem with video analysis.  Audio analysis can cover detection of gunshots and airplanes as well as the sound of abnormal mechanical processes such as a car engine malfunctioning.

A common inner-city application is detection of shouting or screaming consistent with assault or rape.  Effective audio analysis frequently allows security officers to intervene before an incident escalates and the analysis can be invaluable for evidential purposes.  Sterile zones and unusual vehicular behaviourThere is also much scope for applications within transport infrastructure and recent audio analysis at Schipol Airport in the Netherlands revealed that a significant proportion of the noise cited by residents as emanating from aircraft was in fact produced by vehicles on an adjacent motorway.  

As with video analysis, false alarms in the audio field are an anathema to the end-user and damage the credibility of the technology.  Thus, the ability to categorise and separate sounds, making distinctions between, say, rowdy but non-threatening behaviour outside a night-spot and audio signals that indicate a genuine problem becomes an all-important feature.

Distinguishing aggression using audio analytics

It is in social deviance that video analytics holds out massive potential for central and local government.  For many years the CCTV sector's ability to provide security officers with almost limitless video footage has far outstripped the ability of operators to interpret that footage.  High quality, intelligent video analytics has changed this, and a gamut of situations indicating undesirable social behaviour can be assimilated by the software to create alarms.

Body language and pattern of movement in video analysis

Kerb-crawling and prostitutes working from cars are examples where pattern of movement can be used to cue an alarm.  Posture and movement are also relevant to car theft and a correctly configured analytics device in a parking lot will be able to distinguish between the legitimate behaviour of a driver walking straight to his car and unlocking it with the contrasting behaviour of a criminal hovering near a succession of vehicles and assessing them before attempting a break-in. 

Loitering consistent with ATM pin surfingPublic concern over street security, particularly anti-social behaviour, continues to escalate across Europe but video analytics now offers viable solutions for reducing social disturbance.  Intelligent scene analysis is about to bring massive benefits to civil servants and law enforcement bodies who are sufficiently far-sighted to recognise the potential of the technology in this area.

Research and development

Analytics suppliers are currently addressing myriad scenarios in both the commercial and public sectors.  If the software is to continue to keep pace with the variety of tracking demanded by end-users, algorithms and behavioural analysis must develop continually since the type of deviation from normal behaviour against which clients wish to discriminate is infinite.  Some user needs verge on the bizarre and Ipsotek recently received a request from a client who wished to use audio analytics to detect sectarian chanting at football matches.

Multi-platform capability and human resources saving

One of the principal benefits of video analytics is that it can be installed to work with legacy CCTV systems and analogue cameras.  Providing video footage is transmitted to a suitable digital video recorder or network video recorder there is no necessity for IP-addressable cameras though network-addressable systems are of course becoming increasingly common. 

Trackside intrusion and inappropriate behaviourThe financial savings on manned guarding and control room staff are enormous and in a recent development, an Ipsotek client in the estate management sector has expanded its use of video analytics at a cost of €35,000 when a comparable increase in manned guarding would have cost in excess of €56,000 with the surveillance being performed at a demonstrably inferior level.

As analytics continues to improve and the leading providers respond resourcefully to a broad range of user demands, scene analysis will gain wider acceptance in both government and commercial spheres.  The scenarios detected will become increasingly subtle, allowing innovative end-users to improve public safety by employing this exciting technology.

Chris Gomersall, Chief Executive Officer, Ipsotek Ltd

Chris Gomersall
Chief Executive Officer
Ipsotek Ltd.

Share with LinkedIn Share with Twitter Share with Facebook Share with Facebook
Download PDF version

In case you missed it

How intelligent video surveillance supports smart mobility
How intelligent video surveillance supports smart mobility

The ease of getting from point A to point B, the effective movement of goods and services, and the flexibility and integration of various modes of transportation are key aspects of mobility today. Smart Mobility has been a key theme in the transportation industry for a while. The idea is to keep traffic flowing and help people to get where they need to be, in a smarter way. To this end, industry players are now innovating and introducing advanced technologies and solutions. Examples include intelligent traffic management systems, free-flow tolls, autonomous driving, smart location solutions, and more. At the same time, traffic congestion, aging infrastructure, rapid urbanisation, and increasing sustainability demands are also intensifying the need for smart mobility solutions. One way to overcome these obstacles is to use intelligent video surveillance technology for improved traffic management, making the roads safer and more efficient for every user, while also reducing emissions. Perceptive intersections Relying on intelligent video analytics, traffic video cameras identify traffic build ups at intersections by counting numbers of vehicles crossing an intersection and detecting their speed, while also counting the number of vehicles queueing in real-time. Aggregated data informs the system when to switch traffic lights to red or green. Intelligent optimisation for traffic signals ensures more effective traffic flow.Aggregated data informs the system when to switch traffic lights to red or green The benefits? Improved safety on the roadways; intersection reconstruction can be avoided; drivers can be advised about the speed of their route, forecasted by traffic signals; reduced wait times and stress for commuters; reduction of harmful emissions; and positive impact on public satisfaction. Road safety Traffic incidents can be disastrous, not merely for causing congestion on the roads but sometimes far worse – resulting in injuries and even fatalities. These incidents have many causes, not the least of which is drivers willfully violating traffic laws. Video technology can aid in detecting all kinds of events – for example, illegal parking, running a red light, wrong-way driving, speeding, and making illegal U-turns can all be detected by smart camera technology. By using deep learning technology, cameras can recognise these events and traffic authorities can be immediately notified and take necessary actions even before traffic incidents occur. Scenarios include stopping a driver who is occupying an emergency lane, or notifying a driver who parked their car illegally. Furthermore, ticketing systems can be incorporated to further regulate driving behaviors. Benefits here include incident prevention, better driver performance, and increased safety on the roads and streets, to name just a few. Scenarios include stopping a driver who is occupying an emergency lane, or notifying a driver who parked their car illegally Public information Sharing information is key to keeping city drivers and travelers informed. Intelligent communication about warnings and updates helps everyone save time, avoid frustration, and simplify everyday mobility. This can be done via traffic guidance screens displayed at highly visible locationsThis can be done via traffic guidance screens displayed at highly visible locations, such as congested areas, transportation hubs, shopping malls, and city plazas – or even at your fingertips on your favorite mobile apps! Traffic video cameras generate real-time data of traffic flow and incidents, sending it to a central platform to further fuse with data from third-party systems such as radar and GPS systems. They also disseminate traffic information, including traffic status, warning and advisory notices, as well as parking status.  The benefits are improved public awareness of traffic information, improved travel convenience, overall enhancement of mobility in the city, and more. The Hikvision practice Hikvision has accumulated sophisticated experience in traffic management both at home and abroad. Product lines offer versatile solutions to resolve multitudes of problems in urban traffic management, traffic incident management, highway management, and more. Going deeper, it’s essential to note that efficient signal control management is dependent on the quality of traffic data, system algorithms, and the hardware devices in use; it is also closely related to the mobile environment, such as road conditions, historical traffic conditions, and urban infrastructure. Because of this, no single solution solves traffic congestion everywhere. Hikvision believes that only by working closely with city authorities, public safety organisations, consultants, even academia and other relevant stakeholders, can applications and operational processes be developed to achieve the best possible outcomes. The possibilities for traffic video data are endless, especially now that it can employ artificial intelligence for advanced functionality. Harnessing its power will make all the difference, but the ultimate goal remains the same: safe and smooth traffic, smart mobility, and improved quality of human life.

What impact are data analytics having on security?
What impact are data analytics having on security?

We live in an era of Big Data. Surrounded by a flood of information, more companies are looking for ways to analyse that information (data) and systematically extract information that can help them operate more efficiently and profitably. The data obsession has extended to the physical security industry, too, where large amounts of data have historically been a little-used byproduct of our access control and even video systems. But the picture is changing. We asked this week's Expert Panel Roundtable: What impact are data analytics having on the security market?

Embracing digital transformation in the security industry
Embracing digital transformation in the security industry

Many industries are, to a greater or lesser extent, in the throes of digital transformation. As with any change programme, digital transformation efforts often under-perform against expectations. Yet, the number of digital transformation programmes continue to increase, as commercial pressures intensify. As security professionals we need to embrace our role in digital transformation, as security is everybody’s business. For all those people weary of hearing about digital transformation and believe it’s a business fad, consider your own behaviours. If you use a smartphone to search, find, order, buy, message, watch, learn, play, bank, pay, enter, exit, navigate, communicate and more then you are part of the reason that digital transformation is a commercial necessity. The way we live our lives has changed significantly over the past twenty years and this needs to be reflected into how we rethink the way we do business. Digital transformation is about more than technology, it allows people to solve their traditional problems in new and better ways than before. Better can mean faster, at lower cost, using fewer resources, easier to maintain, more compliant and/or easier to report insights. IoT, criminal activity and security  The number of internet connected devices worldwide is increasing at an exponential rate; by the end of 2025 there are expected to be 75.44 billion. Internet of Things (IoT) means digital transformation converges physical and digital for security professionals. Criminals use smarter digital tools such as malware, drones, key cloners, signal readers and more, which impact both physical and cybersecurity. To counter this, digital transformation provides security professionals with access As security professionals we need to embrace our role in digital transformation, as security is everybody’s businessto valuable actionable insights to identify and deter threats to people and assets. All transformation starts with an idea generated by people and ends with people experiencing the output. Therefore, digital transformation starts and ends with people. To ensure a solid foundation to any digital transformation agenda, people need to have a clear purpose to engage. This is where security leaders can inspire their colleagues with a laudable purpose of embracing disruption at the same time as focusing on safeguarding people and assets. Non-security colleagues should understand that security risks are advancing at a faster pace than enterprises can adapt. As a security leader, you are advocating a movement where your colleagues adopt relevant enterprise security risk management practices in their daily thinking and working. The message is clear that digital transformation presents abundant opportunities and these need to be evaluated alongside the proliferating security threats that can become a business continuity failure. Security professionals and digital influence  The number of internet connected devices worldwide is increasing at an exponential rate; by the end of 2025 there are expected to be 75.44 billionSecurity professionals can influence digital transformation success by translating an enterprise’s strategy into secure operational reality. The security narrative should emphasise the people side of digital transformation and how technology can act as an enabler of a safe and secure experience, both for employees and customers. Operationally, digital transformation is about agility, adaptability and navigating uncertainty. Old ways of thinking and working will be blockers to transformation, so security leaders ought to identify the rapid enablers of a ‘secure’ digital transformation. Better people, processes and overall technology People generally don’t want more in their lives, they want better. Better people. Better data. Better technology. Better processes. Digital transformation creates significant ‘better’ benefits for security: For example, connected (IoT) sensors, video analytics at the edge and machine learning identify threats faster; workflow technologies and automation detect, investigate and remediate routine responses; cloud provides many benefits such as agility, scale and mobility; and, smartphones/digital devices provide real-time communication and collaboration. Tackling all the ‘better’ needs within a security approach is necessary – focusing on the prioritised commercial needs first. Think about how to drive radical simplification into digital transformation agendas to ensure complexity doesn’t create too many unmanageable risks. Designing enterprise security risk management into the business operating model will facilitate colleagues to be empowered for safe and secure change. Communicating security successes and breaches with commercial impact insights in a timely and concise manner across the enterprise will prove the value of active security engagement throughout digital transformation programmes. Transforming the world Digital technology is transforming the world around us, in a way that impacts every area of security. Security professionals are now businesspeople and technologists, in addition to their traditional security remits. Embracing this impacts security recruitment, training and employee engagement, within the security team and with non-security colleagues. Without a doubt, security professionals are integral to digital transformation programmes.