The majority of security hardware manufacturers support the introduction of the H.265 compression standard to video surveillance
The integration of H.265 technology may be hindered by the
availability of optimised H.264 best encoding for surveillance systems

Video compression technology has been a crucial element in surveillance system design since the advent of Internet Protocol (IP) in the 1990s. Since that time, standards for video encoding have been explored in various capacities. Currently, the industry is all abuzz around H.265 High Efficiency Video Coding – the next iteration beyond H.264, which currently dominates IP video encoding technology.

What is H.265?

H.265 is a significant step forward. Specifically, H.265 doubles the compression efficiency of H.264. Therefore, when transmitting images of a given quality, H.265 uses only half the bit rate of the previous codec. This means that both bandwidth and storage requirements are drastically reduced – a great benefit for both hardware and software usage. Users essentially do more with less. Because of this, the majority of security hardware manufacturers support the introduction of the H.265 compression standard to video surveillance. So, for video applications, expect to see H.265 replacing H.264 as the next standard.

However, that being said, H.265 is still a way away from mass adoption. With the popularity of HD video that has been widely applied across the industry, do users have any other option to optimise HD image transmission and squeeze storage before that turnover happens in the surveillance realm? Recent advancements in the current H.264 codec are optimising bitrates, and doing it in three ways: predictive encoding, noise suppression, and “long-term” bitrate control. The result is a reduction of up to 75% in storage requirements within the H.264 paradigm. Thanks to these innovations (and a couple of other factors), it looks likely that in the next five or 10 years, the two standards will co-exist in the market.    

Impediments to H.265 adoption

The integration of H.265 technology will likely be hindered by the availability of optimised H.264 encoding, as well as the cost of upgrading current systems to H.265 since all or most of the components in a system will need to be replaced by those that support this new standard. Other impediments include the industrial chain – changing manufacturing processes to produce H.265 equipment – and issues over patents (which we’ll address below). Basically, H.264 remains the viable and workable standard for a vast majority of security surveillance systems. It’s still getting the job done – and rather well, too.  

a number of innovative manufacturers have introduced optimised H.264 encoding technologies
With the higher cost, users will need to be convinced
that the upgrade to H.265 is really worth it

Limitations of laboratory testing

According to tests carried out by the Joint Collaborative Team on Video Coding (JCT-VC), the compression rate of H.265 has doubled from that of H.264. But as you’d expect, these tests were carried out in laboratory environments, away from the various complexities of real-world applications. What we’d like to see, in the development of H.265 products, is real-time encoding in action, balancing the algorithm’s complexity with its compression capability. As it exists right now, for industrial and surveillance applications, H.265’s compression capabilities may not reach the 100% improvement as claimed over H.264 in an actual application scenario.  

It stands to note that H.264 has had 10+ years of industry integration in which to develop, with support from all chipset manufacturers and the widest variety of encoders and decoders available (not to mention decreased costs because of this wide availability and range of product designs). It’s tested and proven in real-world surveillance and industrial applications. H.265 tech has a lot of catching up to do here.   

Higher patent cost

Another issue which may prevent widespread adoption of the H.265 standard is the issue of patents. The H.264 patent enjoys a wide variety of enterprise owners, while H.265, at this early stage of its existence, is not common in the industry, and the enterprises which own it are not unified on the matter. The result is a much higher patent cost – a major issue which security businesses need to consider seriously, as it affects manufacturing and, thereby, the price tag for the consumer. And the price tag, naturally, is critical when a new standard is introduced – especially if users have to replace both the frontend and backend of their system to take advantage of improved video compression. With a higher cost, they will need to be convinced that the upgrade is really worth it.

Optimised H.264 encoding technologies              

The issues mentioned above notwithstanding, the primary reason we feel H.265 won’t become the dominant encoding solution any time soon is simply the lack of demand – a number of innovative manufacturers have introduced optimised H.264 encoding technologies so the need hasn’t arrived yet. It’s a “solution in search of a problem,” as the saying goes.
 

Optimised H.264 technologies use predictive encoding to reduce the bitrate being spent on an unchanging background image
Optimised H.264 technologies use predictive encoding to reduce the bitrate being
spent on an unchanging background image

Since the launch of H.264 technology circa 2003, the security industry has been developing high performance video encoders in order to transmit higher quality video for surveillance applications. Add to that the increasing popularity of HD video and the subsequent bitrate and resolution demands, and it’s easy to see where the overall system and component cost has risen. The sheer amount of video data produced means users have had to invest in ever-expanding storage solutions.

Manufacturing capabilities have continually matured over this time; processing capabilities have flourished; algorithms have been optimised. The pervasive use of H.264 throughout the industry has both informed all of these developments and required major surveillance equipment manufacturers to commit to improving the range of available H.264 encoding solutions.

Predictive encoding

How are improvements to the H.264 codec being made? First, research in the way video compression is actually used at the ground level in various industries. For example, in any given surveillance video, users are primarily concerned with moving objects rather than the scene’s generally stagnant background. When the background doesn’t change, it can be encoded as a reference frame. Optimised H.264 technologies capitalise on this and use predictive encoding to reduce the bitrate being spent on an unchanging background image. By applying that predictive encoding across an entire system, users can reap big savings in both bandwidth and storage.   

Noise suppression  

Another important element of H.264 optimisation is its noise suppression. “Noise,” or unwanted electrical signal displaying in the video feed, is a potent foe of digital video bandwidth. It results in an image’s background appearing to be littered with extraneous pixels and is caused by fluctuations in light, temperature, or other various signals in the air. But optimised H.264 technologies, using intelligent analysis algorithms, suppress much of this noise by encoding the foreground subject of the image at a higher bitrate relative to the background image. The result: sharp images with accurate colour. Or, more of what you want to see, less of what you don’t.

It looks likely that in the next five or 10 years, the H.264 and H.265 standards will co-exist in the market
Improvements over basic H.264 encoding currently exceed
what the available H.265 encoding technology has to offer

Long-term bitrate control

Lastly, bitrate requirements for any given scene can fluctuate over the course of a day. In a typical street scene, for example, there is little foreground movement at night so bitrate requirements remain low. During the day, however, those bitrate requirements increase dramatically, with both vehicles and pedestrians moving across the fore- and background of the scene. Advanced H.264 encoding technologies manage this hour-specific variance by calculating an overall average bitrate, then automatically allocating the required bitrate at the time of day when it is needed. This is done while still maintaining the average bitrate as the encoder’s set value. Known as long-term bitrate control, the major of advantage here is that users are able to accurately predict their video storage requirements, since the bitrate – and thus storage size – can be user-specified.  

These improvements over basic H.264 encoding currently exceed what the available H.265 encoding technology has to offer. They also bring along other advantages: compatibility with existing systems, lower product costs, wider product variability, and lower current patent risk.   

The 10-year compression itch

Video compression developments have tended to follow a (roughly) 10-year cycle. In 1994, MPEG2 was introduced. H.264 launched in 2003 and H.265 in 2013. The historical context is important here because video encoding standards react not just to technological changes, but to trends across the whole video industry.

When MPEG2 was the standard, the industry focused mainly on DVD players and standard definition televisions, where MPEG2 could be utilised. The advent of H.264 coincided with the introduction of HD technology, advanced IT technology, and the mobile internet, which meant that the more powerful compression standard was more fully exploited. These developments included HD digital television, Internet video, mobile video, video surveillance, Blu-ray, and others.

As H.265 makes its way onto the scene, we believe it will be used most widely in the development of ultra-HD technologies and in cloud storage applications, for example.

Beyond H.265

After the launch of H.265, the members of the Joint Collaborative Team on Video Coding (JCT-VC) began looking at what would come next. In 2015, they established the Joint Video Exploring Team (JVET), focusing on further improvements in compression capabilities. Their latest test data suggests they have achieved a 20% improvement on H.265’s compression performance. At the same time, another organisation – the Alliance for Open Media (AOM) – was set up by a number of internet-focused companies, including Microsoft, Google, Intel, and Amazon, aiming to offer a free standard for internet video. The plan is that this standard would accelerate technology updates to meet the manic speeds of development in the online world.

The competition to develop these standards is likely to be fierce – and it might also mean the 10-year compression cycle falls by the wayside, with a new standard appearing in a much shorter period this time around.

Share with LinkedIn Share with Twitter Share with Facebook Share with Facebook
Download PDF version

Author profile

In case you missed it

How intelligent video surveillance supports smart mobility
How intelligent video surveillance supports smart mobility

The ease of getting from point A to point B, the effective movement of goods and services, and the flexibility and integration of various modes of transportation are key aspects of mobility today. Smart Mobility has been a key theme in the transportation industry for a while. The idea is to keep traffic flowing and help people to get where they need to be, in a smarter way. To this end, industry players are now innovating and introducing advanced technologies and solutions. Examples include intelligent traffic management systems, free-flow tolls, autonomous driving, smart location solutions, and more. At the same time, traffic congestion, aging infrastructure, rapid urbanisation, and increasing sustainability demands are also intensifying the need for smart mobility solutions. One way to overcome these obstacles is to use intelligent video surveillance technology for improved traffic management, making the roads safer and more efficient for every user, while also reducing emissions. Perceptive intersections Relying on intelligent video analytics, traffic video cameras identify traffic build ups at intersections by counting numbers of vehicles crossing an intersection and detecting their speed, while also counting the number of vehicles queueing in real-time. Aggregated data informs the system when to switch traffic lights to red or green. Intelligent optimisation for traffic signals ensures more effective traffic flow.Aggregated data informs the system when to switch traffic lights to red or green The benefits? Improved safety on the roadways; intersection reconstruction can be avoided; drivers can be advised about the speed of their route, forecasted by traffic signals; reduced wait times and stress for commuters; reduction of harmful emissions; and positive impact on public satisfaction. Road safety Traffic incidents can be disastrous, not merely for causing congestion on the roads but sometimes far worse – resulting in injuries and even fatalities. These incidents have many causes, not the least of which is drivers willfully violating traffic laws. Video technology can aid in detecting all kinds of events – for example, illegal parking, running a red light, wrong-way driving, speeding, and making illegal U-turns can all be detected by smart camera technology. By using deep learning technology, cameras can recognise these events and traffic authorities can be immediately notified and take necessary actions even before traffic incidents occur. Scenarios include stopping a driver who is occupying an emergency lane, or notifying a driver who parked their car illegally. Furthermore, ticketing systems can be incorporated to further regulate driving behaviors. Benefits here include incident prevention, better driver performance, and increased safety on the roads and streets, to name just a few. Scenarios include stopping a driver who is occupying an emergency lane, or notifying a driver who parked their car illegally Public information Sharing information is key to keeping city drivers and travelers informed. Intelligent communication about warnings and updates helps everyone save time, avoid frustration, and simplify everyday mobility. This can be done via traffic guidance screens displayed at highly visible locationsThis can be done via traffic guidance screens displayed at highly visible locations, such as congested areas, transportation hubs, shopping malls, and city plazas – or even at your fingertips on your favorite mobile apps! Traffic video cameras generate real-time data of traffic flow and incidents, sending it to a central platform to further fuse with data from third-party systems such as radar and GPS systems. They also disseminate traffic information, including traffic status, warning and advisory notices, as well as parking status.  The benefits are improved public awareness of traffic information, improved travel convenience, overall enhancement of mobility in the city, and more. The Hikvision practice Hikvision has accumulated sophisticated experience in traffic management both at home and abroad. Product lines offer versatile solutions to resolve multitudes of problems in urban traffic management, traffic incident management, highway management, and more. Going deeper, it’s essential to note that efficient signal control management is dependent on the quality of traffic data, system algorithms, and the hardware devices in use; it is also closely related to the mobile environment, such as road conditions, historical traffic conditions, and urban infrastructure. Because of this, no single solution solves traffic congestion everywhere. Hikvision believes that only by working closely with city authorities, public safety organisations, consultants, even academia and other relevant stakeholders, can applications and operational processes be developed to achieve the best possible outcomes. The possibilities for traffic video data are endless, especially now that it can employ artificial intelligence for advanced functionality. Harnessing its power will make all the difference, but the ultimate goal remains the same: safe and smooth traffic, smart mobility, and improved quality of human life.

What impact are data analytics having on security?
What impact are data analytics having on security?

We live in an era of Big Data. Surrounded by a flood of information, more companies are looking for ways to analyse that information (data) and systematically extract intelligence that can help them operate more efficiently and profitably. The data obsession has extended to the physical security industry, too, where large amounts of data have historically been a little-used byproduct of our access control and even video systems. But the picture is changing. We asked this week's Expert Panel Roundtable: What impact are data analytics having on the security market?

Embracing digital transformation in the security industry
Embracing digital transformation in the security industry

Many industries are, to a greater or lesser extent, in the throes of digital transformation. As with any change programme, digital transformation efforts often under-perform against expectations. Yet, the number of digital transformation programmes continue to increase, as commercial pressures intensify. As security professionals we need to embrace our role in digital transformation, as security is everybody’s business. For all those people weary of hearing about digital transformation and believe it’s a business fad, consider your own behaviours. If you use a smartphone to search, find, order, buy, message, watch, learn, play, bank, pay, enter, exit, navigate, communicate and more then you are part of the reason that digital transformation is a commercial necessity. The way we live our lives has changed significantly over the past twenty years and this needs to be reflected into how we rethink the way we do business. Digital transformation is about more than technology, it allows people to solve their traditional problems in new and better ways than before. Better can mean faster, at lower cost, using fewer resources, easier to maintain, more compliant and/or easier to report insights. IoT, criminal activity and security  The number of internet connected devices worldwide is increasing at an exponential rate; by the end of 2025 there are expected to be 75.44 billion. Internet of Things (IoT) means digital transformation converges physical and digital for security professionals. Criminals use smarter digital tools such as malware, drones, key cloners, signal readers and more, which impact both physical and cybersecurity. To counter this, digital transformation provides security professionals with access As security professionals we need to embrace our role in digital transformation, as security is everybody’s businessto valuable actionable insights to identify and deter threats to people and assets. All transformation starts with an idea generated by people and ends with people experiencing the output. Therefore, digital transformation starts and ends with people. To ensure a solid foundation to any digital transformation agenda, people need to have a clear purpose to engage. This is where security leaders can inspire their colleagues with a laudable purpose of embracing disruption at the same time as focusing on safeguarding people and assets. Non-security colleagues should understand that security risks are advancing at a faster pace than enterprises can adapt. As a security leader, you are advocating a movement where your colleagues adopt relevant enterprise security risk management practices in their daily thinking and working. The message is clear that digital transformation presents abundant opportunities and these need to be evaluated alongside the proliferating security threats that can become a business continuity failure. Security professionals and digital influence  The number of internet connected devices worldwide is increasing at an exponential rate; by the end of 2025 there are expected to be 75.44 billionSecurity professionals can influence digital transformation success by translating an enterprise’s strategy into secure operational reality. The security narrative should emphasise the people side of digital transformation and how technology can act as an enabler of a safe and secure experience, both for employees and customers. Operationally, digital transformation is about agility, adaptability and navigating uncertainty. Old ways of thinking and working will be blockers to transformation, so security leaders ought to identify the rapid enablers of a ‘secure’ digital transformation. Better people, processes and overall technology People generally don’t want more in their lives, they want better. Better people. Better data. Better technology. Better processes. Digital transformation creates significant ‘better’ benefits for security: For example, connected (IoT) sensors, video analytics at the edge and machine learning identify threats faster; workflow technologies and automation detect, investigate and remediate routine responses; cloud provides many benefits such as agility, scale and mobility; and, smartphones/digital devices provide real-time communication and collaboration. Tackling all the ‘better’ needs within a security approach is necessary – focusing on the prioritised commercial needs first. Think about how to drive radical simplification into digital transformation agendas to ensure complexity doesn’t create too many unmanageable risks. Designing enterprise security risk management into the business operating model will facilitate colleagues to be empowered for safe and secure change. Communicating security successes and breaches with commercial impact insights in a timely and concise manner across the enterprise will prove the value of active security engagement throughout digital transformation programmes. Transforming the world Digital technology is transforming the world around us, in a way that impacts every area of security. Security professionals are now businesspeople and technologists, in addition to their traditional security remits. Embracing this impacts security recruitment, training and employee engagement, within the security team and with non-security colleagues. Without a doubt, security professionals are integral to digital transformation programmes.