Recently, ultra-high-definition surveillance cameras introduced 4K resolution to the security industry. However, 4K resolution has yet to achieve wide application, mainly because of the tremendous bandwidth and data storage requirements. Limiting the bitrate of an ultra-HD video feed while retaining a high-quality, 4K-image remains the biggest problem—a problem whose solution will decide the fate of ultra-HD surveillance video. Video transmission balances image quality, transmission capabilities, and data requirements—i.e., how much information and how it is handled. Therefore, image transmission optimisation lies in advancements in video compression technology.

H.265: Compression technology on a new level

Until now, H.264 compression has been the industry-standard codec. When the H.264 codec found wide use, Hikvision developed its own compatible algorithm to go the next step, calling it “H.264+”. The next iteration in this codec lineage—H.265—presently stands at the cusp of widespread adoption. Once again, Hikvision has already pushed this compression technology to a new level. H.265+ employs an intelligent algorithm whose encoding technology stems from the H.265/High Efficiency Video Coding (HEVC) standard.

H.265+ optimises the existing codec most strikingly where specific criteria are met in a surveillance video feed. This criteria consists of: 1.) a stable background where information rarely changes; 2.) a primary focus on the objects moving across that stagnant scene; 3.) a substantial period of time where a scene’s moving objects appear only occasionally; and 4.) 24-hour non-stop surveillance where visual noise has a relatively large impact on image quality. In this type of environment, field-tests show H.265+ radically decreases the required bitrate of the ultra-high-definition surveillance video by up to 67% over H.265, thereby reducing required bandwidth and storage. Bitrate reduction means cost reduction for consumers, as well as increased efficiency, stability, and reliability of all the hardware in a given surveillance system. Here’s how it works.

With ultra-HD resolutions and higher efficiency transmission as the two primary objectives, H.265+ improves the compression ratio based on three key technologies: 1.) predictive encoding technology based on a background or reference frame, 2.) digital noise suppression technology, and 3.) long-term bitrate control technology.

Predictive encoding

Predictive encoding can be divided into “Inter-frame prediction,” creating a prediction model from one or more previously encoded video frames, and “Intra-frame prediction,” where the samples of a macroblock (processing unit) are predicted by using only information of previously transmitted macroblocks of the same frame. With inter-frame prediction, bitrate can be reduced by compressing only the difference in rates between a reference frame and any other frame. This reference frame—usually the background of a scene—will contain few if any moving objects. Fortunately, in most security surveillance, the background remains stagnant.

Example scenario

In a traffic intersection field-test, three unique frames are analysed from a video feed. The first frame is the empty intersection (T0), the second two (T1 and T2) include a moving object—in this case, an automobile. The first image gets encoded as the reference frame; thereafter, reference frame data no longer needs to be sent or stored with every frame. This liberates the VMS to follow moving vehicles only, since new data (bits) will not be required for each frame capturing the background. The requirement for bits, bandwidth, and storage immediately drop. In the case where a strictly empty background or reference frame cannot be captured, the alternative is to encode two or more frames that might include a moving object. Intelligent software can fill in spaces that are vacated by those moving objects with similar information found in the immediately surrounding space. Thus, bitrate usage can be lowered while guaranteeing normal playback for the user.

In the case where a strictly empty background or reference frame cannot be captured, the alternative is to encode two or more frames that might include a moving object
In a traffic intersection field-test, three unique frames are analysed from a video feed

Noise suppression

In order to guarantee a high image quality of moving objects, the encoding module also encodes the visual noise in the scene. However, using the predictive encoding methods mentioned above, the H.265+ intelligent analysis algorithm distinguishes between the background image and moving objects so that each can be encoded with different encoding strategies.

A background image is encoded with high compression in order to suppress noise and applies data to new or moving objects. Since data transmission is limited, the overall bitrate dips substantially when compared against conventional video compression.

Long-Term Bitrate Control

Hikvision has introduced a concept it calls “Long-Term Average Bitrate” to make full use of a data from a video feed. Long-Term Average Bitrate calculates the rates over a specified time period (usually 24 hours). With the average bitrate control, the camera can assign higher bitrates to busier hours while reducing it during idle hours—e.g., midnight to 6 AM outdoors, or 8 PM to 7 AM in an office. In the case of a constant bitrate mode for H.265 encoding, the bitrate varies slightly but stays near the predefined maximum bitrate value. Using H.265+, average bitrate can be as low as half of the maximum bitrate. Image quality can still be optimised since the H.265+ technology makes full use of every bit.

In variable bitrate mode, the instant bitrate varies according to a scene’s activity, while the image quality remains steady. Employing H.265+, the bitrate change can take two courses: 1.) if the configured average bitrate value is limited, H.265+ encoding can provide a better image quality within the limited bitrate; and 2.) if the configured average bitrate value is high for the scene being monitored, the actual average bitrate—the actual amount of data used—can be lower than the predefined value, lowering the total data storage requirement.

Instant bitrate comparison between two scenes

A bitrate-reduction test was conducted, based on cameras featuring 1080p resolution at 25 fps. The scene was a small café under video surveillance feed for a 24-hour period.

Testing the same scene—a busy café—at different times of day, showed that the rate difference between codecs appears less significant as the number of moving objects in the scene increases. Nevertheless, the numbers are still remarkable. The average bitrate between H.264 and Hikvision’s H.265+ decreased by a substantial 83%. The rate between the standard H.265 and Hikvision’s H.265+ codec decreased by 67%—a smaller difference, but nonetheless significant when applied to real-world surveillance systems.

In discreet, 24-hour file size comparison of two different scenes, drastic reductions were plain to see

24-hour file size in different scenes

In discreet, 24-hour file size comparison of two different scenes, drastic reductions were plain to see. Scene one was a café, where the H.264 codec yielded an average of 22.7 GB, and H.265 yielded 11.8 GB, on average. Remarkably, Hikvision’s H.265+ averaged only 3.9 GB. Scene two was a traffic Intersection. Here, the 24-hour file size comparison yielded similar results. H.264 averaged 36.4 GB, H.265 averaged 21.1 GB, and H.265+ averaged the lowest bitrate again at only 7.5 GB.

Here are in those numbers in percentages. In the café monitoring scenario, the rate of the 24-hour file size between H.265 and Hikvision H.265+ decreased by 66.4%, while the rate between H.264 and Hikvision H.265+ decreased by a substantial 82.5%. For the traffic intersection monitoring, the rate of the 24-hour file size between H.265 and Hikvision H.265+ decreased by 64.5%, while the rate between H.264 and Hikvision H.265+ decreased by 79.4%.

Improved bandwidth, storage, imaging, & VCAs

First, H.265+ makes the best use of every bit, so HD and ultra-HD resolutions looks as clear, sharp, and focused as possible. Also, as H.265+ improves image transmission, target objects will have more pixels so the use of VCAs will arguably become more precise, more accurate. Next, a network utilising H.265+ has more bandwidth available at any given time. More bandwidth means better system functioning all around. In real terms, on a 20 Mb broadband network, the H.264 codec can accommodate five cameras. H.265 doubles that, carrying the load of 10 cameras. But H.265+ doubles even that, accommodating 20 or more cameras on the single network. Therefore, H.265+ will be the best choice for users expanding an installation and moving to 4K at the same time.

A background image is encoded with high compression in order to suppress noise and applies data to new or moving objects
The overall bitrate dips substantially when compared against conventional video compression

What’s more, users reduce costs and other resources involved in storing video-feed data. Here's another scenario: when eight 2-Megapixel cameras are connected to a network, and a storage device holds five 5-Terrabyte hard drives, recording capacities vary significantly. A system running on H.264 will hit its storage ceiling in about two weeks. H.265 will do a bit better, filling up after about one month. Hikvision’s H.265+, however, will continue recording—up to about two full months. When considering these results on a monthly or annual basis for budgeting expenses and hardware allocations, H.265+ reduces expenditures all around. While the jump to H.265+ might be slow initially, the benefits will prove advantageous far into the future.

Applications are everywhere

The applications here extend at least as wide as those of any previous codec. However, under conditions such as an unstable network or limited bandwidth, or where customers are required to store data for extended periods of time, H.265+ will be most profoundly effective. Furthermore, this codec can be integrated into comprehensive security solutions for specific functions—4K, panoramic, and explosion-proof cameras, ultra-low light products, and anti-corrosion products are a few examples.

As with any new technological improvement, industry-wide upgrading from current or legacy standards requires investing time and resources. For H.265, migration is accelerating, primarily in newly designed systems since upgrading existing H.264 systems only increases expenditure. H.265 will become more desirable to system integrators and end-users since its decreased bitrates yield high-definition resolutions and images come through more clearly. Added to that, target objects can be isolated and enlarged with more clarity, and more accurate VCAs can be employed.

Hikvision’s H.265+ codec optimises the H.265/HEVC encoding technology, meeting its compression standards and operating with the vast majority of hardware and software designed to employ H.265. With H.265+, video quality remains virtually the same as that of H.265/HEVC while radically reducing transmission bandwidth and data storage capacity requirements. The H.265+ codec will serve to widen the application of ultra-HD resolutions in video surveillance, such as 8 MP and 12 MP devices. Wherever applied, this new codec will cut storage costs, make the fullest use of surveillance video investments, and broaden the use of 4K and ultra-HD security video.

Download PDF version

In case you missed it

The new alliance of humans and robotics in security solutions in 2018
The new alliance of humans and robotics in security solutions in 2018

  The past year has proved to be a year full of many changes both within our industry and for Robotic Assistance Devices (RAD). While we have experienced increased adoption of artificial intelligence-based solutions, the industry has been challenged with an ever-evolving technology landscape. Protecting enterprise organisations from both cyber and physical security threats will be an ongoing challenge the industry must grapple with. Greater adoption of robotic solutions To address the physical security challenges, we saw a greater adoption of robotic solutions across the board. Our massive industry started to make the change: Shifting from an uneducated view of this advanced technology to increased interest about artificial intelligence across multiple markets including guarding companies, integrators and, most importantly, end-users. In 2017 there was a greater adoption of robotic solutions across the board With security-guard robots, security directors now have access to additional tools to meet their performance and budget goals. Currently, we see a great adoption with progressive guarding companies, which are signing up to have RAD as their robotic guarding partner. RAD deployed its first robot this year, and we look forward to deploying many more as we work with our customers to customise our robotic solution to their needs. Human collaboration with robotics I believe our industry is at the beginning stages of what could be a serious paradigm shift in how we rely on a combination of humans and technology to do a job. We've seen that in video analytics and the wide variety of solutions available on the market today. The trend has progressed beyond video analytics and into robotics, and that will continue to evolve into 2018 and beyond. As we continue to build on the success of our security guard robot solution, we look forward to expanding our product offerings to meet the security needs of our customers.

CES 2018: Security technologies influencing the consumer electronics market
CES 2018: Security technologies influencing the consumer electronics market

Security is more-than-ever linked to consumer electronics, especially in the residential/smart home market. CES 2018 in Las Vegas is therefore brimming with news that will have a direct impact on the security market, today and especially looking into the future. Products for the future of security   CES is a giant trade show for consumer electronics with 2.75 million net square feet of exhibitor space and featuring more than 3,900 exhibitors, including 900 startups - in contrast, ISC West has some 1,000 exhibitors. During the week-long show welcoming 170,000-plus attendees from 150 countries, more than 20,000 new products are being launched. The products incorporate ingredient technologies such as artificial intelligence and 5G that will also be familiar elements as the future of the security industry unfolds. Familiar players at security shows also have a presence at CES, and many consumer technologies on display offer a glimpse of what’s ahead for security The areas of consumer electronics and security are closely intertwined. For example, Apple recently expanded near-field communication (NFC) support to include the NDEF (NFC Data Exchange Format), which will likely accelerate the adoption of smartphones for access control credentialing. In another recent development, Amazon acquired Blink, a home security camera startup that offers wireless home security systems. The acquisition aligns with Amazon’s effort to offer more home devices. Key security technologies at CES 2018 Familiar players at security shows also have a presence at CES. For example, Bosch is highlighting its “Simply. Connected” portfolio of smart city technology to transform security as well as urban mobility, air quality and energy efficiency. Many consumer technologies on display offer a glimpse of what’s ahead for security. Are Panasonic’s 4K OLEDs with HDR10+ format or Sony’s A8F OLED televisions a preview of the future of security control room monitors? At CES, Johnson Controls is announcing support for Apple HomeKit now offered in their DSC iotega wireless security and automation solution. Consumers can manage both their security system and also other home automation abilities using Apple’s Home app, or Siri on their iPhone, iPad or Apple Watch. Interlogix is announcing new features and components of its UltraSync SmartHome system, including hands-free voice control, high-definition cameras, an LTE cellular module and soon-to-be-released doorbell camera. The areas of consumer electronics and security are closely intertwined Developments in crime awareness ADT has a high profile at CES, including the launch of its ADT Go mobile app, equipped with 24/7 emergency response from ADT’s live monitoring agents and backed by Life360’s location technology, providing emergency response, family connectivity, safety assistance and crime awareness.  ADT is also unveiling a video doorbell and expanding its monitoring to cybersecurity. IC Realtime is introducing Ella, a cloud-based deep-learning search engine that augments surveillance systems with natural language search capabilities across recorded video footage. Ella enables any surveillance or security cameras to recognise objects, colours, people, vehicles and animals. Ella was designed using the technology backbone of Camio, a startup founded by ex-Googlers who designed a simpler way to apply searching to streaming video feeds. It’s a “Google for video:” Users can type in queries such as “white truck” to find every relevant video clip. Smarter homes and smarter computers Do-it-yourself smart home security company Abode Systems announces iota, an all-in-one system giving customers more freedom and flexibility to build out and monitor their smart home. The new form factor has a built-in full-HD resolution camera enabling customers to see and hear what’s going on in their home 24/7 while a built-in gateway supports hundreds of devices to make homes more convenient, safer and more secure. There is also support for Apple HomeKit. Highly programmable and high-performance platforms will no doubt play a role in the future of video surveillance systems in our market  The Z-Wave Alliance will host 30-plus leading smart home brands in the Z-Wave pavilion at CES. A full walk-through home will demonstrate different brands working together to create one cohesive smart home experience. Sigma Designs unveils its 700-Series Z-Wave platform, including numerous performance and technology enhancements in energy-efficiency and RF performance. Personal protection in attendance Self-defence product company SABRE will debut a combination pepper spray with dual sound-effect personal alarm that “alternates between the traditional wailing sound and a primal scream, while a strobe blinks 19 times per second to disorient assailants.” SABRE’s Modern Fake Security Camera includes “sleek, realistic design to deter would-be thieves.” Chip maker Ambarella is introducing the CV1 4K Stereovision Processor with CFflow Computer Vision Architecture. The chip combines environmental perception with advances in deep neural network processing for a variety of applications, including video security cameras and fully autonomous drones. At CES, applications will focus on automotive uses, including advanced driver assistance systems (ADAS), self-driving, electronic mirror and surround view systems. The highly programmable and high-performance platform will no doubt play a role in the future of video surveillance systems in our market. A full walk-through home will demonstrate different brands working together to create one cohesive smart home experience Extending home security and efficiency  The Ring whole-house security ecosystem creates a “Ring of Security” around homes and neighbourhoods. Products include “Stick Up” indoor/outdoor security cameras, integrated LED lighting, a “Ring Alarm” integrated bundle for $199 including a base station, keypad, contact sensor, and Z-Wave extender. “Ring Protect Plans” include 24/7 professional monitoring. The “Streety” phone app, from Vivint Smart Home, extends home security into the neighbourhood. Streety makes it easy for neighbours to monitor neighbourhood activity through a network of shared residential cameras. They can keep an eye on kids, cars and property through live video feeds and use recorded video clips to investigate incidents. A new device making its debut at CES is the Walker “commercialised biped robot,” from UBTECH Robotics, which provides a complete home butler service and is designed to ease the day-to-day operations of a busy home or office. The varied of functions includes video surveillance monitoring, security patrol monitoring, motion detection and “instant alarm,” as well as dancing and playing games with children. The company says Walker will “bridge the gap between technologies that were once only available in scientific research institutions and everyday people.”

How IoT and Cloud-based security will make cities safer in 2018
How IoT and Cloud-based security will make cities safer in 2018

In 2017 we saw a lot of new construction projects, and many existing buildings upgraded their security systems to include high-resolution cameras and better-quality recording systems. Because the economy is stronger, many businesses and municipalities increased their security budgets for large-scale and public projects due to terrorism threats in public places.   Smart cities became more popular One of the bigger trends we saw in 2017 is the growing popularity of smart cities and the adoption of public safety systems in both North American and Europe. This includes many cities creating wireless network infrastructure for public WiFi connectivity and for their surveillance network. Oftentimes smart cities develop because of an initial safe city initiative and then cities start to leverage the same infrastructure for more applications. Impact of terrorism Unfortunately, we saw a growth in terrorism attacks in 2017 in Europe and the United States. This has had a significant impact on security in public spaces where large groups of people congregate for entertainment, shopping and sporting events, all of which are now potential targets. We started to see cities install bollards on streets to prevent trucks from driving up on people on sidewalks and video surveillance systems so that police can monitor public spaces in real time. An example was the SuperBowl LIVE venue in Houston, which held several large outdoor events. To help monitor these events the city deployed a mmWave wireless network system for the surveillance cameras which were installed to monitor this area. Cybersecurity a growing concern In addition to terrorism threats, cybersecurity has become a growing concern and focus. More and more manufacturers, including Siklu, have begun to develop secure systems that are extremely difficult for hackers to gain access to because an encrypted network is no longer enough. The devices on the network also have to be secure. There is a growing shift towards younger generations wanting to live in the city where they have access to public transportation, restaurants and entertainment Looking ahead to 2018, the security market should expect to see continued growth in the use of video analytics for proactive surveillance purposes and more technology that leverages the intelligence of this data. Also, there is a growing shift towards younger generations wanting to live in the city where they have access to public transportation, restaurants and entertainment. They also expect to live in a safer environment and this is where the smart city approach comes into play with the introduction of WiFi in parks and public spaces, along with surveillance systems. These two solutions and services can now sit on the same network, thanks to better connectivity options and interference free solutions, such as mmWave wireless radios. Embracing new technology Next year the winners will be those who embrace new technology and do not solely focus on security. It’s important to embrace other IoT devices and recognise that video as a service is growing in demand. Cloud-based solutions are also growing for both video storage and monitoring management systems. The losers will be those who are not willing to embrace new technology, those who offer poor service and those who don’t expand their business to include professional services. Siklu success Siklu’s security business has doubled year over year, and there are now more than 100 cities globally with a Siklu radio deployed. This is because there is an increasing acceptance of our mmWave wireless technology and people are starting to recognise the benefits our systems provide when compared with installing new fiber or a traditional WiFi system. We recently introduced a new point-to-multipoint solution called MultiHaul™, which utilises immune narrow beams within a point-to-multipoint network topology and enables interference free connectivity and complete security. The solution’s 90-degree scanning antenna auto-aligns multiple terminal units from a single base unit, serving multiple locations while reducing installation times to minutes instead of hours by a single person and the total cost of ownership for end users.