Recently, ultra-high-definition surveillance cameras introduced 4K resolution to the security industry. However, 4K resolution has yet to achieve wide application, mainly because of the tremendous bandwidth and data storage requirements. Limiting the bitrate of an ultra-HD video feed while retaining a high-quality, 4K-image remains the biggest problem—a problem whose solution will decide the fate of ultra-HD surveillance video. Video transmission balances image quality, transmission capabilities, and data requirements—i.e., how much information and how it is handled. Therefore, image transmission optimisation lies in advancements in video compression technology.

H.265: Compression technology on a new level

Until now, H.264 compression has been the industry-standard codec. When the H.264 codec found wide use, Hikvision developed its own compatible algorithm to go the next step, calling it “H.264+”. The next iteration in this codec lineage—H.265—presently stands at the cusp of widespread adoption. Once again, Hikvision has already pushed this compression technology to a new level. H.265+ employs an intelligent algorithm whose encoding technology stems from the H.265/High Efficiency Video Coding (HEVC) standard.

H.265+ optimises the existing codec most strikingly where specific criteria are met in a surveillance video feed. This criteria consists of: 1.) a stable background where information rarely changes; 2.) a primary focus on the objects moving across that stagnant scene; 3.) a substantial period of time where a scene’s moving objects appear only occasionally; and 4.) 24-hour non-stop surveillance where visual noise has a relatively large impact on image quality. In this type of environment, field-tests show H.265+ radically decreases the required bitrate of the ultra-high-definition surveillance video by up to 67% over H.265, thereby reducing required bandwidth and storage. Bitrate reduction means cost reduction for consumers, as well as increased efficiency, stability, and reliability of all the hardware in a given surveillance system. Here’s how it works.

With ultra-HD resolutions and higher efficiency transmission as the two primary objectives, H.265+ improves the compression ratio based on three key technologies: 1.) predictive encoding technology based on a background or reference frame, 2.) digital noise suppression technology, and 3.) long-term bitrate control technology.

H.265+ optimises the existing codec most strikingly where specific criteria are met in a surveillance video feed

Predictive encoding

Predictive encoding can be divided into “Inter-frame prediction,” creating a prediction model from one or more previously encoded video frames, and “Intra-frame prediction,” where the samples of a macroblock (processing unit) are predicted by using only information of previously transmitted macroblocks of the same frame. With inter-frame prediction, bitrate can be reduced by compressing only the difference in rates between a reference frame and any other frame. This reference frame—usually the background of a scene—will contain few if any moving objects. Fortunately, in most security surveillance, the background remains stagnant.

Example scenario

In a traffic intersection field-test, three unique frames are analysed from a video feed. The first frame is the empty intersection (T0), the second two (T1 and T2) include a moving object—in this case, an automobile. The first image gets encoded as the reference frame; thereafter, reference frame data no longer needs to be sent or stored with every frame. This liberates the VMS to follow moving vehicles only, since new data (bits) will not be required for each frame capturing the background. The requirement for bits, bandwidth, and storage immediately drop. In the case where a strictly empty background or reference frame cannot be captured, the alternative is to encode two or more frames that might include a moving object. Intelligent software can fill in spaces that are vacated by those moving objects with similar information found in the immediately surrounding space. Thus, bitrate usage can be lowered while guaranteeing normal playback for the user.

In the case where a strictly empty background or reference frame cannot be captured, the alternative is to encode two or more frames that might include a moving object
In a traffic intersection field-test, three unique frames are analysed from a video feed

Noise suppression

In order to guarantee a high image quality of moving objects, the encoding module also encodes the visual noise in the scene. However, using the predictive encoding methods mentioned above, the H.265+ intelligent analysis algorithm distinguishes between the background image and moving objects so that each can be encoded with different encoding strategies.

A background image is encoded with high compression in order to suppress noise and applies data to new or moving objects. Since data transmission is limited, the overall bitrate dips substantially when compared against conventional video compression.

Long-Term Bitrate Control

Hikvision has introduced a concept it calls “Long-Term Average Bitrate” to make full use of a data from a video feed. Long-Term Average Bitrate calculates the rates over a specified time period (usually 24 hours). With the average bitrate control, the camera can assign higher bitrates to busier hours while reducing it during idle hours—e.g., midnight to 6 AM outdoors, or 8 PM to 7 AM in an office. In the case of a constant bitrate mode for H.265 encoding, the bitrate varies slightly but stays near the predefined maximum bitrate value. Using H.265+, average bitrate can be as low as half of the maximum bitrate. Image quality can still be optimised since the H.265+ technology makes full use of every bit.

In variable bitrate mode, the instant bitrate varies according to a scene’s activity, while the image quality remains steady. Employing H.265+, the bitrate change can take two courses: 1.) if the configured average bitrate value is limited, H.265+ encoding can provide a better image quality within the limited bitrate; and 2.) if the configured average bitrate value is high for the scene being monitored, the actual average bitrate—the actual amount of data used—can be lower than the predefined value, lowering the total data storage requirement.

Instant bitrate comparison between two scenes

A bitrate-reduction test was conducted, based on cameras featuring 1080p resolution at 25 fps. The scene was a small café under video surveillance feed for a 24-hour period.

Testing the same scene—a busy café—at different times of day, showed that the rate difference between codecs appears less significant as the number of moving objects in the scene increases. Nevertheless, the numbers are still remarkable. The average bitrate between H.264 and Hikvision’s H.265+ decreased by a substantial 83%. The rate between the standard H.265 and Hikvision’s H.265+ codec decreased by 67%—a smaller difference, but nonetheless significant when applied to real-world surveillance systems.

In discreet, 24-hour file size comparison of two different scenes, drastic reductions were plain to see

24-hour file size in different scenes

In discreet, 24-hour file size comparison of two different scenes, drastic reductions were plain to see. Scene one was a café, where the H.264 codec yielded an average of 22.7 GB, and H.265 yielded 11.8 GB, on average. Remarkably, Hikvision’s H.265+ averaged only 3.9 GB. Scene two was a traffic Intersection. Here, the 24-hour file size comparison yielded similar results. H.264 averaged 36.4 GB, H.265 averaged 21.1 GB, and H.265+ averaged the lowest bitrate again at only 7.5 GB.

Here are in those numbers in percentages. In the café monitoring scenario, the rate of the 24-hour file size between H.265 and Hikvision H.265+ decreased by 66.4%, while the rate between H.264 and Hikvision H.265+ decreased by a substantial 82.5%. For the traffic intersection monitoring, the rate of the 24-hour file size between H.265 and Hikvision H.265+ decreased by 64.5%, while the rate between H.264 and Hikvision H.265+ decreased by 79.4%.

Improved bandwidth, storage, imaging, & VCAs

First, H.265+ makes the best use of every bit, so HD and ultra-HD resolutions looks as clear, sharp, and focused as possible. Also, as H.265+ improves image transmission, target objects will have more pixels so the use of VCAs will arguably become more precise, more accurate. Next, a network utilising H.265+ has more bandwidth available at any given time. More bandwidth means better system functioning all around. In real terms, on a 20 Mb broadband network, the H.264 codec can accommodate five cameras. H.265 doubles that, carrying the load of 10 cameras. But H.265+ doubles even that, accommodating 20 or more cameras on the single network. Therefore, H.265+ will be the best choice for users expanding an installation and moving to 4K at the same time.

A background image is encoded with high compression in order to suppress noise and applies data to new or moving objects
The overall bitrate dips substantially when compared against conventional video compression

What’s more, users reduce costs and other resources involved in storing video-feed data. Here's another scenario: when eight 2-Megapixel cameras are connected to a network, and a storage device holds five 5-Terrabyte hard drives, recording capacities vary significantly. A system running on H.264 will hit its storage ceiling in about two weeks. H.265 will do a bit better, filling up after about one month. Hikvision’s H.265+, however, will continue recording—up to about two full months. When considering these results on a monthly or annual basis for budgeting expenses and hardware allocations, H.265+ reduces expenditures all around. While the jump to H.265+ might be slow initially, the benefits will prove advantageous far into the future.

Applications are everywhere

The applications here extend at least as wide as those of any previous codec. However, under conditions such as an unstable network or limited bandwidth, or where customers are required to store data for extended periods of time, H.265+ will be most profoundly effective. Furthermore, this codec can be integrated into comprehensive security solutions for specific functions—4K, panoramic, and explosion-proof cameras, ultra-low light products, and anti-corrosion products are a few examples.

As with any new technological improvement, industry-wide upgrading from current or legacy standards requires investing time and resources. For H.265, migration is accelerating, primarily in newly designed systems since upgrading existing H.264 systems only increases expenditure. H.265 will become more desirable to system integrators and end-users since its decreased bitrates yield high-definition resolutions and images come through more clearly. Added to that, target objects can be isolated and enlarged with more clarity, and more accurate VCAs can be employed.

Hikvision’s H.265+ codec optimises the H.265/HEVC encoding technology, meeting its compression standards and operating with the vast majority of hardware and software designed to employ H.265. With H.265+, video quality remains virtually the same as that of H.265/HEVC while radically reducing transmission bandwidth and data storage capacity requirements. The H.265+ codec will serve to widen the application of ultra-HD resolutions in video surveillance, such as 8 MP and 12 MP devices. Wherever applied, this new codec will cut storage costs, make the fullest use of surveillance video investments, and broaden the use of 4K and ultra-HD security video.

Share with LinkedIn Share with Twitter Share with Facebook Share with Facebook
Download PDF version

In case you missed it

Which technologies will disrupt the security industry in the second half of 2020?
Which technologies will disrupt the security industry in the second half of 2020?

The first half of 2020 has been full of surprises, to say the least, and many of them directly impacted the physical security market. The COVID-19 pandemic created endless new challenges, and the physical security market has done our part to meet those challenges by adapting technology solutions such as thermal cameras and access control systems. In the second half of 2020, we can all hope for a return to normalcy, even if it is a “new normal.” In any case, technology will continue to play a big role. We asked this week’s Expert Panel Roundtable: Which technologies have the greatest potential to disrupt the security industry in the second half of 2020?

What do you need to know about thermal imaging cameras?
What do you need to know about thermal imaging cameras?

As businesses, schools, hospitals and sporting venues look to safely reopen in a COVID-19 world, thermal imaging systems will play a critical role in helping to detect and distinguish skin temperature variations in people. Thermal surveillance, a mainstay of traditional physical security and outdoor perimeter detection, is now being deployed to quickly scan employees, contractors and visitors as part of a first line of defense to detect COVID-19 symptoms. In the coming weeks and months, the security industry will look to implement thermal camera solutions for customers, yet many questions remain as to the differences between different system types and how to properly install thermal imaging cameras. In this Q&A, Jason Ouellette, Head of Technology Business Development for Johnson Controls, answers several of these questions. Q: What are some of the different thermal imaging solutions available in the market to detect an elevated temperature in a person? For the general market, there are three types of these thermographic screenings. There is the handheld device, which is typically lower cost, very portable, and very easy to use. Typically, this is a point and shoot type of device, but it requires you to be three feet or less from the person that you're screening, which, in today's world, means the user needs to wear protective personal equipment. For the general market, there are three types of these thermographic screenings The second type of solution would best be described as a thermal camera and kiosk. The advantage of this system over a handheld device is this can be self-service. An individual would go up to and engage with the kiosk on their own. But many of these kiosk type solutions have some integration capability, so they can provide some type of output, for either turnstiles, or physical access control, but not video management systems (VMS). Some of the downside of this type of system is that it’s less accurate than a thermographic solution because it does not have a blackbody temperature calibration device and the readings are influenced by the surrounding ambient temperature, called thermal drift. So instead of being able to achieve a ±0.3ºC accuracy rating, this system probably provides closer to ±0.5ºC at best. Some of these devices may be classed as a clinical thermometer with a higher degree of one time accuracy, but do not offer the speed and endurance of the thermographic solution for adjunctive use. And then there are thermal imaging camera systems with a blackbody temperature calibration device. These types of systems include a dual sensor camera, that has a visual sensor and a thermal sensor built right into the camera, along with a separate blackbody device. This provides the highest degree of ongoing accuracy, because of the blackbody and its ability to provide continuous calibration. These systems can provide much more flexibility and can offer integrations with multiple VMS platforms and access control devices. Q: When installing a thermal imaging camera system what is the most important element to consider? Camera placement is critical to ensure the system works as expected, however the placement of the blackbody device which verifies the correct calibration is in place is equally as important. If the customer wants to follow FDA medical device recommendations for camera placement, both the height of the camera and the blackbody as well as the distance between these devices should comply with the product installation instructions. This takes into account the device focal range and calibration parameters in addressing the distance from the person undergoing the scan. Also, integrators should minimise camera detection angles to ensure optimal accuracy and install cameras parallel with the face as much as possible, and again in compliance with installation instructions. Integrators should minimise camera detection angles to ensure optimal accuracy The blackbody should be placed outside of the area where people could block the device and located more towards the edges of the field-of-view of the camera. You need to keep in mind the minimum resolution for effective thermographic readings which is 320 by 240 pixels as defined by the standards. To achieve this, you would need to follow medical electrical equipment performance standards driven by IEC 80601-2-59:2017 for human temperature scanning and FDA guidelines. Within that measurement, the face needs to fill 240 x 180 pixels of the thermal sensor resolution, which is close to or just over 50 percent of the sensor’s viewing area typically, meaning a single person scanned at a time in compliance with the standards for accuracy.  Along with height and distance placement considerations, the actual placement in terms of the location of the system is key. For example, an expansive glass entryway may impact accuracy due to sunlight exposure. Installations should be focused on ensuring that they are away from airflow, heating and cooling sources, located approximately 16 feet from entry ways and in as consistent of an ambient temperature as possible between 50°F and 95°F. Q: Once a thermal imaging camera system is installed, how do you monitor the device? There are several choices for system monitoring, depending on whether the solution is used as standalone or integrated with other technologies, such as intrusion detection, access control or video systems. For standalone systems, the ability to receive system alerts is typically configured through the camera’s webpage interface, and the cameras include abilities such as the live web page, LED display for alerting, audio alerts and physical relay outputs. When done right, these features will all follow cybersecurity best practices which is important for any network solution today, including changing default passwords and establishing authentication methods. The ability to receive system alerts is typically configured through the camera’s webpage interface These types of thermal cameras can also integrate with turnstile systems, VMS platforms and access control systems. This is typically done through the integration of a relay output, activated by a triggered temperature anomaly event on a thermal imaging camera which can then be used for activities such as locking a turnstile, or through access control and video systems to send an email or provide an automated contagion report for contact tracing. These capabilities and integrations extend the monitoring capability above that of the standalone solution. The camera can be configured to monitor a specific range of low and high alerts. Users can determine the actions that should be taken when that alert exceeds the preset low or high threshold. These actions include things like a bright and easy-to-see LED can provide visual notification through pulsing and flashing lights as an example. Q: What about system maintenance? Does a thermal imaging camera require regular service in order to operate accurately? First it’s important to make sure the system is calibrated. This can be done after the unit stabilises for at least 30 minutes to establish the initial reference temperature source known as the blackbody. Calibrations conducted before this warm up and stability time period can throw off accuracy. Also, as part of your system maintenance schedule you will want to perform a calibration check of the blackbody device every 12 months, along with following recommendations of the FDA and IEC. If you install the solution and don’t perform maintenance and the blackbody calibration certificate expires, over time there’s a risk that the device will experience drift and a less accurate reading will result. There’s a risk that the device will experience drift and a less accurate reading will result Q: What final pieces of advice do you have for either an integrator who plans to install a thermal imaging camera system or an end user who plans to invest in this solution? Before you buy a thermal imaging camera check to see if the manufacturer ships the camera with a calibration certificate. Also, become familiar with FDA’s guidance released in April 2020, Enforcement Policy for Telethermographic Systems During the Coronavirus Disease 2019 (COVID-19) Public Health Emergency. This document places thermal/fever products for adjunctive use under the category of a Class I medical devices and subject to its regulatory control. Driven by these regulations and categorisation, users need to understand specifically what is required to meet the required level of accuracy for successful detection. While thermal imaging camera systems are more complex than traditional surveillance cameras, they can prove to be a valuable resource when set up, configured and maintained properly.

Recognising the importance of security officers to promote safety
Recognising the importance of security officers to promote safety

The general public doesn’t give much thought to the important role of security officers in creating and promoting safer environments. The low-profile work of security officers is vital to protecting people, places and property. During the pandemic, newer aspects to that role have emerged. Security personnel have been called on to perform diverse tasks such as managing queues at the supermarket, safeguarding testing centres and hospitals, ensuring food deliveries, and supporting police patrols. The British Security Industry Association (BSIA) and two other organisations in the United Kingdom are joining forces to raise awareness of the work of security officers and to recognise the vital importance of the duties they perform. BSIA, a trade association, includes members who are responsible for 70% of privately provided UK security products and services, including security guarding, consultancy services, and distribution and installation of electronic and physical security equipment. BSIA, the Security Institute and the Security Commonwealth Joining BSIA in the awareness campaign are the Security Institute, a professional security membership body; and the Security Commonwealth, which is comprised of 40 organisations from across the security landscape with common objectives to build professionalism, raise standards and share best practices. “The recognition of security officers as key workers is the start of a re-appraisal of what service they provide to the community in keeping the public safe and secure,” says Mike Reddington, BSIA Chief Executive. “As we exit lockdown and have to navigate public spaces again, [security officers] will have a crucial role in supporting public confidence. We are working closely with the Police and all other public bodies to find the best way to achieve this.” Security officers acknowledged as key workers The campaign will showcase security professionals as a respected, valued, professional service provider and a key worker that is acknowledged and embedded in daily lives. The British Security Industry Association (BSIA) and two other organisations in the United Kingdom are joining forces to raise awareness of the work of security officers “Great effort has been invested in the professional standards and capabilities of frontline [security] officers, and they have proven their worth during the coronavirus crisis in the UK,” says Rick Mounfield, Chief Executive, the Security Institute. “They, along with the wider security sector, deserve to be recognized, respected and appreciated for the safety and security they provide across the United Kingdom.” “[We are working to] build professionalism, raise standards and share best practices, and I hope this campaign can make more people recognise the changes we have all made and continue to make,” says Guy Matthias, Chairman of the Security Commonwealth (SyCom). The industry will be reaching out to companies, professionals, and organisations in the sector to participate in the campaign. The hope is that, over the coming weeks as lockdown is eased, the industry can play its part to ensure that the country emerges with confidence to start to recover and build for the future. Private security more important than ever The campaign will showcase security professionals as a respected, valued, professional service provider Across the pond in the United States, law enforcement professionals are facing a crisis of confidence during a time of civil unrest as protestors call to “defund the police” and to otherwise undermine and/or recast law enforcement’s role in preserving the peace and ensuring public safety. If an upshot is that public policing is starved of resources, the role of private security to supplement their mission is likely to increase. In short, the role of private security is more important than ever on both sides of the Atlantic. Public recognition of that role is welcome, obviously. In any case, the importance of their role protecting people, places and property has never been greater.