Customers could widen their fields of view and increase detection, recognition and identification
Though primarily developed for consumer electronic devices, the advantages of
H.265 compression technology make it ideal for the world of physical security

Ever since digital video systems were introduced the race was on to develop compression technologies to reduce runaway bandwidth and storage consumption. We’ve watched the industry roll out MJPEG, MPEG and H.264 advanced compression standards in direct response to each innovation. With adoption of HDTV and 4K solutions becoming more widespread – coupled with demands for higher frame rates and longer retention times – it’s easy to see that the trajectory towards H.265 was inevitable.

While the initial push for progressively more advanced compression algorithms originated with the consumer market, nowadays the surveillance industry is adding its own enhancements that address the unique efficiency requirements of security customers.

 How close are we to broad-based adoption of H.265?

Today H.264 holds the lion’s share of recorded video across the security industry.  But it took six years from the time the standard was ratified for it to achieve that status in the surveillance industry. Network camera manufacturers first rolled out products with dual CODEC support so that security practitioners could deploy MPEG4 cameras initially and then enable H.264 when their recording platform offered a solution. This same pattern will likely repeat itself with H.265 but hopefully at a much-accelerated rate.

H.265 was officially ratified in April of 2013 with an additional version updated in 2015. Though primarily developed for consumer electronic devices, the compelling advantages offered by this innovative compression technology made it a prime candidate for adoption in the world of physical security. Yet in 2016 only a few manufactures offered H.265 solutions and there was close to zero support from VMS developers. It’s the same way our industry approached the adoption of H.264: camera manufacturers lead the way and VMS developers played catch up.

Despite the superiority of H.265, there still seems to be a lot of foot dragging about adoption. Part of that is just a matter of technology maturing, but part of that is the question of who owns the patent rights and what they’re doing with them.

Wrestling with licensing and royalty structures

Two organisations – HEVC Advance and MPEG LA – represent the patent pools for H.265. HEVC Advance wants to institute a licensing model for the HEVC CODEC that includes a royalty on revenues generated on the content developed by any HEVC-enabled device. This royalty on content has prompted strong backlash from companies like Google, Amazon and Netflix who have joined others to develop the Alliance for Open Media, a royalty-free alternative to H.265.

Why should the security industry care about this royalty battle? We don’t draw revenue from surveillance video. But here’s the catch. What happens when a customer uses a hosted solution? Video Surveillance as a Service (VSaaS) provides customers with on-demand access to content that will be generated by cameras using H.265. It’s like having a private Netflix account of your recorded video and that service generates revenue for the hosting provider. That’s why HEVC Advance has made choosing video codec support a bottom line discussion for companies offering VSaaS solutions.

An alternative is the MPEG LA which collects the licensing fees we have all been paying for using H.264 and previous versions of CODECs managed by the group. MPEG LA uses a more traditional model that only licenses the encoding or decoding, which most view as simply the cost of doing business in the video industry. This enables MPEG LA to largely avoid the backlash unleashed on HEVC Advance. How it all shakes out in the consumer electronics industry will eventually influence what happens in our industry. But at this point, the immature licensing models are sowing confusion in markets and slowing down the adoption.

Despite the superiority of H.265, there still seems to be a lot of foot dragging about adoption
H.265 represents true cost savings, especially for surveillance professionals
who don’t have unlimited budgets

Why is the push for H.265 worth the effort?

Despite the current controversies, H.265 is well worth the effort. With claims of a 50% decrease in bitrate compared to H.264, H.265 represents true cost savings especially for security professionals who don’t have unlimited budgets. Implementing H.265 can cut existing storage requirements in half. Think what customers could do with the additional space and savings:

  • Increase the resolution on their existing cameras to gain more pixels on target. They could widen their fields of view; increase detection, recognition and identification; and possibly deploy fewer cameras for a given scene.

  • Increase the frame rate of their recordings to increase situational awareness. Operator could review more fluid motion video as well as “frame grab” the perfect image for possible prosecution.

  • Deploy more cameras at the same resolution and frame rate. As more opportunities for surveillance present themselves, H.265 allows users to expand their operation without overtaxing bandwidth consumption and other resources.

Introducing new intelligent compression techniques

H.264 is likely to be the video standard of choice for the foreseeable future based on the barriers of entry for H.265 mentioned above. However, there are still options for reducing bit rates further with existing algorithms, especially for surveillance video. One traditional solution allows the user defines a static region of interest. But there are two problems with that approach: 1) the suspicious individual is likely to move out of a static region of interest and 2) if you try to compensate for that fact by making the region of interest too big, you miss out on the compression savings.

Axis Communications solved those shortcomings with a more advanced technique called Zipstream. A tremendously more efficient implementation of H.264, it can reduce bandwidth and storage requirements by 50 percent or more when compared to standard H.264. Interestingly, that is the same savings that H.265 is touting. What makes Zipstream unique is that it dynamically allocates regions of interest depending on activity in the camera’s field of view.

Getting the H.265 ball rolling

Once the market works out the obstacles with licensing and VMS compatibility, manufacturers and customers will begin rolling out H.265 solutions. Industry pundits expect that more companies will launch H.265 cameras in 2016, but broad adoption may not occur for another few years. On the other hand, video coding enhancements such as Zipstream will most likely be applied to whatever compression standards are launched in the future.

Share with LinkedIn Share with Twitter Share with Facebook Share with Facebook
Download PDF version

Author profile

Fredrik Nilsson Vice President of the Americas, Axis Communications

Fredrik Nilsson is the general manager for Axis Communications with responsibility for the company’s operations in North America since 2003. During this time, he has helped the company increase its revenue more than tenfold and has been instrumental in leading the industry shift from analogue closed circuit television to network video.

In case you missed it

COVID-19 worries boost prospects of touchless biometric systems
COVID-19 worries boost prospects of touchless biometric systems

Spread of the novel coronavirus has jolted awareness of hygiene as it relates to touching surfaces such as keypads. No longer in favour are contact-based modalities including use of personal identification numbers (PINs) and keypads, and the shift has been sudden and long-term. Both customers and manufacturers were taken by surprise by this aspect of the virus’s impact and are therefore scrambling for solutions. Immediate impact of the change includes suspension of time and attendance systems that are touch-based. Some two-factor authentication systems are being downgraded to RFID-only, abandoning the keypad and/or biometric components that contributed to higher security, but are now unacceptable because they involve touching. Touchless biometric systems in demand The trend has translated into a sharp decline in purchase of touch modality and a sharp increase in the demand for touchless systems, says Alex Zarrabi, President of Touchless Biometrics Systems (TBS). Biometrics solutions are being affected unequally, depending on whether they involve touch sensing, he says. Spread of the novel coronavirus has jolted awareness of hygiene as it relates to touching surfaces such as keypads “Users do not want to touch anything anymore,” says Zarrabi. “From our company’s experience, we see it as a huge catalyst for touchless suppliers. We have projects being accelerated for touchless demand and have closed a number of large contracts very fast. I’m sure it’s true for anyone who is supplying touchless solutions.” Biometric systems are also seeing the addition of thermal sensors to measure body temperature in addition to the other sensors driving the system. Fingerscans and hybrid face systems TBS offers 2D and 3D systems, including both fingerscans and hybrid face/iris systems to provide touchless identification at access control points. Contactless and hygienic, the 2D Eye system is a hybrid system that combines the convenience of facial technology with the higher security of iris recognition. The system recognises the face and then detects the iris from the face image and zeros in to scan the iris. The user experiences the system as any other face recognition system. The facial aspect quickens the process, and the iris scan heightens accuracy. TBS also offers the 2D Eye Thermo system that combines face, iris and temperature measurement using a thermal sensor module. TBS's 2D Eye Thermo system combines face, iris and temperature measurement using a thermal sensor module Another TBS system is a 3D Touchless Fingerscan system that provides accuracy and tolerance, anti-spoofing, and is resilient to water, oil, dust and dirt. The 2D+ Multispectral for fingerprints combines 2D sensing with “multispectral” subsurface identification, which is resilient to contaminants and can read fingerprints that are oily, wet, dry or damaged – or even through a latex glove. In addition, the 3D+ system by TBS provides frictionless, no-contact readings even for people going through the system in a queue. The system fills the market gap for consent-based true on-the-fly systems, says Zarrabi. The system captures properties of the hand and has applications in the COVID environment, he says. The higher accuracy and security ratings are suitable for critical infrastructure applications, and there is no contact; the system is fully hygienic. Integration with access control systems Integration of TBS biometrics with a variety of third-party access control systems is easy. A “middleware” subsystem is connected to the network. Readers are connected to the subsystem and also to the corporate access control system. An interface with the TBS subsystem coordinates with the access control system. For example, a thermal camera used as part of the biometric reader can override the green light of the access control system if a high temperature (suggesting COVID-19 infection, for example) is detected. The enrollment process is convenient and flexible and can occur at an enrollment station or at an administration desk. Remote enrollment can also be accomplished using images from a CCTV camera. All templates are encrypted. Remotely enrolled employees can have access to any location they need within minutes. The 3D+ system by TBS provides frictionless, no-contact readings even for people going through the system in a queue Although there are other touchless technologies available, they cannot effectively replace biometrics, says Zarrabi. For example, a centrally managed system that uses a Bluetooth signal from a smart phone could provide convenience, is “touchless,” and could suffice for some sites. However, the system only confirms the presence and “identity” of a smart phone – not the person who should be carrying it. “There has been a lot of curiosity about touchless, but this change is strong, and there is fear of a possible second wave of COVID-19 or a return in two or three years,” says Zarrabi. “We really are seeing customers seriously shifting to touchless.”

How to maximise your body temperature detection systems
How to maximise your body temperature detection systems

There are many companies jumping into selling temperature detection systems to the state, local governments, hospitals, airports and local businesses, but do they know how to drive one? Anyone can get behind a car and drive it into a wall by accident. The same can happen with a temperature detection system.  The first thing you should ask is “does my firm have a certified thermographer?”. If not, the firm are at risk of getting a low quality system that is being resold to make quick cash. Businesses that are doing this do not know how to operate it properly. Asking the right questions Secondly, you should ask whether the system is NDAA compliant. NDAA compliance means that your temperature detection equipment is protected by U.S. law. Does your system have a HSRP device (blackbody)? HSRP (Heat Source Reference Point) is a device that will allow the camera to detect the correct temperature a distance. Even if the room temperature does change throughout the day, treat it as a reference point for the camera to know the temperature at that distance. Can your system scan mutliple people at once? Can your system scan mutliple people at once? This is a bad question but often asked since most systems will say yes. For ease, everyone wants to scan many people at once, but the best practice according to FDA and CDC guidelines is to run one person at a time for best accuracy. Why? The HSRP (blackbody) device tells the camera what the correct temperature is at a given distance away from the camera. Every foot you are away from the HSRP device will be off by 0.1 degrees roughly. If you are in a room full of people, let's say 6, in view of the camera, every person that is not next to the HSRP device (5) will be given an inaccurate reading. Hence why it is so important to run the system correctly with just one person at a time. You will also need to follow the 6 feet rule. If you take that into consideration, one at a time at 6 feet apart, the device should tell you how you need to run the system. Sensitivity of thermal imaging Is your system’s sensor accurate enough? The FDA recommends an error of ±0.5°C or better. When looking for a system, make sure it is better than what they recommend. I would recommend ±0.3°C or better. Do not purchase a system over ±-.5°C degrees as you are doing yourself and your customers or employees an injustice.  Another thing to look at is how many pixels it can determine the temperature from. Some cameras can only tell the temperature of 6 points on the screen, whilst others can take a temperature reading from each pixel. Take a 384x288 camera, for example, which would be over 110,000 points of temperature taking on a single image.      Thermal cameras are very sensitive, so there are a lot of do’s and don’ts. For example, the system cannot see through glasses or hats. On the below image you can see a person with the visual camera on the right, whilst on the left side is through a thermal camera.  Both are pointing at the same area. It is clear the person on the left side is “invisible” to the thermal imaging camera. Demonstrating the sensitivity of thermal imaging If you are a company who wants to detect the temperature of customers or employees though the front door, window or a car window, the answer would be no. You need a clear line of sight without any interference to scan for temperatures. Other things you need to look out for is wind and distance away from the HSRP (blackbody) device. Air and distance away from the HSRP device will make the system less and less accurate the more space between the device. Air and distance away from the HSRP device will make the system less and less accurate Thermal imaging and COVID-19 If you have a clear line of sight, is there anything I need to know? The answer is yes. Reflective materials such as metal can interfere with your temperature readings. Reflective materials are easily picked up from the thermal side so pointing at a medal, glass or anything reflective can cause inaccuracies within the system. In the age of COVID-19, temperature detection systems are more important than ever. Organisations must get a system in place to help scan for high temperatures in order to reduce the spread of the virus.

What are the security challenges of the oil and gas market?
What are the security challenges of the oil and gas market?

Protecting the oil and gas market is key to a thriving economy. The list of security challenges for oil and gas requires the best technology solutions our industry has to offer, from physical barriers to video systems to cybersecurity. We asked this week’s Expert Panel Roundtable: what are the security challenges of the oil and gas market?