“Barrel distortion” can occur with fisheye cameras, where a circular image is created and a straight line within the captured image appears curved
As the technology in omnidirectional cameras continues to improve, they are becoming increasingly more affordable to a wider segment of the video surveillance market

Just a few years ago, omnidirectional cameras were a novelty. Today, however, this technology has taken the leap to the mainstream. Think about how ubiquitous Google’s Street View is, and you can gain a better idea of the power of omnidirectional cameras. Even consumers are starting to see many forms of omnidirectional cameras, from 360-degree lenses on SLRs to 360-degree video from action cameras.

To that end, 360-degree cameras represent one of the strongest areas of growth in surveillance technology, with global unit shipments forecasted by IHS to increase by more than 60 percent year-on-year.

Omnidirectional vs. traditional cameras

 Both 360- and 180-degree surveillance cameras offer panoramic views, helping reduce the number of traditional narrow field-of-view cameras needed in a single installation. Omnidirectional cameras can also be used in concert with PTZ cameras, or replace them entirely depending on the application. Not only does this help increase situational awareness, it decreases the overall cost of the cameras, installation and maintenance.

Compared to PTZ cameras, omnidirectional cameras have the advantage of being able to pan, tilt and zoom around in both live, as well as stored video, which means operators can pinpoint problems in real-time, ensuring incidents can be resolved quickly and efficiently, and at the same time, go back to stored 360-degree video to conduct investigations.

The option for 180- and 360-degree coverage from a single camera is delivered via a specialised lens on one sensor or a camera that integrates with multiple sensors with conventional lenses aligned to provide an ultra-wide-angle coverage. Single-lens or “fisheye” cameras use a specialised lens called a fisheye lens, which, when compared to a conventional lens, employs different optical design techniques that can lead to the distortion of the captured image when viewing beyond a 90-degree horizontal field-of-view. With this, “barrel distortion” can occur, where a circular image is created and a straight line within the captured image appears curved. ‘Dewarping’ software has to be used to correct this optical illusion.

As a consequence of lens design idiosyncrasies in 180- and 360-degree fisheye cameras, either an oval or circular shaped imaged is created. Since image sensors used in surveillance cameras are square or rectangular, some parts of the sensor are not used.

Increasingly affordable solutions

As the technology in these types of cameras continues to improve, they are becoming increasingly more affordable to a wider segment of the video surveillance market. Similarly, higher resolutions and more affordable storage for video data make it more affordable to get increased amounts of coverage and detail at the same time.

As mentioned previously, cost savings can also be realised when a single 360-degree camera replaces three to four fixed cameras, a result that can be recreated in other areas or departments within an organisation to help realise additional cost savings.

Fisheye vs. multi-sensor

Fisheye and multi-sensor cameras both create panoramic images, but do so in very different ways.

Fisheye cameras capture the whole scene in a single view without having to stitch images, so the full view of the captured video footage has consistent brightness, sharpness and contrast across the entire scene. Fisheye cameras also offer a number of other benefits: higher reliability as a result of a single sensor, camera and lens arrangement; no blind spots; fixed focus, making installation quicker; lower cost; and a smaller, less obtrusive form factor. Additionally, the dewarping of the image is carried out in the video management system or network video recorder, allowing for higher frame rates at any given bandwidth.

 

If a camera sends a 360-degree image, the VMS software has to dewarp the image so that users can get normal views while electronically PTZ’ing around in the image
Omnidirectional cameras can pan, tilt and zoom around in both live and stored video, which means operators can pinpoint problems in real-time

 However, fisheye cameras may have fewer pixels per foot, depending on the total resolution, and these types of cameras require client-side dewarping to gain the full benefits of retrospective image adjustment – that is, dewarping of stored video for investigations. Multi-sensor cameras, on the other hand, may offer a higher total resolution depending on the individual resolution of each of the sensors within the camera. Here, dewarping is not required since each sensor is, in essence, a narrow field-of-view camera.

Multi-sensor cameras, however, have more than one sensor, which can lead to an overall higher maintenance costs, and with four or more cameras needed to cover a specific area, there is an increased risk that one or more of the sensors can malfunction — in essence, lower reliability. Installation of multi-sensor cameras is also more complicated and more time-intensive. Additionally, the units themselves can be large and bulky, and complex to operator and manage — each view has to be stitched together, which means captured images have to be carefully calibrated with the correct brightness, colour, contrast and sharpness for the image to be as clear and seamless as it needs to be for viewing and evidentiary purposes. Other possible considerations include: additional licensing fees for each camera connected to an NVR or VMS, total frame rate is generally lower and bandwidth usage will be high. Also, storage costs are higher.

As businesses look to increase situational awareness by investing in omnidirectional cameras, it’s important to carefully evaluate the technology being implemented and various options before moving forward with an implementation

Dewarping images

If a camera sends a 360-degree image, the VMS software has to dewarp the image so that users can get normal views while electronically PTZ’ing around in the image. This is called “client-side” dewarping.

With client-side dewarping, images can be dewarped retrospectively — that is, stored video can be dewarped, enabling users to forensically analyse a scene after the fact. The result is that investigations can be carried on as if the video were being watched in real time, making the data indispensable to investigators examining the details of a crime or security breach. Not only does this approach deliver new levels of situational awareness, but it also allows officials to use the data to examine additional areas of interest.

The virtual PTZ function can only be experienced via client-side dewarping for stored video, and it can also be run on still images. Additionally, different parts of the image might be useful for different applications that are hard to predict in advance. For example, a merchandiser may want to zoom in and look at signage or an end cap after the fact to gain better insight into the business. Client-side dewarping may also be run on mobile devices, on either live or on stored video.

One challenge of client-side dewarping is that VMS and NVR platforms have to support this function. There are already a large number of platforms that support this functionality because of end user demand. On the other hand, camera-side dewarping does not require a VMS/NVR platform to integrate this function. Camera-side dewarping means you can only virtually PTZ around in a live scene, which is the same as using a motorised PTZ camera – and this function requires an operator to manually navigate and record what the camera sees. Once these views are fixed, a user may only see those views in stored footage, severely limiting the possibility of being able to capture a wider scene for analysis. This means there may be more blind spots in live and stored video depending on how the views are configured.

Evaluating technology implemented

As businesses look to increase situational awareness by investing in omnidirectional cameras, it’s important to carefully evaluate the technology being implemented and various options before moving forward with an implementation. There are a number of pros and cons to dewarping software and the views within the cameras to consider.

But, with higher resolutions and more efficient dewarping/stitching technologies, omnidirectional cameras may soon replace narrow field-of-view and PTZ cameras in a number of vertical markets, including transportation, retail, education, banking and finance, maritime, leisure and gaming, ushering in a new era of total situational awareness with a wealth of data and insight yet untapped.

Share with LinkedIn Share with Twitter Share with Facebook Share with Facebook
Download PDF version

Author profile

Jumbi Edulbehram Regional President, Americas, Oncam

Jumbi is currently the President, Americas for Oncam, a maker of 360 degrees cameras and software. He is responsible for all sales, marketing and business development activities in the Americas. Prior to Oncam, Jumbi served as the Director of Business Development for the security division of Samsung Techwin, where he was responsible for managing strategic partnerships with technology partners, consultants/A&Es, and large national integrators. His team was also responsible for developing new business in industry segments such as retail, government and transportation.

In case you missed it

COVID-19 worries boost prospects of touchless biometric systems
COVID-19 worries boost prospects of touchless biometric systems

Spread of the novel coronavirus has jolted awareness of hygiene as it relates to touching surfaces such as keypads. No longer in favour are contact-based modalities including use of personal identification numbers (PINs) and keypads, and the shift has been sudden and long-term. Both customers and manufacturers were taken by surprise by this aspect of the virus’s impact and are therefore scrambling for solutions. Immediate impact of the change includes suspension of time and attendance systems that are touch-based. Some two-factor authentication systems are being downgraded to RFID-only, abandoning the keypad and/or biometric components that contributed to higher security, but are now unacceptable because they involve touching. Touchless biometric systems in demand The trend has translated into a sharp decline in purchase of touch modality and a sharp increase in the demand for touchless systems, says Alex Zarrabi, President of Touchless Biometrics Systems (TBS). Biometrics solutions are being affected unequally, depending on whether they involve touch sensing, he says. Spread of the novel coronavirus has jolted awareness of hygiene as it relates to touching surfaces such as keypads “Users do not want to touch anything anymore,” says Zarrabi. “From our company’s experience, we see it as a huge catalyst for touchless suppliers. We have projects being accelerated for touchless demand and have closed a number of large contracts very fast. I’m sure it’s true for anyone who is supplying touchless solutions.” Biometric systems are also seeing the addition of thermal sensors to measure body temperature in addition to the other sensors driving the system. Fingerscans and hybrid face systems TBS offers 2D and 3D systems, including both fingerscans and hybrid face/iris systems to provide touchless identification at access control points. Contactless and hygienic, the 2D Eye system is a hybrid system that combines the convenience of facial technology with the higher security of iris recognition. The system recognises the face and then detects the iris from the face image and zeros in to scan the iris. The user experiences the system as any other face recognition system. The facial aspect quickens the process, and the iris scan heightens accuracy. TBS also offers the 2D Eye Thermo system that combines face, iris and temperature measurement using a thermal sensor module. TBS's 2D Eye Thermo system combines face, iris and temperature measurement using a thermal sensor module Another TBS system is a 3D Touchless Fingerscan system that provides accuracy and tolerance, anti-spoofing, and is resilient to water, oil, dust and dirt. The 2D+ Multispectral for fingerprints combines 2D sensing with “multispectral” subsurface identification, which is resilient to contaminants and can read fingerprints that are oily, wet, dry or damaged – or even through a latex glove. In addition, the 3D+ system by TBS provides frictionless, no-contact readings even for people going through the system in a queue. The system fills the market gap for consent-based true on-the-fly systems, says Zarrabi. The system captures properties of the hand and has applications in the COVID environment, he says. The higher accuracy and security ratings are suitable for critical infrastructure applications, and there is no contact; the system is fully hygienic. Integration with access control systems Integration of TBS biometrics with a variety of third-party access control systems is easy. A “middleware” subsystem is connected to the network. Readers are connected to the subsystem and also to the corporate access control system. An interface with the TBS subsystem coordinates with the access control system. For example, a thermal camera used as part of the biometric reader can override the green light of the access control system if a high temperature (suggesting COVID-19 infection, for example) is detected. The enrollment process is convenient and flexible and can occur at an enrollment station or at an administration desk. Remote enrollment can also be accomplished using images from a CCTV camera. All templates are encrypted. Remotely enrolled employees can have access to any location they need within minutes. The 3D+ system by TBS provides frictionless, no-contact readings even for people going through the system in a queue Although there are other touchless technologies available, they cannot effectively replace biometrics, says Zarrabi. For example, a centrally managed system that uses a Bluetooth signal from a smart phone could provide convenience, is “touchless,” and could suffice for some sites. However, the system only confirms the presence and “identity” of a smart phone – not the person who should be carrying it. “There has been a lot of curiosity about touchless, but this change is strong, and there is fear of a possible second wave of COVID-19 or a return in two or three years,” says Zarrabi. “We really are seeing customers seriously shifting to touchless.”

How to maximise your body temperature detection systems
How to maximise your body temperature detection systems

There are many companies jumping into selling temperature detection systems to the state, local governments, hospitals, airports and local businesses, but do they know how to drive one? Anyone can get behind a car and drive it into a wall by accident. The same can happen with a temperature detection system.  The first thing you should ask is “does my firm have a certified thermographer?”. If not, the firm are at risk of getting a low quality system that is being resold to make quick cash. Businesses that are doing this do not know how to operate it properly. Asking the right questions Secondly, you should ask whether the system is NDAA compliant. NDAA compliance means that your temperature detection equipment is protected by U.S. law. Does your system have a HSRP device (blackbody)? HSRP (Heat Source Reference Point) is a device that will allow the camera to detect the correct temperature a distance. Even if the room temperature does change throughout the day, treat it as a reference point for the camera to know the temperature at that distance. Can your system scan mutliple people at once? Can your system scan mutliple people at once? This is a bad question but often asked since most systems will say yes. For ease, everyone wants to scan many people at once, but the best practice according to FDA and CDC guidelines is to run one person at a time for best accuracy. Why? The HSRP (blackbody) device tells the camera what the correct temperature is at a given distance away from the camera. Every foot you are away from the HSRP device will be off by 0.1 degrees roughly. If you are in a room full of people, let's say 6, in view of the camera, every person that is not next to the HSRP device (5) will be given an inaccurate reading. Hence why it is so important to run the system correctly with just one person at a time. You will also need to follow the 6 feet rule. If you take that into consideration, one at a time at 6 feet apart, the device should tell you how you need to run the system. Sensitivity of thermal imaging Is your system’s sensor accurate enough? The FDA recommends an error of ±0.5°C or better. When looking for a system, make sure it is better than what they recommend. I would recommend ±0.3°C or better. Do not purchase a system over ±-.5°C degrees as you are doing yourself and your customers or employees an injustice.  Another thing to look at is how many pixels it can determine the temperature from. Some cameras can only tell the temperature of 6 points on the screen, whilst others can take a temperature reading from each pixel. Take a 384x288 camera, for example, which would be over 110,000 points of temperature taking on a single image.      Thermal cameras are very sensitive, so there are a lot of do’s and don’ts. For example, the system cannot see through glasses or hats. On the below image you can see a person with the visual camera on the right, whilst on the left side is through a thermal camera.  Both are pointing at the same area. It is clear the person on the left side is “invisible” to the thermal imaging camera. Demonstrating the sensitivity of thermal imaging If you are a company who wants to detect the temperature of customers or employees though the front door, window or a car window, the answer would be no. You need a clear line of sight without any interference to scan for temperatures. Other things you need to look out for is wind and distance away from the HSRP (blackbody) device. Air and distance away from the HSRP device will make the system less and less accurate the more space between the device. Air and distance away from the HSRP device will make the system less and less accurate Thermal imaging and COVID-19 If you have a clear line of sight, is there anything I need to know? The answer is yes. Reflective materials such as metal can interfere with your temperature readings. Reflective materials are easily picked up from the thermal side so pointing at a medal, glass or anything reflective can cause inaccuracies within the system. In the age of COVID-19, temperature detection systems are more important than ever. Organisations must get a system in place to help scan for high temperatures in order to reduce the spread of the virus.

What are the security challenges of the oil and gas market?
What are the security challenges of the oil and gas market?

Protecting the oil and gas market is key to a thriving economy. The list of security challenges for oil and gas requires the best technology solutions our industry has to offer, from physical barriers to video systems to cybersecurity. We asked this week’s Expert Panel Roundtable: what are the security challenges of the oil and gas market?