Remember the old adage “The whole is greater than the sum of its parts?” Nowhere is that truism more evident than when you add network video to the current generation of Internet of Things (IoT) solutions. Whether we’re talking about industrial IoT applications, “Smart – X” (city, building, parking etc.) or retail operations, integrating network video into the solution provides value far beyond simple situational awareness.

Optimising sophisticated video technology

When video systems first moved from analogue to digital and then became part of the IoT world, they were primarily used to provide visual validation of sensor-detected events. For instance, if an industrial controller sensed an environmental issue such as a temperature exceeding set threshold maximum limits, the sensor would trigger the management software to notify the operator that this event had occurred. The operator could then pull up the video feed of the closest camera and observe the area remotely. While this application is simple, it shows how video enhances sensor management. 

As edge devices, such as sensors and network video become more intelligent, the interactions between systems are growing in sophistication and generating even greater value than each system could provide on its own. 

To appreciate how these smart applications are being used to improve overall efficiencies and profitability, let’s delve into three areas where they’re being deployed: intelligent buildings, smart cities, and smart retailing.  

Lights can automatically turn on or off, brighten or dimmed, to eliminate wasteful energy consumption
By overlaying intelligent operational sensors with intelligent video, it’s now possible to automate lighting levels based on motion detection

Video-based operational analytics

Applying intelligent monitoring to environmental equipment (HVAC) makes it easy for building owners and property managers to determine existing operating costs based on current equipment performance. They can then compare that amount to the cost of upgrades and potential cost savings over time.

Lighting is another significant operating cost within building management. By overlaying intelligent operational sensors with intelligent video (light sensors), it’s now possible to automate lighting levels based on motion detection. Lights can automatically turn on or off, brighten or dimmed, to eliminate wasteful energy consumption. With the addition of occupancy analytics via intelligent video, property managers can determine what caused the motion and learn other operational details such as occupancy counts. Did someone walk through and area causing lighting to turn on or up? Did they dwell in this area? These specifics can help managers efficiently optimise lighting controls and reduce the overall operating cost of the property.

Businesses are also using smart applications to optimise allocation of desk space and conference areas. For instance, intelligent video can determine conference room occupancy (in use, number of people in room, free space even though showing booked) far better than stand-alone motion sensors. When tied to automated room assignment systems, the additional statistics provided by video analytics might suggest room changes based on room size and number of attendees through back-office applications such as Microsoft Outlook.

These examples are just a few of a growing list of available video-based operational analytics currently on the market.

Video analytics in smart cities

Initial forays into smart city technologies such as smart lighting, smart grid, smart parking and so on relied on standalone sensor technologies. Their capabilities were good but limited. Smart Lighting for instance would use basic light detectors to turn street lighting. Smart Parking and traffic systems would use weight sensors to trigger vehicle counts, traffic signal changes or determine if a parking space was in use and paid for. Augmenting these applications with intelligent video and analytics, however, opens up a whole new world of additional details. In Smart Lighting, the video sensor can now trigger a change in lighting based on rules such as vehicular and pedestrian events. Video analytics can yield additional metadata such as vehicle type (commercial versus public use). Smart Parking becomes much more effective when you can begin to provide vehicle detail such as vehicle type or other information based on licence plate recognition. These additional details can help parking lots operate more efficiently and offer value-added services like space reservation and open space location notifications. 

. In Smart Lighting, the video sensor can now trigger a change in lighting based on rules such as vehicular and pedestrian events
Augmenting smart city applications with intelligent video and analytics opens up a whole new world of additional details

Smart Grid offers some less obvious but equally valuable system augmentation capabilities. We often associate Smart Grid with simple automated meter reading but these systems also traverse critical power infrastructure. Solution providers in this arena are now offering heightened asset and perimeter protection via integration of network-based radar detection with video and audio analytics. This strategic mix of technologies can be used to minimise false detection alarms, turn on/off or change lighting levels and point cameras to areas of interest for extremely effective and cost-effective perimeter security.

Network video for retail intelligence

Retailing was one of the earliest adopters of smart device integration with network video and video analytics to support loss prevention and customer safety. They’ve been using video to analyse customer traffic and behaviour in order to improve product placement, increase product sales, as well as cross-sell related items. Adding programmable “Digital Signage” to the mix created new opportunities to display targeted messages based on viewer demographics about additional products and services of potential interest.

Integrating network video with point-of-sale terminals to reconcile cash register receipts, adding heat mapping analytics to study customer foot traffic patterns, measuring check out wait times to increase employee productivity and efficiency as well as improve the customer experience are just some of the ways retailers have applied the principles of IoT to their advantage. Overlay intelligent building controls and you can see the exponential power of integrating intelligent video with other IoT devices and systems.

Overlay intelligent building controls and you can see the exponential power of integrating intelligent video with other IoT devices and system
Retailing was one of the earliest adopters of smart device integration with network video and video analytics to support loss prevention and customer safety

Minimising metadata overload

Smart application integration produces an enormous amount of metadata. Collecting, transporting and synthesising this data into meaningful business intelligence can be daunting. It requires disciplined use of resources from the network infrastructure transporting the data locally to the various cloud technologies (private cloud, hybrid cloud, public cloud) storing and disseminating it securely. 

Generally smart sensor data is fairly light weight in terms of actual data transmitted. Adding video elements can significantly increase bit-rate (bandwidth and storage) requirements. This highlights the need for the video to be more intelligent and interactive with the intelligent sensor and edge device technologies so that resources can be used more efficiently. Smart applications let you do that. You can fine tune video rules and optimise transmission based on retention value. You can program the video to sensor triggers or events, transmitting lower frame rate and resolution video for less interesting video and increasing the video settings when higher quality video is more relevant and valuable based on these sensor triggers.

The back-end collectors of sensor metadata are becoming more mainstream and easier to operate.  In many sectors, service providers are offering management of this sensor output “As a Service.” 

As smart IoT technology continues to mature, the benefits of integration between network video systems and other network solutions will only get better. We’re already seeing greater efficiency in operations as well as higher quantifiable returns on investment through cost savings and more in-depth, usable business intelligence.

Share with LinkedIn Share with Twitter Share with Facebook Share with Facebook
Download PDF version

Author profile

Vince Ricco Business Development Manager, Axis Communications

In case you missed it

Which technologies will disrupt the security industry in the second half of 2020?
Which technologies will disrupt the security industry in the second half of 2020?

The first half of 2020 has been full of surprises, to say the least, and many of them directly impacted the physical security market. The COVID-19 pandemic created endless new challenges, and the physical security market has done our part to meet those challenges by adapting technology solutions such as thermal cameras and access control systems. In the second half of 2020, we can all hope for a return to normalcy, even if it is a “new normal.” In any case, technology will continue to play a big role. We asked this week’s Expert Panel Roundtable: Which technologies have the greatest potential to disrupt the security industry in the second half of 2020?

What do you need to know about thermal imaging cameras?
What do you need to know about thermal imaging cameras?

As businesses, schools, hospitals and sporting venues look to safely reopen in a COVID-19 world, thermal imaging systems will play a critical role in helping to detect and distinguish skin temperature variations in people. Thermal surveillance, a mainstay of traditional physical security and outdoor perimeter detection, is now being deployed to quickly scan employees, contractors and visitors as part of a first line of defense to detect COVID-19 symptoms. In the coming weeks and months, the security industry will look to implement thermal camera solutions for customers, yet many questions remain as to the differences between different system types and how to properly install thermal imaging cameras. In this Q&A, Jason Ouellette, Head of Technology Business Development for Johnson Controls, answers several of these questions. Q: What are some of the different thermal imaging solutions available in the market to detect an elevated temperature in a person? For the general market, there are three types of these thermographic screenings. There is the handheld device, which is typically lower cost, very portable, and very easy to use. Typically, this is a point and shoot type of device, but it requires you to be three feet or less from the person that you're screening, which, in today's world, means the user needs to wear protective personal equipment. For the general market, there are three types of these thermographic screenings The second type of solution would best be described as a thermal camera and kiosk. The advantage of this system over a handheld device is this can be self-service. An individual would go up to and engage with the kiosk on their own. But many of these kiosk type solutions have some integration capability, so they can provide some type of output, for either turnstiles, or physical access control, but not video management systems (VMS). Some of the downside of this type of system is that it’s less accurate than a thermographic solution because it does not have a blackbody temperature calibration device and the readings are influenced by the surrounding ambient temperature, called thermal drift. So instead of being able to achieve a ±0.3ºC accuracy rating, this system probably provides closer to ±0.5ºC at best. Some of these devices may be classed as a clinical thermometer with a higher degree of one time accuracy, but do not offer the speed and endurance of the thermographic solution for adjunctive use. And then there are thermal imaging camera systems with a blackbody temperature calibration device. These types of systems include a dual sensor camera, that has a visual sensor and a thermal sensor built right into the camera, along with a separate blackbody device. This provides the highest degree of ongoing accuracy, because of the blackbody and its ability to provide continuous calibration. These systems can provide much more flexibility and can offer integrations with multiple VMS platforms and access control devices. Q: When installing a thermal imaging camera system what is the most important element to consider? Camera placement is critical to ensure the system works as expected, however the placement of the blackbody device which verifies the correct calibration is in place is equally as important. If the customer wants to follow FDA medical device recommendations for camera placement, both the height of the camera and the blackbody as well as the distance between these devices should comply with the product installation instructions. This takes into account the device focal range and calibration parameters in addressing the distance from the person undergoing the scan. Also, integrators should minimise camera detection angles to ensure optimal accuracy and install cameras parallel with the face as much as possible, and again in compliance with installation instructions. Integrators should minimise camera detection angles to ensure optimal accuracy The blackbody should be placed outside of the area where people could block the device and located more towards the edges of the field-of-view of the camera. You need to keep in mind the minimum resolution for effective thermographic readings which is 320 by 240 pixels as defined by the standards. To achieve this, you would need to follow medical electrical equipment performance standards driven by IEC 80601-2-59:2017 for human temperature scanning and FDA guidelines. Within that measurement, the face needs to fill 240 x 180 pixels of the thermal sensor resolution, which is close to or just over 50 percent of the sensor’s viewing area typically, meaning a single person scanned at a time in compliance with the standards for accuracy.  Along with height and distance placement considerations, the actual placement in terms of the location of the system is key. For example, an expansive glass entryway may impact accuracy due to sunlight exposure. Installations should be focused on ensuring that they are away from airflow, heating and cooling sources, located approximately 16 feet from entry ways and in as consistent of an ambient temperature as possible between 50°F and 95°F. Q: Once a thermal imaging camera system is installed, how do you monitor the device? There are several choices for system monitoring, depending on whether the solution is used as standalone or integrated with other technologies, such as intrusion detection, access control or video systems. For standalone systems, the ability to receive system alerts is typically configured through the camera’s webpage interface, and the cameras include abilities such as the live web page, LED display for alerting, audio alerts and physical relay outputs. When done right, these features will all follow cybersecurity best practices which is important for any network solution today, including changing default passwords and establishing authentication methods. The ability to receive system alerts is typically configured through the camera’s webpage interface These types of thermal cameras can also integrate with turnstile systems, VMS platforms and access control systems. This is typically done through the integration of a relay output, activated by a triggered temperature anomaly event on a thermal imaging camera which can then be used for activities such as locking a turnstile, or through access control and video systems to send an email or provide an automated contagion report for contact tracing. These capabilities and integrations extend the monitoring capability above that of the standalone solution. The camera can be configured to monitor a specific range of low and high alerts. Users can determine the actions that should be taken when that alert exceeds the preset low or high threshold. These actions include things like a bright and easy-to-see LED can provide visual notification through pulsing and flashing lights as an example. Q: What about system maintenance? Does a thermal imaging camera require regular service in order to operate accurately? First it’s important to make sure the system is calibrated. This can be done after the unit stabilises for at least 30 minutes to establish the initial reference temperature source known as the blackbody. Calibrations conducted before this warm up and stability time period can throw off accuracy. Also, as part of your system maintenance schedule you will want to perform a calibration check of the blackbody device every 12 months, along with following recommendations of the FDA and IEC. If you install the solution and don’t perform maintenance and the blackbody calibration certificate expires, over time there’s a risk that the device will experience drift and a less accurate reading will result. There’s a risk that the device will experience drift and a less accurate reading will result Q: What final pieces of advice do you have for either an integrator who plans to install a thermal imaging camera system or an end user who plans to invest in this solution? Before you buy a thermal imaging camera check to see if the manufacturer ships the camera with a calibration certificate. Also, become familiar with FDA’s guidance released in April 2020, Enforcement Policy for Telethermographic Systems During the Coronavirus Disease 2019 (COVID-19) Public Health Emergency. This document places thermal/fever products for adjunctive use under the category of a Class I medical devices and subject to its regulatory control. Driven by these regulations and categorisation, users need to understand specifically what is required to meet the required level of accuracy for successful detection. While thermal imaging camera systems are more complex than traditional surveillance cameras, they can prove to be a valuable resource when set up, configured and maintained properly.

Recognising the importance of security officers to promote safety
Recognising the importance of security officers to promote safety

The general public doesn’t give much thought to the important role of security officers in creating and promoting safer environments. The low-profile work of security officers is vital to protecting people, places and property. During the pandemic, newer aspects to that role have emerged. Security personnel have been called on to perform diverse tasks such as managing queues at the supermarket, safeguarding testing centres and hospitals, ensuring food deliveries, and supporting police patrols. The British Security Industry Association (BSIA) and two other organisations in the United Kingdom are joining forces to raise awareness of the work of security officers and to recognise the vital importance of the duties they perform. BSIA, a trade association, includes members who are responsible for 70% of privately provided UK security products and services, including security guarding, consultancy services, and distribution and installation of electronic and physical security equipment. BSIA, the Security Institute and the Security Commonwealth Joining BSIA in the awareness campaign are the Security Institute, a professional security membership body; and the Security Commonwealth, which is comprised of 40 organisations from across the security landscape with common objectives to build professionalism, raise standards and share best practices. “The recognition of security officers as key workers is the start of a re-appraisal of what service they provide to the community in keeping the public safe and secure,” says Mike Reddington, BSIA Chief Executive. “As we exit lockdown and have to navigate public spaces again, [security officers] will have a crucial role in supporting public confidence. We are working closely with the Police and all other public bodies to find the best way to achieve this.” Security officers acknowledged as key workers The campaign will showcase security professionals as a respected, valued, professional service provider and a key worker that is acknowledged and embedded in daily lives. The British Security Industry Association (BSIA) and two other organisations in the United Kingdom are joining forces to raise awareness of the work of security officers “Great effort has been invested in the professional standards and capabilities of frontline [security] officers, and they have proven their worth during the coronavirus crisis in the UK,” says Rick Mounfield, Chief Executive, the Security Institute. “They, along with the wider security sector, deserve to be recognized, respected and appreciated for the safety and security they provide across the United Kingdom.” “[We are working to] build professionalism, raise standards and share best practices, and I hope this campaign can make more people recognise the changes we have all made and continue to make,” says Guy Matthias, Chairman of the Security Commonwealth (SyCom). The industry will be reaching out to companies, professionals, and organisations in the sector to participate in the campaign. The hope is that, over the coming weeks as lockdown is eased, the industry can play its part to ensure that the country emerges with confidence to start to recover and build for the future. Private security more important than ever The campaign will showcase security professionals as a respected, valued, professional service provider Across the pond in the United States, law enforcement professionals are facing a crisis of confidence during a time of civil unrest as protestors call to “defund the police” and to otherwise undermine and/or recast law enforcement’s role in preserving the peace and ensuring public safety. If an upshot is that public policing is starved of resources, the role of private security to supplement their mission is likely to increase. In short, the role of private security is more important than ever on both sides of the Atlantic. Public recognition of that role is welcome, obviously. In any case, the importance of their role protecting people, places and property has never been greater.