Cameras capable of recording video at 60 frames per second (fps) are becoming widely available in the security industry. It’s important to understand what 60-fps brings to the table for the security industry and how to leverage the technology for particular scenarios.

Capturing video at 60-fps represents a unique application. System integrators typically use much lower frame rates, ranging from 7- to up to 30-fps. The potential for an incident might only represent 1%, or less, of the time a camera is recording. However, when a significant event does occur, it’s better to record at a higher frame rate, because incidents such as a car accident, an altercation, or someone running away are usually only seconds long. Depending on the lighting environment, and the camera setup at that time, you either captured plenty of details or you didn’t.

Casino and stadium security

For example, in casinos, hands, money and chips move around quickly. If there’s a dispute, footage needs to be examined frame-by-frame at a resolution that provides exacting detail. For this reason, Las Vegas casinos require at least 30-fps for any cameras covering gaming action.

Another example is a stadium; if you have a lower frame rate of 10-fps, it might look good when all the seats are empty and there is very little motion. On game day, things can look different. If there is an altercation, at that frame rate, it becomes difficult to ascertain the actual sequence of events. The quality of what is captured in those brief moments is where 60-fps recording pays off with its increased resolution and crystal-clear image detail.

Las Vegas casinos require at least 30-fps for any cameras covering gaming action
Casino footage needs to be examined frame-by-frame at a resolution that provides exacting detail.

Can my infrastructure handle 60-fps?

Running multiple streams of 60-fps 24/7 will consume network resources and storage space at an exponential rate, which is difficult to justify for most organisations. For 60-fps recording to be practical, H.265 encoding and other compression techniques are necessary. With H.265, there is no requirement to upgrade a network infrastructure. H.265 does require a more capable workstation to decode, view and playback video, but most VMS systems utilise GPUs for decoding, so this is a non-issue for most installations.

The best way to reduce network and storage bandwidth is to teach the camera not to run at its maximum frame rate when there is no motion. The frame rate can drop to 5- to 4-fps if there is no motion or other activity, but as soon as there is a visual or audible trigger, the camera can dynamically switch to its highest frame rate. Having analytics in-camera makes this simple to setup and should be part of a camera’s profile.

Performance vs. frame rate

A camera capable of 60-fps output is considered a high-performance camera. It might be more beneficial to put that performance to use enabling features other than pure 60-fps output. Cameras with the power to output 60-fps should also be able to process more data in parallel than regular cameras.

This means that a 60-fps camera could also be used to send out multiple streams at lower frame rates. You might decide on a 30-fps stream to the recorder, with a 15-fps profile feeding a live view, and another 15-fps stream going to a mobile app. In this way, a 60-fps camera can offer tremendous flexibility in how its power and processing are used.

Always remember to tune cameras for nighttime use as well.
Shutter speeds are typically reduced at night to get more light onto a camera’s sensor

WDR (wide dynamic range) has the ability to combine multiple exposures into a single image to allow us to see in the shadows while not overexposing highlights. WDR can also halve your frame rate. A typical 30-fps sensor with WDR enabled has an effective frame rate of 15-fps for motion because of the duplicate frames being used for exposures. Starting with a 60-fps camera, customers can utilise WDR and still have an impressive 30-fps frame rate for an incredible quality image.

Optimising equipment for low-light usage

Shutter speeds are typically reduced at night to get more light onto a camera’s CMOS sensor. The sensitivity of the sensor and the lens f-stop will come into play, but in general, if you force the camera to run at 60-fps at night, it’s going to produce a darker image than a 15-fps or 30-fps camera.

A camera set at 15-fps may also produce more of a ghosting effect on fast moving objects. Ultimately, it’s the customer’s individual use case that should dictate what is most important between luminance and clarity for moving objects.

A powerful 60-fps camera can deliver the best tradeoff between low-light performance and frame rate, giving end users the best possible solution available for their unique requirements. Many VMS solutions can tell cameras to switch profiles at certain times of the day to capture optimal images based on the environment and time of day.

Again, 60-fps cameras can offer the most flexibility across all scenarios. It’s important to remember that most cameras look good in daylight, and since 99% of installations happen in the daytime, always remember to tune cameras for nighttime use as well.

Download PDF version

Author Profile

In case you missed it

Has the gap closed between security fiction and security reality?
Has the gap closed between security fiction and security reality?

Among its many uses and benefits, technology is a handy tool in the fantasy world of movie and television thrillers. We all know the scene: a vital plot point depends on having just the right super-duper gadget to locate a suspect or to get past a locked door. In movies and TV, face recognition is more a super power than a technical function. Video footage can be magically enhanced to provide a perfect image of a license plate number. We have all shaken our heads in disbelief, and yet, our industry’s technical capabilities are improving every day. Are we approaching a day when the “enhanced” view of technology in movies and TV is closer to the truth? We asked this week’s Expert Panel Roundtable: How much has the gap closed between the reality of security system capabilities and what you see on TV (or at the movies)?

How moving to Security as a Service benefits both providers and end users
How moving to Security as a Service benefits both providers and end users

The way we purchase services and products is changing. The traditional concept of buying and owning a product is giving way to the idea that it is possible to purchase the services it offers instead. This approach has come from the consumer realisation that it is the outcome that is important rather than the tools to achieve it. For example, this approach is evident with the rise of music streaming services as opposed to downloads or physical products.   With the physical security industry becoming ever more integrated – and truly open systems now a reality – there is every reason to assume this service-lead trend will come to dominate the way our industry interacts with its clients as well. Interest in service-based security There is a significant change of mindset that the security industry needs to embrace before a large-scale move to Security as a Service can take place. Like many technology sectors in the past, security providers have focussed on ‘shifting boxes’ as their definitive sales model. This approach was especially prevalent when proprietary systems were the mainstay of the security industry. Essentially, if the customer wanted more services they simply bought a new product. This was a straightforward and economic sales approach for manufacturers and installers alike.The security industry needs to embrace a change of mindset before a move to SaaS can take place The flexibility of integrated and open technology has changed the way consumers view their purchase, so it shouldn’t be any surprise that there is increased interest in a service-based approach. Customer choice equates to a change of focus and interest, with physical products being eclipsed by the benefits of the overall solution. We have already seen these changes in other technology areas, notably with smart devices and general IT systems. Cloud-based services put the onus on the result rather than which device the user chooses. This approach is even starting to manifest in areas that couldn’t have been predicted in the past, such as the car industry for example. Consumers are focusing more on the overall costs and convenience of buying a car over the specific specification of the vehicle. Equally, urban dwellers don’t necessarily want the hassle and expense of owning and parking their own vehicle anymore. If you don’t use it every day, it can make more sense to rent a vehicle only when you travel beyond public transport. For these consumers the car has become a service item for a specific journey. Benefits for end users At the heart of this approach is the simple equation that consumers have a need and suppliers need to provide the most cost-effective, and easiest, solution. At the same time, the security operator may not necessarily want to know (or care) what specification the system has, they just want it to perform the task as required.   By discussing with consumers, we can ensure we work even more closely with them to provide the expert support they need and deserve Most security buyers will identify the specific business needs and their budget to achieve this. This is where a service approach really comes into its own. Customers need expert advice on a solution for their requirements which takes away the stress of finding the right products/systems. In the past there was always a risk of purchasing an unsuitable solution, which could potentially be disastrous. The other issue was having to budget for a big capital expenditure for a large installation and then having to find further resources once an upgrade was due when systems went end of life. Most businesses find it far easier to pay a sensible monthly or annual fee that is predictable and can easily be budgeted for. A service model makes this far easier to achieve. Benefits of a service sales model As well as the benefits for end users, there are considerable benefits for security providers too. Rather than simply ‘shifting boxes’ and enduring the inevitable sales peaks and toughs this creates; a service sales model allows manufacturers and installers to enjoy a more stable business model. You don’t have to win new business with every product, but rather sell ongoing services for a set period. Its highly likely that the whole security industry will start to take this approach over the next few years. Manufacturers are already well aware of this shift in customer expectations and are changing their approach to meet demands.There are major opportunities on offer in return for a change of perspective in the security industry With the service and leasing approach already firmly entrenched in other industries, this is well proven in a consumer market. The airline industry is a great example. Manufacturers understand that airlines need flexibility to upscale and downscale operations and therefore whole aircraft and even individual key components (such as engines or seating) can be leased as required. Using this approach, airlines can concentrate on what customers demand and not worry about the logistics of doing this. Manufacturers and leasing businesses provide assurances and guarantees of service time for aircraft and engines, taking care of the servicing and maintenance to ensure this delivery. This approach is just as well suited for the provision of security systems. Servicing the future security market Undoubtedly there are major opportunities on offer in return for a change of perspective in the security industry. However, this will involve substantial changes in some quarters to ensure the business model is aligned with the market. Overall, the security industry needs to not only develop the right systems for the market, but also to deliver them in the right way as well. This will ensure we work even more closely with customers to provide the expert support they need and deserve.

Intelligent video surveillance and deep learning dominate MIPS 2018 agenda
Intelligent video surveillance and deep learning dominate MIPS 2018 agenda

Milestone Systems is embracing artificial intelligence and deep learning in a big way at this week's yearly Milestone Community Days (MIPS 2018) in Las Vegas. The Danish company's theme is "Creating an Intelligent World," and Milestone's stated goal is to make "the Milestone community part of every surveillance installation in the world."    Science fiction becomes reality In a presentation on opening day, Milestone CSMO Kenneth Hune Petersen pointed to the 2002 movie The Minority Report as highlighting a variety of gadgets and systems that seemed futuristic at the time but are now perfectly possible, and in some cases outdated. Films have previously highlighted gadgets and systems that were futuristic, but are now perfectly possible, or outdated "If we dare to dream together we can make this a better world," says Petersen. "Through AI and machine learning, we can help define tomorrow. There's no doubt about it: There is a massive business opportunity for us in artificial intelligence." Despite all the talk about artificial intelligence, only about 0.5 percent of all the data in the world has currently been analysed or used, says Peterson. "Our open platform technology is the foundation for intelligent video systems and our partners have the expertise and infrastructure needed to reach the next frontier in intelligent video solutions," said Bjørn Skou Eilertsen, Milestone Systems CTO. "Together, we can provide unlimited solutions for our customers." Deeper integration and broader coverage Expanding the Milestone community this year has included the addition of 1,000 new models of supported hardware devices; there are currently more than 7,000 models supported. Milestone is also pursuing broader coverage of installations through their partners, with deeper integration of functionality, and by deepening existing relationships with customers. ‘Creating an intelligent world’ includes deep learning and lots of video systems, says Milestone at their annual conference Under new agreements, hardware partners such as Dell EMC and BCDVideo now provide XProtect Essential+ software pre-loaded on servers they sell. The focus at MIPS 2018 on AI included a presentation by Tanmay Bakshi, the "world's youngest IBM coder" and TED Talk speaker, at 14 years old. The prodigy, who has been coding since the age of 4, has worked with IBM and other companies on a variety of AI-related projects. Using deep learning with video is currently limited because so much video is unlabelled and unstructured In his MIPS 2018 keynote speech, Bakshi traced the development of AI through high-profile events, such as IBM's development of the "Watson" computer, which successfully competed on Jeopardy!, and Google's development of AlphaGo, a program that successfully plays the complex ancient board game, Go. Data demands deep-learning Bakshi focused on security and healthcare as two disciplines where deep learning can potentially have a big impact. Using deep learning with video is currently limited because so much video is unlabeled and unstructured. Still, projections are that there will be a billion cameras worldwide by 2020, providing an over-abundance of data that demands the use of deep learning to make sense of it all. "There is a misconception that AI is meant to replace us, to make humans obsolete. AI is not replacing us. It is created by humans to amplify human skills. AI can reduce information overload to enable humans to work with the data more efficiently," said Bakshi. He suggested that AI is equivalent to IA; Bakshi's abbreviation meaning "intelligence augmented." AI can reduce information overload to enable humans to work with the data more efficiently The ability to scale AI applications using "distributed deep learning" and graphics processing unit (GPU) hardware is paving the way for greater use of deep learning in video applications. Adam Scraba, Global Business Development Lead at NVIDIA, outlined the trends that are making the current "Big Bang" of deep learning possible. He said it is "the most exciting time in tech history," with "software that can write its own software" now among the tools that make previously unsolvable problems now solvable. AI-driven intelligent video analytics can now achieve "super-human" results, he said. An intelligent world to combat crime Instead of sitting for hours staking out a suspected drug dealer alone, entire investigations now take hours instead of days A success story about the game-changing capabilities of video data was supplied by Hartford, Conn.'s Capital City Crime Center (C4). The Hartford police department uses video data in a "predictive policing" approach. They have created an "intelligent world with smart policing to combat drug trafficking," according to C4 Supervisor Johnmichael O'Hare of the Hartford Police Department. Instead of sitting for hours staking out a suspected drug dealer, for example, video of a site can be analysed to determine areas with higher levels of foot traffic that indicate drug buys. The result is investigations that take hours instead of days. Hartford incorporates several technologies, including ShotSpotter gunshot detection, Briefcam video synopsis and other systems, all tied together using the Milestone platform. More than 700 attendees make MIPS 2018 the largest such event ever, and exhibits by around 60 Milestone partner companies attest to the continuing expansion of the Milestone community. [Main image: Tanmay Bakshi (left) and Johnmichael O’Hare of the Hartford Police Department (right) discuss key security issues of the modern day]