Milestone Systems has unveiled a new generative AI-driven video analytics plug-in tailored for its XProtect video management software, developed in collaboration with NVIDIA.
This plug-in is designed to assist operators in better interpreting alarms by automating video reviews, minimising false alarms, and potentially decreasing operator alarm fatigue by up to 30%, based on preliminary findings.
The beta version of this innovative tool will be showcased at the Smart City Expo World Congress in Barcelona from November 4-6. General release is anticipated later this year.
Enhancing video management
Today's video systems accumulate considerable data, yet the review process remains largely time-intensive and manual. Milestone's new XProtect plug-in tackles this issue using generative AI, which automatically summarises, contextualises, and validates video content in real time.
This technological advancement helps teams respond promptly, while managing footage more effectively and reducing operator alarm fatigue.
Main features of the plug-in include:
- Automated Incident Reports: Video clips are instantly transformed into incident summaries and structured reports, cutting down documentation time for operators.
- Event Validation: Configured to analyse motion events, the plug-in validates alarms to reduce false positives, enhancing alert management. This is fully integrated with the XProtect rule engine.
- Contextual Bookmark Summaries: Bookmarked footage is automatically summarised through natural-language output, facilitating quick triage without manual review.
This plug-in integrates seamlessly with the XProtect rule engine and can be deployed either on-premises or in the cloud, offering compliance and flexible deployment options.
Commitment to ethical AI
Built on Milestone's Hafnia Vision Language Model (VLM), the plug-in is trained on 75,000 hours of ethically sourced video data from Europe and the US.
NVIDIA Cosmos Curator is used for data preparation, which operates on either cloud infrastructure or regional data centres powered by NVIDIA. The solution employs the NVIDIA Cosmos Reason VLM, positioning it as a cutting-edge and compliant video AI platform.
Driving video intelligence forward
Thomas Jensen, CEO of Milestone Systems, remarked, “With this new XProtect plug-in, we are making advanced video intelligence accessible to cities, organisations, and operators everywhere who manage traffic systems – helping them unlock new levels of efficiency, safety, and insight.”
He added that this development significantly contributes to their mission of transforming global visual data management and learning, responsibly and at scale.
Customers like the cities of Genoa, Italy, and Dubuque, Iowa, are eager to explore these advanced features to enhance traffic management procedures.
Ecosystem transformation
Beyond the plug-in, Milestone is launching a VLM as a Service via APIs, enabling developers, integrators, and partners to create their own generative AI solutions, independent of the video management platform utilised.
Live demonstrations are planned during the Smart City Expo World Congress, showcasing an innovative AI model benchmarking tool and real-time incident summarisation.
Future developments
Milestone will carry this progress forward at the Developer Summit in Copenhagen on November 10-11, where the capabilities of Hafnia and the accomplishments of the Hafnia Hackathon winners will be highlighted.
Milestone Systems, a world pioneer in data-driven video technology, announced a forthcoming generative AI-powered video analytics plug-in for its XProtect video management software, developed in collaboration with NVIDIA.
Designed to help operators contextualise alarms and focus on what truly matters, the new tool automates video review, filters out false alarms, and based on initial findings could reduce up to 30% of operator alarm fatigue.
A beta version will debut at Smart City Expo World Congress in Barcelona, November 4-6, with general availability coming later this year.
Key capabilities
Today’s video systems capture vast amounts of data, yet reviewing footage remains time consuming and largely manual.
Milestone Systems’ new XProtect plug-in addresses this challenge by leveraging generative AI to automatically summarise, contextualise, and validate video content in real time, helping teams respond faster, manage video more efficiently, and effectively reduce operator alarm fatigue.
Key capabilities include:
- Automated Incident Reports – Selected video clips are instantly converted into incident summaries and structured reports, helping operators reduce time spent on documentation.
- Event Validation – The plug-in can be configured to analyse motion events and validate alarms, reducing false positives and improving alert handling. This feature is fully integrated with the XProtect rule engine.
- Contextual Bookmark Summaries – Bookmarked footage is automatically summarised using natural-language output, allowing fast triage without reviewing each clip manually.
The plug-in integrates directly with the XProtect rule engine and is deployable on-premises or in the cloud to support compliance and deployment flexibility.
Built on ethical AI
This new solution is built on Milestone’s Hafnia Vision Language Model (VLM) trained on 75,000 hours of ethically sourced, real-world video data from either Europe or the US, using NVIDIA Cosmos Curator for data preparation and running either on cloud infrastructure or regional data centres powered by NVIDIA.
It leverages the NVIDIA Cosmos Reason VLM, making it one of the most advanced and compliant video AI platforms in the industry.
Making advanced video intelligence accessible
Thomas Jensen, CEO of Milestone Systems, said:
“With this new XProtect plug-in, we are making advanced video intelligence accessible to cities, organisations, and operators everywhere who manage traffic systems – helping them unlock new levels of efficiency, safety, and insight.”
“XProtect users will get access to state-of-the-art generative AI capabilities, and our partners will be able to build value on top of those new capabilities now available within XProtect. It truly marks a pivotal step in our mission to transform how the world manages and learns from visual data, responsibly and at scale.”
XProtect customers like the cities of Genoa, Italy, and Dubuque, Iowa, are excited to try these new capabilities, leading the way in adopting advanced video intelligence solutions to enhance traffic management.
Ecosystem innovation
The plug-in is just the beginning. Milestone is also introducing a VLM as a Service via APIs, allowing developers, integrators, and partners to build their own generative AI solutions regardless of the video management platform in use.
Live demonstrations of the XProtect plug-in will be held in partnership with Vaidio at Smart City Expo World Congress on November 4-6 in Barcelona, in the Dell booth, showcasing a new AI model benchmarking tool and real-time incident summarisation.
Continuing the momentum
Milestone will continue the momentum at the Developer Summit in Copenhagen, Nov. 10–11, where Hafnia’s capabilities and the winners of the Hafnia Hackathon will be revealed.
