The best way is to run a side-by-side (SxS) test on the same cameras over a 24-hour period. Here are some best practices we've learned in the process of assisting with evaluations:
- Connect 3-10 representative streams using Box VM or Box Pro
Make sure that those exact same streams are still recorded by your existing NVR/VMS for SxS comparison of the motion analysis during the exact same period of time.
- Replicate zones
Ensure that any zone masks on the NVR/VMS are replicated as negative zones and any special areas of interest are replicated as regular zones.
- Give thumbs up/down in the web app
You'll likely want to rate results in the Camio web app before downloading them to a CSV file just because it's easier to review quickly while browsing rather than opening each link of the worksheet. The worksheet in step 5 below is good for correlating the exported CSV results with the Events generated by your NVR/VMS.
Use a query like "10pm to 6am" to browse the results. Camio typically reduces false positives by 90%+, so to view and confirm all the unimportant Events as truly unimportant, use the "all" keyword in the query like "all 10pm to 6am". As you view each Event, perform one or more of these actions:
- give thumbs up to real motion Events
- give thumbs down to false positive Events
- If evaluating human, vehicle, other accuracy, use the Label tool:
- Export search results to CSV
For an exhaustive SxS comparison, export all Events to a CSV file so that you have a complete timeline that can be correlated with the Events identified by your NVR/VMS over the same period.
- Compare to your NVR/VMS
Use this Camio vs. Alternative Quality Rating Worksheet TEMPLATE (also at http://go.camio.com/evaltemplate) for your SxS comparison. Import your CSV at cell A4, then add your NVR/VMS ratings in the blue columns to get an automatically calculated comparison.
Please contact us if we can help with your evaluation.