Weird Issues Deleting Old Database Events - Causing High System Resource Usage
Posted: Wed Apr 20, 2022 3:00 pm
Hi there,
We are running ZM 1.36.12 on a Dell R710 server with 120GB RAM, 30TB HDD space, and 56 cameras.
We initially had worked through some issues that required us to scrap the events that had been created up to that point. We simply ran a script that ripped through the events' storage location and deleted all of them.
HOWEVER - We expected that zmaudit would come behind and clean up the database to match the lack of those events. That does not seem to happening - or at least something seems bugged. We frequently are seeing a complete bogging down of the server when a set of certain error logs show, attached below. The errors seem to reference events that do not exist in their expected location, however these errors keep referencing the same exact events. I would expect it to be crunched, deleted as they don't exist, and then never spoken of again (lol).
To add to this, we notice that the ram usage and CPU load go nuts when this is happening. We've lowered all cameras to a 3FPS, VGA quality to attempt to offset the high usage, but something just doesn't seem right. It tends to lock the entire machine up to a point of needing a hard restart.
(Also, I'm aware that the file and component seem to be pointing to the filter, but this is the default DiskSpace Update filter that comes with the distro. Not sure why it would be acting like this or how to fix it.)
Thank you in advance for any advice/direction you're able to give!
ZMN
We are running ZM 1.36.12 on a Dell R710 server with 120GB RAM, 30TB HDD space, and 56 cameras.
We initially had worked through some issues that required us to scrap the events that had been created up to that point. We simply ran a script that ripped through the events' storage location and deleted all of them.
HOWEVER - We expected that zmaudit would come behind and clean up the database to match the lack of those events. That does not seem to happening - or at least something seems bugged. We frequently are seeing a complete bogging down of the server when a set of certain error logs show, attached below. The errors seem to reference events that do not exist in their expected location, however these errors keep referencing the same exact events. I would expect it to be crunched, deleted as they don't exist, and then never spoken of again (lol).
To add to this, we notice that the ram usage and CPU load go nuts when this is happening. We've lowered all cameras to a 3FPS, VGA quality to attempt to offset the high usage, but something just doesn't seem right. It tends to lock the entire machine up to a point of needing a hard restart.
(Also, I'm aware that the file and component seem to be pointing to the filter, but this is the default DiskSpace Update filter that comes with the distro. Not sure why it would be acting like this or how to fix it.)
Thank you in advance for any advice/direction you're able to give!
ZMN