Massive amount of events were just deleted...

[jsylvia007]

Howdy all!

Today I had been doing some server maintenance, and noticed that my storage drive was at about 72%. Nothing out of the ordinary.

I ran some updates for Ubuntu and let things go. If you look back on my post history, you can see that i've been trying to find the right balance of framerate to record to buffer... So i've been watching the server very closely.

At some point today, between 0800 this morning and now (1840), my storage drive went from 72% to 24% and I have no idea why it could have happened. The only filters that I have are the default "purge when full" and "purge greater than 365 days".

The only thing I did today was run ubuntu updates (I'm running Ubuntu 16.04.1) and reboot the server... I thought it was running fine.

Looking for any help that would point me to why this happened.

[SteveGilvarry]

Purge when full can do this when Fast Delete option is on, we have just defaulted it to off in master to prevent it. Basically it means the Purge filter deletes the DB entries, and waits for zmaudit to clean up the files. Problem being filters run more often than audit, so it get's busy deleting db entries each time it runs until eventually zmaudit runs and actually clears the disk space.

The other one that can occur is some connection issue to the storage device, but that normally cleans up everything for you.

[jsylvia007]

Ok then... I guess I will disable that feature.

[Tantamount]

Glad to hear this filter is finally getting retired.

Is there a filter that can delete the oldest entries until a threshold has been met? Much like how backup software / Time Machine works?

Barring that, perhaps a script that utilizes the API?

[SteveGilvarry]

Filter not going away just the option fast delete as a default on, filter is fine as long as Option fast delete is not on. and even then conservative filters with decent storage capacity dint notice it as much.