purgewhenfull question

yod9999 · Post by **yod9999** » Thu Sep 21, 2006 3:44 pm

i've got zm set up and working happily with one camera in record mode. i've left the section length at 600 e.g. 10 minutes, and so i get 144 events per day. i then set up a purgewhenfull filter to delete the first 144 events when the disk hits a certain percentage, with the expectation that it would delete one days worth of events and leave it at that. instead, what has actually happened is it has deleted all my events from the database, and the disk usage percentage is gradually dropping (presumably as zmaudit runs). i turned off fast delete to try and prevent this happening, but the problem has still occured.

i'm at work right now so i can't check the logs, but has anyone got any idea why this might happen? is there a better was to configure purgewhenfull e.g. get it to delete just 5 or 10 events at a time until the disk usage drops below the threshold?

cheers

neil

yod9999 · Post by **yod9999** » Fri Sep 22, 2006 7:57 am

update: having had a look at the logs, it sees that purgewhenfull ignores the fast delete setting, so it only delete events from the database. this means that when the default timing for zmfilter and zmaudit are used, purgewhenfull will run repeated as until zmfilter kicks in no events are deleted from disk

neil

Post by **zoneminder** » Fri Sep 22, 2006 9:28 am

zmfilter should respect the FAST_DELETE setting. Did you restart ZM after changing it?

yod9999 · Post by **yod9999** » Fri Sep 22, 2006 10:45 am

i'm 99% sure i did, as i set up the filter a few days before the threshold was hit hit and i've played around with a few other things since then. i'll try and reproduce it next time the disk fills up, having made sure i've disabled fast delete and restarted

neil

yod9999 · Post by **yod9999** » Thu Oct 05, 2006 10:24 am

just wanted to follow this up. fast deletes is unchecked in the config, and zm has definitely been restarted since the fast deletes setting was last changed. it still looks like zmfilter is ignoring the fast deletes setting and just deleting the database records. any recommendations for what to do next? i guess i need to turn on debugging for zmfilter.

cheers

neil

Code: Select all

Oct  5 10:21:38 localhost zmdc[7841]: INF ['zma -m 1' started at 06/10/05 10:21:38] 
Oct  5 10:21:38 localhost zmdc[6611]: INF ['zma -m 1' starting at 06/10/05 10:21:38, pid = 7841] 
Oct  5 10:21:38 localhost zma_m1[7841]: INF [Debug Level = 0, Debug Log = <none>]
Oct  5 10:21:38 localhost zma_m1[7841]: INF [In mode 4/1, warming up]
Oct  5 10:21:43 localhost zma_m1[7841]: INF [BackGarden: 026 - Starting new event 3282]
Oct  5 10:22:40 localhost zmdc[6611]: INF ['zmc -d /dev/video' stopping at 06/10/05 10:22:40] 
Oct  5 10:22:40 localhost zmc_dvideo[7832]: INF [Got signal (Terminated), exiting]
Oct  5 10:22:40 localhost zmdc[6611]: INF ['zmc -d /dev/video' exited normally] 
Oct  5 10:22:41 localhost zmdc[7875]: INF ['zmc -d /dev/video' started at 06/10/05 10:22:41] 
Oct  5 10:22:41 localhost zmdc[6611]: INF ['zmc -d /dev/video' starting at 06/10/05 10:22:41, pid = 7875] 
Oct  5 10:22:41 localhost zmc_dvideo[7875]: INF [Debug Level = 0, Debug Log = <none>]
Oct  5 10:22:41 localhost zmc_dvideo[7875]: INF [Starting Capture]
Oct  5 10:22:42 localhost zmdc[6611]: INF ['zma -m 1' stopping at 06/10/05 10:22:42] 
Oct  5 10:22:42 localhost zma_m1[7841]: INF [Got signal (Terminated), exiting]
Oct  5 10:22:42 localhost zmdc[6611]: INF ['zma -m 1' exited normally] 
Oct  5 10:22:42 localhost zmdc[6611]: INF ['zma -m 1' starting at 06/10/05 10:22:42, pid = 7883] 
Oct  5 10:22:42 localhost zmdc[7883]: INF ['zma -m 1' started at 06/10/05 10:22:42] 
Oct  5 10:22:42 localhost zma_m1[7883]: INF [Debug Level = 0, Debug Log = <none>]
Oct  5 10:22:42 localhost zma_m1[7883]: INF [In mode 4/1, warming up]
Oct  5 10:22:50 localhost zma_m1[7883]: INF [BackGarden: 026 - Starting new event 3283]
Oct  5 10:28:16 localhost zmc_dvideo[7875]: INF [BackGarden: 1000 - Capturing at 2.99 fps]
Oct  5 10:28:17 localhost zma_m1[7883]: INF [BackGarden: 1000 - Processing at 2.99 fps]
Oct  5 10:30:00 localhost zma_m1[7883]: INF [Ended event]
Oct  5 10:30:00 localhost zma_m1[7883]: INF [BackGarden: 1304 - Starting new event 3284]
Oct  5 10:33:52 localhost zmc_dvideo[7875]: INF [BackGarden: 2000 - Capturing at 2.98 fps]
Oct  5 10:33:53 localhost zma_m1[7883]: INF [BackGarden: 2000 - Processing at 2.98 fps]
Oct  5 10:39:28 localhost zmc_dvideo[7875]: INF [BackGarden: 3000 - Capturing at 2.98 fps]
Oct  5 10:39:29 localhost zma_m1[7883]: INF [BackGarden: 3000 - Processing at 2.98 fps]
Oct  5 10:40:00 localhost zma_m1[7883]: INF [Ended event]
Oct  5 10:40:00 localhost zma_m1[7883]: INF [BackGarden: 3091 - Starting new event 3285]
Oct  5 10:45:04 localhost zmc_dvideo[7875]: INF [BackGarden: 4000 - Capturing at 2.98 fps]
Oct  5 10:45:05 localhost zma_m1[7883]: INF [BackGarden: 4000 - Processing at 2.98 fps]
Oct  5 10:50:00 localhost zma_m1[7883]: INF [Ended event]
Oct  5 10:50:00 localhost zma_m1[7883]: INF [BackGarden: 4877 - Starting new event 3286]
Oct  5 10:50:40 localhost zmc_dvideo[7875]: INF [BackGarden: 5000 - Capturing at 2.98 fps]
Oct  5 10:50:41 localhost zma_m1[7883]: INF [BackGarden: 5000 - Processing at 2.98 fps]
Oct  5 10:55:29 localhost zmfilter[6642]: INF [Deleting event 2614] 
Oct  5 10:55:29 localhost zmfilter[6642]: INF [Deleting event 2615] 
Oct  5 10:55:29 localhost zmfilter[6642]: INF [Deleting event 2616] 
Oct  5 10:55:29 localhost zmfilter[6642]: INF [Deleting event 2617] 
Oct  5 10:55:30 localhost zmfilter[6642]: INF [Deleting event 2618] 
Oct  5 10:55:30 localhost zmfilter[6642]: INF [Deleting event 2619] 
Oct  5 10:55:30 localhost zmfilter[6642]: INF [Deleting event 2620] 
Oct  5 10:55:30 localhost zmfilter[6642]: INF [Deleting event 2621] 
Oct  5 10:55:30 localhost zmfilter[6642]: INF [Deleting event 2622] 
Oct  5 10:55:30 localhost zmfilter[6642]: INF [Deleting event 2623] 
Oct  5 10:56:16 localhost zmc_dvideo[7875]: INF [BackGarden: 6000 - Capturing at 2.98 fps]
Oct  5 10:56:17 localhost zma_m1[7883]: INF [BackGarden: 6000 - Processing at 2.98 fps]
Oct  5 10:56:30 localhost zmfilter[6642]: INF [Deleting event 2624] 
Oct  5 10:56:30 localhost zmfilter[6642]: INF [Deleting event 2625] 
Oct  5 10:56:30 localhost zmfilter[6642]: INF [Deleting event 2626] 
Oct  5 10:56:30 localhost zmfilter[6642]: INF [Deleting event 2627] 
Oct  5 10:56:30 localhost zmfilter[6642]: INF [Deleting event 2628] 
Oct  5 10:56:30 localhost zmfilter[6642]: INF [Deleting event 2629] 
Oct  5 10:56:30 localhost zmfilter[6642]: INF [Deleting event 2630] 
Oct  5 10:56:30 localhost zmfilter[6642]: INF [Deleting event 2631] 
Oct  5 10:56:30 localhost zmfilter[6642]: INF [Deleting event 2632] 
Oct  5 10:56:30 localhost zmfilter[6642]: INF [Deleting event 2633] 
Oct  5 10:57:30 localhost zmfilter[6642]: INF [Deleting event 2634] 
Oct  5 10:57:30 localhost zmfilter[6642]: INF [Deleting event 2635] 
Oct  5 10:57:30 localhost zmfilter[6642]: INF [Deleting event 2636] 
Oct  5 10:57:30 localhost zmfilter[6642]: INF [Deleting event 2637] 
Oct  5 10:57:30 localhost zmfilter[6642]: INF [Deleting event 2638] 
Oct  5 10:57:31 localhost zmfilter[6642]: INF [Deleting event 2639] 
Oct  5 10:57:31 localhost zmfilter[6642]: INF [Deleting event 2640] 
Oct  5 10:57:31 localhost zmfilter[6642]: INF [Deleting event 2641] 
Oct  5 10:57:31 localhost zmfilter[6642]: INF [Deleting event 2642] 
Oct  5 10:57:31 localhost zmfilter[6642]: INF [Deleting event 2643] 
Oct  5 10:58:31 localhost zmfilter[6642]: INF [Deleting event 2644] 
Oct  5 10:58:31 localhost zmfilter[6642]: INF [Deleting event 2645] 
Oct  5 10:58:31 localhost zmfilter[6642]: INF [Deleting event 2646] 
Oct  5 10:58:31 localhost zmfilter[6642]: INF [Deleting event 2647] 
Oct  5 10:58:31 localhost zmfilter[6642]: INF [Deleting event 2648] 
Oct  5 10:58:32 localhost zmfilter[6642]: INF [Deleting event 2649] 
Oct  5 10:58:32 localhost zmfilter[6642]: INF [Deleting event 2650] 
Oct  5 10:58:32 localhost zmfilter[6642]: INF [Deleting event 2651] 
Oct  5 10:58:32 localhost zmfilter[6642]: INF [Deleting event 2652] 
Oct  5 10:58:32 localhost zmfilter[6642]: INF [Deleting event 2653] 
Oct  5 10:59:32 localhost zmfilter[6642]: INF [Deleting event 2654] 
Oct  5 10:59:32 localhost zmfilter[6642]: INF [Deleting event 2655] 
Oct  5 10:59:32 localhost zmfilter[6642]: INF [Deleting event 2656] 
Oct  5 10:59:32 localhost zmfilter[6642]: INF [Deleting event 2657] 
Oct  5 10:59:32 localhost zmfilter[6642]: INF [Deleting event 2658] 
Oct  5 10:59:33 localhost zmfilter[6642]: INF [Deleting event 2659] 
Oct  5 10:59:33 localhost zmfilter[6642]: INF [Deleting event 2660] 
Oct  5 10:59:33 localhost zmfilter[6642]: INF [Deleting event 2661] 
Oct  5 10:59:33 localhost zmfilter[6642]: INF [Deleting event 2662] 
Oct  5 10:59:33 localhost zmfilter[6642]: INF [Deleting event 2663] 
Oct  5 11:00:00 localhost zma_m1[7883]: INF [Ended event]
Oct  5 11:00:00 localhost zma_m1[7883]: INF [BackGarden: 6663 - Starting new event 3287]
Oct  5 11:00:29 localhost zmaudit[6647]: INF [Filesystem event '1/2616' does not exist in database] 
Oct  5 11:00:29 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:00:29 localhost zmaudit[6647]: INF [Filesystem event '1/2654' does not exist in database] 
Oct  5 11:00:29 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:00:53 localhost zmaudit[6647]: INF [Filesystem event '1/2624' does not exist in database] 
Oct  5 11:00:53 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:00:54 localhost zmaudit[6647]: INF [Filesystem event '1/2658' does not exist in database] 
Oct  5 11:00:54 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:01:09 localhost zmaudit[6647]: INF [Filesystem event '1/2652' does not exist in database] 
Oct  5 11:01:09 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:01:09 localhost zmaudit[6647]: INF [Filesystem event '1/2614' does not exist in database] 
Oct  5 11:01:09 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:01:10 localhost zmaudit[6647]: INF [Filesystem event '1/2623' does not exist in database] 
Oct  5 11:01:10 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:01:11 localhost zmaudit[6647]: INF [Filesystem event '1/2633' does not exist in database] 
Oct  5 11:01:11 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:01:11 localhost zmaudit[6647]: INF [Filesystem event '1/2637' does not exist in database] 
Oct  5 11:01:11 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:01:12 localhost zmaudit[6647]: INF [Filesystem event '1/2644' does not exist in database] 
Oct  5 11:01:12 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:01:12 localhost zmaudit[6647]: INF [Filesystem event '1/2650' does not exist in database] 
Oct  5 11:01:12 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:01:18 localhost zmaudit[6647]: INF [Filesystem event '1/2626' does not exist in database] 
Oct  5 11:01:18 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:01:19 localhost zmaudit[6647]: INF [Filesystem event '1/2656' does not exist in database] 
Oct  5 11:01:19 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:01:43 localhost zmaudit[6647]: INF [Filesystem event '1/2642' does not exist in database] 
Oct  5 11:01:43 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:01:44 localhost zmaudit[6647]: INF [Filesystem event '1/2638' does not exist in database] 
Oct  5 11:01:44 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:01:45 localhost zmaudit[6647]: INF [Filesystem event '1/2648' does not exist in database] 
Oct  5 11:01:45 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:01:45 localhost zmaudit[6647]: INF [Filesystem event '1/2635' does not exist in database] 
Oct  5 11:01:45 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:01:46 localhost zmaudit[6647]: INF [Filesystem event '1/2647' does not exist in database] 
Oct  5 11:01:46 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:01:46 localhost zmaudit[6647]: INF [Filesystem event '1/2660' does not exist in database] 
Oct  5 11:01:46 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:01:52 localhost zmc_dvideo[7875]: INF [BackGarden: 7000 - Capturing at 2.98 fps]
Oct  5 11:01:53 localhost zma_m1[7883]: INF [BackGarden: 7000 - Processing at 2.98 fps]
Oct  5 11:02:01 localhost zmaudit[6647]: INF [Filesystem event '1/2629' does not exist in database] 
Oct  5 11:02:01 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:02:02 localhost zmaudit[6647]: INF [Filesystem event '1/2631' does not exist in database] 
Oct  5 11:02:02 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:02:02 localhost zmaudit[6647]: INF [Filesystem event '1/2640' does not exist in database] 
Oct  5 11:02:02 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:02:03 localhost zmaudit[6647]: INF [Filesystem event '1/2620' does not exist in database] 
Oct  5 11:02:03 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:02:03 localhost zmaudit[6647]: INF [Filesystem event '1/2618' does not exist in database] 
Oct  5 11:02:03 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:02:04 localhost zmaudit[6647]: INF [Filesystem event '1/2662' does not exist in database] 
Oct  5 11:02:04 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:02:18 localhost zmaudit[6647]: INF [Filesystem event '5/2632' does not exist in database] 
Oct  5 11:02:18 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:02:19 localhost zmaudit[6647]: INF [Filesystem event '5/2657' does not exist in database] 
Oct  5 11:02:19 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:02:19 localhost zmaudit[6647]: INF [Filesystem event '5/2625' does not exist in database] 
Oct  5 11:02:19 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:02:19 localhost zmaudit[6647]: INF [Filesystem event '5/2621' does not exist in database] 
Oct  5 11:02:19 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:02:20 localhost zmaudit[6647]: INF [Filesystem event '5/2639' does not exist in database] 
Oct  5 11:02:20 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:02:21 localhost zmaudit[6647]: INF [Filesystem event '5/2619' does not exist in database] 
Oct  5 11:02:21 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:02:22 localhost zmaudit[6647]: INF [Filesystem event '5/2622' does not exist in database] 
Oct  5 11:02:22 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:02:22 localhost zmaudit[6647]: INF [Filesystem event '5/2636' does not exist in database] 
Oct  5 11:02:22 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:02:22 localhost zmaudit[6647]: INF [Filesystem event '5/2634' does not exist in database] 
Oct  5 11:02:22 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:02:23 localhost zmaudit[6647]: INF [Filesystem event '5/2663' does not exist in database] 
Oct  5 11:02:23 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:02:23 localhost zmaudit[6647]: INF [Filesystem event '5/2646' does not exist in database] 
Oct  5 11:02:23 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:02:23 localhost zmaudit[6647]: INF [Filesystem event '5/2628' does not exist in database] 
Oct  5 11:02:23 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:02:24 localhost zmaudit[6647]: INF [Filesystem event '5/2661' does not exist in database] 
Oct  5 11:02:24 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:02:24 localhost zmaudit[6647]: INF [Filesystem event '5/2617' does not exist in database] 
Oct  5 11:02:24 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:02:24 localhost zmaudit[6647]: INF [Filesystem event '5/2651' does not exist in database] 
Oct  5 11:02:24 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:02:25 localhost zmaudit[6647]: INF [Filesystem event '5/2649' does not exist in database] 
Oct  5 11:02:25 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:02:25 localhost zmaudit[6647]: INF [Filesystem event '5/2655' does not exist in database] 
Oct  5 11:02:25 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:02:26 localhost zmaudit[6647]: INF [Filesystem event '5/2659' does not exist in database] 
Oct  5 11:02:26 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:02:26 localhost zmaudit[6647]: INF [Filesystem event '5/2641' does not exist in database] 
Oct  5 11:02:26 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:02:26 localhost zmaudit[6647]: INF [Filesystem event '5/2630' does not exist in database] 
Oct  5 11:02:26 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:02:26 localhost zmaudit[6647]: INF [Filesystem event '5/2627' does not exist in database] 
Oct  5 11:02:26 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:02:27 localhost zmaudit[6647]: INF [Filesystem event '5/2645' does not exist in database] 
Oct  5 11:02:27 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:02:27 localhost zmaudit[6647]: INF [Filesystem event '5/2643' does not exist in database] 
Oct  5 11:02:27 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:02:27 localhost zmaudit[6647]: INF [Filesystem event '5/2615' does not exist in database] 
Oct  5 11:02:27 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:02:28 localhost zmaudit[6647]: INF [Filesystem event '5/2653' does not exist in database] 
Oct  5 11:02:28 localhost zmaudit[6647]: INF [deleting] 
Oct  5 11:07:28 localhost zmc_dvideo[7875]: INF [BackGarden: 8000 - Capturing at 2.98 fps]
Oct  5 11:07:29 localhost zma_m1[7883]: INF [BackGarden: 8000 - Processing at 2.98 fps]
Oct  5 11:10:00 localhost zma_m1[7883]: INF [Ended event]
Oct  5 11:10:00 localhost zma_m1[7883]: INF [BackGarden: 8449 - Starting new event 3288]
Oct  5 11:13:04 localhost zmc_dvideo[7875]: INF [BackGarden: 9000 - Capturing at 2.98 fps]
Oct  5 11:13:05 localhost zma_m1[7883]: INF [BackGarden: 9000 - Processing at 2.98 fps]
Oct  5 11:17:28 localhost zmaudit[6647]: INF [Filesystem event '1/1789' does not exist in database] 
Oct  5 11:17:28 localhost zmaudit[6647]: INF [deleting]

Post by **zoneminder** » Thu Oct 05, 2006 3:50 pm

Hmm. You can try editing zmfilter.pl and search for FAST_DELETE. If you replace the line

Code: Select all

if ( !ZM_OPT_FAST_DELETE )

with

Code: Select all

if ( 1 )

it will do the following section unconditionally. It might be worth a try to see if it's an issue with the test or what is done following it.

yod9999 · Post by **yod9999** » Fri Oct 06, 2006 2:48 pm

i made the change you suggested but the problem still occured, zmaudit still had to clear up afterwards. i also changed DBG_LEVEL to 1 in zmfilter.pl, but it didn't seem to produce any extra output in /tmp/zmfilter.log. is there anything else that needs to be changed to get the debug output?

cheers

neil

yod9999 · Post by **yod9999** » Fri Oct 06, 2006 3:15 pm

ok, i didn't realise i had to restart zm after changing the debug value - i thought the script was run every 60 seconds rather than starting once and sleeping for 60 seconds