Offsite copy

[Andyrh]

I would like to send the last week of events off-site. I built my own s3 server with Minio, but I cannot successfully mount and write to the s3 bucket. Minio does not support mounting the bucket as a file system.
So I moved to the next attempt. I have a filter setup to copy the last week of events to a new storage area. I will then rsync the storage area to a remote system. I added 2 purge filters, 1 to purge older than 1 week and 1 to purge when full.

I am aware playing the remote events will not be something done with ZM without other steps.

Are there any flaws in the plan?

Thank you,

[Andyrh]

1st problem I found. The copied event does not seem to be in the DB or tracked. A filter to show events in that storage area is empty despite 150GB of data having been moved.

[Andyrh]

Found the events, they are in Secondary Storage.

2nd problem, the purge filter deletes the original event, not just the one in the offsite pool. (Offsite pool is local) Is this intended or have I done something wrong?

Filter10.png (30.94 KiB) Viewed 772 times

[iconnor]

So my first thought is: This minio thing must not be real s3 then...

Second thought is: I hate S3.

Third thought: Any remote fs that can be mounted can be the secondary fs... I wouldn't bother with rsync

Fourth: deleting an event should delete from both areas... I think. IIRC

[Andyrh]

Minio claims to be fully Amazon s3 compatible. It appears the claims are wrong. Amazon s3 is mountable and I found a recent thread where a Minio developer says mounting is not supported.
After off and on for 2 weeks, I hate s3 also.
I can confirm deleting a copied event deletes both.

I am not sure how to mount a FS across the internet, but I can figure that out. Is there a way to keep a copy of the most recent events elsewhere? The thought is should something happen the what happened needs to be off-site so it can be viewed. I do not want a full copy off-site.

And for those that will suggest it, rsync has no facility for copy by date. If it did this would be easy.

Thank you,

[kobold81]

hi,

i am very happy with rsync.net as my provider for Offshore video storage.
When you Google rclone rsync.net you get a cheaper offer. You can mount the storage or use rclone or rsync

[Andyrh]

Thank you for that information, but I am trying to avoid any monthly bills for things I do not have to have.