Backing up Metadata

Discuss backup and restore functions of the DiskStation with respect other DiskStations, USB/eSATA, Amazon S3, network backup, or other rsync clients.
Forum rules
This is a user forum for Synology users to share experience/help out each other: if you need direct assistance from the Synology technical support team, please use the following form:
https://myds.synology.com/support/suppo ... p?lang=enu

Backing up Metadata

Postby cocjh1 » Tue Jul 19, 2011 9:51 am

Hi,

For Network Backups, under the backup status column, what does 'Backing up Metadata' mean please?

I've been using network backups for a couple of years now and never seen this before.. Further, this part of the backup process is taking hours.. I do nightly 'offsite' backups to another Synology and even if nothing has changed on the source Synology box during the day this 'Backing up Metadata' takes around 8 hours to complete. (Currently averaging 2KB/s!!!)

Confused..

Running DSM 3.1-1748

Thanks,
Chris
DS107+, DS109, DS209, DS112+, DS114
cocjh1
Student
Student
 
Posts: 66
Joined: Sun Jul 06, 2008 9:10 am

Re: Backing up Metadata

Postby cocjh1 » Tue Jul 19, 2011 10:40 am

Screen dump during backup:

Image
DS107+, DS109, DS209, DS112+, DS114
cocjh1
Student
Student
 
Posts: 66
Joined: Sun Jul 06, 2008 9:10 am

Re: Backing up Metadata

Postby jarvis » Tue Jul 19, 2011 8:46 pm

It stores the various properties of the files in each directory (Created, Accessed, modified dates, owner, group, permissions, Windows ACL if present) and dumps it to a file in the same directory, then that file gets backed up along with the other files in the directory. After it's copied all the files that temporary file gets deleted from the directory being backed up.

It seems that creating this file is taking the time rather than transferring it. And this has to be done for every directory even if no files were changed.

If you're not worried about being able to restore file dates, owners, permissions, etc. then un-check the box.
...defiantly mixing and matching drive manufacturers to avoid getting 3 duff drives that fail in the same month...
DS410: Seagate Barracuda ST31000528AS, Hitachi Deckstar HDS721010CLA332, Samsung SpinPoint HD103SJ.
All 1TB capacity, 32Mb buffer in RAID5
Enjoying music streamed to my Linn Majik DS
jarvis
Apprentice
Apprentice
 
Posts: 99
Joined: Sun May 23, 2010 8:52 pm

Re: Backing up Metadata

Postby thunderbird » Wed Jul 20, 2011 11:59 am

I would suggest not to disable that check box since the files in the backup have all the same user and group and are all set to rwxrwxrwx
If you don't want to spend hours for fixing privileges and ownership after a restore, you'd better enable this option.
thunderbird
Sharp
Sharp
 
Posts: 187
Joined: Tue Jul 17, 2007 12:22 pm

Re: Backing up Metadata

Postby cocjh1 » Wed Jul 20, 2011 3:03 pm

Ok, thanks. Just opened my backup tasks and noticed it checked.

Anyone know when this "Enable metadata backup" option was added?

Thanks,
Chris
DS107+, DS109, DS209, DS112+, DS114
cocjh1
Student
Student
 
Posts: 66
Joined: Sun Jul 06, 2008 9:10 am

Re: Backing up Metadata

Postby cocjh1 » Wed Jul 20, 2011 3:11 pm

Oh dear. Unchecked the box and got:
Error: Some files could not be transferred. Possible reasons: 1) backup user has no permission to access the files, 2) files are deleted, 3) illegal file name, 4) too many folders.


Suspect related to:
viewtopic.php?f=160&t=34599

Next time I get this box stable I'm not updating DSM again!!
DS107+, DS109, DS209, DS112+, DS114
cocjh1
Student
Student
 
Posts: 66
Joined: Sun Jul 06, 2008 9:10 am

Re: Backing up Metadata

Postby cocjh1 » Wed Jul 20, 2011 6:51 pm

cocjh1 wrote:Anyone know when this "Enable metadata backup" option was added?


Was add in version 3.1-1605, and set to on by default..
DS107+, DS109, DS209, DS112+, DS114
cocjh1
Student
Student
 
Posts: 66
Joined: Sun Jul 06, 2008 9:10 am


Return to Backup/Restore for DiskStation to DiskStation/USB/eSATA/Off-site backups

Who is online

Users browsing this forum: empreinte and 5 guests