Is Hyper Backup really this slow?

Discuss backup and restore functions of the DiskStation with respect to computer clients, such as Synology Data Replicator, Time Machine, or other client backup software.
Forum rules
1) This is a user forum for Synology users to share experience/help out each other: if you need direct assistance from the Synology technical support team, please use the following form:

https://account.synology.com/support/su ... p?lang=enu



2) To avoid putting users' DiskStation at risk, please don't paste links to any patches provided by our Support team as we will systematically remove them. Our Support team will provide the correct patch for your DiskStation model.
the1lemming
I'm New!
I'm New!
Posts: 7
Joined: Fri Jan 26, 2018 8:43 pm

Is Hyper Backup really this slow?

Unread post by the1lemming » Tue Aug 07, 2018 8:42 pm

I've had my DS214 for 3-4 years however I never gave much thought to actually backing up the NAS box.

Of the couple of times I actually backed up the NAS, I simply used my desktop computer to do a drag and drop into an external USB drive.

a few days ago, I had a stab at automating the process of backing up by connecting a USB external hard drive into a USB3 port and using Hyper Backup to do the task. The external drive was formatted with NTFS.

I only had about 1Tb of data to transfer over. I was shocked to discover that 20 hours later I was only up to 80% of completing the task. I then reformatted the external hard drive to Ext4 and tried Hyper Backup again.

Things went quicker in that I actually completed the task in just under 20 hours. At one point I was getting write speeds to the external hard drive of 16kb/s.
I'm an amateur with no IT qualifications but I'm guessing kilobits per seconds speeds is pitiful.

I then had another go but this time I connected the USB drive to my desktop computer and fired up Acronis and used that to back up the data on my Synology DS214. Over the LAN connection, I was getting between 70Mb/s to 90Mb/s. Things got even faster with the validation process with read speeds of 155mb/s.

Does anybody know why and how backing up my DS214 to an external USB drive connected straight into the box takes days to backup and validate?

Doing the same task from a desktop computer over a LAN connection with Acronis to a USB external drive takes 5-7 hours.

Am I doing something wrong?
The DS214 is using DSM 6.2

tb123
Sharp
Sharp
Posts: 184
Joined: Sun Sep 03, 2017 10:55 am

Re: Is Hyper Backup really this slow?

Unread post by tb123 » Tue Aug 07, 2018 11:08 pm

What was the USB drive, 1,2 or 3?
DS916+, UniFi USG, 16 port PoE switch and 4 x AP’s, some Windows, Mac, Android and iDevices

User avatar
sciurius
Experienced
Experienced
Posts: 132
Joined: Thu Sep 05, 2013 9:35 am

Re: Is Hyper Backup really this slow?

Unread post by sciurius » Wed Aug 08, 2018 7:18 am

And was it connected to the USB3 port at the back, not the USB2 port at the front?
DS418 / DSM 6.2-23739 Update 2 / 2 x WD40EFRX-68WT0N0 (SHR) / MailServer / MailStation / ownCloud / Transmission / ResilioSync / Syncthing / spotweb / LMS+Spotify
DS413 / DSM 6.2-23739 Update 2 / 2 x ST3000DM001-1CH166 (SHR) / Testing

the1lemming
I'm New!
I'm New!
Posts: 7
Joined: Fri Jan 26, 2018 8:43 pm

Re: Is Hyper Backup really this slow?

Unread post by the1lemming » Wed Aug 08, 2018 9:00 pm

a few days ago, I had a stab at automating the process of backing up by connecting a USB external hard drive into a USB3 port and using Hyper Backup to do the task. The external drive was formatted with NTFS.

Good evening. Yep, my USB3 hard drive was plugged into a USB3 port.

Cheers

At this very moment I am using FreeFileSync to backup my NAS drive to an external hard drive which is plugged into my desktop computer. The NAS and computer are hard wired to my router and the task is expected to take just over two hours.

the1lemming
I'm New!
I'm New!
Posts: 7
Joined: Fri Jan 26, 2018 8:43 pm

Re: Is Hyper Backup really this slow?

Unread post by the1lemming » Thu Aug 09, 2018 9:15 pm

At the same time I posted this subject on the forums, I also contacted Synology with a ticket.

Here is the initial reply to the same question.

Spoiler, Synology expects the 1Gb task to take 57 hours.



Thank you for contacting Synology.

Sorry to hear of the issue you have encountered.

From the figures provided (33% in 19 hours), your backup would complete in ~57 hours if this pace is maintained.

This works out to ~5.11MB/s which can be normal on the first runtime of a Hyper Backup task.

The initial speed varies greatly depending on the kind of data being backed up, for example lots of little files take much longer to place in the database format. Very large files can also take a significant amount of time because our database format slices files into smaller chunks for greater deduplication and faster incremental changes.

I sincerely apologise for the slow initial backup, however any subsequent backups should be vastly improved.

Please let me know if you encounter any errors, I would be happy to investigate further.

Kind Regards,

Filip

Technical Support

This is an automated message, please log in to your Synology Account for further actions or replies.

tb123
Sharp
Sharp
Posts: 184
Joined: Sun Sep 03, 2017 10:55 am

Re: Is Hyper Backup really this slow?

Unread post by tb123 » Thu Aug 09, 2018 10:48 pm

Not sure if it depends on what type of files you are backing up, but my initial HyperBackup run on around 1.5TB of data to a USB3 drive was approx 6 hours on a DS916+ with 8 gig of ram.
DS916+, UniFi USG, 16 port PoE switch and 4 x AP’s, some Windows, Mac, Android and iDevices

the1lemming
I'm New!
I'm New!
Posts: 7
Joined: Fri Jan 26, 2018 8:43 pm

Re: Is Hyper Backup really this slow?

Unread post by the1lemming » Fri Aug 10, 2018 1:58 pm

tb123 wrote:
Thu Aug 09, 2018 10:48 pm
Not sure if it depends on what type of files you are backing up, but my initial HyperBackup run on around 1.5TB of data to a USB3 drive was approx 6 hours on a DS916+ with 8 gig of ram.
Hello

If I got speeds of 6 hours for 1Tb to 1.5Tb then I'd be happy with that especially as I'm backing up domestic stuff like word docs, music, photos and home videos. But anything in excess of 24 and possibly 50+hours is not very good in my opinion.

I have now been asked by "Synology Support" to submit a log after initially telling me that 50+hours was acceptable.

Cheers

the1lemming
I'm New!
I'm New!
Posts: 7
Joined: Fri Jan 26, 2018 8:43 pm

Re: Is Hyper Backup really this slow?

Unread post by the1lemming » Mon Aug 13, 2018 9:04 pm

The problem has been solved and confirmed by Synology.

I created a ticket and got in touch with the correct Synology Support Team/Section.

I created and gave Synology the relevant logs created by my DS214 NAS box.
The reply was that my DS214 was working correctly and that there were no errors between my NAS box and my external USB3 hard drive.

It was confirmed by Synology Support that 1Tb of data would take in excess of 50 hours to create and then validate that data.

Its a good job that 3rd party software can deal with backing up 1Tb of data to a domestic Synology NAS box within a couple of hours because, like almost everybody on here, I have considerably more than 1Tb of data to protect.

Here is a copy of Synology's reply:

Hi the1lemming,

Thanks for getting back to me and providing a debug file.

From investigating your system logs, I cannot isolate any problems with the processes running on your NAS and there does not appear to be any evidence that hardware problems exist which would contribute to the slow backup experienced.

Unfortunately, I must conclude that the data being transmitted via Hyper Backup is performing normally and that the speeds you are encountering are expected.

It is often the case that the initial backup is significantly slower than all subsequent backups. I cannot speak for third party alternatives, but our own database format has many integrity checks in place and placing files into this format (especially many very small or very large files) takes significant processing time and this varies greatly depending on the kind of data being backup up.

Usually you can see the transfer rate by hovering over the progress bar on a running task. This will often appear to show adequate speeds but generally stop / start because there are pauses for database calculation.

Again I am sorry for any inconvenience caused, I would recommend proceeding with the initial backup task through Hyper Backup. Subsequent backups will be vastly improved.

Kind Regards,

Post Reply

Return to “Backup/Restore for computer clients”