Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
wget mystery: timestamps are off by a day...
#1
Hi all,

Quick intro: I have 2 Linux based NASses: a Thecus N5200 Pro (the old one) and a QNAP TS-859 PRO (the new one). The QNAP is the main NAS and I decided to reformat the Thecus and use it as a backup means for the QNAP.

I use this script to backup between the 2 systems:

Code:
#!/bin/sh
DATE=`date +%Y%0m%0d%0k%0M%0S`

cd /raid0/data/Data/
wget -r -N -l inf -nv --output-file=mirror_$DATE.log -nH --cut-dirs=1 --ftp-user=<myuser> --ftp-password=<mypassword> ftp://192.168.1.200/Data/

chown -R nobody:smbusers *
chmod -R 664 *
chmod -R a+X *

This script is run on the Thecus and it fetches changed content from the QNAP (192.168.1.200).

Now here's the mystery: files downloaded to the Thecus get a timestamp that is 1 day earlier than the one on the QNAP... I thought I was seeing things so I check again and indeed, if the date of a file on the QNAP is 22/07/2010, the Thecus downloads it and timestamps it 21/07/2010. Yep, one day is gone. It consistently does this for all the files it downloads from the QNAP.

Result: every time I rerun my mirror script the entire array gets downloaded again and again and again (I have 7 TB of data I need to backup).

How can this be? Both systems have the correct time settings, they both use NTP and the timezones are correct...

I'm baffled quite frankly. Anyone has an idea to solve this (please don't say rsync or other methods, I want to first get this wget issue solved)?
Reply
#2
Hi all,

Quick intro: I have 2 Linux based NASses: a Thecus N5200 Pro (the old one) and a QNAP TS-859 PRO (the new one). The QNAP is the main NAS and I decided to reformat the Thecus and use it as a backup means for the QNAP.

I use this script to backup between the 2 systems:

Code:
#!/bin/sh
DATE=`date +%Y%0m%0d%0k%0M%0S`

cd /raid0/data/Data/
wget -r -N -l inf -nv --output-file=mirror_$DATE.log -nH --cut-dirs=1 --ftp-user=<myuser> --ftp-password=<mypassword> ftp://192.168.1.200/Data/

chown -R nobody:smbusers *
chmod -R 664 *
chmod -R a+X *

This script is run on the Thecus and it fetches changed content from the QNAP (192.168.1.200).

Now here's the mystery: files downloaded to the Thecus get a timestamp that is 1 day earlier than the one on the QNAP... I thought I was seeing things so I check again and indeed, if the date of a file on the QNAP is 22/07/2010, the Thecus downloads it and timestamps it 21/07/2010. Yep, one day is gone. It consistently does this for all the files it downloads from the QNAP.

Result: every time I rerun my mirror script the entire array gets downloaded again and again and again (I have 7 TB of data I need to backup).

How can this be? Both systems have the correct time settings, they both use NTP and the timezones are correct...

I'm baffled quite frankly. Anyone has an idea to solve this (please don't say rsync or other methods, I want to first get this wget issue solved)?
Reply
#3
Update: it appears the wget version on the Thecus is too old and new versions should solve this. However, does anyone know where to find a new busybox or wget to install on the Thecus?
Reply
#4
Update: it appears the wget version on the Thecus is too old and new versions should solve this. However, does anyone know where to find a new busybox or wget to install on the Thecus?
Reply
#5
I use wget daily to backup a webserver to the thecus. Don't have any issues with the timestamp of files, but I aren't doing anything complicted, just grabbing the same set of iles over and over each day.

What firmware version are you running?
Reply
#6
I use wget daily to backup a webserver to the thecus. Don't have any issues with the timestamp of files, but I aren't doing anything complicted, just grabbing the same set of iles over and over each day.

What firmware version are you running?
Reply


Possibly Related Threads...
Thread Author Replies Views Last Post
  Timestamps lost with COPY & RSYNC due to known kernel bug visionsbox 0 1,072 08-11-2010, 05:00 PM
Last Post: visionsbox

Forum Jump:


Users browsing this thread: 1 Guest(s)