ZFS TimeMachine style backups update

Moderators: jhartley, MSR734, nola

trying to use launchd with zfstimemachinebackup.perl

Post by grahamperrin » Wed Dec 19, 2012 4:32 pm

Background

The following command works without difficulty, note the sudo in its midst:

Code: Select all
cd ~/Documents/com/github/jollyjinx/ZFS-TimeMachine/028ba53 && sudo ./zfstimemachinebackup.perl --sourcepool=gjp22 --destinationpool=tall/backups/gjp22 --createsnapshotonsource --recursive --verbose


With limited knowledge, I'm trying to use launchd with the .perl script. Here's how the .plist looks:

Code: Select all
macbookpro08-centrim:~ gjp22$ defaults read /Library/LaunchAgents/com.github.jollyjinx.ZFS-TimeMachine~gjp22
{
    Debug = 1;
    Label = "com.github.jollyjinx.ZFS-TimeMachine~gjp22";
    ProgramArguments =     (
        "/Volumes/gjp22/Documents/com/github/jollyjinx/ZFS-TimeMachine/028ba53/zfstimemachinebackup.perl",
        "--sourcepool=gjp22",
        "--destinationpool=tall/backups/gjp22",
        "--createsnapshotonsource",
        "--recursive"
    );
    StartInterval = 300;
}


The problem

In response to any scheduled or manual attempt to start the job:

Code: Select all
2012-12-19 21:24:47.246 com.apple.launchd[1]: (com.github.jollyjinx.ZFS-TimeMachine~gjp22[43226]) Exited with code: 2


The loaded job

Code: Select all
macbookpro08-centrim:~ gjp22$ sudo launchctl list com.github.jollyjinx.ZFS-TimeMachine~gjp22
{
   "Label" = "com.github.jollyjinx.ZFS-TimeMachine~gjp22";
   "LimitLoadToSessionType" = "System";
   "OnDemand" = true;
   "LastExitStatus" = 512;
   "TimeOut" = 30;
   "ProgramArguments" = (
      "/Volumes/gjp22/Documents/com/github/jollyjinx/ZFS-TimeMachine/028ba53/zfstimemachinebackup.perl";
      "--sourcepool=gjp22";
      "--destinationpool=tall/backups/gjp22";
      "--createsnapshotonsource";
      "--recursive";
   );
};


Please, what am I doing wrong?
grahamperrin Offline

User avatar
 
Posts: 1596
Joined: Fri Sep 14, 2012 10:21 pm
Location: Brighton and Hove, United Kingdom

Re: ZFS TimeMachine style backups update

Post by shuman » Mon Jan 07, 2013 2:06 pm

Does anyone know if there are 'time outs' built into the ZFS Timemachine perl script? I have a large filesystem that I can't get sent. I have recently upgraded to 16GB of memory hoping it might help the issue. The transfer runs for ~6 Hours then just stops. No error or anything. Out of 477GB of data, it copied >400GB then just stops. This is the ~5th time I've tried this over several weeks with identical results. Gets nearly complete. . . then nothing. Such a let-down each time ;)
- Mac Mini (Late 2012), 10.8.5, 16GB memory, pool - 2 Mirrored 3TB USB 3.0 External Drives
shuman Offline

User avatar
 
Posts: 96
Joined: Mon Sep 17, 2012 8:15 am

Re: ZFS TimeMachine style backups update

Post by shuman » Tue Jan 08, 2013 3:34 pm

1/8/13 Update: I'm thinking my question/post got lost in the middle of the site update. Please see above post.
- Mac Mini (Late 2012), 10.8.5, 16GB memory, pool - 2 Mirrored 3TB USB 3.0 External Drives
shuman Offline

User avatar
 
Posts: 96
Joined: Mon Sep 17, 2012 8:15 am

Re: ZFS TimeMachine style backups update

Post by jollyjinx » Thu Jan 10, 2013 5:42 pm

The script has no timeouts and zfs send/reveice neither (or not that I know of).
I've run the script to update a server for over 70hours (slow DSL) without problems. Maybe your connection gets dropped ? I usually test progress by looking at the remote site and looking at the used space to see how far in the backup I am.

I've done a couple of 2.5TB inital transfers in the last month and it usually took 12hours for that.

Patrick
jollyjinx Offline


 
Posts: 60
Joined: Sun Sep 16, 2012 12:40 pm
Location: Munich - Germany

Re: ZFS TimeMachine style backups update

Post by shuman » Thu Jan 10, 2013 5:48 pm

I'm wondering if maybe it's a USB bus issue. I check backup the same way - checking the fs size on the rcv side. It makes great progress and then just dies.

Thanks for the response.
- Mac Mini (Late 2012), 10.8.5, 16GB memory, pool - 2 Mirrored 3TB USB 3.0 External Drives
shuman Offline

User avatar
 
Posts: 96
Joined: Mon Sep 17, 2012 8:15 am

Re: ZFS TimeMachine style backups update

Post by jollyjinx » Thu Jan 10, 2013 5:57 pm

I've used Zevo with Firewire, USB (2 + 3) and SATA and have not had such a problem. The only stalling I see if there are a couple of different zfs commands running at the same time. Then the system seems to come to a halt but will continue eventually.
I would look at the network connections if the connection is still in place.
jollyjinx Offline


 
Posts: 60
Joined: Sun Sep 16, 2012 12:40 pm
Location: Munich - Germany

Re: ZFS TimeMachine style backups update

Post by shuman » Thu Jan 10, 2013 8:38 pm

It's actually local so there isn't even a network complicating issues; just cheap external USB devices. Although, I don't honestly know if that is the issue.
- Mac Mini (Late 2012), 10.8.5, 16GB memory, pool - 2 Mirrored 3TB USB 3.0 External Drives
shuman Offline

User avatar
 
Posts: 96
Joined: Mon Sep 17, 2012 8:15 am

Troubleshooting

Post by grahamperrin » Sun Jan 13, 2013 5:48 pm

Try a zfs command without scripting, and whilst it runs, occasionally:

Control-T

– to see how things are progressing.

In the Energy Saver pane of System Preferences, is sleep of hard disks allowed or disallowed?

shuman wrote:… nothing …


shuman wrote:… dies …


Dies in what way?

If there were a bus issue, with USB, I'd expect a zfs command to be not killable.

Maybe take this to the troubleshooting area …
grahamperrin Offline

User avatar
 
Posts: 1596
Joined: Fri Sep 14, 2012 10:21 pm
Location: Brighton and Hove, United Kingdom

Re: ZFS TimeMachine style backups update

Post by scasady » Sat Jan 19, 2013 9:58 am

I repeatedly tried to copy a disk image using usb and eventually gave up. It always quit without error messages after a while. I had to mount it and copy with finder. this was 10.8.2
scasady Offline


 
Posts: 45
Joined: Sat Sep 15, 2012 8:00 am

Orientation

Post by grahamperrin » Mon Jan 21, 2013 1:38 pm

This topic is about the scripts at https://github.com/jollyjinx/ZFS-TimeMachine

For trouble with disk images, please aim for the troubleshooting area.
grahamperrin Offline

User avatar
 
Posts: 1596
Joined: Fri Sep 14, 2012 10:21 pm
Location: Brighton and Hove, United Kingdom

PreviousNext

Return to General Discussion

Who is online

Users browsing this forum: ilovezfs and 1 guest

cron