DoC Computing Support Group


Differences between revisions 1 and 11 (spanning 10 versions)
Revision 1 as of 2008-09-11 10:56:44
Size: 3066
Editor: dwm
Comment:
Revision 11 as of 2018-11-09 11:56:27
Size: 3725
Editor: ldk
Comment:
Deletions are marked like this. Additions are marked like this.
Line 3: Line 3:
CSG operate an online backup system, which allows you to directly access backup copies of home directories and group volume areas. The online backup system contains nightly snapshots of these areas going back several days, meaning that in most common cases, lost or mangled files can be easily recovered without assistance from the systems administrators. CSG operate an [[services/backups|online backup system]], which allows you to directly access backup copies of home directories and group volume areas. The online backup system contains nightly snapshots of these areas going back several days, meaning that -- in most common cases -- lost or mangled files can be easily recovered without the need for assistance from CSG.
Line 7: Line 7:
== Recovering files under Linux == == Recovering files from your Home Directory under Linux ==
Line 9: Line 9:
~+`cd /vol/recover/homes/<username>`+~ ~+`cd /vol/recover2/homes/<username>`+~

'''Please note''': as of Summer 2013, user home directories have been moved to a different
file-server because the filesystem became full. Please use the above location rather than the historic /vol/recover....

You will also need a valid Kerberos ticket to access ~+`/vol/recover2`+~. Please run ~+`kinit ${USER}@IC.AC.UK`+~ prior to attempting to access ~+`/vol/recover2`+~.
Line 22: Line 27:
Group project directories are also backed up and can be found in: == Recovering files from a shared volume (eg. /vol/project) under Linux ==
Line 24: Line 29:
~+`/vol/recover/vol/project`+~ The vast majority of shared volumes, such as /vol/project for group project directories, or /vol/cc for the Custom Computing research group,
are also backed up and can be found in:
Line 26: Line 32:
Remember if you copy any files from the backups to your current home directory you need to rename them to avoid overwriting existing files! ~+`/vol/recover/vol/VOLUMENAME`+~
Line 28: Line 34:
In the specific case of your ~+`.email`+~ file - your email Inbox - you need to be especially careful so as not to lose recent email. We recommend that you copy (say) last night's version back as follows: == Note: Don't accidentally overwrite things by copying them incautiously ==
Line 30: Line 36:
~+`cp /vol/recover/homes/USERNAME/full/.email ~/IMAP/RecoveredInbox`+~

Now you can use your favourite email client (perhaps after refreshing it's idea of what IMAP folders exist), to select the !RecoveredInbox folder, view the messages, and decide which messages to move back into your main Inbox. We recommend that you end up deleting the !RecoveredInbox folder - it's only a transitional folder, don't keep it hanging around for ever!
Remember when you are about to copy any files from the backups to your current home directory (or shared volume), you
need to be extremely clear whether you wish to overwrite existing files or not - by default, of course you '''will overwrite''' anything!
It may be safest to either copy a single file at a time, or to recursively copy a whole directory tree into a '''newly created''' directory
perhaps called ''restored_DIRNAME_CURRENTDATE'', and then very cautiously decide how to merge the two directories.
Line 36: Line 43:
~+`Start`+~ - ~+`Run...`+~ - ~+`\\fs-vol.doc.ic.ac.uk\homebackup`+~ ~+`Start`+~ - ~+`Run...`+~ - ~+`\\fs-vol-recover2.doc.ic.ac.uk\recover2`+~
Line 40: Line 47:
~+`Start`+~ - ~+`Run...`+~ - ~+`\\fs-vol.doc.ic.ac.uk\volbackup`+~ ~+`Start`+~ - ~+`Run...`+~ - ~+`\\fs-vol-recover.doc.ic.ac.uk\recover`+~
Line 42: Line 49:
The folder ~+`homebackup`+~ will contain backups for your home directory. The folder ~+`volbackup`+~ will contain backups of the ~+`/vol`+~ areas such as the group project areas. The layout of the directories is the same as described above. The folder ~+`recover2`+~ will contain backups for your home directory. The folder ~+`recover`+~ will contain backups of the ~+`/vol`+~ areas such as the group project areas. The layout of the directories is the same as described above.
Line 46: Line 53:
If the files that you need to restore were lost more than 12 nights ago, they will not be available from the online backup system. If this is the case, you can contact CSG to request a file restore from the offline tape backup system. If the files that you need to restore were lost more than 12 nights ago, they will not be available from the online backup system. If this is the case, please email CSG (help@doc.ic.ac.uk) to request a file restore from the offline tape backup system.
Line 48: Line 55:
Please note that as this is a time-consuming process requiring retrieval of the appropriate tapes from secure storage and manual processing, you should allow at least 2 working days for file recovery requests to be serviced. Please note that as this is a time-consuming process requiring retrieval of the appropriate tapes from secure storage and manual processing, you should allow at least a working day for file recovery requests to be serviced.  Please help us by being as precise as you can about the Unix path of the data and roughly when it was deleted or corrupted, as we are likely to have several possible dated backup versions of your lost data.

Recovering files from backups

CSG operate an online backup system, which allows you to directly access backup copies of home directories and group volume areas. The online backup system contains nightly snapshots of these areas going back several days, meaning that -- in most common cases -- lost or mangled files can be easily recovered without the need for assistance from CSG.

This document explains how to retrieve historical files from the online backup system.

Recovering files from your Home Directory under Linux

cd /vol/recover2/homes/<username>

Please note: as of Summer 2013, user home directories have been moved to a different file-server because the filesystem became full. Please use the above location rather than the historic /vol/recover....

You will also need a valid Kerberos ticket to access /vol/recover2. Please run kinit ${USER}@IC.AC.UK prior to attempting to access /vol/recover2.

The full copy of your home directory as of the previous night is in the sub-directory full. Each of the inc-n sub-directories contain files that changed about n nights ago.

That is:

full/

last night's copy of your home directory

inc-00/

files that changed between last night and 2 nights ago

inc-01/

files that changed between 2 nights ago and 3 nights ago

inc-02/

files that changed between 3 nights ago and 4 nights ago

...etc.

inc-10/

files that changed between 11 nights ago and 12 nights ago

Recovering files from a shared volume (eg. /vol/project) under Linux

The vast majority of shared volumes, such as /vol/project for group project directories, or /vol/cc for the Custom Computing research group, are also backed up and can be found in:

/vol/recover/vol/VOLUMENAME

Note: Don't accidentally overwrite things by copying them incautiously

Remember when you are about to copy any files from the backups to your current home directory (or shared volume), you need to be extremely clear whether you wish to overwrite existing files or not - by default, of course you will overwrite anything! It may be safest to either copy a single file at a time, or to recursively copy a whole directory tree into a newly created directory perhaps called restored_DIRNAME_CURRENTDATE, and then very cautiously decide how to merge the two directories.

Recovering files under Windows

Start - Run... - \\fs-vol-recover2.doc.ic.ac.uk\recover2

or

Start - Run... - \\fs-vol-recover.doc.ic.ac.uk\recover

The folder recover2 will contain backups for your home directory. The folder recover will contain backups of the /vol areas such as the group project areas. The layout of the directories is the same as described above.

Recovery of older files

If the files that you need to restore were lost more than 12 nights ago, they will not be available from the online backup system. If this is the case, please email CSG (help@doc.ic.ac.uk) to request a file restore from the offline tape backup system.

Please note that as this is a time-consuming process requiring retrieval of the appropriate tapes from secure storage and manual processing, you should allow at least a working day for file recovery requests to be serviced. Please help us by being as precise as you can about the Unix path of the data and roughly when it was deleted or corrupted, as we are likely to have several possible dated backup versions of your lost data.

 
 

guides/file-storage/backups (last edited 2018-11-09 11:56:27 by ldk)