As a lazy sysadmin, I try to make my servers as autonomous as possible : auto-backup, auto-sync tmpfs, report disk status by email, etc.
For all of that, I use a custom little shell framework and some scripts that I share with all my servers through my own git repository.
I decided to publish theses files : it might be useful for some one ;). The “framework” and configuration variables are in bluemind_shellFramework.zip whereas scripts are in bluemind_shellScripts.zip.
What the framework provides
Description
Basicaly, the framework has the following features :
- Redirect all output to a formated log file (eg: prefix added to every line)
- Log file send to admin
- Error manager (auto umounts, send mail, etc.)
- Provides base functionalities such as directory sync, log writing, mysql backup, directory backup, changes detection in directory, etc.
Output example
The framework allows me to write small scripts that output log file like the following (for instance, a backup script):
[17.04.2013-03:00:03][filesrv] ##############################
[17.04.2013-03:00:03][filesrv] Home mirroring for filesrv
[17.04.2013-03:00:03][filesrv] ##############################
[17.04.2013-03:00:03][filesrv]
[17.04.2013-03:00:03][filesrv] Mount mirror partition
[17.04.2013-03:00:03][filesrv] Start Syncronization...
[17.04.2013-03:00:03][filesrv]
[17.04.2013-03:00:03][filesrv] building file list ... done
[17.04.2013-03:00:03][filesrv] home/hidden/path/to/some/changed/file
[17.04.2013-03:00:03][filesrv] home/hidden/path/to/some/changed/file/again
[17.04.2013-03:00:03][filesrv]
[17.04.2013-03:00:03][filesrv] sent 2399992 bytes received 34 bytes 62338.34 bytes/sec
[17.04.2013-03:00:03][filesrv] total size is 925955506298 speedup is 385810.61
[17.04.2013-03:00:48][filesrv]
[17.04.2013-03:00:48][filesrv] Unount mirror partition
[17.04.2013-03:00:49][filesrv]
[17.04.2013-03:00:49][filesrv] ##############################
[17.04.2013-03:00:49][filesrv]
Example scripts
To give some ideas of the framework usage, bellow is 2 examples of scripts I use (together with cron).
Sync logs and backup files from tmps mountpoint to a static storage, plain, simple:
#/bin/bash
. /etc/bluemind/functions
synclog
syncbak
cleanTmp
Another one to backup whole file system and mysql databases with automatic detection of dedicated mount points for /boot and/or /var :
#!/bin/bash
. /etc/bluemind/functions
headerMessage "Starting backup of $HOSTNAME"
apt-get clean
# set BACKUP_DIR to local if needed
if ! [ -d $BACKUP_DIR ] ; then
message "no remote backup dir found : using local backup dir"
BACKUP_DIR="$BACKUP_LOCAL_DIR"
else
message "mounting storage disk"
mountBackupDir
fi
message "Starting backup of /"
backup "/" $BACKUP_DIR "$BACKUP_FILENAME.ROOT"
# make a separate backup if /boot is a partition
if [ "`grep /boot /etc/fstab`" ] ; then
message "Starting backup of /boot";
mountBoot
backup "/boot" $BACKUP_DIR "$BACKUP_FILENAME.BOOT"
fi
# make a separate backup if /var is a partition
if [ "`grep /var /etc/fstab | grep ext4`" ] ; then
message "Starting backup of /var";
backup "/var" $BACKUP_DIR "$BACKUP_FILENAME.VAR"
fi
# mysql database backup
if [ -x mysqld ] ; then
message "MySQL detected !"
backupMysql $BACKUP_DIR "$BACKUP_FILENAME.sql"
fi
message "Unount storage and snapshot"
umountDirs
footerMessage
exitOK "backup"
