rsync folder with sync


To run an rsync from a remote server to a local one and sync the files.

Run the below command

rsync -avz user@server:/tmp/test /tmp/test

Also you can show a progress option with the below addition

rsync -avz --progress user@server:/tmp/test /tmp/test

And add a bandwidth limiter if needed

rsync -avz --bwlimit=100000 user@server:/tmp/test /tmp/test

Copy files from multiple servers to one server


Below is a script which should allow you to copy multiple files that exist on different servers to one location.

You will need SSH keys setting up if you dont want to enter in the password for each time the request is sent to the server.

Further info here

servers.txt contents

server1
server2
server3
server4
server500
#!/bin/bash -
#===============================================================================
#
#          FILE:  copyfiles.sh
#
#         USAGE:  ./copyfiles.sh
#
#   DESCRIPTION:  Copies files on multiple servers to one server from text list of servers hostnames
#
#       OPTIONS:  The right to remain silent
#  REQUIREMENTS:
#          BUGS:  
#         NOTES:  Above^
#        AUTHOR: 
#       COMPANY:
#       CREATED: 18/01/12 13:43:03 BST
#      REVISION: 
#===============================================================================
#Input
servers=$(less servers.txt)
#Action
for IP in $servers
do
scp usernamehere@$IP:/var/log/monitor/file.txt destinationserver.net:/tmp/
done