If you want to synchronise two directories/filesystems the way you described your goal now to be then rsync is the way to go. rsync was built for exactly this purpose. You don't even need to check anything before because the toolw will do that itself and simply do nothing if there is nothing to do (that is, if the directories are in sync already).
I want to find duplicates in file on 2nd field i wrote this code:
nawk '{a++} END{for i in a {if (a>1) print}}' temp
Could not find whats wrong with this.
Appreciate help (5 Replies)
I have a folder which in turn has numerous sub folders all containing pdf files with same file named in different ways.
So I need a script if it can be written to find and print the duplicate files (That is files with same size) along with the respective paths.
So I assume here that same file... (5 Replies)
Hi All,
I am Oracle Apps Tech guy, I have a requirement to find 777 permission is there or not for all Folders and Sub-folders
Under APPL_TOP (Folder/directory) with below conditions
i) the directory names should start with xx..... (like xxau,xxcfi,xxcca...etc)
and exclude the directory... (11 Replies)
Hello,
My text file has input of the form
abc dft45.xml
ert rt653.xml
abc ert57.xml
I need to write a perl script/shell script to find duplicates in the first column and write it into a text file of the form...
abc dft45.xml
abc ert57.xml
Can some one help me plz? (5 Replies)
example data
5666700842511TAfmoham03151008075205999900000001000001000++
5666700843130MAfmoham03151008142606056667008390315100005001
6666666663130MAfmoham03151008142606056667008390315100005001
I'd like to sort on position 10-14 where the characters are eq "130MA".
Then based on positions... (0 Replies)
Hi all,
Using grep command, i want to find the pattern of text in all directories and sub-directories.
e.g: if i want to search for a pattern named "parmeter", i used the command
grep -i "param" ../*
is this correct? (1 Reply)
these are numeric ids..
222932017099186177
222932014385467392
222932017371820032
222932017409556480
I have text file having 300 millions of line as shown above. I want to find duplicates from this file. Please suggest the quicker way..
sort | uniq -d will... (3 Replies)
with below given format,
I have been trying to find out all IDs for those entries with duplicate names in 2nd and 3rd columns and their count like how many time duplication happened for any name if any,
0.237788 Aaban Aahva
0.291066 Aabheer Aahlaad
0.845814 Aabid Aahan
0.152208 Aadam... (6 Replies)
Hello All,
This is a noob question. I tried searching for the answer but the answer found did not help me .
I have a file that can have duplicates.
100
200
300
400
100
150
the number 100 is duplicated twice. I want to find the duplicate along with the line number.
expected... (4 Replies)
Discussion started by: vatigers
4 Replies
LEARN ABOUT DEBIAN
mrb
MRB(8) System Manager's Manual MRB(8)NAME
mrb - manage incremental snapshots with rsync/make.
SYNOPSIS
mrb command
DESCRIPTION
mrb is a simple aid to creating efficient incremental snapshots of a set, or sets, of directories whenever that may be required. It may be
used as part of a regular automated backup regime, or for manually checkpointing changes at convenient points in time.
COMMANDS
The following commands are recognised (where 'MODULE' is the name of one of your snapshot definitions):
new-MODULE
Create a skeleton definition for a new snapshot 'MODULE'.
dest-MODULE
Create the destination dir for 'MODULE'. This directory must exist to create a snapshot.
snap-MODULE
Create a snapshot of 'MODULE'.
sync Create snapshots of all defined modules. If run as root this may be configured to include the modules of other users too (see
MRB_SYNC_USERS in ~/.mrb/defaults).
help Show mrb's own help text.
CONFIGURATION FILES
Per-user configuration
The following files may be used to specify global and local configuration options.
/etc/default/mrb
system default configuration.
~/.mrb/defaults
per-user configuration.
Per-user options
The following options control behaviour for all of a user's modules.
MRB_SNAPSHOT_LOG
An optional file path where transfer details will be recorded. If unset these details will not be logged.
MRB_SYNC_USERS
A space separated list of users whose modules should be included in a sync. This is mostly only useful for root, as mrb will assume
the identity of each user before creating snapshots of their modules. If unset, only the invoking user's modules will be sync'ed.
MRB_CONFDIR
An space separated list of the directories to search for module definition (*.mrc) files. They will be searched in the order given,
with new modules added by default to the last one listed. There should be few reasons to change the default value.
Per-module configuration
The default MRB_CONFDIR value will search for module definitions in:
/etc/mrb/*.mrc
~/.mrb/*.mrc
Those created by new-MODULE will be placed in this latter location by default.
Per-module options
In each case module below is the name of the particular module that the value set should apply to. These options should be defined in a
file named module.mrc.
module_SRC
A space separated list of the files and (top level) directories to include in the snapshots for this module.
module_DEST
The directory root where snapshots of module should be stored.
module_INCLUDE
An optional list of rsync(1) include patterns.
module_EXCLUDE
An optional list of rsync(1) exclude patterns.
module_FILTER
An optional list of rsync(1) filter patterns.
module_FILTER_FILE
An optional filename for rsync(1) dir-merge filtering support.
module_RSYNC_OPTIONS
Optional additional rsync(1) options to pass verbatim when it is invoked.
module_PRECOMMAND
An optional shell command to invoke just prior to creating a new snapshot. If the command does not return a successful exit status,
then the snapshot creation will be aborted before it begins. It may be used to mount removable media or similar.
module_POSTCOMMAND
An optional shell command to execute after making the snapshot. It will not be called if the snaphot creation failed at an earlier
stage, and its return status may halt a sync operation if it fails with more modules still to process. It may be used, for example,
to unmount removable media again.
module_USER
An optional user name to check that mrb is running as before performing a snapshot. This can be used to ensure you have the correct
permisson to access the files being mirrored before you get too far.
SEE ALSO rsync(1), make(1).
AUTHOR
mrb was written by Ron <ron@debian.org>.
May 9, 2006 MRB(8)