mirroring problem (www.postgresql.org)

On Thu, 17 Jun 1999, Oleg Bartunov wrote:

Hi,

seems something wrong with rsync mirroring.
I use
rsync -avz --delete hub.org::postgresql-www /d4/Web/mirrors/pgsql/
and it does well but no images from /images directory are copied.
So my mirror http://www.sai.msu.su:8000/ looks corrupt

Are you on the mirrors mailing list? We're trying to get all of the
mirror admins on it to contact them easier. Anyway, I dropped your
site from automatic redirect while we figure out what happened. There
are two other directories that also don't appear to be transferring:
css and js. I've already asked Marc to look into it - dunno if he
came up with anything yet. It also appears to only be happening to
the sites that have an extra directory in their URL; eg:

Vince.
--
==========================================================================
Vince Vielhaber -- KA8CSH email: vev@michvhf.com flame-mail: /dev/null
# include <std/disclaimers.h> TEAM-OS2
Online Campground Directory http://www.camping-usa.com
Online Giftshop Superstore http://www.cloudninegifts.com
==========================================================================

On Thu, 17 Jun 1999, Vince Vielhaber wrote:

On Thu, 17 Jun 1999, Oleg Bartunov wrote:

Hi,

seems something wrong with rsync mirroring.
I use
rsync -avz --delete hub.org::postgresql-www /d4/Web/mirrors/pgsql/
and it does well but no images from /images directory are copied.
So my mirror http://www.sai.msu.su:8000/ looks corrupt

Are you on the mirrors mailing list? We're trying to get all of the
mirror admins on it to contact them easier. Anyway, I dropped your
site from automatic redirect while we figure out what happened. There
are two other directories that also don't appear to be transferring:
css and js. I've already asked Marc to look into it - dunno if he
came up with anything yet. It also appears to only be happening to
the sites that have an extra directory in their URL; eg:

Just tested things out here, and it created the images directory and
all...is rsync generating any error messages? *raised eyebrow*

There is nothing configured on hub.org to exclude the images directory...

Marc G. Fournier ICQ#7615664 IRC Nick: Scrappy
Systems Administrator @ hub.org
primary: scrappy@hub.org secondary: scrappy@{freebsd|postgresql}.org

There is nothing configured on hub.org to exclude the
images directory...

Sorry in advance for the re/misdirection, but would CVSup be a
suitable alternative for this task? It is working *great* for me to
replicate the CVS tree, but it also handles normal directory trees. It
includes lots of compression optimizations and so is very fast...

- Thomas

--
Thomas Lockhart lockhart@alumni.caltech.edu
South Pasadena, California

On Thu, 17 Jun 1999, Thomas Lockhart wrote:

There is nothing configured on hub.org to exclude the
images directory...

Sorry in advance for the re/misdirection, but would CVSup be a
suitable alternative for this task? It is working *great* for me to
replicate the CVS tree, but it also handles normal directory trees. It
includes lots of compression optimizations and so is very fast...

What was used before rsync that was the bandwidth hog? Wasn't cvs, was
it?

Vince.
--
==========================================================================
Vince Vielhaber -- KA8CSH email: vev@michvhf.com flame-mail: /dev/null
# include <std/disclaimers.h> TEAM-OS2
Online Campground Directory http://www.camping-usa.com
Online Giftshop Superstore http://www.cloudninegifts.com
==========================================================================

On Thu, Jun 17, 1999 at 01:54:33PM +0000, Thomas Lockhart wrote:

There is nothing configured on hub.org to exclude the
images directory...

Sorry in advance for the re/misdirection, but would CVSup be a
suitable alternative for this task? It is working *great* for me to
replicate the CVS tree, but it also handles normal directory trees. It
includes lots of compression optimizations and so is very fast...

Please don;t force us to use CVSup - you have to have Modula-3 to
compile it, and some organisations (mine mostly included) has to start
from source for all this stuff...

Regards,
--
Peter Galbavy
Knowledge Matters Ltd
http://www.knowledge.com/

Sorry in advance for the re/misdirection, but would CVSup be a
suitable alternative for this task? It is working *great* for me to
replicate the CVS tree, but it also handles normal directory trees. It
includes lots of compression optimizations and so is very fast...

Please don;t force us to use CVSup - you have to have Modula-3 to
compile it, and some organisations (mine mostly included) has to start
from source for all this stuff...

Another enthusiast... ;)

I'm not sure what platform you are on, but there is a *very* nice
Modula-3 rpm package from Polytechnic University in Montreal for
linux.

Anyway, for some mirrors CVSup might be a good alternative since Marc
is already running a server. Also, CVSup has a "mirror sync" mode
which makes it even faster; if the mirror is run as a slave server
then the server leaves all of the sync info in cache and does not need
to traverse the directory tree to deduce what should be updated.

- Thomas

--
Thomas Lockhart lockhart@alumni.caltech.edu
South Pasadena, California

Vince,

I found the problem and fixed it. The problem was because I have
alias /images in my main site and it propagates to virtual site.

btw, http://www.postgresql.org redirected to
http://www.postgresql.org/postgresql.wplus.net
This happens with NS 4.05, win95

Regards,

Oleg
On Thu, 17 Jun 1999, Vince Vielhaber wrote:

Date: Thu, 17 Jun 1999 06:57:37 -0400 (EDT)
From: Vince Vielhaber <vev@michvhf.com>
To: Oleg Bartunov <oleg@sai.msu.su>
Cc: pgsql-hackers@hub.org
Subject: Re: [HACKERS] mirroring problem (www.postgresql.org)

On Thu, 17 Jun 1999, Oleg Bartunov wrote:

Hi,

seems something wrong with rsync mirroring.
I use
rsync -avz --delete hub.org::postgresql-www /d4/Web/mirrors/pgsql/
and it does well but no images from /images directory are copied.
So my mirror http://www.sai.msu.su:8000/ looks corrupt

Are you on the mirrors mailing list? We're trying to get all of the
mirror admins on it to contact them easier. Anyway, I dropped your
site from automatic redirect while we figure out what happened. There
are two other directories that also don't appear to be transferring:
css and js. I've already asked Marc to look into it - dunno if he
came up with anything yet. It also appears to only be happening to
the sites that have an extra directory in their URL; eg:

Vince.
--
==========================================================================
Vince Vielhaber -- KA8CSH email: vev@michvhf.com flame-mail: /dev/null
# include <std/disclaimers.h> TEAM-OS2
Online Campground Directory http://www.camping-usa.com
Online Giftshop Superstore http://www.cloudninegifts.com
==========================================================================

_____________________________________________________________
Oleg Bartunov, sci.researcher, hostmaster of AstroNet,
Sternberg Astronomical Institute, Moscow University (Russia)
Internet: oleg@sai.msu.su, http://www.sai.msu.su/~megera/
phone: +007(095)939-16-83, +007(095)939-23-83

On Thu, 17 Jun 1999, Oleg Bartunov wrote:

Vince,

I found the problem and fixed it. The problem was because I have
alias /images in my main site and it propagates to virtual site.

btw, http://www.postgresql.org redirected to
http://www.postgresql.org/postgresql.wplus.net
This happens with NS 4.05, win95

Should be back in business now. msu.su has been added back into the
mirror list and the above was a typo that's been corrected.

Thanks!

Vince.
--
==========================================================================
Vince Vielhaber -- KA8CSH email: vev@michvhf.com flame-mail: /dev/null
# include <std/disclaimers.h> TEAM-OS2
Online Campground Directory http://www.camping-usa.com
Online Giftshop Superstore http://www.cloudninegifts.com
==========================================================================

On Thu, 17 Jun 1999, Thomas Lockhart wrote:

There is nothing configured on hub.org to exclude the
images directory...

Sorry in advance for the re/misdirection, but would CVSup be a
suitable alternative for this task? It is working *great* for me to
replicate the CVS tree, but it also handles normal directory trees. It
includes lots of compression optimizations and so is very fast...

Rsync basically does the same thing, but cleaner...and doesn't require
Modula-3 to install.

Marc G. Fournier ICQ#7615664 IRC Nick: Scrappy
Systems Administrator @ hub.org
primary: scrappy@hub.org secondary: scrappy@{freebsd|postgresql}.org

On Thu, 17 Jun 1999, Vince Vielhaber wrote:

On Thu, 17 Jun 1999, Thomas Lockhart wrote:

There is nothing configured on hub.org to exclude the
images directory...

Sorry in advance for the re/misdirection, but would CVSup be a
suitable alternative for this task? It is working *great* for me to
replicate the CVS tree, but it also handles normal directory trees. It
includes lots of compression optimizations and so is very fast...

What was used before rsync that was the bandwidth hog? Wasn't cvs, was
it?

Nope, ftp/mirror, except that ftp/mirror requires the client to do their
configuration cleanly, whereas with rsync I can setup our end to exclude
stuff (ie. ht/Dig databases)

Marc G. Fournier ICQ#7615664 IRC Nick: Scrappy
Systems Administrator @ hub.org
primary: scrappy@hub.org secondary: scrappy@{freebsd|postgresql}.org