Mirrors that don't suck.

Started by Dan Vande Moreover 22 years ago21 messagesgeneral
Jump to latest
#1Dan Vande More
dvm@firstlink.com

Hey list, I'm just wondering if anyone can point me in the direction of a mirror that doesn't suck.

I generally don't do alot with postgres other than downloading and installing the newest releases.
Everytime there is a release, it takes forever for it to show up on an ftp server.
This is in the case that the ftp server even works. Now in a case where one likes to browse with the browser of their choice, it totally blows because it's _so_ slow.

So is there maybe an http download somewhere? Or an FTP site that doesn't give me an "directory doesn't exist" error, or one that has more than 15k available, or one that maybe has the newest releases(7.4.1)? All of those would be perfect...

Dan

In reply to: Dan Vande More (#1)
Re: Mirrors that don't suck.

So is there maybe an http download somewhere? Or an FTP site that doesn't
give me an "directory doesn't exist" error, or one that has more than 15k
available, or one that maybe has the newest releases(7.4.1)? All of those
would be perfect...

I got a working 7.4.1 from one of the German mirrors.

B.

#3Robert Treat
xzilla@users.sourceforge.net
In reply to: Dan Vande More (#1)
Re: Mirrors that don't suck.

On Tue, 2003-12-23 at 13:39, Dan Vande More wrote:

Hey list, I'm just wondering if anyone can point me in the direction of a mirror that doesn't suck.

I generally don't do alot with postgres other than downloading and installing the newest releases.
Everytime there is a release, it takes forever for it to show up on an ftp server.
This is in the case that the ftp server even works. Now in a case where one likes to browse with the browser of their choice, it totally blows because it's _so_ slow.

So is there maybe an http download somewhere? Or an FTP site that doesn't give me an "directory doesn't exist" error, or one that has more than 15k available, or one that maybe has the newest releases(7.4.1)? All of those would be perfect...

Dan

So this is how not to write an email asking people for help, seriously.
I just checked the first 5 mirror sites on the ftp mirrors page and
everyone of them had the latest code under pub/source/v7.4.1/ (or
something similar). What might have been a more helpful email would be
to point out that the ftp site are still showing 7.4.0 in the main
directory and the directory for latest is also pointing to 7.4.0, both
should be updated to 7.4.1. You might have also included a list of the
mirror sites you were having trouble with so problems with those sites
could be tracked down easier. You might also want to CC
webmaster@postgresql.org as well as posting to the -general list.

Oh, and for future reference you can download via http at
http://developer.postgresql.org/ftpsite/, and also at the sourceforge
site http://sourceforge.net/projects/pgsql/ (though I hesitate to
mention it because I haven't uploaded 7.4.1 there quite yet...)

I hope this helps.

Robert Treat
--
Build A Brighter Lamp :: Linux Apache {middleware} PostgreSQL

#4Dan Vande More
dvm@firstlink.com
In reply to: Robert Treat (#3)
Re: Mirrors that don't suck.

Hey Robert,

Well I got an answer, and that's what I was looking for.

Thanks for the (http)link at the bottom. Looks great.

As far as the sites:

ftp://ftp13.us.postgresql.org/pub/postgresql/ - Directory not found, clicked right on the webpage.
ftp://ftp8.us.postgresql.org/pub/pgsql - Directory not found, clicked right on the webpage
ftp3 times out

**Note: The following are probably user error, wget and lynx both error trying to retrieve it, but double clicking in my browser works. So much for getting it from a command line tool.

**********************************************************************
--12:28:24-- ftp://ftp15.us.postgresql.org/source/v7.4/postgresql-7.4.tar.gz
=> `postgresql-7.4.tar.gz'
Resolving ftp15.us.postgresql.org... done.
Connecting to ftp15.us.postgresql.org[216.29.164.5]:21... connected.
Logging in as anonymous ... Logged in!
==> SYST ... done. ==> PWD ... done.
==> TYPE I ... done. ==> CWD /source/v7.4 ... done.
==> PORT ... done. ==> RETR postgresql-7.4.tar.gz ...
Error in server response, closing control connection.
Retrying.
**********************************************************************
--11:26:53-- ftp://ftp3.ca.postgresql.org/pub/source/v7.4/postgresql-7.4.tar.gz
(try: 5) => `postgresql-7.4.tar.gz'
Connecting to ftp3.ca.postgresql.org[64.141.14.48]:21... connected.
Logging in as anonymous ... Logged in!
==> SYST ... done. ==> PWD ... done.
==> TYPE I ... done. ==> CWD /pub/source/v7.4 ... done.
==> PORT ... done. ==> RETR postgresql-7.4.tar.gz ...
Error in server response, closing control connection.
Retrying.
**********************************************************************
--11:28:10-- ftp://ftp10.us.postgresql.org/pub/postgresql/v7.4/postgresql-7.4.tar.gz
(try: 5) => `postgresql-7.4.tar.gz'
Connecting to ftp10.us.postgresql.org[141.142.2.89]:21... connected.
Logging in as anonymous ... Logged in!
==> SYST ... done. ==> PWD ... done.
==> TYPE I ... done. ==> CWD /pub/postgresql/v7.4 ... done.
==> PORT ... done. ==> RETR postgresql-7.4.tar.gz ...
Error in server response, closing control connection.
Retrying.
**********************************************************************

Thanks for your time.

Dan

-----Original Message-----
From: Robert Treat [mailto:xzilla@users.sourceforge.net]
Sent: Tuesday, December 23, 2003 12:18 PM
To: Dan Vande More
Cc: pgsql-general@postgresql.org; webmaster@postgresql.org; Marc G.
Fournier
Subject: Re: [GENERAL] Mirrors that don't suck.

On Tue, 2003-12-23 at 13:39, Dan Vande More wrote:

Hey list, I'm just wondering if anyone can point me in the direction of a mirror that doesn't suck.

I generally don't do alot with postgres other than downloading and installing the newest releases.
Everytime there is a release, it takes forever for it to show up on an ftp server.
This is in the case that the ftp server even works. Now in a case where one likes to browse with the browser of their choice, it totally blows because it's _so_ slow.

So is there maybe an http download somewhere? Or an FTP site that doesn't give me an "directory doesn't exist" error, or one that has more than 15k available, or one that maybe has the newest releases(7.4.1)? All of those would be perfect...

Dan

So this is how not to write an email asking people for help, seriously.
I just checked the first 5 mirror sites on the ftp mirrors page and
everyone of them had the latest code under pub/source/v7.4.1/ (or
something similar). What might have been a more helpful email would be
to point out that the ftp site are still showing 7.4.0 in the main
directory and the directory for latest is also pointing to 7.4.0, both
should be updated to 7.4.1. You might have also included a list of the
mirror sites you were having trouble with so problems with those sites
could be tracked down easier. You might also want to CC
webmaster@postgresql.org as well as posting to the -general list.

Oh, and for future reference you can download via http at
http://developer.postgresql.org/ftp
site/, and also at the sourceforge
site http://sourceforge.net/projects/pgsql/ (though I hesitate to
mention it because I haven't uploaded 7.4.1 there quite yet...)

I hope this helps.

Robert Treat
--
Build A Brighter Lamp :: Linux Apache {middleware} PostgreSQL

#5Gavin M. Roy
gmr@ehpg.net
In reply to: Robert Treat (#3)
Re: Mirrors that don't suck.

http://mirror.ehpg.net/postgresql/ doesn't suck ;-) But I'm partial.

http://mirror.ehpg.net/postgresql/source/v7.4.1/ is a direct URL.

Gavin

Robert Treat wrote:

Show quoted text

On Tue, 2003-12-23 at 13:39, Dan Vande More wrote:

Hey list, I'm just wondering if anyone can point me in the direction of a mirror that doesn't suck.

I generally don't do alot with postgres other than downloading and installing the newest releases.
Everytime there is a release, it takes forever for it to show up on an ftp server.
This is in the case that the ftp server even works. Now in a case where one likes to browse with the browser of their choice, it totally blows because it's _so_ slow.

So is there maybe an http download somewhere? Or an FTP site that doesn't give me an "directory doesn't exist" error, or one that has more than 15k available, or one that maybe has the newest releases(7.4.1)? All of those would be perfect...

Dan

So this is how not to write an email asking people for help, seriously.
I just checked the first 5 mirror sites on the ftp mirrors page and
everyone of them had the latest code under pub/source/v7.4.1/ (or
something similar). What might have been a more helpful email would be
to point out that the ftp site are still showing 7.4.0 in the main
directory and the directory for latest is also pointing to 7.4.0, both
should be updated to 7.4.1. You might have also included a list of the
mirror sites you were having trouble with so problems with those sites
could be tracked down easier. You might also want to CC
webmaster@postgresql.org as well as posting to the -general list.

Oh, and for future reference you can download via http at
http://developer.postgresql.org/ftpsite/, and also at the sourceforge
site http://sourceforge.net/projects/pgsql/ (though I hesitate to
mention it because I haven't uploaded 7.4.1 there quite yet...)

I hope this helps.

Robert Treat

#6Brian Hirt
bhirt@mobygames.com
In reply to: Robert Treat (#3)
Re: Mirrors that don't suck.

I've run into problems with some of the mirrors being consistently
unavailable and really slow to download 4k/sec on a lot of them.

ftp://ftp9.us.postgresql.org/pub/mirrors seems to work great all the
time. Now I hope this doesn't come across as complaining, because the
reason for this email is a question. What type bandwidth can you
expect to use if you become a mirror (1meg/sec? more less?) Also are
http mirrors acceptable? I would like to offer up one of our servers
on mobygames.com because I love postgresql and it would be a way to
help out a bit, but I don't really know enough about the requirements
right now.

Who should i talk to?

However, there are already 7 US mirrors.

On Dec 23, 2003, at 12:17 PM, Robert Treat wrote:

Show quoted text

On Tue, 2003-12-23 at 13:39, Dan Vande More wrote:

Hey list, I'm just wondering if anyone can point me in the direction
of a mirror that doesn't suck.

I generally don't do alot with postgres other than downloading and
installing the newest releases.
Everytime there is a release, it takes forever for it to show up on
an ftp server.
This is in the case that the ftp server even works. Now in a case
where one likes to browse with the browser of their choice, it
totally blows because it's _so_ slow.

So is there maybe an http download somewhere? Or an FTP site that
doesn't give me an "directory doesn't exist" error, or one that has
more than 15k available, or one that maybe has the newest
releases(7.4.1)? All of those would be perfect...

Dan

So this is how not to write an email asking people for help, seriously.
I just checked the first 5 mirror sites on the ftp mirrors page and
everyone of them had the latest code under pub/source/v7.4.1/ (or
something similar). What might have been a more helpful email would be
to point out that the ftp site are still showing 7.4.0 in the main
directory and the directory for latest is also pointing to 7.4.0, both
should be updated to 7.4.1. You might have also included a list of the
mirror sites you were having trouble with so problems with those sites
could be tracked down easier. You might also want to CC
webmaster@postgresql.org as well as posting to the -general list.

Oh, and for future reference you can download via http at
http://developer.postgresql.org/ftpsite/, and also at the sourceforge
site http://sourceforge.net/projects/pgsql/ (though I hesitate to
mention it because I haven't uploaded 7.4.1 there quite yet...)

I hope this helps.

Robert Treat
--
Build A Brighter Lamp :: Linux Apache {middleware} PostgreSQL

---------------------------(end of
broadcast)---------------------------
TIP 5: Have you checked our extensive FAQ?

http://www.postgresql.org/docs/faqs/FAQ.html

#7Joshua D. Drake
jd@commandprompt.com
In reply to: Brian Hirt (#6)
Re: Mirrors that don't suck.

Brian Hirt wrote:

I've run into problems with some of the mirrors being consistently
unavailable and really slow to download 4k/sec on a lot of them.

I can second this.

Sincerely,

Joshua D. Drake

-- 
Command Prompt, Inc., home of Mammoth PostgreSQL - S/ODBC and S/JDBC
Postgresql support, programming shared hosting and dedicated hosting.
+1-503-667-4564 - jd@commandprompt.com - http://www.commandprompt.com
Mammoth PostgreSQL Replicator. Integrated Replication for PostgreSQL
In reply to: Joshua D. Drake (#7)
Re: Mirrors that don't suck.

I've run into problems with some of the mirrors being consistently
unavailable and really slow to download 4k/sec on a lot of them.

I can second this.

Perhaps you should wait a day or so until all mirrors are fully up to date
and the ppl who are in a hurry to get the source have got it..

Alternatively you US boys could get out of bed early and download it before
50% of the USA starts to download. I have got it about 12 hours ago from a
German mirror at a normal speed.

B.

#9The Hermit Hacker
scrappy@hub.org
In reply to: Robert Treat (#3)
Re: Mirrors that don't suck.

On Tue, 23 Dec 2003, Robert Treat wrote:

What might have been a more helpful email would be to point out that the
ftp site are still showing 7.4.0 in the main directory and the directory
for latest is also pointing to 7.4.0, both should be updated to 7.4.1.

All of the above fixed ...

----
Marc G. Fournier Hub.Org Networking Services (http://www.hub.org)
Email: scrappy@hub.org Yahoo!: yscrappy ICQ: 7615664

#10The Hermit Hacker
scrappy@hub.org
In reply to: Joshua D. Drake (#7)
Re: Mirrors that don't suck.

On Tue, 23 Dec 2003, Joshua D. Drake wrote:

Brian Hirt wrote:

I've run into problems with some of the mirrors being consistently
unavailable and really slow to download 4k/sec on a lot of them.

I can second this.

Any idea of how fast your mirror is running at right now?

----
Marc G. Fournier Hub.Org Networking Services (http://www.hub.org)
Email: scrappy@hub.org Yahoo!: yscrappy ICQ: 7615664

#11Joshua D. Drake
jd@commandprompt.com
In reply to: The Hermit Hacker (#10)
Re: Mirrors that don't suck.

I can second this.

Any idea of how fast your mirror is running at right now?

I just tried :

ftp6.us.postgresql.org

Which doesn't even have PostgreSQL on it ;) It is the home of opennms
(at least to some degree).

----
Marc G. Fournier Hub.Org Networking Services (http://www.hub.org)
Email: scrappy@hub.org Yahoo!: yscrappy ICQ: 7615664

-- 
Command Prompt, Inc., home of Mammoth PostgreSQL - S/ODBC and S/JDBC
Postgresql support, programming shared hosting and dedicated hosting.
+1-503-667-4564 - jd@commandprompt.com - http://www.commandprompt.com
Mammoth PostgreSQL Replicator. Integrated Replication for PostgreSQL
#12The Hermit Hacker
scrappy@hub.org
In reply to: Joshua D. Drake (#11)
Re: Mirrors that don't suck.

On Tue, 23 Dec 2003, Joshua D. Drake wrote:

I just tried :

ftp6.us.postgresql.org

Which doesn't even have PostgreSQL on it ;) It is the home of opennms
(at least to some degree).

If it doesn't have PostgreSQL on it, why is it listed as one? :)

----
Marc G. Fournier Hub.Org Networking Services (http://www.hub.org)
Email: scrappy@hub.org Yahoo!: yscrappy ICQ: 7615664

#13Tony
tony@unihost.net
In reply to: The Hermit Hacker (#12)
Re: Mirrors that don't suck.

Use the torrent.... it's quite quick!

T.

Marc G. Fournier wrote:

Show quoted text

On Tue, 23 Dec 2003, Joshua D. Drake wrote:

I just tried :

ftp6.us.postgresql.org

Which doesn't even have PostgreSQL on it ;) It is the home of opennms
(at least to some degree).

If it doesn't have PostgreSQL on it, why is it listed as one? :)

----
Marc G. Fournier Hub.Org Networking Services (http://www.hub.org)
Email: scrappy@hub.org Yahoo!: yscrappy ICQ: 7615664

---------------------------(end of broadcast)---------------------------
TIP 8: explain analyze is your friend

#14Oliver Elphick
olly@lfix.co.uk
In reply to: The Hermit Hacker (#9)
Re: Mirrors that don't suck.

On Tue, 2003-12-23 at 20:31, Marc G. Fournier wrote:

On Tue, 23 Dec 2003, Robert Treat wrote:

What might have been a more helpful email would be to point out that the
ftp site are still showing 7.4.0 in the main directory and the directory
for latest is also pointing to 7.4.0, both should be updated to 7.4.1.

All of the above fixed ...

It would be helpful if someone were to add to the links page the UK
mirror http://www.mirror.ac.uk/sites/ftp.postgresql.org/

--
Oliver Elphick Oliver.Elphick@lfix.co.uk
Isle of Wight, UK http://www.lfix.co.uk/oliver
GPG: 1024D/3E1D0C1C: CA12 09E0 E8D5 8870 5839 932A 614D 4C34 3E1D 0C1C
========================================
"And this shall be a sign unto you; Ye shall find the
babe wrapped in swaddling clothes, lying in a manger."
Luke 2:12

#15The Hermit Hacker
scrappy@hub.org
In reply to: Oliver Elphick (#14)
Re: Mirrors that don't suck.

On Tue, 23 Dec 2003, Oliver Elphick wrote:

On Tue, 2003-12-23 at 20:31, Marc G. Fournier wrote:

On Tue, 23 Dec 2003, Robert Treat wrote:

What might have been a more helpful email would be to point out that the
ftp site are still showing 7.4.0 in the main directory and the directory
for latest is also pointing to 7.4.0, both should be updated to 7.4.1.

All of the above fixed ...

It would be helpful if someone were to add to the links page the UK
mirror http://www.mirror.ac.uk/sites/ftp.postgresql.org/

Send the details to webmaster@ so that the guys can add it to the database
... but, how are you mirroring? All official mirrors use rsync, and they
are auto-added to the list of mirrors, and updated nightly ...

----
Marc G. Fournier Hub.Org Networking Services (http://www.hub.org)
Email: scrappy@hub.org Yahoo!: yscrappy ICQ: 7615664

#16Dave Page
dpage@pgadmin.org
In reply to: The Hermit Hacker (#15)
Re: [webmaster] Mirrors that don't suck.

-----Original Message-----
From: Marc G. Fournier [mailto:scrappy@postgresql.org]
Sent: 23 December 2003 20:48
To: Joshua D. Drake
Cc: Marc G. Fournier; Brian Hirt; Robert Treat;
webmaster@postgresql.org; pgsql-general@postgresql.org; Dan Vande More
Subject: Re: [webmaster] [GENERAL] Mirrors that don't suck.

On Tue, 23 Dec 2003, Joshua D. Drake wrote:

I just tried :

ftp6.us.postgresql.org

Which doesn't even have PostgreSQL on it ;) It is the home

of opennms

(at least to some degree).

If it doesn't have PostgreSQL on it, why is it listed as one? :)

Ftp6.us is not currently listed on the website because it hasn't synced
up in about 12 months. Guessing the numbers is not a good idea because
at any given time something like 50% of the mirrors are out of date and
therefore automatically removed from the published list. Their DNS
entries are not removed however as that would just cause all sorts of
fun due to the propagation time/ttl value.

In response to a earlier comment on the 'freshness' of the mirrors, the
system tracks which mirrors sync up and when, and lists only those that
have synced within the last 48 hours +/- a few hours for reasons I won't
bore you all with.

For those that are interested, there are over 225 mirrors currently in
the system, all provided by volunteers. There will often be an error on
at least one of them (or on the net between any given client and a
mirror) and unfortunately we cannot easily detect such problems. We do
remain grateful to those that donate their time and resources to provide
a mirror though.

Regards, Dave.

#17Dave Page
dpage@pgadmin.org
In reply to: Dave Page (#16)
Re: [webmaster] Mirrors that don't suck.

-----Original Message-----
From: Marc G. Fournier [mailto:scrappy@postgresql.org]
Sent: 23 December 2003 21:09
To: Oliver Elphick
Cc: Marc G. Fournier; Robert Treat; Dan Vande More;
pgsql-general@postgresql.org; webmaster@postgresql.org
Subject: Re: [webmaster] [GENERAL] Mirrors that don't suck.

It would be helpful if someone were to add to the links page the UK
mirror http://www.mirror.ac.uk/sites/ftp.postgresql.org/

Send the details to webmaster@ so that the guys can add it to
the database ... but, how are you mirroring? All official
mirrors use rsync, and they are auto-added to the list of
mirrors, and updated nightly ...

It is listed - it's: ftp2.uk.postgresql.org

/D

#18bpalmer
bpalmer@crimelabs.net
In reply to: Dan Vande More (#1)
Re: Mirrors that don't suck.

Hey list, I'm just wondering if anyone can point me in the direction of a mirror that doesn't suck.

At least in the US, I think I should be pretty decent
(ftp3.us.postgresql.org). I've rate limited down to 6M/s but that should
be enough for anyone. I rsync every 4 hours. If anyone can't get to the
site of it's slow, please complain to me, I would love to know.

- Brandon

----------------------------------------------------------------------------
c: 917-697-8665 h: 201-435-6226
b. palmer, bpalmer@crimelabs.net pgp:crimelabs.net/bpalmer.pgp5

#19Mark Kirkwood
mark.kirkwood@catalyst.net.nz
In reply to: The Hermit Hacker (#15)
Re: Mirrors that don't suck.

ftp://ftp.au.postgresql.org/pub/postgresql/ is still only displaying
7.4.0 right now...

Marc G. Fournier wrote:

Show quoted text

Send the details to webmaster@ so that the guys can add it to the database
... but, how are you mirroring? All official mirrors use rsync, and they
are auto-added to the list of mirrors, and updated nightly ...

----
Marc G. Fournier Hub.Org Networking Services (http://www.hub.org)
Email: scrappy@hub.org Yahoo!: yscrappy ICQ: 7615664

---------------------------(end of broadcast)---------------------------
TIP 8: explain analyze is your friend

#20Dave Page
dpage@pgadmin.org
In reply to: Brian Hirt (#6)
Re: [webmaster] Mirrors that don't suck.

It's rumoured that Brian Hirt once said:

What type bandwidth can you
expect to use if you become a mirror (1meg/sec? more less?)

I honestly couldn't say, but I would suspect it would be a *lot* less than
that. Whilst PostgreSQL is popular, the type of application that it is
means that it will never get anything remotely like the level of downloads
of say, Mozilla or OpenOffice.

Also are
http mirrors acceptable?

Currently only to mirror the web content (this is mainly because the
mirror code expects an ftp mirror to use ftp and a web mirror to use http
- changing this would require a fair bit of recoding).

I would like to offer up one of our servers
on mobygames.com because I love postgresql and it would be a way to
help out a bit, but I don't really know enough about the requirements
right now.

Who should i talk to?

Me please. I'll need your server IP, and the IP of whatever boxes will be
used to rsync the content. For web mirrors you must be able to setup a
virtual host, for ftp, I alsoneed to know the path to the content (eg.
/pub/postgresql/)

However, there are already 7 US mirrors.

There's closer to 20, but most are not active :-(

Regards, Dave.

#21Brian Hirt
bhirt@mobygames.com
In reply to: Dave Page (#20)