postgresql-11 installation errors via deb package on ubuntu 16

On 3/18/19 7:24 AM, Vijaykumar Jain wrote:

Hey Guys,

I do not know if this list is also for asking ubuntu package related queries.

We have been recently getting a lot of below errors, as a result of
which the entire postgresql installation gets broken.
the config folder /etc/postgresql/* is empty, initdb fails to
initialize the db and we cannot move forward.

the problem is this is happening only on a certain set of servers, but not all.
so i do not know if this is an issue with the package or anything else?
maybe bad mirror?

Per the package below the servers are all Xenial, correct?
More below.

i came across a similar issue but this is ages back.
https://stackoverflow.com/questions/2748607/how-to-thoroughly-purge-and-reinstall-postgresql-on-ubuntu
and it was marked close for some reasons.
i get the part that removing everything and reinstalling the package
resolves the issue,

24 service postgresql stop
25 rm -rf /etc/postgresql*
26 rm -rf /var/lib/postgresql*
27 rm -rf /var/run/postgresql*
28 rm /var/cache/apt/archives/postgresql-*
29 apt-get purge postgresql-11
30 apt-get purge postgresql-client-common
31 rm -rf /var/log/postgresql*
32 puppet agent -t --debug --verbose (this takes care of installation)

So what is Puppet actually doing?

Do you have Postgres clusters that exist before you try the initial install?

and then things are fine from here on.

error messages from /var/log/apt/term.log

Preparing to unpack .../postgresql-11_11.2-1.pgdg16.04+1_amd64.deb ...
Unpacking postgresql-11 (11.2-1.pgdg16.04+1) ...
Processing triggers for postgresql-common (199.pgdg16.04+1) ...
Building PostgreSQL dictionaries from installed myspell/hunspell packages...
Removing obsolete dictionary files:
Setting up postgresql-11 (11.2-1.pgdg16.04+1) ...
Unescaped left brace in regex is deprecated, passed through in regex;
marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at
/usr/sbin/pam_getenv line 78.
Unescaped left brace in regex is deprecated, passed through in regex;
marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at
/usr/sbin/pam_getenv line 78.
Unescaped left brace in regex is deprecated, passed through in regex;
marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at
/usr/sbin/pam_getenv line 78.
Unescaped left brace in regex is deprecated, passed through in regex;
marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at
/usr/sbin/pam_getenv line 78.
Unescaped left brace in regex is deprecated, passed through in regex;
marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at
/usr/sbin/pam_getenv line 78.
Unescaped left brace in regex is deprecated, passed through in regex;
marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at
/usr/sbin/pam_getenv line 78.
Unescaped left brace in regex is deprecated, passed through in regex;
marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at
/usr/sbin/pam_getenv line 78.
Unescaped left brace in regex is deprecated, passed through in regex;
marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at
/usr/sbin/pam_getenv line 78.
Unescaped left brace in regex is deprecated, passed through in regex;
marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at
/usr/sbin/pam_getenv line 78.
Unescaped left brace in regex is deprecated, passed through in regex;
marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at
/usr/sbin/pam_getenv line 78.
Unescaped left brace in regex is deprecated, passed through in regex;
marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at
/usr/sbin/pam_getenv line 78.
Unescaped left brace in regex is deprecated, passed through in regex;
marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at
/usr/sbin/pam_getenv line 78.
Unescaped left brace in regex is deprecated, passed through in regex;
marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at
/usr/sbin/pam_getenv line 78.
Unescaped left brace in regex is deprecated, passed through in regex;
marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at
/usr/sbin/pam_getenv line 78.
Unescaped left brace in regex is deprecated, passed through in regex;
marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at
/usr/sbin/pam_getenv line 78.
Configuring already existing cluster (configuration:
/etc/postgresql/11/main, data: /var/lib/postgresql/11/main, owner:
112:118)
Error: move_conffile: required configuration file
/var/lib/postgresql/11/main/postgresql.conf does not exist
Error: could not create default cluster. Please create it manually with

pg_createcluster 11 main --start

----
all installation happen via
deb http://apt.postgresql.org/pub/repos/apt/ xenial-pgdg main 11

this has been really painful to debug, coz i do not know how randomly
we get these errors and sometimes not.

Regards,
Vijay

--
Adrian Klaver
adrian.klaver@aklaver.com

Vijaykumar Jain <vjain@opentable.com> writes:

I do not know if this list is also for asking ubuntu package related queries.

Not really; you'd be better off filing a bug with ubuntu where their
packager(s) will see it.

The symptoms you describe definitely look like there is something
wrong with a packager-supplied configuration adjustment script.
More than that is hard to say without familiarity with the ubuntu
postgres packages, which I lack.

regards, tom lane

uname -a
Linux <hostname> 4.4.0-116-generic #140-Ubuntu SMP Mon Feb 12 21:23:04
UTC 2018 x86_64 x86_64 x86_64 GNU/Linux

lsb_release -a
Distributor ID: Ubuntu
Description: Ubuntu 16.04.4 LTS
Release: 16.04
Codename: xenial

no, these fresh installations. existing installations do not have issues.
we have customization, but at the core, this is the part which is
installing the package.
https://github.com/puppetlabs/puppetlabs-postgresql/blob/master/manifests/server/install.pp
(the puppet module version being 4.9.0 though)

now this never happens in my vagrant (I am from india) and all my runs
are clean.
this happens when we run installations on US machines, but coz this is
not reproducible, i do not know if this is package issue or something
else.

also i tried to check if there are issues with apt database etc, but
none of the other packages show errors in installation but this.

from /var/lib/dpkg/status, both package show as installed ok.

Package: postgresql-common
Status: install ok installed
Priority: optional
Section: database
Installed-Size: 627
Maintainer: Debian PostgreSQL Maintainers <team+postgresql@tracker.debian.org>
Architecture: all
Multi-Arch: foreign
Version: 199.pgdg16.04+1
Depends: adduser, debconf (>= 0.5.00) | debconf-2.0, lsb-base (>=
3.0-3), postgresql-client-common (= 199.pgdg16.04+1), procps, ssl-cert
(>= 1.0.11), ucf, init-system-helpers (>= 1.18~)
Recommends: e2fsprogs, logrotate
Suggests: libjson-perl
Breaks: postgresql-9.1 (<< 9.1.1-3~), systemd (<< 204)
Conflicts: postgresql-7.4, postgresql-8.0
Conffiles:
/etc/apt/apt.conf.d/01autoremove-postgresql ce792928ef7a41f68842bb9380ddcc48
/etc/init.d/postgresql 1b9da643d7a403248d70e1776fb98458
/etc/logrotate.d/postgresql-common 101326ef5d138998692ece35109ef1a2
/etc/sysctl.d/30-postgresql-shm.conf 9453b06c646f9033eada574154c31a9d
Description: PostgreSQL database-cluster manager
The postgresql-common package provides a structure under which
multiple versions of PostgreSQL may be installed and/or multiple
clusters maintained at one time.
.
The commands provided are pg_conftool, pg_createcluster, pg_ctlcluster,
pg_dropcluster, pg_lsclusters, pg_renamecluster, pg_upgradecluster,
pg_virtualenv.
.
PostgreSQL is a fully featured object-relational database management
system. It supports a large part of the SQL standard and is designed
to be extensible by users in many aspects. Its features include ACID
transactions, foreign keys, views, sequences, subqueries, triggers,
outer joins, multiversion concurrency control, and user-defined types
and functions.

Package: postgresql-11
Status: install ok installed
Priority: optional
Section: database
Installed-Size: 43901
Maintainer: Debian PostgreSQL Maintainers <team+postgresql@tracker.debian.org>
Architecture: amd64
Version: 11.2-1.pgdg16.04+1
Provides: postgresql-contrib-11
Depends: locales | locales-all, postgresql-client-11,
postgresql-common (>= 194~), ssl-cert, tzdata, debconf (>= 0.5) |
debconf-2.0, libc6 (>= 2.17), libgcc1 (>= 1:3.0), libgssapi-krb5-2 (>=
1.8+dfsg), libicu55 (>= 55.1-1~), libldap-2.4-2 (>= 2.4.7), libllvm6.0
(>= 1:6.0~svn298832-1~), libpam0g (>= 0.99.7.1), libpq5 (>= 9.3~),
libselinux1 (>= 2.1.12), libssl1.0.0 (>= 1.0.2~beta3), libstdc++6 (>=
5.2), libsystemd0, libuuid1 (>= 2.16), libxml2 (>= 2.7.4), libxslt1.1
(>= 1.1.25), zlib1g (>= 1:1.1.4)
Recommends: sysstat
Breaks: postgresql-11-citus (<< 8.0.0.PGDG-2~), postgresql-11-cron (<<
1.1.3-2~), postgresql-11-pgextwlist (<< 1.8-2~),
postgresql-11-pglogical (<< 2.2.1-4~), postgresql-11-plsh (<<
1.20171014-3~), postgresql-11-rum (<< 1.3.2-4~),
postgresql-11-wal2json (<< 1.0-5~)
Description: object-relational SQL database, version 11 server
PostgreSQL is a powerful, open source object-relational database
system. It is fully ACID compliant, has full support for foreign
keys, joins, views, triggers, and stored procedures (in multiple
languages). It includes most SQL:2008 data types, including INTEGER,
NUMERIC, BOOLEAN, CHAR, VARCHAR, DATE, INTERVAL, and TIMESTAMP. It
also supports storage of binary large objects, including pictures,
sounds, or video. It has native programming interfaces for C/C++,
Java, .Net, Perl, Python, Ruby, Tcl, ODBC, among others, and
exceptional documentation.
.
This package provides the database server for PostgreSQL 11.
Homepage: http://www.postgresql.org/
Postgresql-Catversion: 201809051

let me know if you need more info.

Regards,
Vijay

Thanks Tom,

I probably thought it was not the right forum, but thanks for being
polite and saying no.
I just wanted to take a chance if this was known to anyone, coz
googling did not show recent issues with the same.
But ok, I'll ask in ubuntu forums.

Regards,
Vijay

On 3/18/19 7:49 AM, Vijaykumar Jain wrote:

Thanks Tom,

I probably thought it was not the right forum, but thanks for being
polite and saying no.

Given that you are using the PGDG packages I would consider this the
correct list.

I just wanted to take a chance if this was known to anyone, coz
googling did not show recent issues with the same.
But ok, I'll ask in ubuntu forums.

I would start closer to the package you are actually working with:

https://redmine.postgresql.org/projects/pgapt

You will need to set up a Postgres community account, if you do not
already have one, to access the issue tracker.

Regards,
Vijay

On Mon, Mar 18, 2019 at 8:15 PM Tom Lane <tgl@sss.pgh.pa.us> wrote:

Vijaykumar Jain <vjain@opentable.com> writes:

I do not know if this list is also for asking ubuntu package related queries.

Not really; you'd be better off filing a bug with ubuntu where their
packager(s) will see it.

The symptoms you describe definitely look like there is something
wrong with a packager-supplied configuration adjustment script.
More than that is hard to say without familiarity with the ubuntu
postgres packages, which I lack.

regards, tom lane

--
Adrian Klaver
adrian.klaver@aklaver.com