Share my experience and Thank you !

Started by JingYuan Chenalmost 10 years ago5 messagesgeneral
Jump to latest
#1JingYuan Chen
phil.cyc@gmail.com

Hello,

I want to share my experience about one of my projects and say thank you to
the community.

Scenario :
My company's ERP system is SAP and rent a procurement system for bid. It's
architecture bases on Webshpere5 and Oracle and IBM Java 1.4. The provider
informed us that they decide to close this bid platform on 2016/03/31 about
3 month ago.

The good news is that they can give us the complete source code. But we
don't have Webshpere and another Oracle License for this system.
Fortunately, I found that there is a PostgreSQL wiki site providing useful
information about tools and migration tips. After doing some analysis, I
decide to use Jetty 9 and PostgreSQL 9.1 and Oracle Java 1.7 to replace
them. Transferring data is another problem. I decide to use Pentaho Data
Integration tool. It is an ETL tool. I can learn about the status of
transferring until the job was done. It helps me to keep the consistency of
data in Oracle and PostgreSQL.

After modifying many SQL commands to be suitable for PostgreSQL and
setting web.xml for Jetty, our procurement system can be active
successfully without Webshpere and Oracle. However, its performance is
poorly. I found that there are two problems to result in this situation.
One is that JVM will crash accidentally. The other is that sometimes JDBC
could not connect to PostgreSQL.

Fortunately, Jetty is flexible and Java's garbage collection log provides
useful information. I can tune JVM with different parameters while
initiating Jetty. The last problem is JDBC. It use DBCP 1.3 as default to
connect database. According to our new architecture, I replace DBCP with
PGConnectionPoolDataSource.

Now our system is running smoothly with this kind of architecture. I also
use some PERL scripts to transfer data and JCO RFC to perform SAP's
transaction.

Thank You All !

Regards,

Chingyuan

#2Arthur Silva
arthurprs@gmail.com
In reply to: JingYuan Chen (#1)
Re: Share my experience and Thank you !

Any specific reason for choosing this old version of postgres?
On May 13, 2016 8:46 AM, "JingYuan Chen" <phil.cyc@gmail.com> wrote:

Show quoted text

Hello,

I want to share my experience about one of my projects and say thank you
to the community.

Scenario :
My company's ERP system is SAP and rent a procurement system for bid. It's
architecture bases on Webshpere5 and Oracle and IBM Java 1.4. The provider
informed us that they decide to close this bid platform on 2016/03/31 about
3 month ago.

The good news is that they can give us the complete source code. But we
don't have Webshpere and another Oracle License for this system.
Fortunately, I found that there is a PostgreSQL wiki site providing useful
information about tools and migration tips. After doing some analysis, I
decide to use Jetty 9 and PostgreSQL 9.1 and Oracle Java 1.7 to replace
them. Transferring data is another problem. I decide to use Pentaho Data
Integration tool. It is an ETL tool. I can learn about the status of
transferring until the job was done. It helps me to keep the consistency of
data in Oracle and PostgreSQL.

After modifying many SQL commands to be suitable for PostgreSQL and
setting web.xml for Jetty, our procurement system can be active
successfully without Webshpere and Oracle. However, its performance is
poorly. I found that there are two problems to result in this situation.
One is that JVM will crash accidentally. The other is that sometimes JDBC
could not connect to PostgreSQL.

Fortunately, Jetty is flexible and Java's garbage collection log provides
useful information. I can tune JVM with different parameters while
initiating Jetty. The last problem is JDBC. It use DBCP 1.3 as default to
connect database. According to our new architecture, I replace DBCP with
PGConnectionPoolDataSource.

Now our system is running smoothly with this kind of architecture. I also
use some PERL scripts to transfer data and JCO RFC to perform SAP's
transaction.

Thank You All !

Regards,

Chingyuan

#3JingYuan Chen
phil.cyc@gmail.com
In reply to: JingYuan Chen (#1)
Re: Share my experience and Thank you !

I use Debian Wheezy and PostgreSQL 9.1 is the default package.

On Fri, May 13, 2016 at 3:13 PM, JingYuan Chen <phil.cyc@gmail.com> wrote:

Show quoted text

I use Debian Wheezy and PostgreSQL 9.1 is the default package.

On Fri, May 13, 2016 at 3:06 PM, Arthur Silva <arthurprs@gmail.com> wrote:

Any specific reason for choosing this old version of postgres?
On May 13, 2016 8:46 AM, "JingYuan Chen" <phil.cyc@gmail.com> wrote:

Hello,

I want to share my experience about one of my projects and say thank you
to the community.

Scenario :
My company's ERP system is SAP and rent a procurement system for bid.
It's architecture bases on Webshpere5 and Oracle and IBM Java 1.4. The
provider informed us that they decide to close this bid platform on
2016/03/31 about 3 month ago.

The good news is that they can give us the complete source code. But we
don't have Webshpere and another Oracle License for this system.
Fortunately, I found that there is a PostgreSQL wiki site providing useful
information about tools and migration tips. After doing some analysis, I
decide to use Jetty 9 and PostgreSQL 9.1 and Oracle Java 1.7 to replace
them. Transferring data is another problem. I decide to use Pentaho Data
Integration tool. It is an ETL tool. I can learn about the status of
transferring until the job was done. It helps me to keep the consistency of
data in Oracle and PostgreSQL.

After modifying many SQL commands to be suitable for PostgreSQL and
setting web.xml for Jetty, our procurement system can be active
successfully without Webshpere and Oracle. However, its performance is
poorly. I found that there are two problems to result in this situation.
One is that JVM will crash accidentally. The other is that sometimes JDBC
could not connect to PostgreSQL.

Fortunately, Jetty is flexible and Java's garbage collection log
provides useful information. I can tune JVM with different parameters while
initiating Jetty. The last problem is JDBC. It use DBCP 1.3 as default to
connect database. According to our new architecture, I replace DBCP with
PGConnectionPoolDataSource.

Now our system is running smoothly with this kind of architecture. I
also use some PERL scripts to transfer data and JCO RFC to perform SAP's
transaction.

Thank You All !

Regards,

Chingyuan

#4Pierre Chevalier Géologue
pierrechevaliergeol@free.fr
In reply to: JingYuan Chen (#3)
Re: Share my experience and Thank you !

Hello,

I think that you can safely add the PostgreSQL repository to your system, so that you can get the latest packages for your Debian.

See there how to do it:
https://wiki.postgresql.org/wiki/Apt

Regards,
Pierre

Le 13 mai 2016 09:14:28 GMT+02:00, JingYuan Chen <phil.cyc@gmail.com> a écrit :

I use Debian Wheezy and PostgreSQL 9.1 is the default package.

On Fri, May 13, 2016 at 3:13 PM, JingYuan Chen <phil.cyc@gmail.com>
wrote:

I use Debian Wheezy and PostgreSQL 9.1 is the default package.

On Fri, May 13, 2016 at 3:06 PM, Arthur Silva <arthurprs@gmail.com>

wrote:

Any specific reason for choosing this old version of postgres?
On May 13, 2016 8:46 AM, "JingYuan Chen" <phil.cyc@gmail.com> wrote:

Hello,

I want to share my experience about one of my projects and say

thank you

to the community.

Scenario :
My company's ERP system is SAP and rent a procurement system for

bid.

It's architecture bases on Webshpere5 and Oracle and IBM Java 1.4.

The

provider informed us that they decide to close this bid platform on
2016/03/31 about 3 month ago.

The good news is that they can give us the complete source code.

But we

don't have Webshpere and another Oracle License for this system.
Fortunately, I found that there is a PostgreSQL wiki site providing

useful

information about tools and migration tips. After doing some

analysis, I

decide to use Jetty 9 and PostgreSQL 9.1 and Oracle Java 1.7 to

replace

them. Transferring data is another problem. I decide to use Pentaho

Data

Integration tool. It is an ETL tool. I can learn about the status

of

transferring until the job was done. It helps me to keep the

consistency of

data in Oracle and PostgreSQL.

After modifying many SQL commands to be suitable for PostgreSQL and
setting web.xml for Jetty, our procurement system can be active
successfully without Webshpere and Oracle. However, its performance

is

poorly. I found that there are two problems to result in this

situation.

One is that JVM will crash accidentally. The other is that

sometimes JDBC

could not connect to PostgreSQL.

Fortunately, Jetty is flexible and Java's garbage collection log
provides useful information. I can tune JVM with different

parameters while

initiating Jetty. The last problem is JDBC. It use DBCP 1.3 as

default to

connect database. According to our new architecture, I replace DBCP

with

PGConnectionPoolDataSource.

Now our system is running smoothly with this kind of architecture.

I

also use some PERL scripts to transfer data and JCO RFC to perform

SAP's

transaction.

Thank You All !

Regards,

Chingyuan

--
Envoyé de mon appareil Android avec K-9 Mail. Veuillez excuser ma brièveté.

#5Allan Harvey
allan.harvey@onesteel.com
In reply to: JingYuan Chen (#1)
Re: Share my experience and Thank you !

Chingyuan,

I also use some PERL scripts to transfer data and JCO RFC to perform SAP's transaction.

FYI. We also "mate" Postgres with SAP.

Our transactions are exposed on the SAP system via a SOAP interface ( some "switches" your SAP people need to throw ).

Tested and developed with bash scripts and cURL the executable to get the headers etc correct, then our own C executable using cURL as a library, then wrapped Postgres C function call around our C code to have Postgres function.

SAP transactions are fully integrated into the "SQL" of the system.

Allan

Arrium Limited and associated entities are currently in Voluntary Administration. A list of all associated entities in Voluntary Administration may be obtained from: "http://www.arrium.com/~/media/Arrium Mining and Materials/Files/Corporate documents/Arrium Administration_Groups List.pdf". The material contained in this email is confidential and may be subject to legal privilege and/or copyright. Please do not re-transmit, distribute, copy or commercialise any of the material in this message unless you are authorised to do so. If you are not the intended recipient, use, disclosure or copying of this information is prohibited. If you have received this document in error, please advise the sender and delete the document. None of Arrium Limited, its related bodies corporate or the sender accept responsibility for any viruses contained in this email or any attachments. All and any rights as to confidentiality, legal professional privilege and copyright are expressly reserved.