ETL tool to replace custom shell scripts
Hello, Our current production database is in Informix 9.4. We also have a data warehouse in Informix 9.4 that pulls data from the production box using custom shell scripts. I'm sure we can do more to increase the performance of our scripts but are there any good ETL tools that work well in an Informix environment that could eventually replace the scripts? I'm thinking that just about any tool would be easier to maintain than our current setup but is there any particular tool that would outperfrom scripts? We will likely be moving to v11.7 in the next year or two and we also will likely begin pulling data in from sources outside of Informix (namely Msft SQL Server). Thanks Don
Check out IBM Data Studio. Art On Sep 7, 2012 5:53 PM, "DON CHADWICK" <d.l.chadwick@gmail.com> wrote: > Hello, > Our current production database is in Informix 9.4. We also have a data > warehouse in Informix 9.4 that pulls data from the production box using > custom > shell scripts. I'm sure we can do more to increase the performance of our > scripts but are there any good ETL tools that work well in an Informix > environment that could eventually replace the scripts? I'm thinking that > just > about any tool would be easier to maintain than our current setup but is > there > any particular tool that would outperfrom scripts? We will likely be > moving to > v11.7 in the next year or two and we also will likely begin pulling data in > from sources outside of Informix (namely Msft SQL Server). > Thanks > Don > > > > ******************************************************************************* > Forum Note: Use "Reply" to post a response in the discussion forum. > > --14dae9341119b486ed04c9242cbf
Typically common ETL tools are considered expensive... The clear advantage is manageability and ability to access multiple heterogeneous data sources. Performance in ETL tools is a tricky issue. People tend to do mistakes and at some point a DBA says "I can do that quickly with a database script". The most common problem is that people tend to ignore the impacts of data movement and repeatable (millions) of single row lookups. Having said all this, IBM has Infosphere Information Server (datastage) and some Informix editions include SQL Warehouse. Regards On Sep 7, 2012 10:53 PM, "DON CHADWICK" <d.l.chadwick@gmail.com> wrote: > Hello, > Our current production database is in Informix 9.4. We also have a data > warehouse in Informix 9.4 that pulls data from the production box using > custom > shell scripts. I'm sure we can do more to increase the performance of our > scripts but are there any good ETL tools that work well in an Informix > environment that could eventually replace the scripts? I'm thinking that > just > about any tool would be easier to maintain than our current setup but is > there > any particular tool that would outperfrom scripts? We will likely be > moving to > v11.7 in the next year or two and we also will likely begin pulling data in > from sources outside of Informix (namely Msft SQL Server). > Thanks > Don > > > > ******************************************************************************* > Forum Note: Use "Reply" to post a response in the discussion forum. > > --20cf3074b386b69fd104c92c0b5c
On 07/09/12 22:52, DON CHADWICK wrote: > Hello, > Our current production database is in Informix 9.4. We also have a data > warehouse in Informix 9.4 that pulls data from the production box using custom > shell scripts. I'm sure we can do more to increase the performance of our > scripts but are there any good ETL tools that work well in an Informix > environment that could eventually replace the scripts? I'm thinking that just > about any tool would be easier to maintain than our current setup but is there > any particular tool that would outperfrom scripts? We will likely be moving to > v11.7 in the next year or two and we also will likely begin pulling data in > from sources outside of Informix (namely Msft SQL Server). > Thanks > Don My SQSL scripting language can natively pull in a scripted way data from one database connection (Informix, DB2 and Solid are supported) and push it to another. Check it out at http://www.4glworks.com/sqsl.htm -- Ciao, Marco ______________________________________________________________________________ Marco Greco /UK /IBM Standard disclaimers apply! Structured Query Scripting Language http://www.4glworks.com/sqsl.htm 4glworks http://www.4glworks.com Informix on Linux http://www.4glworks.com/ifmxlinux.htm
Have a look at Pentaho Data Integration<http://www.pentaho.com/explore/pentaho-data-integration/>- part of the Open Source Pentaho BI suite, I implemented it successfully at a few clients and found the JDBC connectors to work fine with a wide range of DBMS including the ones mentioned by you. Your mileage may vary as far as speed is concerned. Regards On 7 September 2012 23:52, DON CHADWICK <d.l.chadwick@gmail.com> wrote: > Hello, > Our current production database is in Informix 9.4. We also have a data > warehouse in Informix 9.4 that pulls data from the production box using > custom > shell scripts. I'm sure we can do more to increase the performance of our > scripts but are there any good ETL tools that work well in an Informix > environment that could eventually replace the scripts? I'm thinking that > just > about any tool would be easier to maintain than our current setup but is > there > any particular tool that would outperfrom scripts? We will likely be > moving to > v11.7 in the next year or two and we also will likely begin pulling data in > from sources outside of Informix (namely Msft SQL Server). > Thanks > Don > > > > ******************************************************************************* > Forum Note: Use "Reply" to post a response in the discussion forum. > > -- Skip +264-81-124-2345 --f46d0444eebb26756a04c953294a