Speed of Importing Data

denisv · Post by **denisv** » Wed Sep 06, 2006 6:50 am

We are having a lot of issues importing data.

We have several BO's and there are relationships. We have ordered the import to take account of this and that seems fine. We do not use validation.

A single BO with 195,000 records, one field no reference items takes up to 10 minutes to import. That in itself is not a problem.

Another BO, has 3 required referenced attributes and one possible.

With the data for the first 3 already in the system, we ignore any value for the 'possible', an import of 4300 records takes about 15 minutes. This accurately extarploates to about 11 hours. There is then a further two business objects with between 60000 and 90000 and makes completing the import very difficult.

You indicated managing to import 500,000 recs in 10 mins. Do our figures look correct ? Is it the case that your import has no reference items etc ?

aware_support · Post by **aware_support** » Wed Sep 06, 2006 7:18 am

Yes, our test harness does not have references.

Import without references and without validation is very fast. References make it a lot slower because for every reference in every record Aware IM has to look for the referred instance. If there is a considerable number of referred instances this may take a while. Indexation of attributes on referred instances may help.