how to access a log file and a bad file?
Hi,
I have a ETL process that runs on weekly basis which read data froma flat file to an external table.In this process i have defined log file and bad file too, to keep a track of the data transformation. But as i am using all this for the 1st time....I dont know how to later use the .bad and .log file to compare data with the actual database ,
i got this solution like this ...
Unless there's something I don't see, here it is: after data gets loaded, first check the LOG file. In there you'll see whether all records are successfully loaded or not.
After that i got the status of the records so next ho can i proceed to rollback .
Means my senario is like this
Supose
A file has 1000 records that has to be uploaded into a table. After uploading 700 records, process breakdown, now ODI needs to re start upload from the breaking point i.e. upload should start from 701th record.
So what is the good Solution for this .
Thanks
Raghava
Two solutions.
1. commit each row as it is processed... then you can just "skip" the **** data and move on... BUT, this may necessitate manual rollback, to deal with any "and new we're completely screwed" exceptions... which is no bid deal on ONE table (as long as there's no cascading deletes).
2. try { all transactions } catch (offending row) { delete offending row; goto 2 }
I've done this both ways... they're about equally bad... the choice between them really depends on your requirements, and only you really know them.
Hope that helps some.
Keith.
Thanks for u r Reply
But we are using with Tool ,i put auto commit,
run time how it possible .
if souposes power will lose then after we can start from 701 right
othere wise total proceudre takes more time .
using with sql loader , is there any chance to put the check points..
Hi First Solution not suit for my scinario, because i am using ETL ODI Tool,i am just auto commit , this will happen at runtime .Second Solution is i did,'t under stand that procedure,so can u give me the steps
