Thoughts on historicisation with this product

Historicisation is ancient history, really. I started with data-warehousing in 2001 and back then it was ancient history (no pun meant, would be lame anyway). No rocket science at all. Still it is a major topic in my daily life to date. I am very astonished no database has take on this topic so far, well no that I know of. I did not research just my own experience with Oracle, DB2 LUW and PostgreSQL. As a hobby, I implement such a framework for PostgreSQL (pre-alpha so far). Back to datastage. DataStage does provide at least two stage sets to tackle this but far from being a DS hotshot or even seasoned DS developer, I could not make to get run those Change Capture/Apply and Slowly Changing Dimension stage setup properly.

Kommentare

Kommentar veröffentlichen

Beliebte Posts aus diesem Blog

Error when checking operator: Could not find input field 'field_name'

Well, you checked and double-checked the existence of respective field and it is there! Yeah, stumbled over it again. And again! Possible solutions You need to compile jobs explicitly. You're done then. Try it. Go! What are you waiting for? If you are really extra sure compiled the job, then double-check the presence of the respective field again, but not in the stage DS tells you but in the very source at the start of the dataflow where this field comes from. It happens that if the column name of your SQL is not identical to the field name propagated. I do absolutely not know why: compilation does not reveal the problem DataStage misses the correct problem location by far
Mehr anzeigen

Missing record delimiter "\n", saw EOF instead

Actually, this warning is quite simple to fix. Apparently, DS expects the last record of a file to terminate with the record delimiter in any case - maybe there is a setting to alter this behaviour but I did not deem worthwhile the effort to look for it. So the solution is just to terminate the file on a single empty line. Obviously, this case is for Unix like line breaks. The others delimiters are handled analogously.
Mehr anzeigen