Ha! excellent! I get standardised reports from a well known search company beginning with G... they used to send one CSV file, with around 1.5m rows, apparently they got so many people messing up the reports they now break them up into smaller files, but to be extreme have decided that the right number to break it up into is 251 files, which seems a little bit odd to me, but oh well Batch append works..
I take great glee in putting massive data processing costs into every project, costs go something like
We speak to your suppliers and source data directly: £x
We speak to your systems team and work through them: £1.2x
We work with your marketing team to get the data: £5x
Ha! excellent! I get standardised reports from a well known search company beginning with G... they used to send one CSV file, with around 1.5m rows, apparently they got so many people messing up the reports they now break them up into smaller files, but to be extreme have decided that the right number to break it up into is 251 files, which seems a little bit odd to me, but oh well Batch append works..