...
After creating this new script we test it. It still gives more time than flat files. We scan this code and find many blockings present in this code i.e database write operation blocking. We remove these blockings by processing each line and store results in hash keys instead of inserting in to tables and when all results of one day data is calculated the at last all results are inserted into tables. This step removes the blocking of database write operation that took place for every processed line. By this we also achieved speed and database performs better than flat-files.
For achieving more performance