According to avaradha, NCED collections which were published earlier to SDA were very hard to query and retried as there were thousands of small files stored under each directory. We have to think about a way to solve this issue. Currently looking at taring files or storing a limited number of files under a directory.