Design And Implementation Of Massive Throughput Data Read And Storage Module In Embedded System

Reading and writing data on the disk are facing all kinds of problems every moment.In addition to the requirements of the stability and accuracy of reading and writing data,now on many occasions, the treatment of sudden failure on fast reading and writingscheduling, which appeared easily, and their process of massive data make new challengesto modern data information management. Only combined the process of reading andwriting data rapidly, stable, accurately and timely processing problems and many otherrequirements can make each product get to a new level. Therefore, with these higherdemands on reading and writing data I researched for massive throughput data read andstorage in embedded system.In order to be able to achieve the company’s goal better, which is the new generationof the surveillance equipment to process and compress images, and then get the datastored to the specified disk, and read the data on disk we need. I researched and developedthis program that scheduling reading and writing data based on embedded Linux system.With the cutting Linux system support, the whole program is made up by writing data,finding and reading data of the disk and disk management, with using these three modulestogether to make the scheduling of reading and writing data rapidly and stable. There areseveral difficulties in reading and writing data, such as how to process packed data fromFPGA and then put the data into specific hard disk efficiently; another problem is how todeal with the error in reading and writing data. Therefore in reading and writing moduledesign I used the sharing memory to improve efficiency, and disk management modules ismainly used for logging reading and writing data, and it can provide reliable logginginformation while there are mistakes, so as to fix the mistakes and recover the data timelyand efficiently. And at the same time logging information also can be provided for user ininquiry related data as key words.When the software is completed after a period of time, it had several tests, in theactual operation we can see that the program can deal with the large amount of dataquickly and accurately, and it also can move these data into hard disk effectively; at thesame time it can provide finding and reading data which the customer needs conveniently. But there are still some loopholes in handling errors, sometimes mistakes are unable todeal with, so the stability of the entire program needs to improve.