Design And Implementation Of Process Quality Analysis System Based On Big Data

Quality management and control are important means for enterprises to realize the precautionary principle and maintain production stability.The traditional process quality analysis system is mainly based on excel calculation method and small quality analysis calculation system,and its calculation ability is limited.With the expansion of the business scale of the company's equipment department and the improvement of the actual production capacity of the factory,related industrial equipment data has seen an explosive growth,with an average of tens of billions of data access every day.When the traditional process quality analysis system processes such a huge amount of data,a series of related problems such as long processing time,data duplication,and data loss have appeared in the links of collection,processing,and storage.In order to better process industrial data and meet the new system requirements of users,the development of a new process quality analysis system based on big data has been established.The author participated in all stages of system development during the project development process.In the demand analysis,through the analysis of user needs and actual application scenarios,the system is divided into big data processing module,CPK online calculation module,CPK timing calculation module,GRR calculation module and result display module.In the overall design,the overall system architecture and related database table structure were designed according to the demand analysis,and the overall system architecture diagram and database entity connection diagram were drawn.In the detailed design,for the big data processing module,Kafka,Flink,Clickhouse big data processing and storage technology are used to process the data to ensure data security.For the CPK calculation module and GRR calculation module,the algorithm selection and algorithm optimization of the CPK algorithm and GRR algorithm used therein are carried out to ensure the calculation performance of the system.In the system test,the author wrote the corresponding test cases according to the requirements and objectives to ensure the quality of the system.At present,the process quality analysis system based on big data has been successfully launched,and user feedback is good.The total number of calculations has exceeded 10,000,and the calculation success rate can reach more than 95%.The results achieved have exceeded expectations.