Design And Development Of The Image Data Middle Platform

This article first explains the concept of data middle platform.As a hot concept emerging in the big data industry,it is difficult to make a widely accepted definition of data middle platform.In the article,I elaborated on the development history,hierarchical structure and value of the business in the data middle platform,and gave a definition in the practical sense.The so-called data center,that is,to achieve data layering and horizontal decoupling,precipitation of public data capabilities,through data modeling to achieve cross-domain data integration and knowledge precipitation,through data services to achieve the encapsulation and opening of data,quickly and flexibly meet The requirements of upper-layer applications meet the needs of personalized data and applications through data development tools.Then,I explained the overall business process of the system and the design of the data warehouse.In order to clean the presentation data structure,reduce duplication of development,and facilitate management and maintenance,a hierarchical model of the data warehouse is essential.Each database level has an independent theme,corresponding to a macro analysis area.It can be refined into multiple theme tables for specific decision needs,specifically to determine the scope of the decision and the problems to be solved.As enterprises grow larger and larger,clear data tiers are also conducive to the allocation of permissions for different developers,and different sensitive maintenance strategies are adopted for databases at different tiers.Finally,I elaborated on the detailed architecture of the system as well as the contents and scheduling methods of each module.The entire mezzanine system is functionally divided into a data collection module,a data registration module,a data labeling module,an index generation module and a report generation module.Each module is connected linearly in the data path or can be independently called as a service.Thus a data middle platform system formed eventually.At present,the system has been put into use,has collected more than 100 images and the structured storage and preliminary data analysis,including more than 2000 brands distributed in four cities such as milan,Paris show pictures,an incremental updates every six months,half a year and 1000 sets a blogger published images of incremental updating every day.