关系型数据库的数据采集(Data collection of relational database)

问题: 生产过程数据主要存放在MES系统中,例如订单的最新生产情况,产量数据,问题Lot情况等。对于大数据分析,业务部门希望可以基于及时的数据进行分析展示。

但是MES系统的数据不仅包含仅有insert的历史数据表,同时有很多包含Insert/Update/Delete的事务表。如何将这些数据加载到大数据平台?

方案一:

方案二:

————————

Problem: the production process data is mainly stored in the MES system, such as the latest production status of the order, output data, lot status, etc. For big data analysis, the business department hopes to analyze and display based on timely data.

However, the data of MES system includes not only the historical data table with insert only, but also many transaction tables with insert / update / delete. How to load these data into the big data platform?

Scheme I:

Scheme II: