Unit 1
Unit 1
There are three levels to the diagram: (1) data sources, (2) data integration, and (3) knowledge discovery
and information access.
Data sources
Data sources refer to the broad variety of sources that may now be available to build enterprise solutions.
Data integration
The data integration layer allows data from different formats to be put together in a manner that can be
used by the information access and knowledge discovery tools.
Staged Data
Staged data is data that has been abstracted to manage the rate at which it is received by the
analysis platform. Essentially, “staged data” allows the correct flow of data to reach information
access and knowledge discovery tools to be retrieved at the correct time.
Strong Type Data
Strong type data refers to data that is stored in traditional database formats, i.e. it can be
extracted into tabular format and can be subjected to traditional database analysis techniques.
Weak Type Data:
Weak type data is data that is not well structured according to traditional database techniques.
Examples are streaming data or data from sensors.
Often, this sort of data has a different analysis technique compared to strong type data
Processed data
Processed data is combined data from both strong and weak typed data that has been combined within an
IoT context to create maximum value for the enterprise in question.
There are various means by which to do this processing from stripping data separately and creating
relational tables from it or pooling relevant data together in one combined database for structured queries.
Retrieval layer
Once data has been collated and processed, it is time to develop insights from the data via retrieval. This
can be of two main forms: Information Access and Knowledge Discovery.
Information access tools
Information access relates to more traditional access techniques involving the creation of
standardized reports from the collation of strong and weak typed data.
Information access essentially involves displaying the data in a form that is easily understandable
and readable by end users.
Knowledge discovery tools
Knowledge Discovery, meanwhile, involves the more detailed use of ICT in order to create knowledge,
rather than just information, from the data in question.
Knowledge Discovery means that decisions may be able to be taken on such outputs for example, in
the case where actuators (rather than just sensors) are involves, Knowledge Discovery Systems may
be able to raise an alert that a bridge or flood control system may need to be activated.