Book Chapter 9 Inferential Modeling and Soft Sensors
Book Chapter 9 Inferential Modeling and Soft Sensors
Soft Sensors
Muhammad Asad Ullah Khalid
School of Mechanical Engineering, Chung-Ang University,
Seoul, South Korea
Shahid Aziz
Jeju National University, South Korea
Data should be correctly categorized into different classes after collection based on
the information required so that feature identification is easy. Data contamination is
a serious concern, affecting the model’s performance, and the soft sensor model’s
reliability is compromised. This suggests that the data pretreatment is important
before passing it to a model structure. The data pretreatment might involve nor
malization, filtration, etc. The characteristics of process data have been discussed by
Ghosh et al. (2020) include problems like missing data, data outliers, and data
collinearity and how to deal with them. They are also briefly discussed here to
provide a complete understanding of the concepts. The typical process flow for soft
sensor modeling is given in Figure 9.1.
Before reviewing the data characteristics, let’s look at the flow diagram of soft
sensor-integrated process monitoring and control shown in Figure 9.2. The diagram
shows that the soft sensor depends on a hardware sensor’s data to determine the
estimated variables. The process generates process variables, which pass through
this soft sensor module comprising a hardware sensor and an estimator. This esti
mator is our soft sensor design model, which estimates new parameters by ana
lyzing the historical process data of the hardware sensor to determine new estimated
variables. These new estimated variables can then be used as process monitoring
parameters as well as control parameters. To keep the consistency of the concepts
being discussed, it is important to mention that the estimator or soft sensor model is
FIGURE 9.2 A flow diagram of a soft sensor integrated process monitoring and control.
Inferential Modeling and Soft Sensors 141
FIGURE 9.3 Images of a front panel and block diagram for LabVIEW-based VIs for
sensor-based measurements in a bioprocess ( Khalid et al., 2022).
concentration of additives and temperature of that fluid (Bispo et al., 2017). The
modeling of ANN-based soft sensors can be found in many research works (“Soft
Sensor Model Based on Improved Elman Neural.Pdf”; Ghosh et al., 2020).
Then this topic will briefly discuss some soft sensors implemented-bioreactors with
a case study.
Bioreactors are engineered spaces to allow safer and controlled bioreactions. To
briefly describe the main purpose of bioreactor designing is to realize perfect
conditions for these bioreactions, which may involve cell culture and micro
organism growth for various applications like the production of biofuels, metabolic
products, biowaste management etc. There are many types of bioreactors depending
on the application, to name a few, they are stirred-tank reactor, bubble reactor,
airlift reactor, loop reactor, reactor with immobilized cells, fluidized reactor with
recycling of cells, solid-phase tray reactor, rotary drum bioreactor as discussed by
Carl (2016). They have discussed the advantages and shortcomings of these bior
eactors’ designs. In this text, only specific sensor-integrated bioreactors will be
discussed. When we talk about key parameters of bioprocess monitoring, they
mostly include some physical and/or chemical environmental parameters, e.g.,
temperature, CO2, and culture media pH. However, biosensors also play a very
important role in determining the state and output of the bioreactor systems. These
biosensors can detect metabolic products, proteins, DNA/RNA structures, or the
microorganisms themselves with very high specificity. For example, a review was
conducted on the usefulness of soft sensing systems in online monitoring of up
stream industrial bioprocess, focusing on the sensing performance and process’
outputs in terms of production economy (Randek & Mandenius, 2018). A basic
overview of the soft sensing requirements and applications in various industrial
bioprocesses, like recombinant protein production and production of baker’s yeast
has been presented. Similarly, different online analytical techniques like near and,
mid-infrared (N/MIR) spectroscopy with high potential for soft sensor development
have been discussed, which can measure several parameters like metabolic prod
ucts’ concentrations or cell numbers. Other discussed techniques include in-situ
microscopy (ISM), fluorescence microscopy, high-performance liquid chromatog
raphy (HPLC), and biosensors. Similarly, they reviewed various upstream biopro
cess monitoring by soft sensors’ examples, followed by suggesting a step-wise soft
sensor development general methodology for this purpose.
FIGURE 9.4 (a) Metabolic heat soft sensor for bioprocess control, and (b) Estimated
metabolic heat, specific growth rate (µmetabol) and biomass concentration (Xmetabol,n) with
passing cultivation time in pre-set feed rate ( Paulsson et al., 2014).
Similarly, further mathematical modeling was done to derive specific growth rate
µmetabol and biomass concentration Xmetabol,n and the feed rate was controlled using a
conventional proportional-integral (PI) controller. Further details can be found in
the original work (Paulsson et al., 2014). Figure 9.4b shows the estimated outputs of
the soft sensing system for uncontrolled fed-batch cultivation. In the end, the soft
sensor’s performance with hardware-based sensor probes and capacitance on-line
sensor, measuring the same parameters, were in high agreement.
Apart from this, many other soft sensors have been developed for bioprocess
monitoring and control applications. A few of them have been presented in
Table 9.1 for a brief review.
Inferential Modeling and Soft Sensors 147
TABLE 9.1
Soft Sensors Developed for Various Bioprocesses’ Monitoring and Control
Soft Sensors Purpose & Parameters Estimated Reference
a. Biomass concentration from an Recombination protein (GFP) Warth et al.,
online NIR probe, production in E. Coli cultivation, 2010
b. Biomass concentration from titrant mainly for
addition, a. Biomass concentration estimation
c. Specific growth rate from titrant b. Estimation of specific growth rates
addition,
d. Specific growth rate from the NIR
probe, and
e. Specific substrate uptake rate and by-
product rate from online HPLC and
NIR probe signals
Feed-forward ANN, support vector, and Biomass and product concentrations Simutis et al.,
relevance vector regression soft sensor 2013
mode based on glucose/lactose feed
rate and oxygen uptake
Biomass soft sensor in Eppendorf Biomass production and biomass Kager et al., 2017
DASbox® Mini Bioreactor System specific nutrient uptake estimation
using the DASware® control software (e.g., substrate uptake rate)
using mass balancing
Multiphase Artificial Neural Network For biomass concentration of Murugan and
(MANN) based dynamic soft sensor Trichoderma estimated from online Natarajan, 2019
having Nonlinear Auto Regressive sensors data like pH, substrate
with eXogenous input (NARX) models concentration and agitation speed.
to capture the complete dynamics of
lag, log, and stationary phases of the
microbe
The end of the growth phase in a Dynamic control of compressor based Alarcon and
thraustochytrid Industry 4.0 (I4.0) on dissolved oxygen (DO) levels Shene, 2021
fermentation process
FIGURE 9.5 A gut bilayer organ on chip for hypoxia bioprocess monitoring: (a) Sensors
(DO, reactive oxygen species, and TEEI) integrated microfluidic biochip expanded view,
(b) Schematic cross-section indicating different components like printed electrochemical
(DO and reactive oxygen species) sensors, TEEI sensor, cell culture area and cell types etc.,
(c) Hypoxia bioprocess schematic, (d) Response of the sensors in real-time for both normoxia
and hypoxia bioprocesses ( Khalid et al., 2022).
Inferential Modeling and Soft Sensors 149
FIGURE 9.6 A lung cancer on chip with integrated sensors for process monitoring and
chemotherapeutic assessment: (a) Schematic representation of the sensor (optical pH sensor,
TEER sensor, and a portable microscope) integrated process, (b) Results of the sensors in
normal process monitoring and response analysis to chemotherapeutic drug Doxorubicin
( Khalid et al., 2020).
FIGURE 9.7 The Hubka-Eder map for smart bioreactor on chip systems.
Handbook of Manufacturing Systems and Design
Inferential Modeling and Soft Sensors 151
9.5 CONCLUSION
Data-driven soft sensor models expand the capabilities of existing hardware sensors
and systems in traditional integrated process monitoring and control applications.
They can estimate the parameters which are not compatible with hardware mea
surement strategies. However, data selection is the most crucial step in modeling soft
sensors. This data should be high-quality and free of noise, disturbances, and mis
information, for which different data treatment strategies are applied. A few infer
ential models have been briefly reviewed in this chapter. And some recent literature
on soft sensors in smart multi-stage manufacturing systems and smart bioreactor
systems has also been discussed, which suggest the more widespread use of soft
sensor models in complex bioprocess monitoring and control with a case study.
Similarly, emerging state-of-the-art bioreactor on-chip systems, which use online
monitoring strategies, were explored with the potential for soft sensor integration to
enhance different biotechnological aspects of these systems. Some conceptual soft
sensor integration frameworks have also been presented in this regard.
REFERENCES
Alarcon, C., Shene, C. 2021. Fermentation 4.0, a Case Study on Computer Vision, Soft
Sensor, Connectivity, and Control Applied to the Fermentation of a Thraustochytrid.
Computers in Industry, 128: 103431.
Asif, A., Park, S. H., Soomro, A. M., Khalid, M. A. U., Salih, A. B. C., Kang, B., Ahmed, F.,
Kim, K. H., Choi, K. H. 2021. Microphysiological System with Continuous Analysis
of Albumin for Hepatotoxicity Modeling and Drug Screening. Journal of Industrial
and Engineering Chemistry, 98: 318–326. doi: 10.1016/j.jiec.2021.03.035
152 Handbook of Manufacturing Systems and Design
Bambach, M., Imran, M., Sizova, I., Buhl, J., Gerster, S., Herty, M. 2021. A Soft Sensor for
Property Control in Multi-Stage Hot Forming Based on a Level Set Formulation of Grain
Size Evolution and Machine Learning. Advances in Industrial and Manufacturing
Engineering, 2: 100041.
Biechele, P., Busse, C., Solle, D., Scheper, T., Reardon, K. 2015. Sensor Systems for
Bioprocess Monitoring. Engineering in Life Sciences, 15(5): 469–488.
Bispo, V. D. da Silva, Scheid, C. M., Calçada, L. A., Meleiro, L. A. C. 2017. Development of
an ANN-Based Soft-Sensor to Estimate the Apparent Viscosity of Water-Based
Drilling Fluids. Journal of Petroleum Science and Engineering, 150: 69–73.
Busse, C., Biechele, P., Vries, I., Reardon, K. F., Solle, D., Scheper, T. 2017. Sensors for
Disposable Bioreactors. Engineering in Life Sciences, 17(8): 940–952.
Caplin, J. D., Granados, N. G., James, M. R., Montazami, R., Hashemi, N. 2015. Microfluidic
Organ-on-a-Chip Technology for Advancement of Drug Development and Toxicology.
Advanced Healthcare Materials, 4(10): 1426–1450.
Carl, F. M. 2016. Bioreactors. Edited by Carl-Fredrik Mandenius. Weinheim, Germany:
Wiley-VCH Verlag GmbH & Co. KGaA.
Chen, K., He, M., Zhang, D. 2009. Sliding-Window Recursive PLS Based Soft Sensing
Model and Its Application to the Quality Control of Rubber Mixing Process.
Communications in Computer and Information Science, 51: 16–24.
Ching, T., Toh, Y. C., Hashimoto, M., Zhang, Y. S. 2021. Bridging the Academia-to-Industry
Gap: Organ-on-a-Chip Platforms for Safety and Toxicology Assessment. Trends in
Pharmacological Sciences, 42(9): 715–728.
Farooqi, H. M. U., Kang, B., Khalid, M. A. U., Salih, A. R. C., Hyun, K., Park, S. H.,
Huh, D., Choi, K. H. 2021. Real-Time Monitoring of Liver Fibrosis through
Embedded Sensors in a Microphysiological System. Nano Convergence, 8(1).
Springer Singapore.
Farsang, B., Balogh, I., Németh, S., Székvölgyi, Z., Abonyi, J. 2015. PCA Based Data
Reconciliation in Soft Sensor Development – Application for Melt Flow Index
Estimation. In Chemical Engineering Transactions, 43: 1555–1560.
Fu, Y., Yang, W., Xu, O., Zhou, L., Wang, J. 2017. Soft Sensor Modelling by Time Difference,
Recursive Partial Least Squares and Adaptive Model Updating. Measurement Science
and Technology, 28(4).
Ghosh, S., Yang, S., Bequette, B. W. 2020. Inferential Modeling and Soft Sensors. In Smart
Manufacturing: Concepts and Methods, 323–351. Elsevier Inc.
Gonzaga, J. C. B., Meleiro, L. A. C., Kiang, C., Filho, R. M. 2009. ANN-Based Soft-Sensor
for Real-Time Process Monitoring and Control of an Industrial Polymerization
Process. Computers and Chemical Engineering, 33(1): 43–49.
Hasnen, S. H., Zabiri, H., Prakash, K. K., Mat, T. T. 2019. Adaptive PLS Inferential Soft
Sensor for Continuous Online Estimation of NOx Emission in Industrial Water-Tube
Boiler. IOP Conference Series: Materials Science and Engineering, 702(1).
Herceg, S., Andrijić, U., Bolf, N. 2021. Support Vector Machine-Based Soft Sensors in the
Isomerisation Process. Chemical and Biochemical Engineering Quarterly, 34(4):
243–255.
Hong, S., An, N., Cho, H., Lim, J., Han, I. S., Moon, I., Kim, J. 2022. A Dynamic Doft
Sensor Based on Hybrid Neural Networks to Improve Early Off-Spec Detection.
Engineering with Computers, 0123456789. Springer London.
Hubka, V., Eder, W. E. 1988. Theory of Technical Systems. Berlin, Heidelberg: Springer
Berlin Heidelberg.
Ingber, D. E. 2022. Human Organs-on-Chips for Disease Modelling, Drug Development and
Personalized Medicine. Nature Reviews Genetics, 0123456789. Springer US.
Inferential Modeling and Soft Sensors 153
Kager, J., Fricke, J., Herwig, C. 2017. A Generic Biomass Soft Sensor and Its Application in
Bioprocess Development. Eppendorf, 357: 1–8, https://www.eppendorf.com/
product‐media/doc/en/228755/Fermentors‐Bioreactors_Application‐Note_357_
DASware_A‐Generic‐Biomass‐Soft‐Sensor‐Its‐Application‐Bioprocess‐Development.
pdf (accessed on 7 June 2023).
Kazi, M. K., Eljack, F., Mahdi, E. 2021. Data-Driven Modeling to Predict the Load vs.
Displacement Curves of Targeted Composite Materials for Industry 4.0 and Smart
Manufacturing. Composite Structures, 258: 113207.
Khalid, M. A. U., Kim, K. H., Salih, A. B. C., Hyun, K., Park, S. H., Kang, B., Soomro, A.
M. 2022. High Performance Inkjet Printed Embedded Electrochemical Sensors for
Monitoring Hypoxia in a Gut Bilayer Microfluidic Chip. Lab on a Chip, 22(9):
1764–1778.
Khalid, M. A. U., Kim, Y. S., Ali, M., Lee, B. G., Cho, Y.-J., Choi, K. H. 2020. A Lung
Cancer-on-Chip Platform with Integrated Biosensors for Physiological Monitoring and
Toxicity Assessment. Biochemical Engineering Journal, 155: 107469.
Leung, C. M., Haan, P., Bouchard, K. R., Kim, G. A., Ko, J., Rho, H. S., Chen, Z., et al.
2022. A Guide to the Organ-on-a-Chip. Nature Reviews Methods Primers, 2(1).
Springer US.
Luigi, F., Graziani, S., Rizzo, A., Xibilia, M. G. 2007. Soft Sensors for Monitoring and Control
of Industrial Processes. Advances in Industrial Control. London: Springer London.
Ma, Y., Liu, S., Xue, G., Gong, D. 2020. Soft Sensor with Deep Learning for Functional
Region Detection in Urban Environments. Sensors, 20(12): 1–17.
Murugan, C., Natarajan, P. 2019. Estimation of Fungal Biomass Using Multiphase Artificial
Neural Network Based Dynamic Soft Sensor. Journal of Microbiological Methods,
159: 5–11.
Paulsson, D., Gustavsson, R., Mandenius, C. F. 2014. A Soft Sensor for Bioprocess
Control Based on Sequential Filtering of Metabolic Heat Signals. Sensors, 14(10):
17864–17882.
Pe, E. A. G., Oliveira, V. A., Cruvinel, P. E. 2018. Soft-Sensor Approach Based on Principal
Components Analysis to Improve the Quality of the Application of Pesticides in
Agricultural Pest Control. 95–100.
Poerio, D. V., Brown, S. D. 2020. Localized and Adaptive Soft Sensor Based on an Extreme
Learning Machine with Automated Self-Correction Strategies. Journal of Chemometrics,
34(7): 0–2.
Randek, J., Mandenius, C. F. 2018. On-Line Soft Sensing in Upstream Bioprocessing.
Critical Reviews in Biotechnology, 38(1): 106–121.
Shi, J., Liu, X.-G. 2006. Product Quality Prediction by a Neural Soft-Sensor Based on MSA
and PCA. International Journal of Automation and Computing, 3(1): 17–22.
Simutis, R., Galvanauskas, V., Levisauskas, D., Repsyte, J., Vaitkus, V. 2013. Comparative
Study of Intelligent Soft-Sensors for Bioprocess State Estimation. Journal of Life
Sciences and Technologies, 1(3): 163–167.
Wang, B., Wang, Z., Chen, T., Zhao, X. 2020. Development of Novel Bioreactor Control
Systems Based on Smart Sensors and Actuators. Frontiers in Bioengineering and
Biotechnology, 8: 7.
Wang, L., Tao, T., Su, W., Yu, H., Yu, Y., Qin, J. 2017. A Disease Model of Diabetic
Nephropathy in a Glomerulus-on-a-Chip Microdevice. Lab on a Chip, 17(10):
1749–1760.
Wang, Z. X., He, Q. P., Wang, J. 2015. Comparison of Variable Selection Methods for PLS-
Based Soft Sensor Modeling. Journal of Process Control, 26: 56–72.
154 Handbook of Manufacturing Systems and Design
Warth, B., Rajkai, G., Mandenius, C.-F. 2010. Evaluation of Software Sensors for On-line
Estimation of Culture Conditions in an Escherichia Coli Cultivation Expressing a
Recombinant Protein. Journal of Biotechnology, 147(1): 37–45.
Wu, Q., Liu, J., Wang, X., Feng, L., Wu, J., Zhu, X., Wen, W., Gong, X. 2020. Organ-on-a-
Chip: Recent Breakthroughs and Future Prospects. BioMedical Engineering Online,
19(1): 1–19.
Xie, W., Wang, J. S., Xing, C., Guo, S. S., Guo, M. W., Zhu, L. F. 2020. Adaptive Hybrid
Soft-Sensor Model of Grinding Process Based on Regularized Extreme Learning
Machine and Least Squares Support Vector Machine Optimized by Golden Sine Harris
Hawk Optimization Algorithm. Complexity, 2020.