Sensemaking of Block Flow Diagrams in Chemical Engineering
Sensemaking of Block Flow Diagrams in Chemical Engineering
INTRODUCTION
As engineering educators, we all want our students to make sense of the ideas they encounter in
our courses. Sensemaking has been shown to help students build new knowledge and create
connections within the knowledge they already have [1]. The process of sensemaking also helps
students achieve coherence between a concept and a scenario in the real world [2]. Additionally,
sensemaking can positively benefit students’ problem-solving, leading to more efficient,
insightful, and accurate solutions [3]. In the education literature, most prior research on
sensemaking has focused on mathematical sensemaking [3], [4] or building connections between
a concept in science and a scenario in the real world [5]. Very few studies have focused on
sensemaking in engineering.
In science and engineering, visual diagrams are often used for presenting and engaging with
complex scientific concepts. Experimental studies and case studies have reported positive effects
of various types of scientific representations [6]. Multiple representations can complement each
other because they differ either in the processes each supports or in the information each contains.
For example, Tabachneck et al. examined the representations that learners created to solve
algebra word problems and found that each representation was associated with a different
strategy. The use of multiple representations and hence multiple strategies was about twice as
effective as any strategy used alone [7]. Using one representation can also constrain the
interpretation of a second representation. For example, textual representations are generally less
specific than graphical representations. When these two representations are presented together,
interpretation of the first (ambiguous) representation may be constrained by the second (specific)
representation [8]. Thus, combinations of representations can support students’ learning.
However, students often struggle to use representations effectively [9]. For example, students
have difficulty moving across and connecting representations. Students also tend to focus on the
surface features instead of the underlying scientific principles.
In chemical engineering, students are introduced to block flow diagrams (BFDs), a new type of
pictorial representation of a chemical process, early in the curriculum. For example, in the
sophomore-level material and energy balances, often an initial exercise is to convert a word
problem into a simple block flow diagram. The block flow diagram consists of a series of blocks
representing different equipment or unit operations that are connected by input and output
streams. Important information such as operating temperatures, pressures, and flow rates are
included in the diagram. However, the diagram does not include any details of equipment within
any of the blocks [10]. In the capstone design course in senior year, students will use block flow
diagrams again to draw out the initial design of a chemical process before turning the block flow
diagram into a process flow diagram (PFD) that contains much more detailed information
(including all the major pieces of equipment and numbered streams). Thus, understanding how to
read block flow diagrams is useful for understanding the overall operation of chemical plants and
is an essential skill for chemical engineering students to develop.
However, because of the complexity of the information presented in the block flow diagram, it
can be quite challenging to fully understand a block flow diagram for students learning about this
representation for the first time [11]. Additionally, typical instruction in material and energy
balances doesn’t have a large focus on the design of the chemical process [11], [12]. Thus, even if
students know how to read a BFD, they may not be able to make sense of it to identify possible
design flaws or suggest improvements.
To address gaps in the literature on sensemaking in engineering, we chose to investigate student
sensemaking with block flow diagrams. We selected block flow diagrams because they are a
unique and important representation within engineering, which may be able to provide future
information about how students make sense of other engineering representations (e.g., phase
diagrams). Our research question is: how do chemical engineering students make sense of block
flow diagrams (BFDs)?
THEORY
General features of sensemaking include being active, self-conscious, motivated, and purposeful
in the world. There is an abundance of science education research literature that aims to define
and characterize scientific sensemaking. When taken as a whole, the literature conceptualizes
sensemaking in three different ways: 1) as a stance or frame towards science learning, 2) a
cognitive process, and 3) a discourse practice [5], [13].
From a framing perspective, sensemaking is a way in which students approach science learning,
which is characterized by trying to “figure something out” using one’s prior knowledge. From a
cognitive process perspective, sensemaking is a way in which students construct new knowledge
by building connections to and within their prior knowledge. From a discourse perspective,
sensemaking is a mode of argumentative dialogue in which students articulate and strengthen
explanations. Instead of trying to win the argument, the goal of sensemaking is to strengthen
claims and improve their explanatory power. Based on a thorough review of the literature, Odden
and Russ gave a definition of sensemaking that incorporates the three different ways of viewing
sensemaking. This is also the definition of sensemaking we will use in our work. “Sensemaking
is a dynamic process of building and revising an explanation in order to figure something out – to
ascertain the mechanism underlying a phenomenon in order to resolve a gap or inconsistency in
one’s understanding [13].”
METHODS
In the assessment, we ask the participant what the first thing they notice about the BFD is, what
additional information they would request to evaluate the process, and finally ask them to suggest
changes or improvements to the BFD. The initial BFD has some errors and inefficiencies, so we
then present the participant with a corrected BFD and ask what main differences they notice, what
additional information they would request, and if they believe the revised BFD is fully optimized.
Finally, we provide the third BFD, which is further optimized compared to the second BFD, and
ask the participant what has changed in the diagram and if they agree with the changes their
colleague made. The questions were designed to allow many possible lines of reasoning without
any obvious right or wrong answer.
After developing the assessment, we recruited 7 students (3 sophomores, 2 juniors, 1 senior, and 1
PhD candidate) to participate in our study. All of the students are in the chemical engineering
department at a large public research university in the southeastern US. The sophomores were
taking a material and energy balances class in which BFDs were taught at the time of
participating in our study. The other students had already taken the material and energy balances
class. Each participant was asked to participate in a one-hour think-aloud interview [16] with the
second author. The participants were given a link to the Qualtrics survey for the assessment and
were asked to complete the assessment and talk about their thought process during the interview.
The responses in Qualtrics, interview audio files, and interview video files were used during the
data analysis.
ANALYSIS
We transcribed the interviews using the audio files and broke the transcript into 15-second blocks.
The first two authors chose one interview transcript to code independently using an open-coding
approach [17]. Once the researchers had independent codes, they increased the reliability of the
coding by comparing and resolving differences until a consensus was reached and a single set of
consistent codes was accepted. The second author then used the same coding approach to code
the rest of the interview transcripts. After the transcripts were coded, we added color coding for
common behaviors that emerged (e.g., reading questions, requesting relevant information, actions
to make diagrams easier to interpret) and used the codes and color coding to identify four general
stages of the sensemaking process. While reading short sections of the interview transcripts, the
stages appear to be linearly connected. However, when reading the interview transcript of each
student as a whole, we realized that a cyclic structure is more suitable for describing the
sensemaking process, as we will discuss below.
RESULTS
Our analysis revealed a four-stage cyclic structure that students followed when carrying out the
sensemaking of all three diagrams. Because our research is phenomenographic, the specific
actions and behaviors we observed within each stage varied widely from student to student, but
the structure we provide aims to highlight how students made sense of the block flow diagrams
and reached their conclusions. Figure 2 provides a summary of the sensemaking cycle.
Sensemaking Cycle
II. Connecting I. Forming a Surface-level
Diagram to the Understanding of the
Reactions Diagram
Figure 2: A diagram displaying the relation between and progression through each stage.
“Right here we’ve got CCl4 and then we have Cl2 coming out and then excess CCl4 .
We have some of this (CCl3 -CCl3 ) here (products of reactor I), and then that gets this
(CCl2 =CCl2 ).”
Students also made note of the basic layout of the process units as well as the temperatures at
each as in this example:
“So, there is a sequence of separators and pyrolysis reactors . . . also as we progress
downstream, we can see the temperatures decrease. So, the first pyrolysis reactor is
operated at 800 ºC, and the second reactor is operated at 500 ºC, while the liquid gas
separator. . . initially it is 100 ºC and then it’s increasing to 150 ºC.”
These prior examples were all taken from students’ analysis of the first diagram. This stage was
present in student engagement with all three diagrams but most heavily in diagram one since
students are still forming a framework with which to interpret the diagram. In the following
diagrams in which changes were incorporated, students built upon this framework. When
presented with the second and third diagrams, students still initially engaged in a surface-level
understanding of the process:
“I’m noticing the CCl4 that they’re moving back into the feed, they’re not moving
into the second stream out of pyrolysis reactor one.”
It is important to note that this stage does not involve further analysis of the changes such as their
implications rather only the identification of the structural change of the diagram.
The ability to determine a viable correct answer and the exact process to get there was unique for
each student, but the overall sensemaking cycle aimed to broadly describe the general process that
was observed in each participant. We also compared the sensemaking cycle with stages of
sensemaking identified in related studies. In particular, in the sensemaking epistemic game paper,
Odden and Russ identified four stages for the sensemaking process for students working in pairs
on an electric circuit, which involves 1) assembling a knowledge framework, 2) noticing an
inconsistency or gap in knowledge, 3) generating an explanation to reconcile it, 4) and
resolution [5]. Stages one and two form an iterative process, with students identifying new
inconsistency in their new explanations. Although the context for sensemaking is different
between this paper and our study (electric circuit and block flow diagram), similar stages are
identified and both processes involve iterations.
In our study, all students except one failed to suggest an improvement when analyzing diagram
one (Fig. 1), it was only after seeing the change made in diagram two that they were able to
suggest an improvement of their own. This could point to the fact that block flow diagrams
contain a large amount of information making it hard for students to dissect them initially.
Students also did not suggest the same improvements at the same frequency. The most commonly
suggested improvement to diagram two was the addition of a CCl3 –CCl3 recycle stream similar to
the example discussed above for stage IV. Interestingly, two students suggested different
solutions, one suggesting the reactors react consecutively followed by separation and appropriate
recycling, and the other suggesting the removal of reactor two and subsequent separators and
recycling everything back into reactor one. Each of these students had unique approaches to the
task, with the former focusing on trying to reduce the total number of separators, and the latter
looking to combine separators. Both students had chemical engineering internship experience,
and these results may be a product of their time in the field.
As mentioned in Stage IV in the results section, several students justified the changes in the
diagram that they observed or justified the changes that they suggested. These justifications strike
us as particularly strong instances of engineering sensemaking because the students sought
coherence between at least three representations: one or two block flow diagrams, the chemical
reactions, and conceptual knowledge about chemical engineering processes (e.g., benefits of
using a recycle stream). In the work on student sensemaking about equipotential graphs, the
authors also observed students justifying their claims [18].
Throughout the sensemaking process of the BFDs, students created a “story” that followed the
flow of the diagram which they would use in tandem with the diagram. For example, when the
students first saw the BFD, they would trace the streams to explain to themselves the purpose of
each unit. In chemical engineering education, most problems are word problems and students are
taught to make diagrams to model the problems. For problems involving BFDs, the focus is
shifted to diagrams and students tend to use verbal descriptions (i.e., a ”story”) to help them
understand the diagram. Additionally, in stage two, students connected the BFDs to the given
information about the chemical reactions. Both of these are evidence of students creating links
between different types of scientific representations (written or verbal descriptions and diagrams).
This is consistent with the cognitive process perspective of sensemaking: when making sense of a
new science concept, students construct new knowledge by building connections to and within
their prior knowledge and these connections may be facilitated when students create links
between different types of scientific representations for that concept [5].
Although students were able to suggest some improvements to the diagrams after seeing the
changes that were made in diagrams 2 and 3 compared to diagram 1, and were able to request
some relevant information, most of them failed to identify any flaws in diagram 1 before they saw
diagram 2. Also, none of the students were able to identify all the flaws in the diagrams or suggest
all the needed improvements. We hypothesize that this is partially due to the lack of design
experience in the material and energy balances course in which students learned BFDs and
partially due to the large amount of information that’s contained in the BFD. This calls for a need
of effective instructional practices that can better support students’ sensemaking of BFDs. For
example, students should be given more opportunities to troubleshoot flawed BFDs and make
design improvements. It would also be helpful for students to work in pairs and critique each
others’ solutions.
Although the one-on-one think aloud interviews revealed general stages of the sensemaking cycle
for BFDs, we were not able to capture the sensemaking process of students working in pairs on
the assessment. As suggested by the discourse practice perspective of sensemaking, whether it is
being done collaboratively or individually, sensemaking always involves the dialogue between
construction and critique [5]. A single person may use different mental “voices” for construction
and critique [19]. It will be useful to conduct interviews with students when they are working on
the BFDs in pairs and check if the same sensemaking stages emerge. Additional future directions
include developing instructional practices that support sensemaking of BFDs and using our
sensemaking assessment in classrooms as a pre-test and post-test to evaluate the effectiveness of
the instructional practices.
References
[1] A. Gupta and A. Elby, “Beyond epistemological deficits: Dynamic explanations of engineering students’
difficulties with mathematical sense-making,” International Journal of Science Education, vol. 33, no. 18,
pp. 2463–2488, 2011.
[2] T.-R. Sikorski and D. Hammer, “Looking for coherence in science curriculum,” Science Education, vol. 101,
no. 6, pp. 929–943, 2017.
[3] E. Kuo, M. M. Hull, A. Elby, and A. Gupta, “Assessing mathematical sensemaking in physics through
calculation-concept crossover,” Physical Review Physics Education Research, vol. 16, no. 2, p. 020109, 2020.
[4] F. Zhao and A. Schuchardt, “Development of the sci-math sensemaking framework: categorizing sensemaking
of mathematical equations in science,” International Journal of STEM Education, vol. 8, no. 1, pp. 1–18, 2021.
[5] T. O. B. Odden and R. S. Russ, “Sensemaking epistemic game: A model of student sensemaking processes in
introductory physics,” Physical Review Physics Education Research, vol. 14, no. 2, p. 020122, 2018.
[6] A. Furberg, A. Kluge, and S. Ludvigsen, “Student sensemaking with science diagrams in a computer-based
setting,” International Journal of Computer-Supported Collaborative Learning, vol. 8, no. 1, pp. 41–64, 2013.
[7] H. J. Tabachneck, K. R. Koedinger, and M. J. Nathan, “Toward a theoretical account of strategy use and
sense-making in mathematics problem solving,” in Proceedings of the sixteenth annual conference of the
cognitive science society, pp. 836–841, Routledge, 2019.
[8] S. Ainsworth, “Deft: A conceptual framework for considering learning with multiple representations,” Learning
and instruction, vol. 16, no. 3, pp. 183–198, 2006.
[9] D. Bodemer, R. Ploetzner, I. Feuerlein, and H. Spada, “The active integration of information during learning
with dynamic and interactive visualisations,” Learning and instruction, vol. 14, no. 3, pp. 325–341, 2004.
[10] R. Turton, J. A. Shaeiwitz, D. Bhattacharyya, and W. B. Whiting, Analysis, synthesis and design of chemical
processes. Pearson Education, 2021.
[11] D. L. Silverstein, L. G. Bullard, and M. A. Vigeant, “How we teach: Material and energy balances,” in 2012
ASEE Annual Conference & Exposition, pp. 25–703, 2012.
[12] L. Ford, J. Brennan, K. Dahm, D. Silverstein, L. Landherr, C. West, J. Cole, S. Thiel, B. Vaughen, and
M. Jamieson, “How we teach: Material and energy balances,” in 2022 ASEE Annual Conference & Exposition,
2022.
[13] T. O. B. Odden and R. S. Russ, “Defining sensemaking: Bringing clarity to a fragmented theoretical construct,”
Science Education, vol. 103, no. 1, pp. 187–205, 2019.
[14] E. Burkholder and C. E. Wieman, “Work in progress: Testing an assessment of problem solving in introductory
chemical process design courses,” in 2020 ASEE Virtual Annual Conference Content Access, 2020.
[15] E. Burkholder, L. Hwang, and C. Wieman, “Supporting authentic problem-solving through a cornerstone design
course in chemical engineering,” Chemical Engineering Education, vol. 55, no. 3, pp. 122–133, 2021.
[16] K. A. Ericsson and H. A. Simon, “Verbal reports as data,” Psychological Review, vol. 87, no. 3, p. 215, 1980.
[17] J. W. Creswell and J. D. Creswell, Research design: Qualitative, quantitative, and mixed methods approaches.
Sage publications, 2017.
[18] P. J. Emigh, J. W. Alfson, and E. Gire, “Student sensemaking about equipotential graphs,” in Proceedings of the
Physics Education Research Conference (PERC, pp. 99–102, 2019.
[19] M. J. Ford, “A dialogic account of sense-making in scientific argumentation and reasoning,” Cognition and
Instruction, vol. 30, no. 3, pp. 207–245, 2012.