Students
Students
Students
Homework Assignment
Strategies
The optimum time students should spend on homework has been
widely researched although the results are far from unanimous. The
main objective of this research is to analyze how homework
assignment strategies in schools affect students' academic
performance and the differences in students' time spent on homework.
Participants were a representative sample of Spanish adolescents (N =
26,543) with a mean age of 14.4 (±0.75), 49.7% girls. A test battery
was used to measure academic performance in four subjects: Spanish,
Mathematics, Science, and Citizenship. A questionnaire allowed the
measurement of the indicators used for the description of homework
and control variables. Two three-level hierarchical-linear models
(student, school, autonomous community) were produced for each
subject being evaluated. The relationship between academic results
and homework time is negative at the individual level but positive at
school level. An increase in the amount of homework a school assigns
is associated with an increase in the differences in student time spent
on homework. An optimum amount of homework is proposed which
schools should assign to maximize gains in achievement for students
overall.
The role of homework in academic achievement is an age-old debate (Walberg
et al., 1985) that has swung between times when it was thought to be a tool for
improving a country's competitiveness and times when it was almost
outlawed. So Cooper (2001) talks about the battle over homework and the
debates and rows continue (Walberg et al., 1985, 1986; Barber, 1986). It is
considered a complicated subject (Corno, 1996), mysterious (Trautwein and
Köller, 2003), a chameleon (Trautwein et al., 2009b), or Janus-faced (Flunger
et al., 2015). One must agree with Cooper et al. (2006) that homework is a
practice full of contradictions, where positive and negative effects coincide. As
such, depending on our preferences, it is possible to find data which support
the argument that homework benefits all students (Cooper, 1989), or that it
does not matter and should be abolished (Barber, 1986). Equally, one might
argue a compensatory effect as it favors students with more difficulties
(Epstein and Van Voorhis, 2001), or on the contrary, that it is a source of
inequality as it specifically benefits those better placed on the social ladder
(Rømming, 2011). Furthermore, this issue has jumped over the school wall
and entered the home, contributing to the polemic by becoming a common
topic about which it is possible to have an opinion without being well
informed, something that Goldstein (1960) warned of decades ago after
reviewing almost 300 pieces of writing on the topic in Education Index and
finding that only 6% were empirical studies.
The relationship between homework time and educational outcomes has
traditionally been the most researched aspect (Cooper, 1989; Cooper et al.,
2006; Fan et al., 2017), although conclusions have evolved over time. The first
experimental studies (Paschal et al., 1984) worked from the hypothesis that
time spent on homework was a reflection of an individual student's
commitment and diligence and as such the relationship between time spent on
homework and achievement should be positive. This was roughly the idea at
the end of the twentieth century, when more positive effects had been found
than negative (Cooper, 1989), although it was also known that the relationship
was not strictly linear (Cooper and Valentine, 2001), and that its strength
depended on the student's age- stronger in post-compulsory secondary
education than in compulsory education and almost zero in primary education
(Cooper et al., 2012). With the turn of the century, hierarchical-linear models
ran counter to this idea by showing that homework was a multilevel situation
and the effect of homework on outcomes depended on classroom factors (e.g.,
frequency or amount of assigned homework) more than on an individual's
attitude (Trautwein and Köller, 2003). Research with a multilevel approach
indicated that individual variations in time spent had little effect on academic
results (Farrow et al., 1999; De Jong et al., 2000; Dettmers et al.,
2010; Murillo and Martínez-Garrido, 2013; Fernández-Alonso et al.,
2014; Núñez et al., 2014; Servicio de Evaluación Educativa del Principado de
Asturias, 2016) and that when statistically significant results were found, the
effect was negative (Trautwein, 2007; Trautwein et al., 2009b; Lubbers et al.,
2010; Chang et al., 2014). The reasons for this null or negative relationship lie
in the fact that those variables which are positively associated with homework
time are antagonistic when predicting academic performance. For example,
some students may not need to spend much time on homework because they
learn quickly and have good cognitive skills and previous knowledge
(Trautwein, 2007; Dettmers et al., 2010), or maybe because they are not very
persistent in their work and do not finish homework tasks (Flunger et al.,
2015). Similarly, students may spend more time on homework because they
have difficulties learning and concentrating, low expectations and motivation
or because they need more direct help (Trautwein et al., 2006), or maybe
because they put in a lot of effort and take a lot of care with their work
(Flunger et al., 2015). Something similar happens with sociological variables
such as gender: Girls spend more time on homework (Gershenson and Holt,
2015) but, compared to boys, in standardized tests they have better results in
reading and worse results in Science and Mathematics (OECD, 2013a).
On the other hand, thanks to multilevel studies, systematic effects on
performance have been found when homework time is considered at the class
or school level. De Jong et al. (2000) found that the number of assigned
homework tasks in a year was positively and significantly related to results in
mathematics. Equally, the volume or amount of homework (mean homework
time for the group) and the frequency of homework assignment have positive
effects on achievement. The data suggests that when frequency and volume
are considered together, the former has more impact on results than the latter
(Trautwein et al., 2002; Trautwein, 2007). In fact, it has been estimated that
in classrooms where homework is always assigned there are gains in
mathematics and science of 20% of a standard deviation over those
classrooms which sometimes assign homework (Fernández-Alonso et al.,
2015). Significant results have also been found in research which considered
only homework volume at the classroom or school level. Dettmers et al.
(2009) concluded that the school-level effect of homework is positive in the
majority of participating countries in PISA 2003, and the OECD (2013b), with
data from PISA 2012, confirms that schools in which students have more
weekly homework demonstrate better results once certain school and student-
background variables are discounted. To put it briefly, homework has a
multilevel nature (Trautwein and Köller, 2003) in which the variables have
different significance and effects according to the level of analysis, in this case
a positive effect at class level, and a negative or null effect in most cases at the
level of the individual. Furthermore, the fact that the clearest effects are seen
at the classroom and school level highlights the role of homework policy in
schools and teaching, over and above the time individual students spend on
homework.
From this complex context, this current study aims to explore the
relationships between the strategies schools use to assign homework and the
consequences that has on students' academic performance and on the
students' own homework strategies. There are two specific objectives, firstly,
to systematically analyze the differential effect of time spent on homework on
educational performance, both at school and individual level. We hypothesize
a positive effect for homework time at school level, and a negative effect at the
individual level. Secondly, the influence of homework quantity assigned by
schools on the distribution of time spent by students on homework will be
investigated. This will test the previously unexplored hypothesis that an
increase in the amount of homework assigned by each school will create an
increase in differences, both in time spent on homework by the students, and
in academic results. Confirming this hypothesis would mean that an excessive
amount of homework assigned by schools would penalize those students who
for various reasons (pace of work, gaps in learning, difficulties concentrating,
overexertion) need to spend more time completing their homework than their
peers. In order to resolve this apparent paradox we will calculate the optimum
volume of homework that schools should assign in order to benefit the largest
number of students without contributing to an increase in differences, that is,
without harming educational equity.
Methods
Participants
The population was defined as those students in year 8 of compulsory
education in the academic year 2009/10 in Spain. In order to provide a
representative sample, a stratified random sampling was carried out from the
19 autonomous regions in Spain. The sample was selected from each stratum
according to a two-stage cluster design (OECD, 2009, 2011, 2014a; Ministerio
de Educación, 2011). In the first stage, the primary units of the sample were
the schools, which were selected with a probability proportional to the number
of students in the 8th grade. The more 8th grade students in a given school,
the higher the likelihood of the school being selected. In the second stage, 35
students were selected from each school through simple, systematic sampling.
A detailed, step-by-step description of the sampling procedure may be found
in OECD (2011). The subsequent sample numbered 29,153 students from 933
schools. Some students were excluded due to lack of information (absences on
the test day), or for having special educational needs. The baseline sample was
finally made up of 26,543 students. The mean student age was 14.4 with a
standard deviation of 0.75, rank of age from 13 to 16. Some 66.2% attended a
state school; 49.7% were girls; 87.8% were Spanish nationals; 73.5% were in
the school year appropriate to their age, the remaining 26.5% were at least 1
year behind in terms of their age.
Procedure
Test application, marking, and data recording were contracted out via public
tendering, and were carried out by qualified personnel unconnected to the
schools. The evaluation, was performed on two consecutive days, each day
having two 50 min sessions separated by a break. At the end of the second day
the students completed a context questionnaire which included questions
related to homework. The evaluation was carried out in compliance with
current ethical standards in Spain. Families of the students selected to
participate in the evaluation were informed about the study by the school
administrations, and were able to choose whether those students would
participate in the study or not.
Instruments
The performance test battery consisted of 342 items evaluating four subjects:
Spanish (106 items), mathematics (73 items), science (78), and citizenship
(85). The items, completed on paper, were in various formats and were subject
to binary scoring, except 21 items which were coded on a polytomous scale,
between 0 and 2 points (Ministerio de Educación, 2011). As a single student is
not capable of answering the complete item pool in the time given, the items
were distributed across various booklets following a matrix design
(Fernández-Alonso and Muñiz, 2011). The mean Cronbach α for the booklets
ranged from 0.72 (mathematics) to 0.89 (Spanish). Student scores were
calculated adjusting the bank of items to Rasch's IRT model using the
ConQuest 2.0 program (Wu et al., 2007) and were expressed in a scale with
mean and standard deviation of 500 and 100 points respectively. The
student's scores were divided into five categories, estimated using the
plausible values method. In large scale assessments this method is better at
recovering the true population parameters (e.g., mean, standard deviation)
than estimates of scores using methods of maximum likelihood or expected a-
posteriori estimations (Mislevy et al., 1992; OECD, 2009; von Davier et al.,
2009).
Homework Variables
A questionnaire was made up of a mix of items which allowed the calculation
of the indicators used for the description of homework variables. Daily
minutes spent on homework was calculated from a multiple choice question
with the following options: (a) Generally I don't have homework; (b) 1 h or
less; (c) Between 1 and 2 h; (d) Between 2 and 3 h; (e) More than 3 h. The
options were recoded as follows: (a) = 0 min.; (b) = 45 min.; (c) = 90 min.; (d)
= 150 min.; (e) = 210 min. According to Trautwein and Köller (2003) the
average homework time of the students in a school could be regarded as a
good proxy for the amount of homework assigned by the teacher. So the mean
of this variable for each school was used as an estimator of Amount or volume
of homework assigned.
Control Variables
Four variables were included to describe sociological factors about the
students, three were binary: Gender (1 = female); Nationality (1 = Spanish;
0 = other); School type (1 = state school; 0 = private). The fourth variable
was Socioeconomic and cultural index (SECI), which is constructed with
information about family qualifications and professions, along with the
availability of various material and cultural resources at home. It is expressed
in standardized points, N(0,1). Three variables were used to gather
educational history: Appropriate School Year (1 = being in the school year
appropriate to their age; 0 = repeated a school year). The other two
adjustment variables were Academic Expectations and Motivation which were
included for two reasons: they are both closely connected to academic
achievement (Suárez-Álvarez et al., 2014). Their position as adjustment
factors is justified because, in an ex-post facto descriptive design such as this,
both expectations and motivation may be thought of as background variables
that the student brings with them on the day of the test. Academic
expectations for finishing education was measured with a multiple-choice
item where the score corresponds to the years spent in education in order to
reach that level of qualification: compulsory secondary education (10 points);
further secondary education (12 points); non-university higher education (14
points); University qualification (16 points). Motivation was constructed from
the answers to six four-point Likert items, where 1 means strongly disagree
with the sentence and 4 means strongly agree. Students scoring highly in this
variable are agreeing with statements such as “at school I learn useful and
interesting things.” A Confirmatory Factor Analysis was performed using a
Maximum Likelihood robust estimation method (MLMV) and the items fit an
essentially unidimensional scale: CFI = 0.954; TLI = 0.915; SRMR = 0.037;
RMSEA = 0.087 (90% CI = 0.084–0.091).
As this was an official evaluation, the tests used were created by experts in the
various fields, contracted by the Spanish Ministry of Education in
collaboration with the regional education authorities.
Data Analyses
Firstly the descriptive statistics and Pearson correlations between the
variables were calculated. Then, using the HLM 6.03 program (Raudenbush et
al., 2004), two three-level hierarchical-linear models (student, school,
autonomous community) were produced for each subject being evaluated: a
null model (without predictor variables) and a random intercept model in
which adjustment variables and homework variables were introduced at the
same time. Given that HLM does not return standardized coefficients, all of
the variables were standardized around the general mean, which allows the
interpretation of the results as classical standardized regression analysis
coefficients. Levels 2 and 3 variables were constructed from means of
standardized level 1 variables and were not re-standardized. Level 1 variables
were introduced without centering except for four cases: study time,
motivation, expectation, and socioeconomic and cultural level which were
centered on the school mean to control composition effects (Xu and Wu, 2013)
and estimate the effect of differences in homework time among the students
within the same school. The range of missing variable cases was very small,
between 1 and 3%. Recovery was carried out using the procedure described
in Fernández-Alonso et al. (2012).
The results are presented in two ways: the tables show standardized
coefficients while in the figures the data are presented in a real scale, taking
advantage of the fact that a scale with a 100 point standard deviation allows
the expression of the effect of the variables and the differences between groups
as percentage increases in standardized points.
Results
Table 1 shows the descriptive statistics and the matrix of correlations between
the study variables. As can be seen in the table, the relationship between the
variables turned out to be in the expected direction, with the closest
correlations between the different academic performance scores and
socioeconomic level, appropriate school year, and student expectations. The
nationality variable gave the highest asymmetry and kurtosis, which was to be
expected as the majority of the sample are Spanish.
TABLE 1
Author Contributions
RF and JM have designed the research; RF and JS have analyzed the data; MA
and JM have interpreted the data; RF, MA, and JS have drafted the paper; JM
has revised it critically; all authors have provided final approval of the version
to be published and have ensured the accuracy and integrity of the work.
Funding
This research was funded by the Ministerio de Economía y Competitividad del
Gobierno de España. References: PSI2014-56114-P, BES2012-053488. We
would like to express our utmost gratitude to the Ministerio de Educación
Cultura y Deporte del Gobierno de España and to the Consejería de Educación
y Cultura del Gobierno del Principado de Asturias, without whose
collaboration this research would not have been possible.
References
Barber, B. (1986). Homework does not belong on the agenda for educational
reform. Educ. Leadersh. 43, 55–57.
Google Scholar
Barber, M., and Mourshed, M. (2007). How the World's Best-Performing
School Systems Come Out on Top. McKinsey and Company. Available online
at: http://mckinseyonsociety.com/downloads/reports/Education/Worlds_Sc
hool_Systems_Final.pdf (Accessed January 25, 2016).
Fan, H., Xu, J., Cai, Z., He, J., and Fan, X. (2017). Homework and students'
achievement in math and science: a 30-year meta-analysis, 1986-2015. Educ.
Res. Rev. 20, 35–54. doi: 10.1016/j.edurev.2016.11.003
CrossRef Full Text | Google Scholar
Farrow, S., Tymms, P., and Henderson, B. (1999). Homework and attainment
in primary schools. Br. Educ. Res. J. 25, 323–341. doi:
10.1080/0141192990250304
CrossRef Full Text | Google Scholar
Fernández-Alonso, R., and Muñiz, J. (2011). Diseños de cuadernillos para la
evaluación de competencias b1sicas. Aula Abierta 39, 3–34.
OECD (2013a). PISA 2012 Results: What Students Know and Can Do.
Student Performance in Mathematics, Reading and Science (Volume I).
Paris: OECD Publishing.
Scheerens, J., Hendriks, M., Luyten, H., Sleegers, P., and Cees, G.
(2013). Productive Time in Education. A Review of the Effectiveness of
Teaching Time at School, Homework and Extended Time Outside School
Hours. Enschede: University of Twente. Available online
at: http://doc.utwente.nl/86371/ (Accessed January 25, 2016).