Correlations Between Tree Thinking and Acceptance of Evolution in Introductory Biology Students

Background

Tree thinking refers to an approach to evolution education that emphasizes reading and interpreting phylogenetic trees. We studied the relationship between introductory biology students’ tree-thinking ability and their acceptance of evolutionary theory.

Results

Comparisons between a semester in which interpretation of phylogenetic trees and related concepts were taught as stand-alone topics versus one in which tree thinking was used as an organizing framework for the course curriculum found significant increases in students’ ability to read and interpret trees in both semesters, but only in the tree thinking semester was there a significant increase in students’ scores on the Measure of the Acceptance of the Theory of Evolution (MATE) instrument. Over four additional semesters, the Tree Thinking Concept Inventory (TTCI) was used to assess students’ tree-thinking abilities before and after the course. We found that MATE posttest scores correlated with gains in tree-thinking ability. These increases in MATE posttest scores were predominantly due to students’ reporting greater acceptance of the scientific evidence supporting evolutionary theory.

Conclusions

Increased acceptance of evolution in a tree-thinking versus non-tree-thinking semester and significant positive correlations between TTCI and MATE scores indicate there is a relationship between tree-thinking ability and acceptance of evolution. This result suggests that, as a framework to connect different forms of data and investigate a variety of biological phenomena, tree thinking can promote greater acceptance of the evidence and scientific validity of evolutionary theory in introductory biology students.

Surveys consistently report low levels of understanding and acceptance of evolution in the United States (Miller et al. 2006). Far from being a feature of the general public alone, many undergraduates enter introductory biology courses with minimal understanding of and numerous misconceptions about evolution and its relationship to other biological principles (Johnson and Peeples 1987; Sundberg 1997; Dagher and BouJaoude 1997; Bishop and Anderson 1990; Meir et al. 2007; Nehm and Reilly 2007). This lack of understanding has been shown to often continue throughout undergraduate education and even into graduate school (Alters and Nelson 2002; Nehm and Reilly 2007; Gregory and Ellis 2009 Losos et al. 2013).

Insufficient instruction by high school biology teachers who may accept evolution but hold misconceptions about it or limit coverage to avoid conflicts; teachers who do not accept the scientific validity of evolution, question the existence of evidence supporting evolution, or doubt its acceptance by scientists; and teachers who continue to present non-scientific explanations as equivalent if not superior “alternatives” to biological evolution have been identified as causes of low understanding and acceptance of evolution in high school graduates (National Academy of Sciences 1999, 2008; Rutledge and Mitchell 2002: Miller 2005; Moore and Kraemer 2005; Verhey 2005; Berkman et al. 2008; Cavallo and McCall 2008; Moore 2008; Moore and Cotner 2009a, b; Smith 2010; Berkman and Plutzer 2011; Moore et al. 2011; Lloyd-Strovas and Bernal 2012). In a recent study, Yates and Marek (2014) found that students in some high school biology classes started the course with a more accurate understanding of evolution than their teachers, but left those courses with less understanding of and more misconceptions about evolution than they had when they entered.

Unfortunately, challenges in evolution education do not end once students enter college and university introductory biology courses. Because evolution is built upon a synthesis of data from scientific fields ranging from molecular genetics to paleontology, presenting the sheer breadth of this information in only a few introductory biology lectures can potentially overwhelm students and cause them to consider evolution as just one of the many separate topics covered during the semester rather than a unifying principle of biology (National Research Council 2012). Furthermore, it has been suggested that overemphasis on microevolution in introductory courses and insufficient coverage of other essential facets of evolutionary theory such as speciation, ancestor–descendant relationships, biogeography, and extinction (Catley 2006; Catley and Novick 2009; Smith 2010), as well as inconsistent and potentially confusing presentation of evolution in textbooks (Linhart 1997) can also prevent introductory students from developing a complete understanding of evolutionary theory (Lloyd-Strovas and Bernal 2012; Hobbs et al. 2013).

When investigating the effect of any curricular activity in science education in general and evolution education in particular, it is important to be mindful of the relationships and distinctions among knowledge, belief, and acceptance. Knowledge and belief are separate constructs that influence teaching and learning about evolution (Smith and Siegel 2004; Alters 2005). Beliefs are highly subjective, based on personal experience, and resistant to contrary evidence, so they are typically resistant to change (Sinatra et al. 2008). Likewise, beliefs are not subject to the same empirical criteria as scientific evidence (Southerland et al. 2001). Consequently, changing students’ beliefs may not be an appropriate objective in evolution education. Indeed, changing beliefs about evolution is difficult (Demastes-Southerland et al. 1995; Nadelson and Southerland 2010). Therefore, rather than attempting to change beliefs a more appropriate objective is increasing students’ acceptance of evolutionary theory (Smith and Siegel 2004). Acceptance indicates an understanding of the scientific evidence, critical evaluation of empirical evidence and the methods used to gather and analyze it, and a scientifically logical interpretation of how that evidence fits into the larger framework of scientific theory (Rutledge and Mitchell 2002; Nadelson and Southerland 2010).

One curricular change that has been suggested to improve evolution education and promote greater acceptance of evolution, particularly at the introductory level, is to increase emphasis on phylogenetic tree thinking. The concept of tree thinking encompasses the skills and knowledge necessary to correctly interpret and understand the information about evolutionary relationships, patterns, and processes contained in phylogenetic trees (Baum et al. 2005; Baum and Offner 2008; Baum and Smith 2013). Ever since Darwin first used a branching tree diagram to represent his initial conceptions of nested, evolutionary diversification of lineages from a common ancestor in his Notebook B and later as the only figure in The Origin of Species (Darwin 1859), phylogenetic trees have become the primary diagrammatic representation of broad-scale evolution that guides research and thought throughout biology (Baum and Smith 2013). It has been suggested that greater inclusion of tree thinking in biology courses will not only increase students’ skills in phylogenetics, a topic that has historically received less attention at the introductory level than others, but it can also serve as a platform to improve their broader understanding and acceptance of evolutionary theory (O’Hara 1997; Baum et al. 2005; Catley 2006; Gregory 2008; Catley and Novick 2009; Kalinowski et al. 2010; Smith 2010).

Correctly applying tree thinking to interpret phylogenetic trees requires technical knowledge of the diagrams and an understanding of fundamental biological and evolutionary principles they represent (Donovan 2005; Baum and Offner 2008). Consequently, mistakes reading phylogenetic trees can give insights into student misconceptions about different aspects of evolution and evolutionary theory (Baum et al. 2005; Crisp and Cook 2005; Meir et al. 2007; Meisel 2010). For example, determining relationships by using branch tip proximity (i.e., “reading across the tips”) or the number of nodes between lineages (i.e., “node counting”) not only signify deficient skills in how to read a tree, but also a fundamental misunderstanding of the concept of common ancestry that is the core of evolutionary theory. In addition to providing a diagnostic tool to identify students’ misconceptions about evolution, tree thinking can also serve as an organizing concept that connects different forms of data that serve as evidence of evolution. Thus, there are reasons to suspect that improved tree thinking might foster greater acceptance of evolution in undergraduates (Alters and Nelson 2002; Nehm et al. 2009; Halverson 2011).

A number of individual activities have been developed to teach tree thinking and improve acceptance of evolution (Gendron 2000; Goldsmith 2003; Perry et al. 2008; Smith and Cheruvelil 2009; Halverson 2010; Gibson and Cooper 2014). Prior studies have failed to show convincingly that completing a single tree-thinking activity increases students’ acceptance of evolution and have not yielded uniform conclusions (Southerland and Sinatra 2005; Lloyd-Strovas and Bernal 2012). Larger curricular modifications that infuse tree thinking throughout a course may be necessary to significantly change acceptance of evolutionary theory. Indeed, significant increases in acceptance of evolution were found when tree thinking was emphasized throughout upper level biology courses (Nadelson and Southerland 2010: Dodick and Orion 2002; Catley and Novick 2009). While this is encouraging, the effect of including tree thinking on introductory-level students’ acceptance of evolution has not been thoroughly explored.

In this study, we investigated the relationship between introductory biology students’ tree-thinking skills and their acceptance of evolution to determine whether using tree thinking as an organizing framework throughout an introductory-level course can improve students’ acceptance of evolution as a valid, scientific theory that unifies a diverse array of empirical evidence and provides a foundation for all areas of biology. Thus, the tree thinking framework we are investigating can be summarized as embodying the classic statement by Dobzhansky (1973) that, “Nothing in biology makes sense except in the light of evolution,” and its two more recent logical extensions that “Nothing in evolution makes sense except in the light of phylogeny” (Society of Systematic Biologists 2001) and “Nothing in evolution makes sense except in the light of DNA” (Kalinowski et al. 2010).

Course and Study Participants

The study focused on BIOL 1134 Evolution, Ecology, and Diversity. It is one of two introductory-level courses required for biology, plant biology, and microbiology majors and serves as a general education science course for non-majors. The course objective is to introduce students to biological diversity, the evolutionary processes that produce biological diversity, and the basic features of structure and function in biological systems at the organismal and ecological levels. The course includes a single lecture (taught by JPG) and weekly laboratory sessions (taught by graduate teaching assistants). Participants were recruited on the first day of class each semester and provided a participant consent form to opt-in for participation in the study in accordance with IRB approved and mandated procedures. Background information about major, year in college, and whether they had previously completed college or university introductory biology courses that covered evolution was also collected from each student.

Because only one section of BIOL 1134 is offered each semester, it was not possible to compare non-tree-thinking and tree-thinking curricula in concurrent sections. Thus, in our initial study, we compared a section of BIOL 1134 offered in Fall 2009 (designated F09) that covered phylogenetics but did not emphasize tree thinking with a section offered in Spring 2010 (designated S10) that used a tree-thinking framework throughout the course. The same general topics were covered in both semesters, and both used case studies, guided inquiry, and active learning activities. However, the S10 tree thinking section included additional activities that involved phylogenetic analysis or interpretation. Most of the content that was cut from lecture to allow greater coverage of tree thinking was accommodated in laboratory sessions. Due to human subjects research guidelines, only the tree-thinking curriculum was used in the final four semesters of the study from spring semester 2011 through fall semester 2012 (designated S11, F11, S12, and F12, respectively). However, by using multiple linear regression analysis to look for correlations between the extent to which individual students improved their tree thinking and their acceptance level, we were able to more accurately assess whether improved teaching tree thinking also raises acceptance of evolution.

Tree-Thinking Curriculum Structure

At the broad scale, evolution is a process of nested descent with modification, with lineages diverging from common ancestors and producing the branching patterns of phylogenetic trees. The tree-thinking curriculum we are studying emphasizes integrating concepts of inheritance, microevolution, macroevolution, and trait diversification to help students understand the many ways in which DNA and other forms of data corroborate one another across different hierarchical levels and support evolutionary theory. Because tree thinking depends on understanding common ancestry and descent, there was deliberate emphasis on how successful reproduction and inheritance of genetic variation among many individuals and across generations are represented in phylogenetic trees. These themes showed up repeatedly in many topics covered in the course (e.g., floral adaptations, host-parasite interactions, Hox genes, animal diversity, etc.). The goal was to draw close connections from such fundamental concepts as Mendelian inheritance and pedigrees to the more complex topics of phylogenetics and tree thinking. This approach emphasizes evolution as an emergent property of biological systems operating from the molecular to the ecosystem levels of organization.

Active learning exercises were employed in lecture throughout the course in all semesters. Case studies and problem sets explored the following topics: inheritance, pedigree analysis, and population genetics (Aronova-Tiuntseva and Herreid 2003; Leander and Huskey 2008; Rice 2010); natural selection (Evarts et al. 2006; Gibson 2008; Horvath 2009a); phylogeny construction and interpretation (Horvath 2009b); and trait evolution (Herreid 2005; Flammer 2007). Laboratory sessions paralleled lecture topics. In lab, students used guided inquiry activities to learn and apply tree thinking in several different modules. Basic principles and process of phylogenetic analyses were studied using the Great Clade Race (Goldsmith 2003) and a modification of the Dendrogrammaceae phylogenetic construction activity (Duncan et al. 1980). Students applied their knowledge of phylogenetic data collection and analysis through activities that investigated plant and animal diversity (Smith and Cheruvelil 2009; Gibson and Cooper 2014). These involved students collecting morphological data from representative specimens of different taxa and then using their data to construct trees with the phylogenetic analysis program Mesquite (Mesquite Project Team 2009). Next, students constructed phylogenies using genetic data (e.g., rbcL or mitochondrial gene sequences) for comparison to their structural tree. These activities not only gave students opportunities to develop phylogenetic analysis skills, but also provided multiple opportunities to apply tree thinking using different forms of data so they could engage in the scientific processes biologists use to investigate evolution questions. Resources for specific activities and sample syllabi are available at http://www.ou.edu/gibsonlab/Tree_Thinking/Tree_Thinking.html.

Assessment

All students in the course were given the opportunity to complete the assessment instruments for a small number of points, but only data from students who self-selected to participate and completed all pretest and posttest assessments were included in the analysis.

In initial study comparing students between the non-tree thinking (F09) and tree thinking (S10) semesters, students’ overall ability to read and interpret phylogenetic trees was evaluated using a subset of questions from the Understanding Evolutionary Trees Worksheet (UET, Additional file 1), a general tree thinking assessment instrument developed by Meir et al. (2007) that includes multiple choice questions about phylogenetic trees and questions asking students to construct a simple phylogeny from provided data.

Although data from the UET assessment are informative, aspects of the wording in distractors and limited topic coverage were found to present confounding factors that limited detailed analysis of results. Consequently, we replaced the UET instrument with a subset of 14 multiple-choice questions from Naegle’s (2009) Tree Thinking Concept Inventory (TTCI, Additional file 2) in the S11, F11, S12, and F12 semesters. The TTCI instrument supports more detailed exploration of specific aspects of students’ ability to describe basic features of trees, read phylogenetic trees to determine relationships, and interpret the evolutionary information contained in them. Distractors in the TTCI included common misconceptions about time, common ancestry, trait evolution, and evolutionary processes. The TTCI also asks students to report whether they have previously seen or learned to read phylogenetic tree diagrams. The TTCI was administered as a pretest (TTCI_PRE) and posttest (TTCI_POST).

Acceptance of evolution was assessed in all six semesters using the Measure of Acceptance of the Theory of Evolution (MATE) instrument (Rutledge and Warden, 1997; Rutledge and Sadler 2007), administered as both a pretest (MATE_PRE) and a posttest (MATE_POST). The MATE is a 20-question, five-point Likert-scale instrument that asks respondents the extent to which they agree or disagree with statements about the process, the evidence for, and the scientific validity of evolutionary theory. Statements are paired for each topic with a positive and negative phrasing. For example statement M16, (Evolutionary theory is supported by factual, historical, and laboratory data.) and statement M4 (The theory of evolution is based on speculation and not valid scientific observation and testing.) address the same topic (Basis of evolutionary theory in scientific data) with a positive and negative phrasing, respectively.

Data Analysis

To evaluate tree-thinking ability, the frequencies of different misconception and deficient skills were summarized and compared between pretest and posttest responses from the UET assessment administered in F09 and S10. Mean score between the UET pretest and posttest were compared through Paired Samples t tests. For the TTCI data, mean and standard deviation (SD) were calculated for the TTCI_PRE and TTCI_POST scores within the S11, F11, S12, and F12 semesters and for data pooled across semesters. Mean TTCI_PRE and TTCI_POST scores were then compared within pretests and posttests via ANOVA or Paired Samples t tests. The TTCI_PRE and TTCI_POST scores were compared by Paired Samples t tests. All data were analyzed using PASW Statistics (version 18.0).

Because scaled ordinal data from Likert responses in the MATE instrument violate assumptions of parametric statistical techniques (Huck 2008), range, median (Mdn), and quartiles were calculated for MATE_PRE and MATE_POST in all semesters. Within pretests and posttests, median values of MATE_PRE and MATE_POST were compared via Kruskal–Wallis tests and Mann–Whitney U tests. MATE pretest and posttest scores for individual semesters and pooled data across semesters were compared through a non-parametric Related-Samples Wilcoxon Signed Ranks Test (Sokal and Rohlf 2012).

Normalized change, c, was calculated as

to compare the difference between the pre and post-test scores relative to the maximum possible gain in post-test score(Marx and Cummings 2007). This statistic was calculated for UET scores (c _U ) in F09 and S10, TTCI scores (c _T ) in S11 through F12, and MATE scores (c _M ) in all semesters to quantify individual student learning gains. Patterns of correct and incorrect answers to each question in the TTCI were further evaluated through Item Analysis to calculate the Discrimination Index (D) that quantifies the difference in percentage of correct responses between the upper 27 % (U _27 % ) and lower 27 % (L _27 % ) of TTCI scores (Hopkins and Stanley 1981). Responses were also compared between the U _27 % and L _27 % of MATE scores, but because there are no correct or incorrect responses, D was not calculated.

Students enrolled in a particular semester do not represent a random sampling of potential participants. Because it is not possible to randomly assign students to control and treatment groups, evaluating of the effect of a tree-thinking versus non-tree-thinking curriculum is best achieved through comparisons of MATE_PRE and MATE_POST scores within semesters. To do this, a student-level, multiple linear regression model was used to investigate the relationship between tree thinking and acceptance of evolution in semesters S11, F11, S12, and F12 (Theobald and Freeman 2014). Instead of comparing “control’ and “treatment” semesters, multiple linear regression analysis accounts for various non-random factors such as previous introductory biology coursework or preexisting differences in ability to read phylogenetic trees that can affect acceptance of evolution,. In particular, the pretest MATE and TTCI values serve as controls in linear regression analysis of posttest scores making it possible to evaluate the effect of gains in tree thinking and on acceptance of evolution at the end of the course.

Data from the S11 through F12 MATE and TTCI instruments were pooled across the four semesters for linear regression analysis. Spearman’s rho (ρ) was calculated using nonparametric correlation (Sokal and Rohlf 2012; Theobald and Freeman 2014) to evaluate the individual relationships among students’ background data, their tree thinking ability, and their acceptance of evolution. Multiple linear regression analysis of MATE_PRE scores used background data (e.g., year, previous biology, etc.), whether students had previously seen or learned to read phylogenetic trees, and the TTCI_PRE score as predictors. Multiple linear regression analysis of MATE_POST scores included background data, MATE_PRE, TTCI_PRE, and TTCI_POST scores in the model. Analysis of MATE_POST scores was also conducted with TTCI scores replaced by c _T values to measure correlations between acceptance of evolution and change in TTCI pretest and posttest scores.

A total of 332 students participated in the study across all six semesters (Table 1). Study participants reflected the typical composition of students in BIOL 1134, with most being sophomores (40.5 %) majoring in the life sciences (95.9 %). Overall, 53.6 % had previously completed at least one semester of introductory biology at the university level. Because participation in the study was voluntary, it is possible that self-selection bias could potentially influence the results. However, we did not notice any differences in student characteristics, assessment instrument scores, or responses to assessment instrument questions between participants and other course enrollees that would suggest participants were dissimilar from course enrollees overall. Furthermore, study participants’ UET and TTCI scores showed a range of tree-thinking abilities, and scores on MATE pretests and posttests ranged from very high acceptance to very low acceptance of evolution. Therefore, we are confident that was no bias towards students with high tree-thinking skills or initial acceptance of evolution. Unfortunately, the procedures to collect the necessary data and methods to statistically detect, identify, and correct for the myriad of potential factors that can contribute to self-selection bias (Cuddeback et al. 2004) are beyond the scope of this study.

Tree Thinking and Acceptance of Evolution in F09 and S10 Semesters

The mean UET score (Table 2) was significantly higher in posttests than pretests for both semesters (F09: t = 3.86, df = 14, p < 0.01; S10: t = 3.77, df = 12, p < 0.01) and showed a normalized change increase of c _U  = 0.28 ± 0.31 (mean ± SD) in F09 and c _U  = 0.23 ± (0.2) in S10. Analysis of pretest responses to the UET assessment administered in F09 and S10 identified similar initial misconceptions (Table 2). In both pretests, students had a poor understanding of how time is represented in phylogenies and they frequently used node counting and reading across the tips to determine relationships. Consequently, rotations of trees at the nodes were thought to indicate different evolutionary relationships among lineages. Node counting was used to determine relatedness by 73 and 82 % of students in F09 and S10 pre-tests, respectively. However, the frequency of node counting decreased by over 70 % in posttests for both semesters. Surprisingly, the use of reading across the tips to determine relatedness increased slightly in posttests for both semesters. Students had difficulty reading how traits of different lineages are represented in trees in pretests. They also considered taxa on branches at the left of the phylogeny to be older or “less evolved” than taxa on branches on the right side of the phylogeny. Although many students had difficulty constructing a phylogenetic tree when given a small data set for five hypothetical taxa in pretests, they showed marked improvement in their ability to construct a simple phylogentic tree in the posttest.

Median MATE_PRE scores in both F09 and S10 (Table 3, top portion) were in the High Acceptance of Evolution category (MATE scores 77–88). MATE_POST scores increased in both semesters but were significantly greater than MATE_PRE in the S10 semester only. The interquartile range showed a greater increase in S10 than F09. In the S10 MATE_POST responses (Table 4), shifts towards increased acceptance of evolution were particularly clear in questions probing students’ attitudes on the occurrence of evolution (M1, M3, M15, M19), the evidence supporting evolutionary theory (M6, M7, M8, M11), the scientific validity of evolutionary theory (M2, M4, M10, M12, M16, M20), the scientific applicability of evolutionary theory (M9, M13, M14, M18,), and the acceptance of evolutionary theory in the scientific community (M5, M17). Normalized change for MATE in S10, the semester in which tree thinking was integrated into the curriculum, was almost twice as large the normalized change for MATE in F09 (Table 3).

Tree Thinking and Acceptance of Evolution in S11 Through F12 Semesters

Mean TTCI_POST scores were significantly higher than mean TTCI_PRE scores for all individual semesters and in the pooled data (Table 5, Additional file 3). Students who reported having previously taken introductory biology or previously seen or learned to read phylogenetic trees had significantly better tree reading than those who had not (Table 6). Within pretests and posttests, there were no differences in TTCI scores among students in different years of school or between majors and non-majors. Normalized change scores, c _T , showed an average increase of 33 % across all questions in pooled data, with a low of 15 % in S12 and a high of 46 % in S11 (Table 5). Reliability analysis of the TTCI had a Cronbach’s α of 0.60 and 0.68 in the pretest and posttest, respectively, indicating that the assessment instrument questions are measuring the same conceptual construct.

Pretest TTCI assessment showed that in approximately half of the responses, students correctly answered that phylogenies show relationships among lineages indicated by lines in the diagram (Fig. 1, Table 7). Slightly over one-third of responses correctly identified how time is represented in a phylogeny. Only one fourth correctly responded that nodes indicate where lineages diverge, but approximately one third held the misconception that nodes indicated where lineages came together or hybridized. Students correctly described relationships shown in phylogenies in half of their TTCI_PRE responses. As in F09 and S10, node counting was used to determine relationships in phylogenies to a greater extent than reading across the tips. Students could generally identify identical trees showed the same branching pattern of relationships despite node rotations. However, there was a low percentage of correct answers in questions asking students to interpret how trait evolution and speciation is shown in trees. Posttest responses showed improvement in all areas (Fig. 1; Table 7). In posttests, a greater percentage of responses correctly described the components of a phylogenetic tree, and students improved in their ability to determine relationships and interpret traits in trees. Although the frequency of node counting to determine relationships decreased in the TTCI posttest, it still tended to used with greater frequency than reading across the tips. Responses in the TTCI posttest showed increases in correct responses of 15 % or less in Questions T1, T5, T6, T7, and T11. Other questions showed larger increases of 20–40 % in the percentage of correct answers.

Summary of concepts and skills from S11–F12 TTCI. Percentage of TTCI responses for different tree-thinking concepts and skills. Misconceptions and incorrect methods of determining relationships are indicated by an asterisk. TTCI questions addressing a concept or skill are given in parenthesis. See Additional file 2 and Table 7.

Full size image

Looking across questions, TTCI pretest discrimination index values had an average of D = 0.45 ± 0.130 (indicating that the percentage of correct answers to pretest questions was 45 % higher in the U _27 % group than the L _27 % group) (Table 7). Questions such as T4 had low D values due to low percentages of correct answers in the U _27 % and L _27 % groups, while questions such as T5 and T6 had high percentages of correct answers in all groups. Most informative were the questions with the higher D-values (i.e., T1, T9, T12, and T13) which showed that the tree thinking skills that seemed to be most difficult for the low scoring students involved determining relationships and interpreting information about speciation and character evolution.

Median MATE_PRE scores were in the High Acceptance of Evolution category (MATE scores 77–88), in combined data and for F11, S12, and F12 (Table 3, lower portion) and in the Moderate Acceptance of Evolution category (MATE scores 65–76) for S11. Median MATE_POST scores were in the High Acceptance category overall and for individual semesters. The median MATE_POST (Mdn = 82.50) was significantly higher (Z = 7.97, p < 0.001) than MATE_PRE (Mdn = 79.00) in pooled data and within semesters (S11: Z = 2.60, p = 0.009; F11: Z = 3.23, p = 0.001; S12: Z = 4.47, p < 0.001; F12: Z = 4.90, p < 0.001). Reliability analysis of the MATE showed excellent internal consistency, with Cronbach’s α values of 0.95 in pretests and 0.925 in posttests.

The only significant differences in MATE pretest or posttest scores detected among different student categories were for year in school in which seniors had significantly higher MATE_PRE and MATE_POST scores than students in other years of school (Table 6). Median MATE posttest scores were significantly higher than pretest scores in all categories except for students who were not life science majors and students who had not previously completed introductory biology. Mean normalized change across semesters for MATE scores were significantly greater than zero (t = 7.648, df = 295, p < 0.001) and showed an average increase of 23 % (c _M  = 0.23 ± 0.53 N = 296). A large majority of the pretest and posttest responses from students in the U _27 % group were in Likert categories indicating high acceptance of evolution, whereas pretest and posttest responses in the L _27 % group spanned a greater range of Likert categories (Table 8). Despite covering the scientific evidence of evolution during the semester, posttest responses showed that low acceptance of evolution persisted in some students. However, there were shifts in the MATE posttest responses of the L _27 % group in statements that address the basis of evolutionary theory on data and scientific research (Table 8).

Correlation and Linear Regression Analyses of TTCI and MATE

Pooling across the S11 through S12 semesters, MATE_PRE scores had a significant, positive correlation with all variables except year in school and major (Table 9). The correlation coefficient calculated in regression analysis of MATE_PRE was low (R = 0.309, F _{(6, 297)} = 5.21, p < 0.001), and the only significant predictors of MATE_PRE in the model were the TTCI_PRE score and whether a student had previously seen phylogenetic trees. The R value for MATE_POST over twice as large as in MATE_PRE linear regression analyses (R = 0.823, F _{(8, 295)} = 77.58, p < 0.001). MATE_POST scores had a significant, positive correlation with all variables except major and previous introductory biology experience, but only year in school, MATE_PRE, and TTCI_POST were significant predictors of a students’ acceptance of evolution as measured by MATE_POST at the end of the semester in linear regression model (Table 9). MATE_POST also had a high correlation coefficient when TTCI scores were replaced with c _T in the model (R = 0.822 F _{(7, 296)} = 87.87, p < 0.001), indicating that final acceptance of evolution in the MATE posttest was not only significantly correlated with a student’s initial acceptance of evolution, but also their gains in tree reading ability. The relationship between is improvement in tree thinking and acceptance of evolution is further supported by a significant, positive correlation between c _T and c_M with ρ = 0.127 (p < 0.05).

The present study identified a significant relationship between students’ tree thinking and their acceptance of evolution. We found that after completing a semester of introductory biology in which a number of tree-thinking activities emphasizing macroevolution and phylogenetic perspectives were used as an organizing theme throughout the semester, students improved in their ability to read and interpret phylogenetic trees as indicated by significantly higher TTCI_POST than TTCI_PRE scores, and showed significantly greater acceptance of evolution as indicated by MATE posttest scores. Many misconceptions about phylogenetic trees, as well as misconceptions and conflicting opinions about evolution were corrected for most students. The assessment instrument responses indicated that the tree-thinking curricular structure, therefore, not only promoted development of the fundamental skills for tree thinking, it also improved acceptance and understanding of the scientific evidence supporting evolution.

In terms of learning tree thinking as a skill, we found that university students at the introductory biology level are capable of learning and applying complex phylogenetic concepts and techniques. Errors detected in pretests, such as not knowing that a phylogeny shows relationships among taxa or that there is a time axis inherent in a phylogeny, indicate that some students have a fundamental misunderstanding of phylogenetic trees and the information they contain. Other errors, such as reading across the tips and node counting, indicate how students who have not been instructed how to correctly read trees use superficial features to interpret phylogenies (Halverson 2011). After completing the different activities and modules, however, students’ ability to read and interpret phylogenetic trees was significantly improved (Tables 2, 5). Common misconceptions detected in UET and TTCI pretests (Tables 2, 7; Fig. 1) were not different from those that have been identified in other studies, particularly the high occurrence of node counting. (Baum et al. 2005; Meir et al. 2007; Meisel 2010). Detailed item analysis of TTCI responses demonstrated that many of the mistakes students made when interpreting trees in TTCI pretest questions related to misunderstandings of nodes in phylogenetic trees and the evolutionary events they signify (Fig. 1, Additional file 3). For example, approximately one-fourth of students in the TTCI pretest correctly responded that nodes indicate isolation of lineages, while the majority responded that they indicate other events. Interestingly, 30 % thought that nodes indicated hybridization, which suggests these students may be confusing phylogenies with pedigrees. Although pedigrees and phylogenies are superficially similar, their interpretation is drastically different, particularly at the nodes. Applying principles for pedigree interpretation to a phylogeny could account for students’ use of methods such as node counting, which is informative to calculate degree of relatedness in a pedigree but not in a phylogeny.

Our results also showed that after completing a semester of introductory biology that used a tree-thinking curriculum, students demonstrated significantly higher acceptance of evolution (Table 3). At the start of the semester, tree-thinking ability, as indicated by the TTCI_PRE score, was a predictor of the MATE_PRE score (Table 9). However, by the end of the course in S11 through F12, students not only had significantly higher TTCI and MATE scores, but there were no longer differences in TTCI and MATE scores between students with different prior experience. In posttest assessment of MATE_POST, the TTCI_POST and MATE_PRE scores were the only significant predictors of the MATE_POST score. While the results do not allow a direct conclusion of causality, they strongly indicate that a tree-thinking curriculum that engages students in collecting data, testing hypotheses, interpreting results, and learning phylogenetic techniques can increase students’ acceptance of evolution.

Although we have detected a significant relationship between tree thinking and acceptance of evolution, the results of the study also demonstrate that ability to read phylogenetic trees does not in itself translate into significantly greater acceptance of evolution. Although students in the F09 semester had significant improvements in tree thinking, they did not show the corresponding increases in acceptance of evolution. Tree thinking does require understanding fundamental concepts and principles of evolutionary theory. However, promoting increased acceptance of evolution requires that students also put tree thinking into a larger context and understand how phylogenies serve as a conceptual starting point for researchers investigating evolution. We think that this is the key benefit of our tree-thinking curriculum. It promotes increased acceptance of evolution by helping students improve their understanding of the nature of science and how evolution is studied scientifically (Johnson and Peeples 1987; Southerland et al. 2001). For example, MATE pretest responses in all semesters of the study (Tables 4, 8) indicated that although students understood evolution to be a scientific theory, many did not understand how evolution research is conducted or how the available scientific data are evidence of evolutionary processes. Students in the L _27 % groups of the MATE_PRE assessment in particular responded that although scientists accept evolution, they thought that evolutionary theory is neither based on valid scientific experimentation and data nor is it a valid scientific theory (Table 8). These conflicting views strongly suggest that basic unfamiliarity with the nature of science in evolutionary biology research is likely an important factor shaping students’ acceptance of evolutionary theory.

Doubts about the existence and validity of evidence supporting evolution not uncommon (Alters 2005; Miller et al. 2006; Moore 2008; Smith 2010; Yates and Marek 2014), particularly given the complexities of some data (e.g., molecular sequences) and unfamiliar methods of analysis (e.g., cladistics). Significant increases in acceptance of evolution for S10 students overall and in the L _27 % group were primarily due to responses reporting greater acceptance of the data and research supporting evolutionary theory (e.g., statements M2, M4, M6, M8, M12, and M16) in the MATE posttest after the tree-thinking semester, whereas the responses to these questions in the F09 non-tree-thinking semester remained largely the same (Tables 3, 4). Similar changes were also detected in MATE_POST responses for the other four semesters of this study (Tables 3, 8). These results indicate that an increased emphasis on macroevolutionary research and repeated exposure to and experience working with different forms of phylogenetic data not only improved students’ understanding of these topics, but also clarified how evolution research is conducted, and thereby resulted in a significant increase in students’ acceptance of evolution under the tree-thinking curriculum.

Increased proficiency in a technique or method of analysis such as phylogenetic analysis does not automatically relate to increased acceptance of evolutionary theory (Sinatra et al. 2008). Instead, we would suggest that the tree-thinking curriculum fosters a deeper understanding of how evolution is scientifically studied and validated, which is likely critical to improving acceptance of evolutionary theory. Regardless of what students believe, and MATE responses indicate that some students continue to hold beliefs that are not completely consistent with evolution, students showed an improved understanding of the methods and evidence supporting evolutionary theory, which was responsible for the increased MATE scores. The tree-thinking focus in the introductory curriculum provides a larger, unifying conceptual framework throughout the course that presents, for what is likely the first time for many students, how biologists study evolution.

Evolution is a complex theory that requires synthesis of many different forms of data. By presenting students with tree thinking activities that draw upon examples using ecological, genetic, developmental, behavioral, and other forms of data, the tree-thinking curriculum provides a framework to synthesize data across different fields and show how they converge in support of evolutionary theory. Additionally, the curriculum focuses on macroevolution, which is an important, fundamental component of evolutionary theory that often receives scant emphasis in evolution education. The increased emphasis on macroevolution provides additional perspectives on evolution and the nature of science, both of which are necessary to develop a broader understanding, appreciation, and acceptance of evolutionary theory (Johnson and Peeples 1987; Southerland et al. 2001; Southerland and Sinatra 2005; Hawley et al. 2011).

Correctly applying tree thinking requires a fundamental understanding that lineages of different taxa descend and diverge from one another through a series of nested ancestor-descendent relationships. We expected that by establishing how evolution is based on tangible and uncontroversial processes of inheritance, students should develop a better understanding of how genetic data provide a record of successful reproduction and transmission of information across generations. The tree-thinking curriculum focused on demonstrating how DNA and other forms of data based on genetics (e.g., structural and developmental homology) can provide highly informative, empirical evidence about the historical relationships within and among lineages that can be used in evolutionary studies. By teaching phylogenetic approaches and tree thinking, we predicted that students would learn about and gain experience using the phylogenetic framework biologists use to develop hypotheses and explore questions about how organisms and their features evolve.

Tree thinking involves not only the technical aspect of reading phylogenies, but also using an overarching understanding of evolution as an emergent biological phenomenon and how these diagrams graphically represent the nested hierarchy and descent from a common ancestor that are the core of evolution research. Thus, the ability to read and interpret trees correctly reflects not only proficiency in using specific skills, but also an understanding of the evolutionary basis of these diagrams. The results of our study support the use of tree thinking as a curricular theme in introductory biology education and demonstrate how a curriculum focused on tree thinking helps students learn not only an important skill, but can also promote greater acceptance of evolution. In particular, efforts to improve evolution education should continue to explore the relationship between students’ understanding of the nature of science in evolution research and their acceptance of the theory (Johnson and Peeples 1987). Further studies should also strive to identify whether there are certain activities we used or specific aspects of tree-thinking curriculum that have a greater influence on correcting misconceptions and increasing acceptance of evolution. By identifying the most useful activities or the attributes of modules that have a particularly effective influence on students’ understanding and acceptance of evolution, science education researchers can not only continue to develop activities that improve tree-thinking skills, but also include features in those activities and curricular modifications that are known to promote the greatest increases in understanding and acceptance of evolution.

MATE:

measure of the acceptance of the theory of evolution

TTCI:

Tree thinking Concept Inventory

UET:

understanding evolutionary trees

JPG taught and developed the BIOL 1134 course, collected data, and analyzed data. MHH informed students about and recruited students for the study. Both JPG and MHH participated in development and design of the study, and the drafting and editing of the manuscript. All authors read and approved the final manuscript.

Acknowledgements

Research funded by NSF DUE #0940835. Research conducted under OU IRB #12682. Thanks to M. Jones, J. Cooper, C. Halverson, S. Brownell, and D. Baum who provided valuable comments on different aspects of this research and two anonymous reviewers who provided comments that improved the manuscript.

Compliance with Ethical Guidelines

Competing Interests The authors declare that they have no competing interests.

Affiliations

1. Department of Biology, University of Oklahoma, Norman, OK, 73019, USA

   • J Phil Gibson
   •  & Mariëlle H Hoefnagels

2. Department of Microbiology and Plant Biology, University of Oklahoma, Norman, OK, 73019, USA

   • J Phil Gibson
   •  & Mariëlle H Hoefnagels

Corresponding author

Correspondence to J Phil Gibson.

Reprints and Permissions