Abstract
Three to five student learning outcomes (SLOs) were written for each of seven units for the Principles of Horticultural Science course, the foundation course for all nine specializations within the undergraduate horticulture program at Kansas State University. The SLOs were then used as the framework for development of the course. A pre- and post-assessment was given to the students enrolled in the course in the fall semesters of 2005 through 2008 in an effort to assess if the SLOs were being met. The 50-item assessment asked students to record their confidence in ability to do something reflective of the SLOs such as “distinguish between transpiration and respiration” or “write a scientific plant name.” The comparison of the student-reported confidence at the start of the course and their academic performance in the course were not correlated. Students' reported confidence at the conclusion of the course was correlated with their academic performance in 3 of the 4 years that were examined. Because confidence was correlated with academic performance in the course and a course would be considered a domain-specific construct, it is more likely that self-efficacy rather than confidence was impacted as the students moved through the course.
Many undergraduate horticulture programs offer an introductory or foundations course in horticulture or horticultural science. At Kansas State University, this course is HORT 201, Principles of Horticultural Science. HORT 201 is a foundation course that students in all nine specializations in horticulture are required to take and is a prerequisite for 15 upper division horticulture classes. The course is offered every fall semester, and enrollment over the past 8 years has ranged from 75 to 150 students. In addition to horticulture majors, students from all colleges across campus have enrolled in the course with most nonhorticulture students coming from other departments in the College of Agriculture and the disciplines of landscape architecture and business. The course consists of three 50-min lecture periods and one 2-h laboratory period per week. There is a required textbook and laboratory manual. Additional learning resources are made available through K-State Online, a web-based instructional platform.
Initially, based on the selected textbook (Preece and Read, 2005), the course was comprised of four units: 1) an introduction to horticulture: what it is, who is involved, what they do, and where it is going; 2) horticultural biology: how plants are named and categorized, plant structure and function, and how to apply this knowledge in horticulture; 3) horticultural environment: light, temperature, water, and soil—definitions of, their role(s) in plant growth, and how to apply this knowledge in horticulture; and 4) horticultural technology: applications of horticultural principles (propagation, postharvest, pest management, breeding, pruning) based on biological principles. Based on the units, seven course objectives were identified: 1) define horticulture and explain the relationship between horticulture and other fields of study; 2) explain the importance of horticulture to society and quality of life; 3) describe career and personal opportunities; 4) describe the general response of plants to major environmental variables; 5) give examples of practices/techniques commonly used to produce a desired response in plants and explain how and why the practice/techniques yield the desired responses; 6) use your acquired knowledge to solve basic/common horticultural problems; and 7) use your basic horticultural vocabulary in questions, answers, descriptions, definitions, and identifications.
As I began to teach this course, I was involved in writing our assessment of student learning plan for our undergraduate program in horticulture and participating in LEA/RN™ (Learning Enhancement Action/Resource Network; Iowa State University, Ames, IA), a teaching workshop led by education professionals from Iowa State University that met monthly throughout the fall and spring semesters. As I learned more about assessment of student learning and student learning outcomes, I decided to use student learning outcomes (SLOs) as the framework for the design of HORT 201. Student learning outcomes state what students should know and be able to do as a result of their coursework (Maki, 2002). As a result, the course is now designed around seven units with each unit or topic within a unit having three to five targeted SLOs (Table 1). I then used the 49 SLOs to direct and focus my plans for the class and the students. For SLOs to be effective, the students must be aware of them and must be presented with several opportunities to develop the desired outcomes (Jenkins and Unwin, 1996; Maki, 2002). Each year I created more assignments, lecture activities, and online resources to reinforce the SLOs. For example, a unit overview handout was prepared for each unit with the SLOs listed at the top, the reading assignments for that unit were listed, key terms and phrases related to the SLOs were given, and several assignments that reinforced the SLOs were offered. An example of an assignment is: Using the student learning outcomes as your guide, write five test questions. The questions must be true/false, matching, or multiple choice and cannot be all the same type of question. For each question indicate which of the student learning outcomes you are assessing.
Student learning outcomes for the seven units of an undergraduate principles of horticultural science course.
The SLOs were presented as part of a PowerPoint (Microsoft, Redmond, WA) presentation in lecture on the first day of a unit and at the conclusion of a unit. Sample examination questions assessing each SLO in a unit were also presented at the conclusion of each unit. The SLOs were also used to guide preparation of examination questions. I would write examination questions that I thought would assess the student's achievement of the SLO. For example, for the student learning outcome “Given the rules of nomenclature, students will be able to write a scientific plant name,” a likely multiple choice question would be “The correct way to write the scientific name of cultivar is” followed by multiple choices of a scientific plant name.
The use of SLOs for the development and implementation of HORT 201 was a new approach for me. The purpose of this study was to assess student confidence as a way to evaluate if the in-class activities, lectures, assignments, and examinations effectively targeted the SLOs such that the students were achieving the SLOs.
Materials and methods
To assess if the SLOs helped with student learning, a pre- and post-assessment was given to the students on the first day of class and a day in the last week of class. The survey instrument consisted of 50 statements reflective of the SLOs. Students were asked to indicate how confident they were on that day to do the statement using a five-item Likert-type scale from not confident at all to very confident. For example, the students indicated how confident they were on that day to “distinguish a monocot from a dicot,” “remove meristematic tissue from a growing plant,” and “explain what a cultivar is.” The pre- and post-assessments were administered in 2005 (100 students), 2006 (92 students), 2007 (77 students), and 2008 (78 students). Pre- and post-assessments were pair-matched by a student identification number with 75 matched pairs in 2005 (75% of enrolled students), 48 matched pairs in 2006 (52% of enrolled students), 53 matched pairs in 2007 (69% of enrolled students), and 53 matched pairs in 2008 (68% of enrolled students). Students' final course grade, as a percent, was used as an indicator for learning.
Descriptive statistics, paired t tests, Tukey's test, Duncan's multiple range test, analysis of variance, and correlational analysis were conducted using Excel 2007 (Microsoft) and SPSS (Version 18 for Windows; IBM SPSS, Chicago, IL). Confidence scores were calculated based on the five-item Likert scale. An average confidence score could range from 1 to 5 with 1 being the lowest possible score and 5 being the highest possible score. These scores are based on a rating in which 1 = not confident at all, 2 = slightly confident, 3 = somewhat confident, 4 = confident, and 5 = very confident as a response to the 50-item survey.
Results
Students reported slight confidence (close to two on the five-item Likert scale each year) at the start of the course and confidence (around four on the five-item Likert scale) at the end of the course in performing the 50 horticultural tasks on the day they completed the survey (Table 2). The positive change in confidence was significant every year and the change averaged 1.49 to 2.04 (Table 2). There was a positive change pre- to post-assessment in all 50 statements in all years (data not shown).
Mean scores of confidence to perform horticultural skills of students enrolled in an undergraduate principles of horticultural science course.
There was no difference in the students' reported confidence across all years at the start of the semester [F (3,196) = 0.620, P = 0.603] (Fig. 1); however, there was a difference at the end of the semester [F (3,196) = 11.108, P < 0.001] (Fig. 2). Students' confidence at the end of the semester in 2005 was significantly different from the other years (P < 0.05).
Mean scores of confidence to perform 50 horticultural skills of students at the start of an undergraduate principles of horticultural science course. Scores are based on a rating in which 1 = not confident at all, 2 = slightly confident, 3 = somewhat confident, 4 = confident, and 5 = very confident. There was no difference in the students' reported confidence across all years at the start of the semester [analysis of variance: F (3,196) = 0.620, P = 0.603].
Citation: HortTechnology hortte 20, 4; 10.21273/HORTTECH.20.4.683
Mean scores of confidence to perform 50 horticultural skills of students at the end of an undergraduate principles of horticultural science course. Scores are based on a rating in which 1 = not confident at all, 2 = slightly confident, 3 = somewhat confident, 4 = confident, and 5 = very confident. There was a difference in the students' reported confidence at the end of the semester [analysis of variance: F (3,196) – 11.108, P < 0.001]. Students' confidence at the end of the semester in 2005 was significantly different from the other years (Tukey's honestly significant difference test at P < 0.05).
Citation: HortTechnology hortte 20, 4; 10.21273/HORTTECH.20.4.683
Average grade earned by semester increased from fall semester 2005 to fall semester 2008 [F (3,339) = 2.033, P < 0.10] (Fig. 3). In addition, there were differences in the percent of students earning each grade across years [F (18,210) = 132.366, P < 0.05] (Fig. 4).
Average semester grade for students enrolled in an undergraduate principles of horticultural science course. Bars with the same letter are not significantly different (Duncan multiple range test at P = 0.05).
Citation: HortTechnology hortte 20, 4; 10.21273/HORTTECH.20.4.683
Percentage of students earning each letter grade in an undergraduate principles of horticultural science course.
Citation: HortTechnology hortte 20, 4; 10.21273/HORTTECH.20.4.683
The comparison of the students' reported confidence at the start of the course and their academic performance in the course was not correlated (Table 3). Students' reported confidence at the conclusion of the course was correlated with their academic performance in the course in all years except 2006.
Pearson correlation coefficients for students reported confidence to do 50 horticultural tasks at the start of an undergraduate horticultural science course and at the end of the course and their course grade.
Discussion
Do those who know more also know that they know more? This is the question that inspired psychologists in the field of decision-making and education to study confidence. Know refers to performance accuracy, and knowing how much they know relates to confidence (Lichtenstien and Fischoff, 1977). Confidence is a measure of one's belief in one's own abilities and is considered a psychological trait that is related to but distinct from both personality and ability traits (Stankov and Lee, 2008). An interrelated construct is self-efficacy, which refers to a person's belief in one's capabilities to learn or perform behaviors at designated levels (Bandura, 1977, 1986). Much research shows that self-efficacy influences academic motivation, learning, and achievement (Pajares, 1996; Schunk, 1995). Although confidence and self-efficacy are interrelated, a defining aspect of self-efficacy, which distinguishes it from the more general construct of confidence, is its domain-specific nature. Thus, it is more likely that self-efficacy rather than confidence was impacted as students moved through HORT 201 because 1) all the activities associated with a course means a course is a domain-specific construct; and 2) the students' reported confidence at the end of the semester was correlated with academic performance (Table 3).
Because HORT 201 is the first horticulture course taken by most of the students, their report of slight confidence at the start of the semester is realistic (Table 2; Fig. 1). As students move through the semester, they are affected by personal (e.g., goal setting, information processing) and situational influences (e.g., teacher feedback, grades) that provide them cues about how well they are learning. Self-efficacy is enhanced when students perceive they are performing well or becoming more skillful (Schunk and Pajares, 2002). Lack of success or slow progress will not necessarily lower self-efficacy if learners believe they can perform better by expending more effort or using more effective strategies (Schunk, 1995). One teaching strategy used in HORT 201 that may have targeted self-efficacy was the review of a unit's SLOs at the conclusion of each unit through sample examination questions reflective of each SLO. The SLO was presented followed by sample examination questions. Students were given time to consider each question before the answer was given. This activity was conducted in a fun and nonthreatening manner. From anecdotal reports from students, providing the example examination questions for each SLO helped the students understand what it meant to demonstrate achievement of the SLO and also helped them in preparing for examinations.
Instructional and other classroom processes' effects on self-efficacy have been researched. Processes beneficial for developing self-efficacy include “proximal and specific learning goals, strategy instruction and verbalization, social models, performance and attributional feedback, and performance-contingent rewards. These processes inform students of their capabilities and progress in learning, and this information motivates students to continue to perform well” (Schunk, 1995). Having three to five learning goals (SLOs) for each unit, featuring them repeatedly, and reinforcing them through lecture and assignment activities may have also targeted self-efficacy. This may also explain the improvement in overall academic performance from 2005 to 2008 (Figs. 3 and 4). There were more opportunities to affect self-efficacy because each year I built on the previous year, thus increasing opportunities to understand and demonstrate mastery of the SLOs through more assignments, lecture activities, and online resources. This may also explain why student confidence at the end of the semester was lower in the first year I implemented the SLOs than the other years (Fig. 2). Goal-setting and self-efficacy can strongly influence academic attainments (Zimmerman et al., 1992). Learning goals that are specific, short-term, and viewed as challenging but attainable enhance students' self-efficacy better than do goals that are general, long-term, or not viewed as attainable (Schunk, 1995).
Based on the pre- and post-assessment results compared with the students' academic performance, the change in confidence was an indication of student learning. Using SLOs as a framework for the course was certainly a useful tool for me as an instructor. However, for SLOs to be effective for student learning, the students must be aware of them and must be presented with several opportunities to develop the desired outcomes. Ensuring that this was the case for HORT 201 inadvertently resulted in targeting domain-specific mediators of self-efficacy that ultimately resulted in improved student learning.
Literature cited
Bandura, A. 1977 Self-efficacy: The exercise of control Freeman New York, NY
Bandura, A. 1986 Social foundations of thought and action: A social cognitive theory Prentice Hall Englewoods Cliffs, NJ
Jenkins, A. & Unwin, D. 1996 How to write learning outcomes 15 Mar. 2010 <http://www.ncgia.ucsb.edu/education/curricula/giscc/units/format/outcomes.html>.
Lichtenstien, S. & Fischoff, B. 1977 Do those who know more also know more about how much they know? Organizational Behavior Human Performance 20 159 183
Maki, P.L. 2002 Developing an assessment plan to learn about student learning J. Acad. Librarianship 28 8 13
Pajares, F. 1996 Self-efficacy beliefs in achievement settings Rev. Educ. Res. 66 543 578
Preece, J.E. & Read, P.E. 2005 The biology of horticulture Wiley Hoboken, NJ
Schunk, D.H. 1995 Self-efficacy and education and instruction 281 303 Maddus J.E. Self-efficacy, adaptation, and adjustment: Theory, research, and application Plenum Press New York, NY
Schunk, D.H. & Pajares, F. 2002 The development of academic self-efficacy 15 31 Wigfield A. & Eccles J. Development of achievement motivation Academic Press San Diego, CA
Stankov, L. & Lee, J. 2008 Confidence and cognitive test performance J. Educ. Psychol. 100 961 976
Zimmerman, B.J., Bandura, A. & Martinez-Pons, M. 1992 Self-motivation for academic attainment: The role of self-efficacy beliefs and personal goal-setting Am. Educ. Res. J. 29 663 676