Showing posts with label freshmen. Show all posts
Showing posts with label freshmen. Show all posts

Tuesday, June 12, 2012

Clickers, Participation, Assessment Outcomes, and Library Instruction

Clickers, or personal response systems, may encourage participation and help students enjoy library instruction more.  Emily Chan and Lorrie Knight, from the University of the Pacific,  conducted a study that discovered this to be true.  They also learned that assessment outcomes may not necessarily improve as a result of using clickers. 

Published in Communications in Information Literacy, their article "Clicking with Your Audience: Evaluating the Use of Personal Response Systems in Library Instruction" first identifies the makeup of college students participating in their study.  They belong to the Millennial generation who "tend to share these main character traits: feeling special, being sheltered, having confidence, preferring team or group activities, favoring the conventional, feeling pressured, and needing to achieve" (193).  They make the following claim: "Library instruction, often delivered through one-shot sessions, may seem out of touch to Millennials if it does not incorporate technology in a meaningful and entertaining manner" (193).  With this premise as their foundation, they propose the usage of personal response systems (PRS or clickers) to engage students.

Through their look at the literature they show that others have found that professional use of PRS helps students be involved in the classroom, promotes conversations, and enhances learning among students (193).  They note that PRS make the lectures and class activities more lively and less "stagnant" (193).  As mentioned elsewhere, clickers allow instructors to adjust in the moment they are teaching.  They can understand what the students know.  Therefore, an atmosphere of active engagement and learning may be easier to establish with clickers (193). 

Not enough has been written about the PRS and actual learning outcomes, so Chan and Knight worked to look at this with their study.  They cite Anne C. Osterman's 2008 article that identifies library instructors' two greatest fears: (1) boring students and (2) teaching above their heads.  At this point they refer to another article when they write: "The use of clickers can prompt greater classroom interactivity through an assessment of students' understanding of IL concepts" (194).  Additionally, they found another article that states the finding that clickers increase student involvement in the classroom as well as their usage of resources in the library (194).  To repeat myself once more, this study looks at student enjoyment, engagement, and achievement as they relate to the implementation of clickers in the classroom.

As with other studies, they prepare the reader by defining the constituents involved--in this case freshmen at the University of the Pacific--and explain the course objectives of the freshman seminar courses and the library evaluations gathered before the study took place.  "At the end of each library session, students completed a brief evaluation measuring their achievement of learning outcomes.  The Assessment Office tabulated and analyzed the results, which proved to be inconclusive" (195).  Librarians convinced their library dean to fund a second instruction room equipped with more technology, such as a smart board, a computer for all participants, and clickers.  This allowed the librarians to conduct an experiment to see if the technology influenced student learning outcomes. 

Surprisingly enough, they found that the classes without clickers scored slightly better than the ones with them.  They write: "The students in Classroom NC (non-clicker) scored significantly higher in the assessment than the students who had their library session in Classroom C (clickers) (P value < 0.001)" (197).  That is not to say that there were no positive outcomes for students taking the instruction with the clickers.  Chan and Knight write: "The students in the technology-rich Classroom C found the library sessions to be more enjoyable, organized, well-presented, and participatory" (197).  Perhaps these positive results would continue to justify the use of clickers in the classroom.

No doubt the authors must have been perplexed that the technology did not increase content retention; however, they offer some reasons why the students in technology-rich classroom may not have achieved higher scores on the assessment measures.  They do so by noting potential benefits of a paper assessment:
  1. Able to use the paper assessment as a resource
  2. Allows the student to self-regulate order and pace during the test time
  3. Lets them to see all the questions from the start (this is similar to reason #1 above)
  4. With paper exams students can review and correct their answers before turning them in to be graded
  5. A paper test gives students the opportunity to judge how they use their time; they are more in control of this than if the test is offered with technology, especially if the instructor changes the questions (198)
If librarians use the clicker technology to assess learning, these reasons may be worth remembering. 
Boulder Chain Lakes area in White Clouds of Idaho.  Lakes in photo may be of Sliderock Lake (l) and Shelf Lake (r) .  Photo by Spencer Jardine.  2010.
Here are a few other things worth mentioning from this article.  Classes with clickers seemed to enjoy the instruction more, felt it was more organized, well-presented, and participatory than those that did not have them (199).  Millenials may expect and want technology to be used.  Indeed, Chan and Knight also mention another study that suggests "the use of clickers can restart the attention span of students" (199).  Sometimes this is necessary to bring back students to the subject at hand. 

The authors see clickers as useful tools to invite participation, adjust to student needs, and as a means to get things going at the beginning of library instruction sessions.  They write: "With the clickers' ability instantly to poll the audience, library faculty used warm-up questions as icebreakers in order to foster a more collaborative and engaging environment" (199).  They had wanted the clickers to increase content retention, but the non-clicker classroom student out-performed their peers in the classroom with clickers.  Naturally, other researchers, just as the authors mention, should look to see how learning outcomes are influenced by the use of technology in the library instruction classroom.

Chan, Emily K., and Lorrie A. Knight.  "Clicking with Your Audience: Evaluating the Use of Personal Response Systems in Library Instruction."  Communications in Information Literacy 4.2 (2010): 192-201.  Print.

Thursday, May 31, 2012

Effectiveness of Clickers in Big, Intro to Psychology Classes

A group of researchers from the University of Delaware, in a study that looked at the effectiveness of personal response systems, found that modest use of "clickers" increased exam performance.  They did not see evidence that clickers actually increased engagement in their study.  In a reference to the literature they write: "According to some researchers, students like clickers, and students also believe clickers make them feel more engaged" (45).  As far as their own students went, however, they note: "Although Dr. B reported that students 'got a kick out of them,' clickers had only marginal effects on self-reports of student engagement, attendance, and reading in this study--effects that may be attributable to Type I error" (48). 

Freshmen students at the University of Delaware, at the time of the study that is, mark which classes they want to take their first year, and a computer assigns their schedule.  Morley, McAuliffe, and DiLorenzo mention more than once that this made their study more reliable and random, due to the random nature of the process.  Students personal preferences did not determine when they took the psychology class.  Morley explains that the teachers used the clicker system only minimally:
Both professors taught using an interactive lecture style.  Both professors taught the earlier section without clickers ('traditional' sections) and the later section with clickers.  In clicker sections, at the beginning of class, the instructor posted five multiple-choice, fact-based questions, based on the day's required reading.  Students earned extra credit for answering these questions correctly.  Later in the class period, if relevant, the instructor would briefely elaborate on a clicker question that most students had misunderstood.  Other than this change, instructors taught the two sections identically.  (46)
 Data gathered from the exam results did indicate that "exam scores were higher for clicker sections than for tratidtional sections" (47).  This occurred regardless of the teacher; there were two teachers who taught two sections of large, introductory psychology classes.  Morling et al. summarize it in more formal language: "Our data suggest that using clickers to quiz students in class on material from their reading resulted in a small, positive effect on exam performance in large introductory psychology classes" (47).

Further studies might consider looking at teaching methods used in conjunction with the technology.  For example, they suggest looking at concept inventories, group discussions, and Just in Time Teaching (JiTT), which could all be joined with clickers to see how they might enhance learning (48).  For more clarification, the authors write: "In our study, the instructors used clickers very minimally--to administer quizzes, publicly display the results, and quickly correct any widespread misunderstandings" (47-48). 

Moreover, the article addressed the possibility that some students cheated while taking the reading quizzes, though they concede that this may have actually promoted a cooperative learning environment, which would have improved their engagement in the class (49).  Overall, this was a good article, as it found a positive result of using clickers via a scientific study, rather than relied on anecdotes or the fact that the technology was trendy at the time.

Works Cited
Morling, Beth, Meghan McAuliffe, Lawrence Cohen, and Thomas M. DiLorenzo.  "Efficacy of Personal Response Systems ("Clickers") in Large, Introductory Psychology Classes."  Teaching of Psychology 35.1 (2008): 45-50.

Stowell, Jeffrey R., and Jason M. Nelson.  Teaching of Psychology 34.4 (2007): 253-58.

Tuesday, March 24, 2009

Working with Faculty on Library Assignments

Today I was made aware of an excellent post on the "In the Library with the Lead Pipe" blog. It talks about librarians working with faculty in a positive way. I'm glad that Ellie Collier wrote this very helpful post on communicating with campus faculty about library assignments. I particularly appreciate the possible responses that one could send to a faculty member; they are very diplomatic and respectful.

Our First Year Seminar program directors believe that a library scavenger hunt would be a great tool for introducing the freshmen to the campus library. I think that a well-crafted scavenger hunt might be a good experience for freshmen who have never entered a larger library in their lives, such as our campus library.

Of course, capitalizing on what the Library has would be optimal. For example, some students may not be aware of the student lounge, location/availability of study rooms, computer usage, how to find a book on the shelf, etc. They may not consider the Library as a relaxing place where they may read popular magazines or check their email.

My experience has been that all students do not appreciate the library tour very much, so they might learn more from a scavenger hunt that they work on with a small group of their peers, especially peers they did not know previously. A First Year Seminar program ought to facilitate networking among students. Perhaps I am digressing, but a (library) scavenger hunt done as a group could help new freshmen get to know someone they might not have. Their instructors know who they pal up with in the class, so they can assign students to groups with individuals other than their pals.

I appreciate how Ellie mentioned why some library assignments are bad. Sometimes I hear people disparage scavenger hunts in blanket statements, and it makes me hesitate to ask why, as if it should be intrinsically known already. If we can talk about the reasons why they are taboo/bad, then maybe we can find solutions for improving them.

While library tours are not the most enthralling events for freshmen, many of them do appreciate learning about the existence of computers, study rooms, and reference librarians. If nothing else, they seem to enjoy the rare books in our Special Collections: pop-up books, art books [they think the shoe book is cool], the 16th-century book of sermons by John Calvin, and ISU maps.

Wednesday, August 13, 2008

Freshmen Library Tours

New and eager students will flood the campus soon. This typically means high energy and excitement as well as a fresh round of library tours. Many libraries throughout the country have innovated in this area of freshmen orientation. Recently, several posts to the Information-Literacy and Instruction listserv have focused on the different ways librarians have introduced incoming freshmen to the academic library. At Cornell College's Cole Library in Mt. Vernon, IA, they give ice cream; cones were donated by a local bank wanting to get publicity. Peer tutors guided them to different "stations" of the library where they learned about the function of that part of the library and entered their names into raffles.

Students at the University of North Carolina at Greensboro Library divide into groups before they go to different parts of the library to answer questions. When they return, the larger group goes on the tour, and those students who answered questions give the tour to their peers while the librarian stands to the side, periodically contributing additional information. Students, then, teach each other about the library. Apparently, instructors and students have enjoyed this.

In the California State University at Stanislaus Library they will be playing golf in the library to help their students improve their putts and knowledge of the library building and resources. A guide shows them where to tee off, inserting useful information about the library. On the east coast, the University of South Carolina Upstate Library incorporates an iPod into the tour as well as a worksheet for them to fill out. Students must travel around the library and complete various tasks, including copy articles of interest out of encyclopedias, magazines, and reference books as well as answer questions regarding the library services and resources.

Here, at Idaho State's Oboler Library we conduct traditional tours to familiarize students with our library. We hope students will understand better what the library offers--more than just books--and have a positive experience that will draw them back to ask us questions and take advantage of the study space, the books, the computers, the videos, the services, etc. If you want a tour of the Eli M. Oboler Library, please contact me to arrange a time and date. jardspen(at)isu.edu

Wednesday, October 10, 2007

Objective: Help Freshmen Feel Comfortable w/Library Things

Today I will be teaching the First-Year Seminar [FYS] students again. In fact, I will teach the same section that I taught on Monday. We talked about plagiarism and academic honesty. This was the class where a student challenged me for plagiarizing the PowerPoint Presentation. Yesterday I taught a different group of students and led them in a discussion on academic integrity. One of my colleagues attended the session, and today she came and talked with me about how surprised she was at how rude the students acted in the class. At one point I had to say, "We will wait until the students in the back finish talking before going on with the discussion." I feel that doing this causes those students who are disruptive to understand that their peers do not appreciate having to wait for them or having them be disruptive so much.

One student in the front of the class took me off guard. He vocalized his ideas so loudly at times that it took me aback and I did not know how to respond to this behavior. I would almost say he was a bit aggressive and did not believe in the value of academic honesty. What do you do when students undermine your ideas by their attitude and comments? I think of my recent involvement in creating the Banned and Challenged Books Display. One of the quotations I read said something like, "The way to fight a bad idea is to present a better one," meaning that to repress or censor an idea really does not solve the problem.

Today I will be showing the catalog, inviting students to find a book on the shelves, and demonstrating how to use the EBSCOHost Academic Search Complete database. There's always so much to teach students. About a month ago I updated the worksheet, outline, and objectives for FYS. In our library instruction meeting we determined our objectives for the FYS sessions. The overarching objective is to help all students become comfortable using the library, especially the at-risk freshmen. We believe that pairing the students into groups of two or three would be useful in making it a more positive and stress-free experience.

More specifically, we want students to be inclined to ask for help at the Reference Desk or through our Ask-A-Librarian form. We want them to be able to search the library catalog effectively and be able to locate a book on the shelves. Sending the students out to find a book in the stacks will take time; however, if students look with another student we are hoping that it will take less time. Once they return from retrieving a book we will show them the database searching. Hopefully, there will be time to do this. Students will be completing exercises on a worksheet, so first they will conduct a few basic searches in the library catalog. I need to remember and give them some book jackets to search for a book. I've forgotten to do this in the past. Time management will be a factor. I want to include some Affluenza searches.

I better go and practice a few of the searches before heading up to the classroom.