�ݺ�ߣ

10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html Using game mechanics and social networking to motivate student contributions to a course Edward F. Gehringer Dept. of Computer Science North Carolina State University Your feedback welcome … http://www4.ncsu.edu/~efg/form.html

Outline The goal: Authentic assessment Virtual demo Social networking and game mechanics Reputation systems Summary 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

Authentic assessment What is it? Why is it hard? How can we facilitate it? Student-generated content Peer review 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

Student-generated content gets students working together to improve others’ learning experiences, helps them learn, by performing tasks that are similar to real-world responsibilities, gives them experience in writing their ideas up for an audience of their peers, allows each cohort to “stand on the shoulders” of students in earlier classes. 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

“ Virtual” demo Creating an assignment Selecting a topic Reviewing Feedback from author to reviewer Teammate review 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

Setting up a wiki assignment 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html 10/30/09

Let’s create some teams … 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html 10/30/09

Here’s how we import it 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

Now there are five teams … 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

“ Virtual” demo Setting up an assignment Selecting a topic Reviewing Feedback from author to reviewer Teammate review 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

Selecting a Topic 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

Let’s review a wiki page 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

Click on the assignment … 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

… then on “Others’ work” 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

Choose a review 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

Read the submitted wiki page 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

Then fill out the review template 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

Save and view the review 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

Now the reviewee logs in … 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

… and views the scores 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

Click on “View” to expand review 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

Notice the link down at the bottom 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

Use it to give feedback to the reviewer 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

Then the reviewer can view the feedback 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

Review of teammates 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

Summary of feedback in Expertiza Reviews Feedback to author Teammate reviews Metareviews ( x reviews y ’s review of z ) 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

Instructor report 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

How to motivate students? Runners in a race are motivated by seeing other runners ahead of them. Players in online games are motivated to catch the leaders. Can we do the same thing in our peer-review system? 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

Motivating Students: Achievement System Categories in we can track achievement Quality of submitted work Quality of reviews Helpfulness to authors Contribution to team These factors make up reputation. 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

Recognizing Achievement: Leaderboards Students can list their achievements for all to see. 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

Now a new review is entered … 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

… and the leaders change 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

A new metareview is entered … 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

… and a new leader is recognized 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

What we have here is … a social network! Connections among many individuals. Information contributed from many sources (albeit coerced!) Can be used to discover competencies of individuals. 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

Future work: Message boards for extra credit Student a posts a question Student b responds Student a rates student b ’s response Others can rate response too. TAs can also respond Prompt reviews/answers are more helpful, so reward for these … 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

New Features Coming to Expertiza Levels “ Special power”―rearranging messages Microtasks/micropayments … incentivize useful work 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

Outline The goal: Authentic assessment Virtual demo Student-generated content Social networking and game mechanics Reputation systems Summary 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

Are the evaluations reliable? Author feedback Metareviewing helps. Algorithmic strategies 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

Algorithmic approaches Strategies use quality and leniency as metrics for assigning grades. Quality is dependent on leniency, and vice versa. Their approach yields a system of simultaneous equations, which can be solved to yield values for quality. Other researchers have devised similar methodologies. 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

Other reputation systems What we have seen are “reputation systems” devoted to evaluating required work. Other reputation system deal with voluntary work. Our hope is to blend the two. 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

Summary If students do “real” tasks, authentic assessment is possible. Peer assessment provides a scalable approach to authentic assessment. Incentives such as leaderboards and micropayments can be used to encourage student contributions. A reputation system is needed for quality control. 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

�ݺ�ߣ

Sloan 2009

More Related Content

Sloan 2009