Presenters<\/h3>\n

Mike McLeod, Michigan State University
\nAnn Shivers-McNair, University of Washington
\nJeff Grabill, Michigan State University<\/p>\n

Review<\/h3>\n

Mike McLeod, Ann Shivers-McNair, and Jeff Grabill talked and asked for feedback about their work with Eli Review<\/a> in their \u201cTools for Writing Researchers by Writing Researchers<\/a>\u201d panel at the 2016 Computers and Writing Conference.<\/span><\/p>\n

Shivers-McNair presented first, describing her need for a tool like Eli Review. For instance, she talked about how she realized she needed to better understand the peer review process in order to better communicate its purposes to students. Using Eli Review as a tool for collecting students\u2019 assignments, she began to ask the question \u201cwhat if Eli could systematically study peer review data?\u201d and brought those kinds of questions to the Eli Review staff. This feedback contributed to the development of the option in Eli Review for data export.<\/span><\/p>\n

Grabill talked next. He focused on the business side of Eli Review and the decisions concerning access that were made. He used this time to elaborate on some of the ideas he had talked about in his Friday evening keynote. One such idea was the stupidity of trying to separate the technology from pedagogy. Pedagogy and technology, Grabill reminded, if situated in a positive relationship, cannot and should not be separated; good technology should necessarily influence pedagogy and an open pedagogy should drive technological needs.<\/span>\u00a0Grabill, too, spent some time talking about access. He noted that Eli Review\u2019s data is not open access. Proposals for research must be submitted and reviewed. This approval process also means, though, that those at Eli Review can tailor data exports to specific research projects.<\/span><\/p>\n

Grabill also was sure to talk about the ownership of the students\u2019 work and the protection of anonymity. He noted that Eli still has important ethical questions to answer. Since Eli is already being used in high schools and middle schools, for instance, what happens if middle school students identify their location in their writing projects by using name of school in writing?\u00a0<\/span>Shivers-McNair came back into the conversation to talk about Eli\u2019s attempt to begin to answer those ethical questions. Those at Eli looked to existing corpora (MICUSP<\/a>, PSU C-SAW<\/a>, USE, and BAWE<\/a>) and how those corpora dealt with informed consent. Shivers-McNair also talked about asking several linguists about what Eli should be called: is it a corpus or a repository?<\/span><\/p>\n

Then, discussion turned to incentivizing the use of Eli. How can Eli both compel instructors to use the program and also compel students to share their writing? Existing corpora have different methods for providing that incentive. Some offer students modest payment, others offer something useful to the student in exchange for their writing, and some even share any research that is done that uses corpus data.<\/span><\/p>\n

In his presentation, Mike McLeod (Eli\u2019s head of product) discussed similar practical considerations about Eli\u2019s use and gave the data about how often Eli is already being used. He noted that since 2012 (when Eli was last at the Computers and Writing Conference), Eli has seen 28,799 task prompts in the program, 242,944 \u201ccomposed in Eli\u201d submissions, 95,654 uploaded files, and over 1 million comments.\u00a0<\/span>McLeod then talked about the three primary challenges for an opt-in corpus. One is primarily a hardware question: \u201cHow do we [Eli] isolate and protect the shared data?\u201d Going along with this challenge, though, is one about IRB-compliance. If Eli wants to be used for research, after all, it needs to be compliant to researchers\u2019 home IRBs. The final challenge is one of interface: \u201cHow do we [Eli] persuade people to contribute?\u201d<\/span><\/p>\n

Before using the session as a time to get feedback from instructors on the interface, McLeod described the thought process that went into creating the current interface. He noted how important student comfort was, describing student restraint to share less-than-exceptional work with Eli. Recognizing that discomfort, McLeod talked about the importance of immediately recognizing the students\u2019 wishes: \u201cIf they [students]say \u2018no\u2019 once [to sharing work with Eli], we won\u2019t bug them anymore.\u201d<\/span><\/p>\n

After this talk about the thought behind the interface, session attendees were asked to view the interface and then complete a survey to get real-time, immediate feedback. McLeod, Grabill, and Shivers-McNair then talked with attendees about the results of the survey. They noted that this kind of interaction is precisely the kind that Eli is trying to achieve–immediate feedback for instructors and researchers about Eli Review.<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"

Presenters Mike McLeod, Michigan State University Ann Shivers-McNair, University of Washington Jeff Grabill, Michigan State University Review Mike McLeod, Ann Shivers-McNair, and Jeff Grabill talked and asked for feedback about their work with Eli Review in their \u201cTools for Writing Researchers by Writing Researchers\u201d panel at the 2016 Computers and Writing Conference. Shivers-McNair presented first,<\/p>\n","protected":false},"author":140,"featured_media":12992,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[472],"tags":[61,390],"ppma_author":[1287],"class_list":{"0":"post-12933","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-2016-cw-reviews","8":"tag-computers-and-writing","9":"tag-conference-reviews"},"authors":[{"term_id":1287,"user_id":140,"is_guest":0,"slug":"spencerjsmith","display_name":"Spencer Smith","avatar_url":"https:\/\/secure.gravatar.com\/avatar\/1502ee93dda3570789ed5f4684dcd72f?s=96&d=identicon&r=g","user_url":"https:\/\/spencerjsmith.com\/","last_name":"Smith","first_name":"Spencer","job_title":"","description":"Spencer is a MA student focusing on rhetoric and composition in Ohio University\u2019s English department. He is interested in pedagogy, learning, and how classroom activities help students compose their identities. Outside of the classroom, Spencer also seeks to teach and learn in www.smithbrainconnections.com, an organization he co-founded."}],"_links":{"self":[{"href":"https:\/\/www.digitalrhetoriccollaborative.org\/wp-json\/wp\/v2\/posts\/12933","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.digitalrhetoriccollaborative.org\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.digitalrhetoriccollaborative.org\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.digitalrhetoriccollaborative.org\/wp-json\/wp\/v2\/users\/140"}],"replies":[{"embeddable":true,"href":"https:\/\/www.digitalrhetoriccollaborative.org\/wp-json\/wp\/v2\/comments?post=12933"}],"version-history":[{"count":8,"href":"https:\/\/www.digitalrhetoriccollaborative.org\/wp-json\/wp\/v2\/posts\/12933\/revisions"}],"predecessor-version":[{"id":20906,"href":"https:\/\/www.digitalrhetoriccollaborative.org\/wp-json\/wp\/v2\/posts\/12933\/revisions\/20906"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.digitalrhetoriccollaborative.org\/wp-json\/wp\/v2\/media\/12992"}],"wp:attachment":[{"href":"https:\/\/www.digitalrhetoriccollaborative.org\/wp-json\/wp\/v2\/media?parent=12933"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.digitalrhetoriccollaborative.org\/wp-json\/wp\/v2\/categories?post=12933"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.digitalrhetoriccollaborative.org\/wp-json\/wp\/v2\/tags?post=12933"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.digitalrhetoriccollaborative.org\/wp-json\/wp\/v2\/ppma_author?post=12933"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}