1. What is the point of methodology?
Read the methodology article titled "Methodology matters: Doing Research in the Behavioural and Social Sciences" by McGrath, which provides a nice overview about the importance of methodology and different research strategies.
2. Read about "Experiment" as a Methodology
Each team member should choose ONE article to read under the "Experiment" section on the Methodologies page. Each member must choose a different article. Some of these articles are long, but you can skim and skip to the sections that contain useful information for creating your rubric. Access to the Methodologies page is provided on Slack.
3. Create a Rubric
Based on your reading, each team must create an analytic rubric for Experiment as a methodology. Your rubric will be used to evaluate the paper that your team will choose, critique and present next week. An analytic rubric (see 1, 2, 3 to learn about analytic rubrics) analyzes an artifact (e.g., a research paper) by specific aspects/dimensions. To create this rubric, you first have to come up with a set of aspects/dimensions (min 4, max 8) that you believe are important for experimental research based on the reading, and describe the characteristics of research papers that would warrant different scores along each aspect/dimension. To create the rubric, make a copy this Google doc template to create your team's own rubrics google doc, and pin the link to your team's google doc on your private team channel on Slack. After the submission deadline, a PDF version of your rubric will be posted on the course website, so that students can see the variety of rubrics that were produced.
4. Choose a Paper
Next week, you will critique and present a paper that employs Experiment as a methodlogy, using the rubric that you have created. This week, you simply have to choose the paper. Select your top 3 choices of papers from the Reading page with "Experiment" as the methodology keyword. You can search for relevant papers by typing the word "Experiment" into the search box at the top of the page. Papers are first come first serve. Email the instructor with your top 3 choices, and the instructor will assign you one of the papers, if they are still available. You are welcome to select your own papers outside of this reading list. However, your chosen paper must (1) employ experiment as the main methodology, (2) be about education technology, (3) be published in trusted HCI venues (e.g., CHI, CSCW, UIST, L@S). If you chose a paper outside of the reading list, please direct message the instructor for approval on Slack.
5. Select Presentation Dates
Each team will present twice during the term, once for paper critique and once for masterclass. Use the paper critique doodle and masterclass doodle to select the presentation dates that your team prefers. Use "Team K" as your name, where K is your team number. Note that you will be doing different presentations depending on the theme on that particular presentation date, as dictated by the course schedule.
Due Friday Jan 22
● complete rubric on Google doc.
● email paper choices to instructor.
● select presentation dates.
