1. Choose a Methodology and Paper
There are 5 choices of methodologies: (1) Qualitative Studies (Interview, Observation), (2) Survey, (3) Behaviour Log, (4) Evaluation and (5) Participatory Design. Email your top 3 choices of methodologies to the instructor, and you will be assigned one of the methodologies to create a rubric on. Similar to previous weeks, each team member should choose ONE article to read under the section of your chosen methodology on the Methodologies page. Each member must choose a different article. Some of these articles are long, but you can skim and skip to the sections that contain useful information for creating your rubric. Access to the Methodologies page is provided on Slack.
Next week, you will critique and present a paper that employs your chosen methodology, using the rubric that you have created. This week, you simply have to choose the paper. Select your top 3 choices of papers from the Reading page. You can search for relevant papers by typing the methodology keyword into the search box at the top of the page. Papers are first come first serve. You can see the papers that are already assigned in the "Team information and Paper Assignment" spreadsheet pinned to the #announcements channel. Email the instructor with your top 3 choices, and the instructor will assign you one of the papers, if they are still available. You are welcome to select your own papers outside of this reading list. However, your chosen paper must (1) employ your chosen methodology as the main method, (2) be about education technology, (3) be published in trusted HCI venues (e.g., CHI, CSCW, UIST, L@S). If you chose a paper outside of the reading list, please direct message the instructor for approval on Slack.
2. Create a Rubric
Based on your reading, each team must create an analytic rubric for your chosen methodology. Your rubric will be used to evaluate the paper that your team will choose, critique and present next week. An analytic rubric (see 1, 2, 3 to learn about analytic rubrics) analyzes an artifact (e.g., a research paper) by specific aspects/dimensions. To create this rubric, you first have to come up with a set of aspects/dimensions (min 4, max 8) that you believe are important for research that employs your chosen methodology based on the reading, and describe the characteristics of research papers that would warrant different scores along each aspect/dimension. You can add this rubric to the rubrics Google Doc that is already pinned to your team's private channel. After the submission deadline, a PDF version of your rubric will be posted on the course website, so that students can see the variety of rubrics that were produced.
3. Complete Project Sketch
Your team is asked to complete a 1 page project sketch (excluding references, which has no limits). You can just complete this on Overleaf by the due date/time. Use the sample-sigconf.tex template. The project sketch should answer the following question: (1) what is the motivation behind the project? Provide a 1 paragraph argument and 3-5 citations as evidence to support your argument. (2) What education theory or pedagogical approach is your project based on? Write 1 paragraph and give 3-5 citations from education or education psychology (not computer science) literature. (3) List 1 high-level research question and 3-4 specific hypotheses; briefly explain where these research questions and hypotheses come from. (4) Describe in 2 paragraphs the methodologies that you plan to use and why they are appropriate for your research question; provide as much detail as you can about how you would go about conducting such a study (e.g., what kind of data collection instruments would you use? how many participants would you need? if you have a system, what would this system do?).
Due Friday Feb 26
● email methodology choices to instructor.
● email paper choices to instructor.
● complete rubric on Google doc.
● complete project sketch on Overleaf.
