gradetools: a grading assistant in RStudio

.title[
# <img src='figures/gradetools-logo.png' align='center' width='450px' alt='a hex shaped logo with a cat in front of a laptop sending out paper planes and a notepad with A+ on it. The logo reads gradetools'/> gradetools: a grading assistant in RStudio
]
.subtitle[
## <a href="https://github.com/federicazoe/gradetools-uscots2023/">https://github.com/federicazoe/gradetools-uscots2023/</a>
]
.author[
### Federica Zoe Ricci, Catalina Medina, and Mine Dogucu
]
.date[
### USCOTS - June 1, 2023
]

---

PhD Student @ University of California, Irvine

**Stats interests:** Bayesian statistics + Statistics Education

**Other interests:** Hiking, traveling and cooking

**Website:** <svg aria-hidden="true" role="img" viewBox="0 0 640 512" style="height:1em;width:1.25em;vertical-align:-0.125em;margin-left:auto;margin-right:auto;font-size:inherit;fill:currentColor;overflow:visible;position:relative;"><path d="M579.8 267.7c56.5-56.5 56.5-148 0-204.5c-50-50-128.8-56.5-186.3-15.4l-1.6 1.1c-14.4 10.3-17.7 30.3-7.4 44.6s30.3 17.7 44.6 7.4l1.6-1.1c32.1-22.9 76-19.3 103.8 8.6c31.5 31.5 31.5 82.5 0 114L422.3 334.8c-31.5 31.5-82.5 31.5-114 0c-27.9-27.9-31.5-71.8-8.6-103.8l1.1-1.6c10.3-14.4 6.9-34.4-7.4-44.6s-34.4-6.9-44.6 7.4l-1.1 1.6C206.5 251.2 213 330 263 380c56.5 56.5 148 56.5 204.5 0L579.8 267.7zM60.2 244.3c-56.5 56.5-56.5 148 0 204.5c50 50 128.8 56.5 186.3 15.4l1.6-1.1c14.4-10.3 17.7-30.3 7.4-44.6s-30.3-17.7-44.6-7.4l-1.6 1.1c-32.1 22.9-76 19.3-103.8-8.6C74 372 74 321 105.5 289.5L217.7 177.2c31.5-31.5 82.5-31.5 114 0c27.9 27.9 31.5 71.8 8.6 103.9l-1.1 1.6c-10.3 14.4-6.9 34.4 7.4 44.6s34.4 6.9 44.6-7.4l1.1-1.6C433.5 260.8 427 182 377 132c-56.5-56.5-148-56.5-204.5 0L60.2 244.3z"/></svg> <a href = "https://federicazoe.github.io" style="color:whitesmoke;"> federicazoe.github.io</a>

]

PhD Student @ University of California, Irvine

**Stats interests:** Statistics for Public Health + Statistics Education

**Other interests:** Reading, cooking and binging TV

**Website:** <svg aria-hidden="true" role="img" viewBox="0 0 640 512" style="height:1em;width:1.25em;vertical-align:-0.125em;margin-left:auto;margin-right:auto;font-size:inherit;fill:currentColor;overflow:visible;position:relative;"><path d="M579.8 267.7c56.5-56.5 56.5-148 0-204.5c-50-50-128.8-56.5-186.3-15.4l-1.6 1.1c-14.4 10.3-17.7 30.3-7.4 44.6s30.3 17.7 44.6 7.4l1.6-1.1c32.1-22.9 76-19.3 103.8 8.6c31.5 31.5 31.5 82.5 0 114L422.3 334.8c-31.5 31.5-82.5 31.5-114 0c-27.9-27.9-31.5-71.8-8.6-103.8l1.1-1.6c10.3-14.4 6.9-34.4-7.4-44.6s-34.4-6.9-44.6 7.4l-1.1 1.6C206.5 251.2 213 330 263 380c56.5 56.5 148 56.5 204.5 0L579.8 267.7zM60.2 244.3c-56.5 56.5-56.5 148 0 204.5c50 50 128.8 56.5 186.3 15.4l1.6-1.1c14.4-10.3 17.7-30.3 7.4-44.6s-30.3-17.7-44.6-7.4l-1.6 1.1c-32.1 22.9-76 19.3-103.8-8.6C74 372 74 321 105.5 289.5L217.7 177.2c31.5-31.5 82.5-31.5 114 0c27.9 27.9 31.5 71.8 8.6 103.9l-1.1 1.6c-10.3 14.4-6.9 34.4 7.4 44.6s34.4 6.9 44.6-7.4l1.1-1.6C433.5 260.8 427 182 377 132c-56.5-56.5-148-56.5-204.5 0L60.2 244.3z"/></svg> <a href = "https://catalinamedina.github.io/" style="color:whitesmoke;">catalinamedina.github.io</a>

]

Lecturer @ University College London

Assistant professor @ University of California, Irvine

**Website:** <svg aria-hidden="true" role="img" viewBox="0 0 640 512" style="height:1em;width:1.25em;vertical-align:-0.125em;margin-left:auto;margin-right:auto;font-size:inherit;fill:currentColor;overflow:visible;position:relative;"><path d="M579.8 267.7c56.5-56.5 56.5-148 0-204.5c-50-50-128.8-56.5-186.3-15.4l-1.6 1.1c-14.4 10.3-17.7 30.3-7.4 44.6s30.3 17.7 44.6 7.4l1.6-1.1c32.1-22.9 76-19.3 103.8 8.6c31.5 31.5 31.5 82.5 0 114L422.3 334.8c-31.5 31.5-82.5 31.5-114 0c-27.9-27.9-31.5-71.8-8.6-103.8l1.1-1.6c10.3-14.4 6.9-34.4-7.4-44.6s-34.4-6.9-44.6 7.4l-1.1 1.6C206.5 251.2 213 330 263 380c56.5 56.5 148 56.5 204.5 0L579.8 267.7zM60.2 244.3c-56.5 56.5-56.5 148 0 204.5c50 50 128.8 56.5 186.3 15.4l1.6-1.1c14.4-10.3 17.7-30.3 7.4-44.6s-30.3-17.7-44.6-7.4l-1.6 1.1c-32.1 22.9-76 19.3-103.8-8.6C74 372 74 321 105.5 289.5L217.7 177.2c31.5-31.5 82.5-31.5 114 0c27.9 27.9 31.5 71.8 8.6 103.9l-1.1 1.6c-10.3 14.4-6.9 34.4 7.4 44.6s34.4 6.9 44.6-7.4l1.1-1.6C433.5 260.8 427 182 377 132c-56.5-56.5-148-56.5-204.5 0L60.2 244.3z"/></svg> <a href = "http://minedogucu.com" style="color:whitesmoke;"> minedogucu.com</a>

]
]

---

## Take a moment to

- download latest version of this workshop material from
 [https://github.com/federicazoe/gradetools-uscots2023](https://github.com/federicazoe/gradetools-uscots2023)
 
<img src="figures/take_a_moment.png" alt="Person with long hair sitting with their laptop" width="80%" style="display: block; margin: auto;" />

- link to slides for each sections can be found there

---

## Survey

Today's participants:

- represent a wide array of institutions
- teach classes of varied sizes

The **variety of your experiences** will be very helpful for us to learn improvements that can make gradetools even more helpful!

]
]

---

## Survey

At least half of you teach a course that involves some computing

- This is great because gradetools was made to be compatible with **computing assignments**

- We are working on a new and improved version of gradetools, which **will include** compatibility with **pdfs**!

]
.panel[.panel-name[What we should've asked you]

- Do you feel at least moderately comfortable with RStudio?
- Have you brought your own student submissions to grade?
- Have you ever used GitHub?
- Have you ever used GitHub for your class?

]
]

---

## Workshop outline

- Introduction

- Grading inputs & outputs

- Core functionalities

- **_30 min break (2:30-2:45pm)_**

- Additional functionalities

- gradetools + GitHub

Note: workshop ends at 4:15 pm

---

# Introduction

---
class:  middle

## Terminology

**Grade** - numeric score (e.g. 3.5)

**Feedback** - qualitative comment (e.g. "The response variable should be on the y axis")

---

## Let's think about grading

![:col_header 
1. Preparation 
 ,
 2. Grading and Feedback 
 ,
 3. Returning grades & feedback 
 
 ]

---

## gradetools focus

![:col_header 
1. Preparation 
 ,
 2. Grading and Feedback 
 ,
 3. Returning grades & feedback 
 
 ]

---

## How did gradetools come about?

Once upon a time, Federica was a TA for Mine...

]

.pull-right2[
 
 
<img src="figures/girl-grading.webp" alt="Person with long hair sitting with their laptop" width="70%" style="display: block; margin: auto 0 auto auto;" />
]

---

## How did gradetools come about?

Once upon a time, Federica was a TA for Mine...

... and she needed to grade many .R and .Rmd files for every homework

]

.pull-right2[
 
 
<img src="figures/girl-grading.webp" alt="Person with long hair sitting with their laptop" width="70%" style="display: block; margin: auto 0 auto auto;" />
]

---

## Grading tasks

- Downloading student files

]

.pull-right2[
 
 
<img src="figures/github-logo.png" alt="GitHub logo" width="80%" style="display: block; margin: auto 0 auto auto;" />
]

---

- Downloading student files

- Open each student's file(s), one by one

]

.pull-right2[
<img src="figures/screenshot-assignment-folders.png" alt="A folder structure titled hw-1. There are multiple hw01 folders for different students." width="180%" style="display: block; margin: auto 0 auto auto;" />

]

---

## Grading tasks

- Open each student's file(s), one by one

- Referencing the rubric

]

]

---

## Grading tasks

- Open each student's file(s), one by one

- Referencing the rubric

- Evaluating student's work

]

]

---

## Grading tasks

- Downloading student files

- Open each student's file(s), one by one

- Referencing the rubric

- Evaluating student's work

- Assigning a score for the work

]

]

---

## Grading tasks

- Downloading student files

- Open each student's file(s), one by one

- Referencing the rubric

- Evaluating student's work

- Assigning a score for the work

- Preparing individualized feedback

]

]

---

## Grading tasks

- Downloading student files

- Open each student's file(s), one by one

- Referencing the rubric

- Evaluating student's work

- Assigning a score for the work

- Preparing individualized feedback

- Distributing feedback and grades

]

]

---

## Grading tasks

- **Open each student's file(s), one by one**

- **Referencing the rubric**

- **Evaluating student's work**

- **Assigning a score for the work**

- **Preparing individualized feedback**

- Distributing feedback and grades

]

]

---

## Administrative Tasks

- Opening and closing files

]

---

## Administrative Tasks

- Opening and closing files

- Referencing the rubric

]

---

## Administrative Tasks

- Opening and closing files

- Referencing the rubric

- Entering and storing grades to the gradesheet

]

---

## Administrative Tasks

- Opening and closing files

- Referencing the rubric

- Entering and storing grades to the gradesheet

]

## Pedagogical Decisions

- Evaluating students' work

]

---

## Administrative Tasks

- Opening and closing files

- Referencing the rubric

- Entering and storing grades to the gradesheet

]

## Pedagogical Decisions

- Evaluating students' work

- Assigning a score

]

---

## Administrative Tasks

- Opening and closing files

- Referencing the rubric

- Entering and storing grades to the gradesheet

]

## Pedagogical Decisions

- Evaluating students' work

- Assigning a score

- Providing feedback

]

---

The gradetools package

- .emph[automates] the repetitive .emph[administrative tasks] in the grading workflow

- minimizes switching between different interfaces

- .emph[saves time for] more meaningful tasks that require .emph[pedagogical decisions].

---

## Example: a homework

_Many of the following questions will be based on the **bike rental data** in Los Angeles. The data represents all bike rides from Metro Bike Share company in April-June of 2019._

_The data and a description of each variable can be found at (https://bikeshare.metro.net/about/data/)._

_Throughout the homework, make sure you use a reasonable font size and **label axes**. You are welcome to use colors and themes whenever you would like. Adhere to tidyverse style guide._

---

## Example: a homework

_**Question 1**_

_How many observations and variables are there? What does each observation represent? Answer with inline code when appropriate._

_**Question 2**_

_Make a plot that shows the number of rentals by each pass type._

_**Question 3**_

_Does bike type preference seem to vary by passholder type? Make a plot and refer to it in your answer to this question._

---

### Demo of gradetools in action!

```r
assist_grading(
  rubric_path = "rubric.csv", 
  roster_path = "roster.csv", 
  grading_progress_log_path = "grading-progress-log.csv", 
  final_grade_sheet_path = "quiz01-final-grade-sheet.csv", 
  example_assignment_path = "quiz01/quiz01-BaronPoisson.Rmd",
  example_feedback_path = "quiz01/quiz01-BaronPoisson-feedback.html",
  example_student_identifier = "BaronPoisson"
)
```