02-grading-inputs-outputs.knit

# Grading inputs & outputs

---

## Function call

For the demo before, we ran

```r
assist_grading(
  rubric_path = "rubric.csv", 
  roster_path = "roster.csv", 
  grading_progress_log_path = "grading-progress-log.csv", 
  final_grade_sheet_path = "quiz01-final-grade-sheet.csv", 
  example_assignment_path = "quiz01/quiz01-BaronPoisson.Rmd",
  example_feedback_path = "quiz01/quiz01-BaronPoisson-feedback.html",
  example_student_identifier = "BaronPoisson"
)
```

---

## Function call

```r
assist_grading(
*  rubric_path = "rubric.csv", 
  roster_path = "roster.csv", 
  grading_progress_log_path = "grading-progress-log.csv", 
  final_grade_sheet_path = "quiz01-final-grade-sheet.csv", 
  example_assignment_path = "quiz01/quiz01-BaronPoisson.Rmd",
  example_feedback_path = "quiz01/quiz01-BaronPoisson-feedback.html",
  example_student_identifier = "BaronPoisson"
)
```

Location of the rubric

---

## Function call

```r
assist_grading(
  rubric_path = "rubric.csv", 
*  roster_path = "roster.csv", 
  grading_progress_log_path = "grading-progress-log.csv", 
  final_grade_sheet_path = "quiz01-final-grade-sheet.csv", 
  example_assignment_path = "quiz01/quiz01-BaronPoisson.Rmd",
  example_feedback_path = "quiz01/quiz01-BaronPoisson-feedback.html",
  example_student_identifier = "BaronPoisson"
)
```

Location of the roster

---

## Function call

```r
assist_grading(
  rubric_path = "rubric.csv", 
  roster_path = "roster.csv", 
*  grading_progress_log_path = "grading-progress-log.csv", 
*  final_grade_sheet_path = "quiz01-final-grade-sheet.csv", 
  example_assignment_path = "quiz01/quiz01-BaronPoisson.Rmd",
  example_feedback_path = "quiz01/quiz01-BaronPoisson-feedback.html",
  example_student_identifier = "BaronPoisson"
)
```

Where we want the grading progress and the final grade book to be stored

---

## Function call

```r
assist_grading(
  rubric_path = "rubric.csv", 
  roster_path = "roster.csv", 
  grading_progress_log_path = "grading-progress-log.csv", 
  final_grade_sheet_path = "quiz01-final-grade-sheet.csv", 
*  example_assignment_path = "quiz01/quiz01-BaronPoisson.Rmd", 
  example_feedback_path = "quiz01/quiz01-BaronPoisson-feedback.html",
  example_student_identifier = "BaronPoisson"
)
```

Location of one student's assignment submission

---

## Function call

```r
assist_grading(
  rubric_path = "rubric.csv", 
  roster_path = "roster.csv", 
  grading_progress_log_path = "grading-progress-log.csv",
  final_grade_sheet_path = "quiz01-final-grade-sheet.csv", 
  example_assignment_path = "quiz01/quiz01-BaronPoisson.Rmd", 
*  example_feedback_path = "quiz01/quiz01-BaronPoisson-feedback.html", 
  example_student_identifier = "BaronPoisson"
)
```

Where we want their feedback file to be stored

---

## Function call

```r
assist_grading(
  rubric_path = "rubric.csv", 
  roster_path = "roster.csv", 
  grading_progress_log_path = "grading-progress-log.csv", 
  final_grade_sheet_path = "quiz01-final-grade-sheet.csv", 
*  example_assignment_path = "quiz01/quiz01-BaronPoisson.Rmd", 
*  example_feedback_path = "quiz01/quiz01-BaronPoisson-feedback.html", 
  example_student_identifier = "BaronPoisson"
)
```

Note: we only have to provide the locations of the assignment and feedback files for **one student!**

---

## Function call

```r
assist_grading(
  rubric_path = "rubric.csv", 
  roster_path = "roster.csv", 
  grading_progress_log_path = "grading-progress-log.csv",
  final_grade_sheet_path = "quiz01-final-grade-sheet.csv", 
  example_assignment_path = "quiz01/quiz01-BaronPoisson.Rmd", 
  example_feedback_path = "quiz01/quiz01-BaronPoisson-feedback.html",
*  example_student_identifier = "BaronPoisson"
)
```

And that student's identifier (present in the roster)

---

## Function call

```r
assist_grading(
*  rubric_path = "rubric.csv",  
*  roster_path = "roster.csv",  
  grading_progress_log_path = "grading-progress-log.csv",
  final_grade_sheet_path = "quiz01-final-grade-sheet.csv", 
*  example_assignment_path = "quiz01/quiz01-BaronPoisson.Rmd",
  example_feedback_path = "quiz01/quiz01-BaronPoisson-feedback.html"  
*  example_student_identifier = "BaronPoisson"  
)
```

So these are the **inputs** of grading

---

## Function call

```r
assist_grading(
  rubric_path = "rubric.csv",  
  roster_path = "roster.csv",  
*  grading_progress_log_path = "grading-progress-log.csv", 
*  final_grade_sheet_path = "quiz01-final-grade-sheet.csv", 
  example_assignment_path = "quiz01/quiz01-BaronPoisson.Rmd",
*  example_feedback_path = "quiz01/quiz01-BaronPoisson-feedback.html", 
  example_student_identifier = "BaronPoisson"
)
```

And these are the **outputs**

---

---

---

## Roster: formatting

- .csv file

- Must have `student_identifier`  column
  - Can be anything unique to the student, for example:  
      - Name
      - Student id
      - GitHub username
  
---

## Roster: formatting

---

## Roster: formatting

- .csv file

- Must have `student_identifier`  column
  - Can be anything unique to the student, for example:  
      - Name
      - Student id
      - GitHub username

- other columns can be present

---

## Roster
  
<img src="figures/roster-extra-columns.png" alt="A spreadsheet with four columns. The first row reads student_identifier, first name, last name, student ID. The other rows contain the corresponding information for three fictitious students." width="60%" style="display: block; margin: auto;" />

---

## Roster <i class="fa-solid fa-arrow-right"></i> Grade book
  
<img src="figures/roster_to_gradebook.png" alt="On the left, a screenshot of a spreadsheet with four columns. The first row reads student_identifier, first name, last name, student ID. The other rows contain the corresponding information for three fictitious students. In the middle, a yellow arrow pointing from the figure on the left to the figure on the right. On the right, a screenshot of the same spreadsheet as the one shown on the left, but with an extra column indicating a numeric grade for each student." width="100%" style="display: block; margin: auto;" />

---

## Roster

- used to **create the grade book**

- used to **find student submission files**
  - student identifiers from the roster must be the only thing unique in the file paths!
  
---

---

---

## Assignment directories

- How submissions must be stored

]

]

---

## Assignment directories

- How submissions must be stored
- Each student has a unique identifier:  
e.g. `BaronPoisson`

]

]

---

## Assignment directories

- How submissions must be stored
- Each student has a unique identifier:  
e.g. `BaronPoisson`
- The **rest of the path is common to all** students:  
e.g. `quiz01/quiz01-XXXXXX.Rmd`
]

]

---

## Assignment directories

- How submissions must be stored
- Each student has a unique identifier:  
e.g. `BaronPoisson`
- The **rest of the path is common to all** students:  
e.g. `quiz01/quiz01-XXXXXX.Rmd`
- All extensions that can be opened with `navigateToFile()` are supported:  
e.g. `.Rmd`

]

]

---

## Assignment directories

]

---

## Assignment directories

---

## Subfolders: supported

---

## Subfolders: supported

<div class="container">
  <div class="row">
    <div class="col-sm">
    <img src="figures/subfolders-same-filename.jpg" alt="A folder structure titled quiz01. There are three subfolders, one for each student. Each subfolder has a file named quiz01.Rmd. A green validation mark on the top right corner indicates that this is a valid directory structure." align="left" width="30%" style="padding:15px">
    </div>
    <div class="col-sm">
    <img src="figures/subfolders-other-file.jpg" alt="A folder structure titled quiz01. There are three subfolders, one for each student. Each subfolder has a file named quiz01.Rmd. One subfolder also has a file called quiz01-DRAFT.Rmd. A green validation mark on the top right corner indicates that this is a valid directory structure." align="left" width="30%" style="padding:15px">
    </div>
    <div class="col-sm" style="color:whitesmoke;">
        Subfolders can contain other files.
    </div>
  </div>
</div>

---

## Subfolders: supported

<div class="container">
  <div class="row">
    <div class="col-sm">
    <img src="figures/subfolders-same-filename.jpg" alt="A folder structure titled quiz01. There are three subfolders, one for each student. Each subfolder has a file named quiz01.Rmd. A green validation mark on the top right corner indicates that this is a valid directory structure." align="left" width="30%" style="padding:15px">
    </div>
    <div class="col-sm">
    <img src="figures/subfolders-other-file.jpg" alt="A folder structure titled quiz01. There are three subfolders, one for each student. Each subfolder has a file named quiz01.Rmd. One subfolder also has a file called quiz01-DRAFT.Rmd. A green validation mark on the top right corner indicates that this is a valid directory structure." align="left" width="30%" style="padding:15px">
    </div>
    <div class="col-sm" style="color:whitesmoke;">
    <img src="figures/subfolders-individual-filename.jpg" alt="A folder structure titled quiz01. There are three subfolders, one for each student. In one of the student's subfolder, the quiz file in a separate subfolder. A red cross marks this folder structure as incorrect." align="left" width="30%" style="padding:15px"> 
    Student identifier might be present multiple times.
    </div>
  </div>
</div>

---

---

## Consider the following situation:

We are grading an assignment with a question asking the students to compute the **standard deviation of a sample**.

Some mistakes we might expect some students to make:

- compute the **population standard deviation** instead of the sample one

- compute the **variance** instead

These would be natural items to have in a rubric where we would provide an explanation and specify the point deduction for each scenario.

---

## Rubric - prompting

.pull-left[
<img src="figures/rubric-prompt-question1.png" alt="A grading prompt in the RStudio console for question 1 that reads 'Enter one or more of the following options, use -- to separate multiple items.' and shows as options '1a: Population not sample SD [-2]', '1b: Didn't take square root [-1]', '0: Correct [-0%]', '99: Missing [-100%]'." width="100%" style="display: block; margin: auto 0 auto auto;" />
]

---

## Rubric - prompting

.pull-left[
<img src="figures/rubric-prompt-question1-name.png" alt="Same question 1 grading prompt as last figure, but has an orange box around 'Question 1'." width="100%" style="display: block; margin: auto 0 auto auto;" />
]

---

## Rubric - prompting

.pull-left[
<img src="figures/rubric-prompt-question1-rubric-item.png" alt="Same question 1 grading prompt, but has an orange box around '1a: Population not sample SD [-2]'." width="100%" style="display: block; margin: auto 0 auto auto;" />
]

---

## Rubric - prompting

.pull-left[
<img src="figures/rubric-prompt-question1-prompt-message.png" alt="Same question 1 grading prompt, but has an orange box around 'Population not sample SD'." width="100%" style="display: block; margin: auto 0 auto auto;" />
]

---

## Rubric - prompting

.pull-left[
<img src="figures/rubric-prompt-question1-feedback-file.png" alt="Screen shot of feedback file created from assigning the first rubric item to the first question. Contains feedback detailed feedback message describing why the formula they use was incorrect and specifies what should have been used." width="100%" style="display: block; margin: auto 0 auto auto;" />
]

.pull-right[
- Name of question or component
- Rubric item
- Prompt message for the grader
- **Feedback message** for the student
]

---

## Rubric - prompting

.pull-left[
<img src="figures/rubric-prompt-question1-points-to-remove.png" alt="Same question 1 grading prompt, but has an orange box around '[-2]'." width="100%" style="display: block; margin: auto 0 auto auto;" />
]

.pull-right[
- Name of question or component
- Rubric item
- Prompt message for the grader
- Feedback message for the student
- **Points to remove**
]

---

## Rubric - prompting

.pull-left[
<img src="figures/rubric-prompt-question1-prompt-code.png" alt="Same question 1 grading prompt, but has an orange box around '1a'." width="100%" style="display: block; margin: auto 0 auto auto;" />
]

.pull-right[
- Name of question or component
- Rubric item
- Prompt message for the grader
- Feedback message for the student
- Points to remove
- **Prompt code**
]

---

## Rubric - formatting

The rubric needs to be formatted in a specific way to comply with gradetools

To begin formatting your rubric use

```r
gradetools::create_rubric_template(rubric_path = "Path to your rubric")
```

This will create a csv file with the necessary column names

<div class="datatables html-widget html-fill-item-overflow-hidden html-fill-item" id="htmlwidget-8eff8c37f80eff43b08d" style="width:100%;height:auto;"></div>
<script type="application/json" data-for="htmlwidget-8eff8c37f80eff43b08d">{"x":{"filter":"none","vertical":false,"extensions":["FixedColumns"],"data":[["1"],[null],[null],[null],[null],[null],[null]],"container":"<table class=\"display\">\n  <thead>\n    <tr>\n      <th> <\/th>\n      <th>name<\/th>\n      <th>total_points<\/th>\n      <th>prompt_code<\/th>\n      <th>prompt_message<\/th>\n      <th>feedback<\/th>\n      <th>points_to_remove<\/th>\n    <\/tr>\n  <\/thead>\n<\/table>","options":{"dom":"t","scrollX":true,"fixedColumns":true,"columnDefs":[{"orderable":false,"targets":0}],"order":[],"autoWidth":false,"orderClasses":false}},"evals":[],"jsHooks":[]}</script>

---

## Rubric - formatting

One row of the rubric corresponds to one rubric item

<div class="datatables html-widget html-fill-item-overflow-hidden html-fill-item" id="htmlwidget-69c830ffddb3b1ea7bf0" style="width:100%;height:auto;"></div>
<script type="application/json" data-for="htmlwidget-69c830ffddb3b1ea7bf0">{"x":{"filter":"none","vertical":false,"autoHideNavigation":true,"data":[["Question 1"],["10"],["1a"],["Population not sample SD"],["The formula you used is ..."],["2"]],"container":"<table class=\"display\">\n  <thead>\n    <tr>\n      <th>name<\/th>\n      <th>total_points<\/th>\n      <th>prompt_code<\/th>\n      <th>prompt_message<\/th>\n      <th>feedback<\/th>\n      <th>points_to_remove<\/th>\n    <\/tr>\n  <\/thead>\n<\/table>","options":{"scrollX":true,"autoWidth":true,"columnDefs":[{"width":"100%","targets":"_all"}],"pageLength":15,"lengthChange":false,"order":[],"orderClasses":false},"callback":"function(table) {\ntable.page(3).draw(false);\n}"},"evals":["callback"],"jsHooks":[]}</script>

- The question name does not need to be present in the assignment

- The prompt code must begin with a digit (avoids auto completing)

- The prompt message should be concise to appear nicely in console

- You can include in line latex and code in feedback message

---

## Rubric - formatting

Each question to be graded needs at least one rubric item, but can have as many as desired

<div class="datatables html-widget html-fill-item-overflow-hidden html-fill-item" id="htmlwidget-c61499292672129a3444" style="width:100%;height:auto;"></div>
<script type="application/json" data-for="htmlwidget-c61499292672129a3444">{"x":{"filter":"none","vertical":false,"autoHideNavigation":true,"data":[["Question 1","Question 1"],["10",null],["1a","1b"],["Population not sample SD","Didn't take square root"],["The formula you used is ...","You calculated the variance..."],["2","1"]],"container":"<table class=\"display\">\n  <thead>\n    <tr>\n      <th>name<\/th>\n      <th>total_points<\/th>\n      <th>prompt_code<\/th>\n      <th>prompt_message<\/th>\n      <th>feedback<\/th>\n      <th>points_to_remove<\/th>\n    <\/tr>\n  <\/thead>\n<\/table>","options":{"scrollX":true,"autoWidth":true,"columnDefs":[{"width":"100%","targets":"_all"}],"pageLength":15,"lengthChange":false,"order":[],"orderClasses":false},"callback":"function(table) {\ntable.page(3).draw(false);\n}"},"evals":["callback"],"jsHooks":[]}</script>

When providing multiple rubric items for one question:

- the total points does not need to be specified again

- each prompt code for the same question must be unique

---

## Rubric - formatting
<div class="datatables html-widget html-fill-item-overflow-hidden html-fill-item" id="htmlwidget-a13289b1466cdaa46912" style="width:100%;height:auto;"></div>
<script type="application/json" data-for="htmlwidget-a13289b1466cdaa46912">{"x":{"filter":"none","vertical":false,"autoHideNavigation":true,"data":[["Question 1","Question 1","Question 2"],["10",null,"5"],["1a","1b","1"],["Population not sample SD","Didn't take square root","..."],["The formula you used is ...","You calculated the variance...","..."],["2","1","2"]],"container":"<table class=\"display\">\n  <thead>\n    <tr>\n      <th>name<\/th>\n      <th>total_points<\/th>\n      <th>prompt_code<\/th>\n      <th>prompt_message<\/th>\n      <th>feedback<\/th>\n      <th>points_to_remove<\/th>\n    <\/tr>\n  <\/thead>\n<\/table>","options":{"scrollX":true,"autoWidth":true,"columnDefs":[{"width":"100%","targets":"_all"}],"pageLength":15,"lengthChange":false,"order":[],"orderClasses":false},"callback":"function(table) {\ntable.page(3).draw(false);\n}"},"evals":["callback"],"jsHooks":[]}</script>

After question specific rubric items have been specified, the user can specify two special types of rubric items: "all_questions" and "general_feedback"

---

## Rubric - formatting

Sometimes there are rubric items that are common across all questions. These can be created by specifying `name` as **"all_questions"**

<div class="datatables html-widget html-fill-item-overflow-hidden html-fill-item" id="htmlwidget-2601c8f19b7459b4027d" style="width:100%;height:auto;"></div>
<script type="application/json" data-for="htmlwidget-2601c8f19b7459b4027d">{"x":{"filter":"none","vertical":false,"autoHideNavigation":true,"data":[["Question 1","Question 1","Question 2","all_questions"],["10",null,"5",null],["1a","1b","1","0"],["Population not sample SD","Didn't take square root","...","Correct"],["The formula you used is ...","You calculated the variance...","...","Your answer is correct!"],["2","1","2","0"]],"container":"<table class=\"display\">\n  <thead>\n    <tr>\n      <th>name<\/th>\n      <th>total_points<\/th>\n      <th>prompt_code<\/th>\n      <th>prompt_message<\/th>\n      <th>feedback<\/th>\n      <th>points_to_remove<\/th>\n    <\/tr>\n  <\/thead>\n<\/table>","options":{"scrollX":true,"autoWidth":true,"columnDefs":[{"width":"100%","targets":"_all"}],"pageLength":15,"lengthChange":false,"order":[],"orderClasses":false},"callback":"function(table) {\ntable.page(3).draw(false);\n}"},"evals":["callback"],"jsHooks":[]}</script>

`points_to_remove` will be treated as a percentage for each question

---

## Rubric - formatting

Sometimes there are rubric items that are common across all questions. These can be created by specifying `name` as **"all_questions"**

<div class="datatables html-widget html-fill-item-overflow-hidden html-fill-item" id="htmlwidget-104bf2661e8dc2b60b56" style="width:100%;height:auto;"></div>
<script type="application/json" data-for="htmlwidget-104bf2661e8dc2b60b56">{"x":{"filter":"none","vertical":false,"autoHideNavigation":true,"data":[["Question 1","Question 1","Question 2","all_questions","all_questions"],["10",null,"5",null,null],["1a","1b","1","0","99"],["Population not sample SD","Didn't take square root","...","Correct","Missing"],["The formula you used is ...","You calculated the variance...","...","Your answer is correct!","Your answer is missing."],["2","1","2","0","100"]],"container":"<table class=\"display\">\n  <thead>\n    <tr>\n      <th>name<\/th>\n      <th>total_points<\/th>\n      <th>prompt_code<\/th>\n      <th>prompt_message<\/th>\n      <th>feedback<\/th>\n      <th>points_to_remove<\/th>\n    <\/tr>\n  <\/thead>\n<\/table>","options":{"scrollX":true,"autoWidth":true,"columnDefs":[{"width":"100%","targets":"_all"}],"pageLength":15,"lengthChange":false,"order":[],"orderClasses":false},"callback":"function(table) {\ntable.page(3).draw(false);\n}"},"evals":["callback"],"jsHooks":[]}</script>

---

## Rubric - formatting

General feedback messages can be specified as rubric items with `name` as **"general_feedback"**. No points are associated with general feedback.

<div class="datatables html-widget html-fill-item-overflow-hidden html-fill-item" id="htmlwidget-1dc00779df6ec788b651" style="width:100%;height:auto;"></div>
<script type="application/json" data-for="htmlwidget-1dc00779df6ec788b651">{"x":{"filter":"none","vertical":false,"autoHideNavigation":true,"data":[["Question 1","Question 1","Question 2","all_questions","all_questions","general_feedback"],["10",null,"5",null,null,null],["1a","1b","1","0","99","0"],["Population not sample SD","Didn't take square root","...","Correct","Missing","Great job"],["The formula you used is ...","You calculated the variance...","...","Your answer is correct!","Your answer is missing.","Great job on this quiz!"],["2","1","2","0","100",null]],"container":"<table class=\"display\">\n  <thead>\n    <tr>\n      <th>name<\/th>\n      <th>total_points<\/th>\n      <th>prompt_code<\/th>\n      <th>prompt_message<\/th>\n      <th>feedback<\/th>\n      <th>points_to_remove<\/th>\n    <\/tr>\n  <\/thead>\n<\/table>","options":{"scrollX":true,"autoWidth":true,"columnDefs":[{"width":"100%","targets":"_all"}],"pageLength":15,"lengthChange":false,"order":[],"orderClasses":false},"callback":"function(table) {\ntable.page(3).draw(false);\n}"},"evals":["callback"],"jsHooks":[]}</script>

---

## Rubric - formatting

<div class="datatables html-widget html-fill-item-overflow-hidden html-fill-item" id="htmlwidget-2074ce2554a5d0b1ccc1" style="width:100%;height:auto;"></div>
<script type="application/json" data-for="htmlwidget-2074ce2554a5d0b1ccc1">{"x":{"filter":"none","vertical":false,"autoHideNavigation":true,"data":[["Question 1","Question 1","Question 2","all_questions","all_questions","general_feedback","general_feedback"],["10",null,"5",null,null,null,null],["1a","1b","1","0","99","0","99"],["Population not sample SD","Didn't take square root","...","Correct","Missing","Great job","Office hours"],["The formula you used is ...","You calculated the variance...","...","Your answer is correct!","Your answer is missing.","Great job on this quiz!","Please come to my next office hours and we will go through this quiz together."],["2","1","2","0","100",null,null]],"container":"<table class=\"display\">\n  <thead>\n    <tr>\n      <th>name<\/th>\n      <th>total_points<\/th>\n      <th>prompt_code<\/th>\n      <th>prompt_message<\/th>\n      <th>feedback<\/th>\n      <th>points_to_remove<\/th>\n    <\/tr>\n  <\/thead>\n<\/table>","options":{"scrollX":true,"autoWidth":true,"columnDefs":[{"width":"100%","targets":"_all"}],"pageLength":15,"lengthChange":false,"order":[],"orderClasses":false},"callback":"function(table) {\ntable.page(3).draw(false);\n}"},"evals":["callback"],"jsHooks":[]}</script>

---

## Rubric - positive grading

You can switch the grading scheme to positive grading

```r
create_rubric_template(
  rubric_path = "your-chosen-rubric-path.csv",
*  negative_grading = FALSE
)
```

Last column will be named `points_to_add` instead of `points_to_remove`

<div class="datatables html-widget html-fill-item-overflow-hidden html-fill-item" id="htmlwidget-6a32c6de5337bf451f3c" style="width:100%;height:auto;"></div>
<script type="application/json" data-for="htmlwidget-6a32c6de5337bf451f3c">{"x":{"filter":"none","vertical":false,"extensions":["FixedColumns"],"data":[["1"],[null],[null],[null],[null],[null],[null]],"container":"<table class=\"display\">\n  <thead>\n    <tr>\n      <th> <\/th>\n      <th>name<\/th>\n      <th>total_points<\/th>\n      <th>prompt_code<\/th>\n      <th>prompt_message<\/th>\n      <th>feedback<\/th>\n      <th>points_to_add<\/th>\n    <\/tr>\n  <\/thead>\n<\/table>","options":{"dom":"t","scrollX":true,"fixedColumns":true,"columnDefs":[{"orderable":false,"targets":0}],"order":[],"autoWidth":false,"orderClasses":false}},"evals":[],"jsHooks":[]}</script>

---

## Preparing materials walkthrough

Done with

]

- Now, a walk through of preparing materials for grading with gradetools

- Then hands-on session where you will prepare your materials for grading

]

---

## Example: creating an R project

- In RStudio: **Click File > New Project** > New Directory > New Project
- Enter desired directory name and location

---

## Example: creating an R project

- In RStudio: Click File > New Project > **New Directory** > New Project
- Enter desired directory name and location

---

## Example: creating an R project

- In RStudio: Click File > New Project > New Directory > **New Project**
- Enter desired directory name and location

---

## Example: creating an R project

- In RStudio: Click File > New Project > New Directory > New Project
- **Enter desired directory name and location**

---

## Example: Move grading script

- In RStudio: Click File > New Project > New Directory > New Project
- Enter desired directory name and location
- **Now the working directory will be your new project directory**
    - **Move your `grading-script.R` into this directory**. This script can be found in the `grading-practice` folder

---

## Example: Move submissions into R project

.pull-right[
<img src="figures/demo-new-project-folder.png" alt="Screenshot of files panel of RStudio. Shows in 'USCOTS2023-gradetools-practice' folder there is a R project file, 'grading-script.R', and a folder called 'quiz01'." width="100%" style="display: block; margin: auto;" />
]

---

## Example: Move submissions into R project

.pull-left[
- **Move your submissions** to be graded to your new project directory
- **Make sure files comply** with the gradetools file structure rule: student identifier must be present and only part unique to file path
]

.pull-right[
<img src="figures/demo-new-project-folder.png" alt="Screenshot of files panel of RStudio. Shows in 'USCOTS2023-gradetools-practice' folder there is a R project file, 'gradeing-script.R', and a folder called 'quiz01'." width="100%" style="display: block; margin: auto;" />

<img src="figures/demo-quiz01-folder.png" alt="Screenshot of files panel of RStudio. Shows in a folder called 'quiz01' there is a data folder and three assignments." width="100%" style="display: block; margin: auto;" />
]

---

## Hands-on: prepare project directory (**5 min**)

Apply the steps in the **example** slides to your own material (or the provided grading practice material) to:

- **create** a new R project

- **add** your grading script and submissions to be graded

- **make** sure submissions are saved appropriately

- **review** your assignment
    - If you are using the "grading practice" materials instead of your own assignments, review the `data-viz-quiz-answer-key.Rmd`

---

## Example: Create roster

Use you preferred editor (e.g. Excel, Google Sheets, etc.) to create your roster as a csv file

You need a column named `student_identifier` containing the student identifiers

| student_identifier |
|--------------------|
| BaronPoisson       |
| sergent-gamma      |
| student_T          |

---

## Example: Formatting rubric

Now the rubric needs to be formatted, begin by **creating the rubric template**

```r
rubric_location <- "practice-rubric.csv"

gradetools::create_rubric_template(rubric_path = rubric_location)
```

This will give us the rubric skeleton to fill in

<div class="datatables html-widget html-fill-item-overflow-hidden html-fill-item" id="htmlwidget-a6c7bfb16ec0e01db8fd" style="width:100%;height:auto;"></div>
<script type="application/json" data-for="htmlwidget-a6c7bfb16ec0e01db8fd">{"x":{"filter":"none","vertical":false,"extensions":["FixedColumns"],"data":[["1"],[null],[null],[null],[null],[null],[null]],"container":"<table class=\"display\">\n  <thead>\n    <tr>\n      <th> <\/th>\n      <th>name<\/th>\n      <th>total_points<\/th>\n      <th>prompt_code<\/th>\n      <th>prompt_message<\/th>\n      <th>feedback<\/th>\n      <th>points_to_remove<\/th>\n    <\/tr>\n  <\/thead>\n<\/table>","options":{"dom":"t","scrollX":true,"fixedColumns":true,"columnDefs":[{"orderable":false,"targets":0}],"order":[],"autoWidth":false,"orderClasses":false}},"evals":[],"jsHooks":[]}</script>

---

## Example: Formatting rubric

**Open your assignment rubric draft**, the rubric should contain info for the `name`, `total_points`, `feedback`, and `points_to_remove` (or `points_to_add`) columns
    
<img src="figures/demo-rubric-draft-pdf.png" alt="Screen shot of Quiz 1 Rubric Draft from 'main-demo' folder." width="80%" style="display: block; margin: auto;" />

---

## Example: Formatting rubric

**Input info** for the `name`, `total_points`, `feedback`, and `points_to_remove` (or `points_to_add`) columns

<div class="datatables html-widget html-fill-item-overflow-hidden html-fill-item" id="htmlwidget-ba9be58963a55e124799" style="width:100%;height:auto;"></div>
<script type="application/json" data-for="htmlwidget-ba9be58963a55e124799">{"x":{"filter":"none","vertical":false,"extensions":["FixedColumns"],"data":[["1","2","3","4","5"],["Question 1","Question 1","Question 2","Question 3","Question 3"],["2"," ","2","3"," "],[null,null,null,null,null],[null,null,null,null,null],["Wrong number of observations and variables. Each row is an observation and each column is a variable.","Misidentified observation, one observation is a bike rental.","Didn't change axis labels from default.","Didn't change axis labels from default.","Didn't answer if bike type seemed to vary by passholder type."],["-1","-1","-0.5","-0.5","-1"]],"container":"<table class=\"display\">\n  <thead>\n    <tr>\n      <th> <\/th>\n      <th>name<\/th>\n      <th>total_points<\/th>\n      <th>prompt_code<\/th>\n      <th>prompt_message<\/th>\n      <th>feedback<\/th>\n      <th>points_to_remove<\/th>\n    <\/tr>\n  <\/thead>\n<\/table>","options":{"dom":"t","scrollX":true,"fixedColumns":true,"columnDefs":[{"orderable":false,"targets":0}],"order":[],"autoWidth":false,"orderClasses":false}},"evals":[],"jsHooks":[]}</script>

---

## Example: Formatting rubric

**Create** prompt codes (must begin with a digit) and concise prompt messages

<div class="datatables html-widget html-fill-item-overflow-hidden html-fill-item" id="htmlwidget-7d6094664b750b21ac20" style="width:100%;height:auto;"></div>
<script type="application/json" data-for="htmlwidget-7d6094664b750b21ac20">{"x":{"filter":"none","vertical":false,"extensions":["FixedColumns"],"data":[["1","2","3","4","5"],["Question 1","Question 1","Question 2","Question 3","Question 3"],["2"," ","2","3"," "],["1a","1b","1","1","3"],["Wrong # rows and cols","Misidentified obs","Default axes","Default axes","Didn't answer main question"],["Wrong number of observations and variables. Each row is an observation and each column is a variable.","Misidentified observation, one observation is a bike rental.","Didn't change axis labels from default.","Didn't change axis labels from default.","Didn't answer if bike type seemed to vary by passholder type."],["-1","-1","-0.5","-0.5","-1"]],"container":"<table class=\"display\">\n  <thead>\n    <tr>\n      <th> <\/th>\n      <th>name<\/th>\n      <th>total_points<\/th>\n      <th>prompt_code<\/th>\n      <th>prompt_message<\/th>\n      <th>feedback<\/th>\n      <th>points_to_remove<\/th>\n    <\/tr>\n  <\/thead>\n<\/table>","options":{"dom":"t","scrollX":true,"fixedColumns":true,"columnDefs":[{"orderable":false,"targets":0}],"order":[],"autoWidth":false,"orderClasses":false}},"evals":[],"jsHooks":[]}</script>

---

## Example: Formatting rubric

Add at least one **"all_questions"** rubric item

<div class="datatables html-widget html-fill-item-overflow-hidden html-fill-item" id="htmlwidget-6726791b0a2b49ec087c" style="width:100%;height:auto;"></div>
<script type="application/json" data-for="htmlwidget-6726791b0a2b49ec087c">{"x":{"filter":"none","vertical":false,"extensions":["FixedColumns"],"data":[["1","2","3","4","5","6"],["Question 1","Question 1","Question 2","Question 3","Question 3","all_questions"],["2"," ","2","3"," ",null],["1a","1b","1","1","3","0"],["Wrong # rows and cols","Misidentified obs","Default axes","Default axes","Didn't answer main question","Correct"],["Wrong number of observations and variables. Each row is an observation and each column is a variable.","Misidentified observation, one observation is a bike rental.","Didn't change axis labels from default.","Didn't change axis labels from default.","Didn't answer if bike type seemed to vary by passholder type.","Correct"],["-1","-1","-0.5","-0.5","-1","0"]],"container":"<table class=\"display\">\n  <thead>\n    <tr>\n      <th> <\/th>\n      <th>name<\/th>\n      <th>total_points<\/th>\n      <th>prompt_code<\/th>\n      <th>prompt_message<\/th>\n      <th>feedback<\/th>\n      <th>points_to_remove<\/th>\n    <\/tr>\n  <\/thead>\n<\/table>","options":{"dom":"t","scrollX":true,"fixedColumns":true,"columnDefs":[{"orderable":false,"targets":0}],"order":[],"autoWidth":false,"orderClasses":false}},"evals":[],"jsHooks":[]}</script>

---

## Example: Formatting rubric

Add at least one **"general_feedback"** rubric item

<div class="datatables html-widget html-fill-item-overflow-hidden html-fill-item" id="htmlwidget-f66eb5bcf0e2c8531d64" style="width:100%;height:auto;"></div>
<script type="application/json" data-for="htmlwidget-f66eb5bcf0e2c8531d64">{"x":{"filter":"none","vertical":false,"extensions":["FixedColumns"],"data":[["1","2","3","4","5","6","7"],["Question 1","Question 1","Question 2","Question 3","Question 3","all_questions","general_feedback"],["2"," ","2","3"," ",null,null],["1a","1b","1","1","3","0","0"],["Wrong # rows and cols","Misidentified obs","Default axes","Default axes","Didn't answer main question","Correct","Great job!"],["Wrong number of observations and variables. Each row is an observation and each column is a variable.","Misidentified observation, one observation is a bike rental.","Didn't change axis labels from default.","Didn't change axis labels from default.","Didn't answer if bike type seemed to vary by passholder type.","Correct","Great job!"],["-1","-1","-0.5","-0.5","-1","0",null]],"container":"<table class=\"display\">\n  <thead>\n    <tr>\n      <th> <\/th>\n      <th>name<\/th>\n      <th>total_points<\/th>\n      <th>prompt_code<\/th>\n      <th>prompt_message<\/th>\n      <th>feedback<\/th>\n      <th>points_to_remove<\/th>\n    <\/tr>\n  <\/thead>\n<\/table>","options":{"dom":"t","scrollX":true,"fixedColumns":true,"columnDefs":[{"orderable":false,"targets":0}],"order":[],"autoWidth":false,"orderClasses":false}},"evals":[],"jsHooks":[]}</script>

---

## Hands-on: prepare grading inputs (**15 min**)

Apply the steps in the **example** slides to your own material (or the provided "grading practice" material) to create a roster and format your rubric