Grades
Project Milestone Feedback Templates
13/10/11 12:50
I’ve added the templates I'm using for the evaluation of the project milestones toh the Web page describing the project, http://users.csc.calpoly.edu/~fkurfess/Courses/480/F11/Project/Project.html in the "Grading" part at the bottom of the page.
For Milestone Week 4, the emphasis is on the aspects below
User Feedback
initial reactions, criticism, suggestions, etc. from users of the alpha prototype or to design sketches
possible design modifications, changes in implementation
System Design
overview of the functional parts of the system
block diagram, class hierarchy
Prototype and Implementation
restrictions in functionality
implementation language, development tools
instructions for installation and basic use
Evaluation Plan
description of evaluation methods
detailed instructions for performing the evaluation
explicit evaluation criteria (questions, metrics)
For Milestone Week 4, the emphasis is on the aspects below
User Feedback
initial reactions, criticism, suggestions, etc. from users of the alpha prototype or to design sketches
possible design modifications, changes in implementation
System Design
overview of the functional parts of the system
block diagram, class hierarchy
Prototype and Implementation
restrictions in functionality
implementation language, development tools
instructions for installation and basic use
Evaluation Plan
description of evaluation methods
detailed instructions for performing the evaluation
explicit evaluation criteria (questions, metrics)
More Details on AI Nugget Grading
12/10/11 15:45
I’ve modified the section on grading for the AI Nugget presentations by including the typical allocation of the score within the grading categories:
Grading Criteria
The distribution of points I intend to use for the evaluation of this assignment is as follows; the items in parentheses indicate the typical point distribution for that part:
Grading Criteria
The distribution of points I intend to use for the evaluation of this assignment is as follows; the items in parentheses indicate the typical point distribution for that part:
- Topic proposal: 20% (Title 5, Abstract 10, References 10)
- Final version of presentation slides or notes: 30% (Content: 20, Structure 5, Appearance 5)
- Delivery of presentation: 50% (Topic Knowledge 20, Topic Difficulty 10, AI Relevance 5, Presentation Delivery 5, Supporting Evidence 3, Presentation Structure 3, Audience Interest 2, Timing and Length 2)
Project Documentation on TRAC Wikis
04/10/11 14:42
Over the weekend I had a first look at the project documentation on the team wikis. While I received a few requests for an extension of the deadline of last Thursday, I was quite disappointed to see that most teams do not have anything on their TRAC Wikis yet.
I will grade the Milestone Week 2 documents on Friday, so you need to make sure that your TRAC wiki contains at least the following by Thursday, midnight:
- Title of you project, optionally a team name
- list of the team members
- short description of the project
- comparison against existing related systems
- features, requirements, and evaluation criteria
- schedule
For reference purposes, you can look at last year’s team with the highest score for their documentation, Project Deuce.
My general policy is to let teams revise each document once, but the maximum improvement of their score will be half of the difference between the overall maximum score and their score in the first version. So if a team gets a score of 4 out of 10, the best they can hope for after revisions is (10-4)/2 = 3, resulting in an final score of 4+3 - 7.
I will grade the Milestone Week 2 documents on Friday, so you need to make sure that your TRAC wiki contains at least the following by Thursday, midnight:
- Title of you project, optionally a team name
- list of the team members
- short description of the project
- comparison against existing related systems
- features, requirements, and evaluation criteria
- schedule
For reference purposes, you can look at last year’s team with the highest score for their documentation, Project Deuce.
My general policy is to let teams revise each document once, but the maximum improvement of their score will be half of the difference between the overall maximum score and their score in the first version. So if a team gets a score of 4 out of 10, the best they can hope for after revisions is (10-4)/2 = 3, resulting in an final score of 4+3 - 7.
A2 and other Grades on Blackboard
18/11/11 17:45 Filed in: 480
The grades for A2 for those of you who demonstrated their Wumpus agent to me are now available on Blackboard. There are a few cases where I still need to grade the first part, especially if it was submitted late. I still need to grade Lab 8, and the project Week 8 milestone documents.
Updated Grades on Blackboard
09/11/11 20:38 Filed in: 480
I’ve updated Blackboard with the scores for the following items
* Labs L1 through L7
I just noticed that some of you submitted non-programming labs via Blackboard; I still have to evaluate those.
* Assignments A1 and A2
If you have a score of around 10 for A2, it is only for the first part.
The scores reflect only the programs shown in the lab. I haven’t graded the rest yet.
I changed the maximum score on Blackboard from 33 to 25.
* Project Week 4 and 6 Milestones
I believe this includes all requests for re-evaluation. Let me know if you’ve asked for one, but your score hasn’t changed.
* AI Nugget presentations
I believe I’ve graded all the presentations given so far.
If you’ve given your presentation, but your score is around 60, you probably haven’t submitted your presentation material (slides, Prezi) on the Blackboard Wiki.
* Labs L1 through L7
I just noticed that some of you submitted non-programming labs via Blackboard; I still have to evaluate those.
* Assignments A1 and A2
If you have a score of around 10 for A2, it is only for the first part.
The scores reflect only the programs shown in the lab. I haven’t graded the rest yet.
I changed the maximum score on Blackboard from 33 to 25.
* Project Week 4 and 6 Milestones
I believe this includes all requests for re-evaluation. Let me know if you’ve asked for one, but your score hasn’t changed.
* AI Nugget presentations
I believe I’ve graded all the presentations given so far.
If you’ve given your presentation, but your score is around 60, you probably haven’t submitted your presentation material (slides, Prezi) on the Blackboard Wiki.
Grades Updated on Blackboard
19/10/11 20:31 Filed in: 480
I’ve uploaded the following grades on Blackboard:
- Project Week 2 and 4 Milestones,
- partial AI Nugget grades (proposal, presentation, presentation material)
- Labs 2 and 3,
- modified Quiz 5 scores (I added 10 points to everybody’s score to adjust for the missing question) .
I may be a bit behind with grading of the Week 4 milestone and presentation material, but I wanted to get the grades up before going on my trip tomorrow.
If you see a 0 as a score, it usually means that I haven’t graded that part yet. When I transfer grades from my spreadsheet to Blackboard, Blackboard replaces cells that have no values with zeroes.
- Project Week 2 and 4 Milestones,
- partial AI Nugget grades (proposal, presentation, presentation material)
- Labs 2 and 3,
- modified Quiz 5 scores (I added 10 points to everybody’s score to adjust for the missing question) .
I may be a bit behind with grading of the Week 4 milestone and presentation material, but I wanted to get the grades up before going on my trip tomorrow.
If you see a 0 as a score, it usually means that I haven’t graded that part yet. When I transfer grades from my spreadsheet to Blackboard, Blackboard replaces cells that have no values with zeroes.
Updated Grades on Blackboard
30/11/11 19:13 Filed in: 480
Earlier today, I updated the Blackboard Grade Sheet again. Here’s the current status
* Labs L1 through L9
Up to date as of this afternoon; I still have to evaluate programming labs submitted on Blackboard and not demoed in lab, and some non-programming labs submitted via Blackboard;
* Assignments A1 and A2
Up to date as of this afternoon; I still have to evaluate assignments submitted on Blackboard and not demoed in lab
* Project Week 4 and 6 Milestones
Updated to reflect requests for re-evaluation; I haven’t done the Week 8 Milestones yet
* AI Nugget presentations
Should reflect all the presentations given so far, and materials submitted as of this afternoon.
* Quiz Make-up Questions and Requests for Re-evaluation
Still need to do these; I may also curve the last two (Q8 and Q9) since the averages (66 and 71) were a bit lower than for the earlier ones (around 80), for those students who actually took the quizzes.
* Labs L1 through L9
Up to date as of this afternoon; I still have to evaluate programming labs submitted on Blackboard and not demoed in lab, and some non-programming labs submitted via Blackboard;
* Assignments A1 and A2
Up to date as of this afternoon; I still have to evaluate assignments submitted on Blackboard and not demoed in lab
* Project Week 4 and 6 Milestones
Updated to reflect requests for re-evaluation; I haven’t done the Week 8 Milestones yet
* AI Nugget presentations
Should reflect all the presentations given so far, and materials submitted as of this afternoon.
* Quiz Make-up Questions and Requests for Re-evaluation
Still need to do these; I may also curve the last two (Q8 and Q9) since the averages (66 and 71) were a bit lower than for the earlier ones (around 80), for those students who actually took the quizzes.
Another Round of Grade Updates on Blackboard
05/12/11 21:10 Filed in: 480
I just updated the Blackboard Grade Sheet again. Here’s the current status
* Labs L1 through L10
Up to date as of this evening; I still have to evaluate programming labs submitted on Blackboard and not demoed in lab, and some non-programming labs submitted via Blackboard;
* Assignments A1 and A2
Up to date as of this afternoon; I still have to evaluate assignments submitted on Blackboard and not demoed in lab.
I’ll have to adjust the Blackboard calculation for the reduction of assignments from 3 to 2. So if you didn’t do A3, your overall assignment grade should be better.
* Project Week 4, 6 and 8 Milestones, Final Presentations, Team Evaluation, Team Member Evaluations
Updated, and should be complete except for those students who have not submitted their mutual team member evaluations yet.
My spreadsheet automatically gives you 0 if you haven’t done a self-evaluation; I’ll change this later if you’ve done them for your team members. If you haven’t done any yet, do them as soon as possible.
* AI Nugget presentations
Should reflect all the presentations given so far, and materials submitted as of this afternoon.
* Quiz Make-up Questions and Requests for Re-evaluation
Still need to do these; I may also curve the last two (Q8 and Q9) since the averages (66 and 71) were a bit lower than for the earlier ones (around 80), for those students who actually took the quizzes.
* Labs L1 through L10
Up to date as of this evening; I still have to evaluate programming labs submitted on Blackboard and not demoed in lab, and some non-programming labs submitted via Blackboard;
* Assignments A1 and A2
Up to date as of this afternoon; I still have to evaluate assignments submitted on Blackboard and not demoed in lab.
I’ll have to adjust the Blackboard calculation for the reduction of assignments from 3 to 2. So if you didn’t do A3, your overall assignment grade should be better.
* Project Week 4, 6 and 8 Milestones, Final Presentations, Team Evaluation, Team Member Evaluations
Updated, and should be complete except for those students who have not submitted their mutual team member evaluations yet.
My spreadsheet automatically gives you 0 if you haven’t done a self-evaluation; I’ll change this later if you’ve done them for your team members. If you haven’t done any yet, do them as soon as possible.
* AI Nugget presentations
Should reflect all the presentations given so far, and materials submitted as of this afternoon.
* Quiz Make-up Questions and Requests for Re-evaluation
Still need to do these; I may also curve the last two (Q8 and Q9) since the averages (66 and 71) were a bit lower than for the earlier ones (around 80), for those students who actually took the quizzes.