7669b4d777
Conflicts: cms/djangoapps/contentstore/features/advanced-settings.feature cms/djangoapps/contentstore/features/checklists.feature cms/djangoapps/contentstore/features/component.feature cms/djangoapps/contentstore/features/course-overview.feature cms/djangoapps/contentstore/features/course-settings.feature cms/djangoapps/contentstore/features/course-team.feature cms/djangoapps/contentstore/features/course-updates.feature cms/djangoapps/contentstore/features/courses.feature cms/djangoapps/contentstore/features/discussion-editor.feature cms/djangoapps/contentstore/features/grading.feature cms/djangoapps/contentstore/features/html-editor.feature cms/djangoapps/contentstore/features/problem-editor.feature cms/djangoapps/contentstore/features/section.feature cms/djangoapps/contentstore/features/signup.feature cms/djangoapps/contentstore/features/static-pages.feature cms/djangoapps/contentstore/features/subsection.feature cms/djangoapps/contentstore/features/textbooks.feature cms/djangoapps/contentstore/features/upload.feature cms/djangoapps/contentstore/features/video-editor.feature cms/djangoapps/contentstore/features/video.feature lms/djangoapps/courseware/features/certificates.feature lms/djangoapps/courseware/features/help.feature lms/djangoapps/courseware/features/high-level-tabs.feature lms/djangoapps/courseware/features/homepage.feature lms/djangoapps/courseware/features/login.feature lms/djangoapps/courseware/features/lti.feature lms/djangoapps/courseware/features/navigation.feature lms/djangoapps/courseware/features/problems.feature lms/djangoapps/courseware/features/registration.feature lms/djangoapps/courseware/features/signup.feature lms/djangoapps/courseware/features/video.feature lms/djangoapps/courseware/features/word_cloud.feature
240 lines
11 KiB
Gherkin
240 lines
11 KiB
Gherkin
@shard_1
|
|
Feature: LMS.Answer problems
|
|
As a student in an edX course
|
|
In order to test my understanding of the material
|
|
I want to answer problems
|
|
|
|
Scenario: I can answer a problem correctly
|
|
Given External graders respond "correct"
|
|
And I am viewing a "<ProblemType>" problem
|
|
When I answer a "<ProblemType>" problem "correctly"
|
|
Then my "<ProblemType>" answer is marked "correct"
|
|
And The "<ProblemType>" problem displays a "correct" answer
|
|
|
|
Examples:
|
|
| ProblemType |
|
|
| drop down |
|
|
| multiple choice |
|
|
| checkbox |
|
|
| radio |
|
|
| string |
|
|
| numerical |
|
|
| formula |
|
|
| script |
|
|
| code |
|
|
| radio_text |
|
|
| checkbox_text |
|
|
|
|
Scenario: I can answer a problem incorrectly
|
|
Given External graders respond "incorrect"
|
|
And I am viewing a "<ProblemType>" problem
|
|
When I answer a "<ProblemType>" problem "incorrectly"
|
|
Then my "<ProblemType>" answer is marked "incorrect"
|
|
And The "<ProblemType>" problem displays a "incorrect" answer
|
|
|
|
Examples:
|
|
| ProblemType |
|
|
| drop down |
|
|
| multiple choice |
|
|
| checkbox |
|
|
| radio |
|
|
| string |
|
|
| numerical |
|
|
| formula |
|
|
| script |
|
|
| code |
|
|
| radio_text |
|
|
| checkbox_text |
|
|
|
|
Scenario: I can submit a blank answer
|
|
Given I am viewing a "<ProblemType>" problem
|
|
When I check a problem
|
|
Then my "<ProblemType>" answer is marked "incorrect"
|
|
And The "<ProblemType>" problem displays a "blank" answer
|
|
|
|
Examples:
|
|
| ProblemType |
|
|
| drop down |
|
|
| multiple choice |
|
|
| checkbox |
|
|
| radio |
|
|
| string |
|
|
| numerical |
|
|
| formula |
|
|
| script |
|
|
| radio_text |
|
|
| checkbox_text |
|
|
|
|
|
|
Scenario: I can reset a problem
|
|
Given I am viewing a "<ProblemType>" problem
|
|
And I answer a "<ProblemType>" problem "<Correctness>ly"
|
|
When I reset the problem
|
|
Then my "<ProblemType>" answer is marked "unanswered"
|
|
And The "<ProblemType>" problem displays a "blank" answer
|
|
|
|
Examples:
|
|
| ProblemType | Correctness |
|
|
| drop down | correct |
|
|
| drop down | incorrect |
|
|
| multiple choice | correct |
|
|
| multiple choice | incorrect |
|
|
| checkbox | correct |
|
|
| checkbox | incorrect |
|
|
| radio | correct |
|
|
| radio | incorrect |
|
|
| string | correct |
|
|
| string | incorrect |
|
|
| numerical | correct |
|
|
| numerical | incorrect |
|
|
| formula | correct |
|
|
| formula | incorrect |
|
|
| script | correct |
|
|
| script | incorrect |
|
|
| radio_text | correct |
|
|
| radio_text | incorrect |
|
|
| checkbox_text | correct |
|
|
| checkbox_text | incorrect |
|
|
|
|
|
|
Scenario: I can answer a problem with one attempt correctly and not reset
|
|
Given I am viewing a "multiple choice" problem with "1" attempt
|
|
When I answer a "multiple choice" problem "correctly"
|
|
Then The "Reset" button does not appear
|
|
|
|
Scenario: I can answer a problem with multiple attempts correctly and still reset the problem
|
|
Given I am viewing a "multiple choice" problem with "3" attempts
|
|
Then I should see "You have used 0 of 3 submissions" somewhere in the page
|
|
When I answer a "multiple choice" problem "correctly"
|
|
Then The "Reset" button does appear
|
|
|
|
Scenario: I can view how many attempts I have left on a problem
|
|
Given I am viewing a "multiple choice" problem with "3" attempts
|
|
Then I should see "You have used 0 of 3 submissions" somewhere in the page
|
|
When I answer a "multiple choice" problem "incorrectly"
|
|
And I reset the problem
|
|
Then I should see "You have used 1 of 3 submissions" somewhere in the page
|
|
When I answer a "multiple choice" problem "incorrectly"
|
|
And I reset the problem
|
|
Then I should see "You have used 2 of 3 submissions" somewhere in the page
|
|
And The "Final Check" button does appear
|
|
When I answer a "multiple choice" problem "correctly"
|
|
Then The "Reset" button does not appear
|
|
|
|
Scenario: I can view and hide the answer if the problem has it:
|
|
Given I am viewing a "numerical" that shows the answer "always"
|
|
When I press the button with the label "Show Answer(s)"
|
|
Then the button with the label "Hide Answer(s)" does appear
|
|
And the button with the label "Show Answer(s)" does not appear
|
|
And I should see "4.14159" somewhere in the page
|
|
When I press the button with the label "Hide Answer(s)"
|
|
Then the button with the label "Show Answer(s)" does appear
|
|
And I should not see "4.14159" anywhere on the page
|
|
|
|
Scenario: I can see my score on a problem when I answer it and after I reset it
|
|
Given I am viewing a "<ProblemType>" problem
|
|
When I answer a "<ProblemType>" problem "<Correctness>ly"
|
|
Then I should see a score of "<Score>"
|
|
When I reset the problem
|
|
Then I should see a score of "<Points Possible>"
|
|
|
|
Examples:
|
|
| ProblemType | Correctness | Score | Points Possible |
|
|
| drop down | correct | 1/1 points | 1 point possible |
|
|
| drop down | incorrect | 1 point possible | 1 point possible |
|
|
| multiple choice | correct | 1/1 points | 1 point possible |
|
|
| multiple choice | incorrect | 1 point possible | 1 point possible |
|
|
| checkbox | correct | 1/1 points | 1 point possible |
|
|
| checkbox | incorrect | 1 point possible | 1 point possible |
|
|
| radio | correct | 1/1 points | 1 point possible |
|
|
| radio | incorrect | 1 point possible | 1 point possible |
|
|
| string | correct | 1/1 points | 1 point possible |
|
|
| string | incorrect | 1 point possible | 1 point possible |
|
|
| numerical | correct | 1/1 points | 1 point possible |
|
|
| numerical | incorrect | 1 point possible | 1 point possible |
|
|
| formula | correct | 1/1 points | 1 point possible |
|
|
| formula | incorrect | 1 point possible | 1 point possible |
|
|
| script | correct | 2/2 points | 2 points possible |
|
|
| script | incorrect | 2 points possible | 2 points possible |
|
|
|
|
Scenario: I can see my score on a problem to which I submit a blank answer
|
|
Given I am viewing a "<ProblemType>" problem
|
|
When I check a problem
|
|
Then I should see a score of "<Points Possible>"
|
|
|
|
Examples:
|
|
| ProblemType | Points Possible |
|
|
| drop down | 1 point possible |
|
|
| multiple choice | 1 point possible |
|
|
| checkbox | 1 point possible |
|
|
| radio | 1 point possible |
|
|
| string | 1 point possible |
|
|
| numerical | 1 point possible |
|
|
| formula | 1 point possible |
|
|
| script | 2 points possible |
|
|
|
|
|
|
Scenario: I can reset the correctness of a problem after changing my answer
|
|
Given I am viewing a "<ProblemType>" problem
|
|
Then my "<ProblemType>" answer is marked "unanswered"
|
|
When I answer a "<ProblemType>" problem "<InitialCorrectness>ly"
|
|
And I wait for "1" seconds
|
|
And I input an answer on a "<ProblemType>" problem "<OtherCorrectness>ly"
|
|
Then my "<ProblemType>" answer is marked "unanswered"
|
|
And I reset the problem
|
|
|
|
Examples:
|
|
| ProblemType | InitialCorrectness | OtherCorrectness |
|
|
| drop down | correct | incorrect |
|
|
| drop down | incorrect | correct |
|
|
| checkbox | correct | incorrect |
|
|
| checkbox | incorrect | correct |
|
|
| string | correct | incorrect |
|
|
| string | incorrect | correct |
|
|
| numerical | correct | incorrect |
|
|
| numerical | incorrect | correct |
|
|
| formula | correct | incorrect |
|
|
| formula | incorrect | correct |
|
|
| script | correct | incorrect |
|
|
| script | incorrect | correct |
|
|
|
|
# Radio groups behave slightly differently than other types of checkboxes, because they
|
|
# don't put their status to the top left of the boxes (like checkboxes do), thus, they'll
|
|
# not ever have a status of "unanswered" once you've made an answer. They should simply NOT
|
|
# be marked either correct or incorrect. Arguably this behavior should be changed; when it
|
|
# is, these cases should move into the above Scenario.
|
|
Scenario: I can reset the correctness of a radiogroup problem after changing my answer
|
|
Given I am viewing a "<ProblemType>" problem
|
|
When I answer a "<ProblemType>" problem "<InitialCorrectness>ly"
|
|
And I wait for "1" seconds
|
|
Then my "<ProblemType>" answer is marked "<InitialCorrectness>"
|
|
And I input an answer on a "<ProblemType>" problem "<OtherCorrectness>ly"
|
|
Then my "<ProblemType>" answer is NOT marked "<InitialCorrectness>"
|
|
And my "<ProblemType>" answer is NOT marked "<OtherCorrectness>"
|
|
And I reset the problem
|
|
|
|
Examples:
|
|
| ProblemType | InitialCorrectness | OtherCorrectness |
|
|
| multiple choice | correct | incorrect |
|
|
| multiple choice | incorrect | correct |
|
|
| radio | correct | incorrect |
|
|
| radio | incorrect | correct |
|
|
|
|
|
|
Scenario: I can reset the correctness of a problem after submitting a blank answer
|
|
Given I am viewing a "<ProblemType>" problem
|
|
When I check a problem
|
|
And I input an answer on a "<ProblemType>" problem "correctly"
|
|
Then my "<ProblemType>" answer is marked "unanswered"
|
|
|
|
Examples:
|
|
| ProblemType |
|
|
| drop down |
|
|
| multiple choice |
|
|
| checkbox |
|
|
| radio |
|
|
| string |
|
|
| numerical |
|
|
| formula |
|
|
| script |
|