EASYCHAIR REVIEW METAREVIEW AND COMMENTS GILBERTO BARDALES AARON

EASYCHAIR REVIEW, META-REVIEW AND COMMENTS GILBERTO BARDALES AARON DONK AMMAR TAKI EL-DIN VATSAL SHAH

RECAP & PROTOTYPE Recap a. Problems with excessive wordage b. Presence of technical terminology c. Lengthy form-fills d. Availability and absence of functionality Prototype a. http: //rdeezy. com/Easy. Chair/

SUBJECT FINDINGS - MAIN PAGE a. Not consistent with display b. Centered and left justified stuff doesn’t go well together c. Confused between selection of radiobuttons or clicking links d. Confused as to what the buttons refer to and where they apply e. Lack of title wasn’t appreciated (for Revise and Edit Metareview section)

SUBJECT FINDINGS ADD REVIEW/REVISE REVIEW a. Enjoyed scrolling dialog b. Those familiar with similar websites recommended sticking with "-3 to 3" ranking scheme c. Too much white space d. Center alignment disorienting in "add review" process e. Another person reviewing statement is not unambiguous (physically or as a requested subreview? ) f. Scoring titles weren’t explanatory

SUBJECT FINDINGS - REQUEST REVIEW a. Liked the auto-fill in the request review process b. Didn't like the need to fill out more info in the textbox such as due date c. Preferred to have a small template as to what to write in the text-box. a. However, didn't like the text to be part of the text-box, but liked the idea of a template

SUBJECT FINDINGS - ADD COMMENT a. Difficult to understand what commenting was for in the "add comment" process b. Suggested having comment form-fill after the abstract c. Would have liked the abstract to be shown in more places. d. Wanted the author info to be with the other info about paper; less disconnect

SUBJECT FINDINGS - SHOW REVIEWS a. The "Add Comment" section of this page is located on the very bottom of the page. b. Users would often scroll half way down and not all the way to the bottom. c. There is no indication on the top of the page that the "Add Comment" section exists. d. Liked the grey out effect and color effect for sub-revisions • Preferred to have it ordered by name and not date=

SUBJECT FINDINGS - META REVIEWS a. There is no easy way for a user to see the reviews that they are writing a meta review on b. User's expected to be able to write a meta review from the show reviews page c. Would have liked preview of review along with each review rather than entire reviews list or just links either d. Wanted a scale for accept and reject a. not so black and white b. a Maybe option if possible

CHANGES SINCE OUR LAST PRESENTATION a. All "submit" buttons point to the "my. Papers" portion of the website b. Addition of alerts when "submit" is clicked to show confirmation c. Made formatting changes to "add review" page d. Edited "revise review" page to reflect changes in "add review" page e. Added summary of review table to "meta review" page f. Links in summary of review table on "meta review" page open in a new tab

FINAL CHANGES a. Changed layout on main page and "add review" page to be on the left b. Set scale from 1 -5, 5 being excellent c. Overall Ranking scale set back to "-3 to 3" d. "Revise review" now has a form-fill for why the review was revised e. Added a button for add "meta review" on the "show reviews" page • Added a jump link on "show reviews" page to get to "add comment" • Added a jump link on bottom of "add review" to get to top because it is a long page

UPDATED TIMELINE a. All Users Studies finished on time b. Prototype updated according to user study results c. Just need to polish up the documentation

RISK ANALYSIS a. Rescheduling of subjects b. Time conflicts between subjects and teammates due to classtime restrictions c. Subjects leaving in between due to other commitments, boredom, etc. d. Subjects refusing to do a post-study interview e. User needs are higher than technological capabilities allowed for the modification of the website a. Conflicting user opinions lead to stagnant progress as prototype cannot accommodate conflicting changes • End result may end up being similar to original website if users find no problems with it

THANK YOU! QUESTIONS?