{"id":698,"date":"2017-02-01T09:00:34","date_gmt":"2017-02-01T09:00:34","guid":{"rendered":"https:\/\/commons.mtholyoke.edu\/uxprojects\/?p=698"},"modified":"2019-03-06T20:16:00","modified_gmt":"2019-03-06T20:16:00","slug":"new-discover-usability-testing-bento-style","status":"publish","type":"post","link":"https:\/\/commons.mtholyoke.edu\/uxprojects\/new-discover-usability-testing-bento-style\/","title":{"rendered":"New Discover Usability Testing: Bento-Style"},"content":{"rendered":"<h3>Abstract<\/h3>\n<p>The Smith College Libraries conducted usability testing in 2016 during local development of a new interface and &#8220;bento box&#8221; style of display for search results from EBSCO Discovery Service (EDS).<\/p>\n<p>Research and usability tests were conducted by a team made up of staff members from the Smith College Libraries Web Coordination Team and Discovery &amp; Access and Teaching, Learning &amp; Research departments.\u00a0 Planning for the project was informed by results of EBSCO user experience studies.<\/p>\n<p>The\u00a0 Bento group met to review usability test results and discuss changes &#8212; in content, functionality, design, and language &#8212; after each successive round of testing.\u00a0\u00a0The &#8220;New Discover&#8221; was launched on the Smith Libraries website in January, 2017.<\/p>\n<p><!--more--><\/p>\n<h3>Goal\/Question<\/h3>\n<ul>\n<li>How do users enter searches in Discover?<\/li>\n<li>Do users know enough to know that each of the resource types in a bento box-style display serve different purposes?<\/li>\n<li>Are our data stores differentiated enough? Will we end up with the same results in different parts of the bento display?<\/li>\n<li>How good\/bad are each system\u2019s search engines? Will the steamed turnips in one part of the bento display make the sushi in the other unappetizing (as it were)?<\/li>\n<\/ul>\n<h3>Methods<\/h3>\n<ul style=\"margin-left: 10%\">\n<li>Analysis of EDS <span style=\"font-weight: 400\">search logs (July 1, 2015-June 30, 2016)<\/span><\/li>\n<li>Moderated usability testing including:<br \/>\n<span style=\"font-weight: 400\">Scenario-based questions &#8211; complete specific tasks;<br \/>\n<\/span><span style=\"font-weight: 400\">Discussion &#8211; \u00a0features, content, terminology, presentation of the citations;\u00a0<\/span><span style=\"font-weight: 400\">\u201cproduct value\u201d questions <\/span><\/li>\n<li>Staff sandbox testing<\/li>\n<li>Beta release feedback<\/li>\n<\/ul>\n<h3>Statistics\/Data<\/h3>\n<p style=\"padding-left: 30px\"><strong>Sample size:\u00a0<\/strong>4 rounds of testing, 20 tests<br \/>\n(16 undergraduates, 1 Ada Comstock non-traditional aged undergraduate student, 2 faculty members)<\/p>\n<p style=\"padding-left: 30px\"><span style=\"font-weight: 400\">Approximately 189,000 EDS (Discover) searches on approximately 5,000 search terms\u00a0<\/span><span style=\"font-size: 1rem\">between July 1, 2015-June 30, 2016<\/span><\/p>\n<p style=\"padding-left: 30px\"><strong>Dates:<\/strong> 06\/01\/2016 &#8211; 12\/01\/2016<\/p>\n<p style=\"padding-left: 30px\"><strong>Campus\/College:<\/strong> Smith College<\/p>\n<p style=\"padding-left: 30px\"><strong>Contact:<\/strong>\u00a0Rob O&#8217;Connell, Directory of Discovery &amp; Access, Smith College Libraries<\/p>\n<p style=\"padding-left: 30px\"><strong>Files Used<\/strong><\/p>\n<ul style=\"margin-left: 10%\">\n<li><a href=\"https:\/\/drive.google.com\/file\/d\/1J5HDY0OVekNKbL4JiWOduiuJllrzdR_G\/view?usp=sharing\">Approaches to Search: Bento vs Tabbed<\/a><\/li>\n<\/ul>\n<hr \/>\n<h3>Outcome<\/h3>\n<h4 style=\"padding-left: 30px\">Discover Search Logs: Key Findings<\/h4>\n<ol style=\"margin-left: 10%\">\n<li>Overwhelming majority of searches were for a known item<\/li>\n<li>Significant number of search terms were VERY Broad &#8212; whole disciplines (history, psychology, chemistry) and very general topics (therapy, feminism, women, Africa)<\/li>\n<li>Most \u201csubject\u201d (as opposed to known-item searches) were one word or a short phrase expressing the concept<\/li>\n<\/ol>\n<h4 style=\"padding-left: 30px\">Key Usability Test Findings<\/h4>\n<ol style=\"margin-left: 10%\">\n<li>Proof of the Bento+ concept<\/li>\n<li>Contain the discovery and access within Bento+<\/li>\n<li>Limit citation information to essentials<\/li>\n<li>Limit to \u201cavailability at Smith\u201d<\/li>\n<li>Enable sort by date option<\/li>\n<li>Library-ese (jargon) remains a problem<\/li>\n<\/ol>\n<h4 style=\"padding-left: 30px\">Results<\/h4>\n<p style=\"padding-left: 30px\">User testing through iterations of system development allowed the Smith College team to design an optimized discovery experience interface. Expanded functionality makes it easier for users to scan search results, connect to online content, and refine searches. New Discover provides access to millions of resources in the library catalog, journal article databases, and local primary source collections.<\/p>\n<h4 style=\"padding-left: 30px\">Recommendation<\/h4>\n<p style=\"padding-left: 30px\"><span style=\"font-weight: 400\">Continue to study terminology, functionality, and content types that are problematical.\u00a0 Consider &#8220;guerrilla testing&#8221; for terminology. Conduct additional user studies prior to launch of new developments.<\/span><\/p>\n<h4 style=\"padding-left: 30px\">Related links<\/h4>\n<ul style=\"margin-left: 10%\">\n<li><a href=\"https:\/\/docs.google.com\/presentation\/d\/1lYqYaYN_pEZofSV2pIiE3TptNoUdsqnGZtG_x--zu6s\/edit?usp=sharing\">EBSCO UX presentation w Smith stats 2016-08-02<\/a><\/li>\n<li><a href=\"https:\/\/aci.info\/2017\/03\/08\/smith-college-bento-boxes-and-blogs-a-story-of-innovation\/\">Smith College, Bento Boxes, and Blogs: a Story of Innovation<\/a><br \/>\n(ACI Scholarly Blog, Mar 2017)<\/li>\n<li><a href=\"http:\/\/www.infotoday.com\/cilmag\/mar19\/OConnell--Beyond-the-Bento-A-New-Discovery-Experience-at-Smith-College.shtml\">Beyond the Bento: A New Discovery Experience at Smith College<\/a> (<em>Computers in Libraries<\/em>, Jan\/Feb 2019)<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Abstract The Smith College Libraries conducted usability testing in 2016 during local development of a new interface and &#8220;bento box&#8221; style of display for search results from EBSCO Discovery Service (EDS). Research and usability tests were conducted by a team made up of staff members from the Smith College Libraries Web Coordination Team and Discovery &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/commons.mtholyoke.edu\/uxprojects\/new-discover-usability-testing-bento-style\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;New Discover Usability Testing: Bento-Style&#8221;<\/span><\/a><\/p>\n","protected":false},"author":376,"featured_media":519,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"footnotes":""},"categories":[18,1,32],"tags":[8],"class_list":["post-698","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-discovery-and-search","category-research-projects","category-web-interface","tag-moderated-usability-testing"],"_links":{"self":[{"href":"https:\/\/commons.mtholyoke.edu\/uxprojects\/wp-json\/wp\/v2\/posts\/698","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/commons.mtholyoke.edu\/uxprojects\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/commons.mtholyoke.edu\/uxprojects\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/commons.mtholyoke.edu\/uxprojects\/wp-json\/wp\/v2\/users\/376"}],"replies":[{"embeddable":true,"href":"https:\/\/commons.mtholyoke.edu\/uxprojects\/wp-json\/wp\/v2\/comments?post=698"}],"version-history":[{"count":12,"href":"https:\/\/commons.mtholyoke.edu\/uxprojects\/wp-json\/wp\/v2\/posts\/698\/revisions"}],"predecessor-version":[{"id":783,"href":"https:\/\/commons.mtholyoke.edu\/uxprojects\/wp-json\/wp\/v2\/posts\/698\/revisions\/783"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/commons.mtholyoke.edu\/uxprojects\/wp-json\/wp\/v2\/media\/519"}],"wp:attachment":[{"href":"https:\/\/commons.mtholyoke.edu\/uxprojects\/wp-json\/wp\/v2\/media?parent=698"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/commons.mtholyoke.edu\/uxprojects\/wp-json\/wp\/v2\/categories?post=698"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/commons.mtholyoke.edu\/uxprojects\/wp-json\/wp\/v2\/tags?post=698"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}