Digital libraries evaluation – an analysis of literature published between 2000 and 2012
DOI:
https://doi.org/10.24917/20811861.14.5Keywords:
digital library, evaluation, user interface, usabilityAbstract
Evaluation, which is an important part of the design process of a digital library, is essential in the process of improving the functionality of the library and recognition of users needs. The article presents an analysis of Polish and foreign literature, published mainly between 2000 and 2012, on evaluation of digital libraries, including the concepts of selections of digital library’s elements for evaluation, and also on criteria and methods of evaluation. The user- and system-centered approach to digital library evaluation were described. Among the presented evaluation methods, the user interface usability evaluation was highlighted as a popular and frequently used method, especially in researches conducted abroad. Additionally, user interface usability evaluation methods and holistic model of digital library evaluation were presented. The literature analysis includes researches conducted by Saracevic, Blandford, Borgman, Buchanan and Salako, Chowdhury and Chowdhury, Fuhr, Hang, Jeng, Kelly, Kochang, Janiak and Krakowska, Xie, Tsakonas, Kapidakis and Papatheodorou.
References
Ahmad, M., Abawajy, J., Digital Library Service Quality Assessment Model, “Procedia – Social and Behavioral Sciences” 2014, No. 129, s. 571-580.
Bednarek-Michalska, B., Standardy i dobre praktyki budowania kolekcji cyfrowych 2007 -https://repozytorium.umk.pl/bitstream/handle/item/29/bc-standardy4.pdf?sequence=1 [2015.01.04].
Blandford, A. i.in., Analytical usability evaluation for Digital libraries: a case study, “JCDL '04 Proceedings of the 4th ACM/IEEE-CS joint conference on Digital libraries” 2004, s. 27-36 - http://www.eis.mdx.ac.uk/research/idc/papers/IDC-TR-2004-002.pdf [2012.01.17].
Blandford, A., Concept-based Analysis of Surface and Structural Misfits (CASSM)
Introduction p1: overview 2010 - http://www.uclic.ucl.ac.uk/annb/CASSM/index.html [2012.07.20].
Blandford, A., Understanding user’s experiences: evaluation of digital libraries 2004 - http://www.delos.info/files/pdf/events/2004_Ott_4/Blandford.pdf [2012.01.17].
Blandford, A., Buchanan, G., Usability of digital libraries: a source of creative tensions with technical development, “IEEE-CS Technical Committee on Digital Libraries' on-line newsletter” 2003 - http://discovery.ucl.ac.uk/16648/ [2012.01.18].
Borgman, C. Challenges in building digital libraries for the 21st century, [w:] The International Conference on Asia-Pacific Digital Libraries 2002, red. E. Lim i in., Berlin 2002, s. 1-13.
Buchanan, S., Salako, A., Evaluating the usability and usefulness of a digital library, “Library Review” 2009, Vol. 58, No. 9, s. 638-651.
Chowdhury, G., Chowdhury, S., An overview of the information retrieval features of twenty digital libraries, “Program” 2000, Vol. 34, No. 4, s. 341-373.
Chowdhury, G., Chowdhury, S., Introduction to digital libraries, London 2012.
Chowdhury, S., Landoni, M., Gibb, F., Usability and impact of digital libraries: a review, “Online Information Review” 2006, Vol. 30, No. 6, s. 656-680.
Derfert–Wolf, L., Jakość bibliotek cyfrowych. Próba ustalenia kryteriów oceny z punktu widzenia (zaawansowanego) użytkownika, Konferencja „Polskie Biblioteki Cyfrowe 2010”, Poznań 18-22 października 2010 r. - http://lib.psnc.pl/Content/316/Jako%C5%9B%C4%87%20bibliotek%20cyfrowych.%20Pr%C3%B3ba%20ustalenia%20kryteri%C3%B3w%20oceny%20z%20punktu%20widzenia%20%28zaawansowanego%29%20u%C5%BCytkownika.pdf [2016.04.09].
Domagalska, A., Model jakości bibliotek cyfrowych, „Zeszyty Naukowe Wydziału ETI Politechniki Gdańskiej: Technologie informacyjne” 2006, nr 4, s. 555-562.
Frumkin, J., Defining digital libraries, “OCLC Systems & Services” 2004, Vol. 20, No. 4, s. 155-156.
Fuhr, N. i in., Digital Libraries: a generic classification and evaluation scheme, “Lecture Notes in Computer Science” 2001, Vol. 2163, s. 187-199.
Fuhr, N. i in., Evaluation of digital libraries, “International Journal of Digital Libraries” 2007, Vol. 8, No. 1, s. 21-38.
Głowacka, E., Jakość bibliotek cyfrowych – aspekty i kryteria oceny, „E-Mentor” 2011, nr 2(39) - http://www.e-mentor.edu.pl/artykul/index/numer/39/id/828 [2016.04.08].
Goh, D.H.L. i in., A checklist for evaluating Open Source Digital Library Software, “Online Information Review” 2006, No. 30(4), s. 360-379.
Hang, Y., Developing a Holistic Model for Digital Library Evaluation, “Journal of the American Society for Information Science and Technology” 2010, No. 61(1), s. 88-110.
Hariri, N., Norouzi, Y., Determining evaluation criteria for digital libraries’ user interface: a review, “The Electronic Library” 2011, Vol. 29, No. 5, s. 698-722.
Janiak, M., Krakowska, M. Ocena bibliotek cyfrowych – kryteria jakości, [w:] Polskie Biblioteki Cyfrowe 2010, red. C. Mazurek, M. Stroiński, J. Węglarz, Poznań 2011, s. 101-108.
Jeng, J., Usability assessment of academic digital libraries: effectiveness, efficiency, satisfaction and learnability, “Libri” 2005, Vol. 55, s. 96-121.
Jeng, J., What is usability in the context of the digital library and how can it be measured? “Information Technology and Libraries” 2005, No. 24(2), s. 47-56.
Kadir, R. i.in., A user-based measure in evaluating academic digital library, International Conference on Academic Libraries 2009 - http://crl.du.ac.in/ical09/papers/index_files/ical-13_193_404_1_RV.pdf [2012.01.19].
Kelly, E.J., Assessment of Digitized Library and Archives Materials: A Literature Review, “Journal of Web Librarianship” 2014, Vol. 8, Issue 4, s. 384-403.
Koohang, A., Ondracek, J., Users’ views about the usability of digital libraries, “British Journal of Educational Technology” 2005, Vol. 36, No. 3, s. 407-423.
Motylińska, P. Ocena użyteczności interfejsów użytkownika do bibliotek cyfrowych uniwersytetów. Praca magisterska pod kierunkiem dr hab. M. Próchnickiej, Kraków: Uniwersytet Jagielloński, 2013.
Nahotko, M., Zasady tworzenia bibliotek cyfrowych, „Biuletyn EBIB” 2006, nr 4(74) -http://www.ebib.info/2006/74/nahotko.php [2015.01.04].
NISO Framework Working Group, Institute of Museum and Library Service, A Framework of guidance for building good Digital Collections, Baltimore: National Information Standards Organization, 2007, 3rd Edition - http://www.niso.org/publications/rp/framework3.pdf [2016.04.09].
Reeves, T., Apedoe, X., Hee Woo, Y., Evaluating digital libraries: a user-friendly guide 2005 -https://www.wmich.edu/sites/default/files/attachments/u58/2015/Reeves-2005.pdf [2012.07.25].
Sandusky, R., Digital library attributes: framing research and results, [w:] Fourth DELOS Workshop: Evaluation of digital libraries: Testbeds, measurements and metrics, red. C. Borgman, S. Ingeborg, K. László, Budapest 2002, s. 101-107.
Saracevic, T., Digital library evaluation: toward an evolution of concepts, “Library Trends” 2000, Vol. 49, No. 3, s. 350-369.
Saracevic, T., Evaluation of digital libraries: an overview 2004 -http://comminfo.rutgers.edu/~tefko/DL_evaluation_Delos.pdf [2011.12.07].
Saracevic, T., How were digital libraries evaluated? 2004 -http://comminfo.rutgers.edu/~tefko/DL_evaluation_LIDA.pdf [2016.04.08].
Saracevic, T., Covi, L., Challenges for digital library evaluation, “Annual Meeting 2000 of the American Society for Information Science” 2000, s. 1-12 - http://www.is.inf.uni-due.de/courses/dl_ss04/folien/saracevic00.pdf [2016.04.08].
Schabowska, K., Próba oceny kolekcji bibliotek cyfrowych wyższych uczelni technicznych: (w kontekście pozyskiwania materiałów z historii techniki), „Kwartalnik Historii Nauki i Techniki” 2009, R. 54, nr 3-4, s. 223-234.
Skórka, S., Ewaluacja jakości bibliotek cyfrowych w ujęciu architektury informacji, XVIII edycja seminarium w cyklu „Digitalizacja, biblioteki cyfrowe – systemy zarządzania, obsługi oraz kryteria oceny” Warszawa 2012 - http://pbc.up.krakow.pl/dlibra/doccontent?id=2586&from=FBC [2015.02.19].
Skubała, E., Kazan, A., Analiza zasobu polskich bibliotek cyfrowych w kontekście ich wykorzystania w dydaktyce, „II Wrocławskie Spotkania Bibliotekarzy Polonijnych 2009”, [w.] EBIB Materiały konferencyjne nr 20 - http://www.ebib.pl/publikacje/matkonf/mat20/skubala_kazan.php [2016.04.09].
Theng, Y.L. i in. Design guidelines and user-centred digital libraries -http://www.music.mcgill.ca/~ich/classes/mumt611_08/usability/theng99design.pdf [2016.04.06].
Tsakonas, G. i in., An Exploraton of the Digital Library Evaluation Literature based on an Ontological Representation, “Journal of the American Society for Information Science and Technology” 2013, No. 64(9), s. 1914-1926.
Tsakonas, G.; Kapidakis, S.; Papatheodorou, C., Evaluation of users interaction in digital libraries, “Notes of the DELOS WP7 Workshop on the Evaluation of Digital Libraries” 2004, s. 45-56.
Tsakonas, G.; Papatheodorou, C., Exploring usefulness and usability in the evaluation of open access digital libraries, “Information Processing and Management” 2008, No. 44, s. 1234–1250.
Wójcik, M., Literatura na temat bibliotek cyfrowych - analiza bibliometryczna, [w:] Biblioteki cyfrowe: praca zbiorowa, red. M. Janiak, M. Krakowska, M. Próchnicka, Warszawa 2012, s. 284-294.
Xie, H., Users’ evaluation of digital libraries: their uses, their criteria and their assessment, “Information Processing and Management: an International Journal” 2008, Vol. 44, Issue 3, s. 1346–1373.
Żernicka, K., Dobór serwisów WWW polskich bibliotek cyfrowych do oceny użyteczności – propozycja pragmatycznego podejścia, „Toruńskie Studia Bibliologiczne” 2013, nr 1(10), s. 127-139.
Żernicka, K., Ocena jakości polskich bibliotek cyfrowych. Praca doktorska 2015, Toruń: Uniwersytet Mikołaja Kopernika - https://repozytorium.umk.pl/handle/item/2384 [2016.04.08].
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2017 AUPC Studia ad Bibliothecarum Scientiam Pertinentia
This work is licensed under a Creative Commons Attribution 4.0 International License.
