Smith's study "The Case of the Missing Macron" investigates search engines, such as Google, and their usefulness for finding Māori resources by searching for Te reo keywords with and without the macron. These terms, effectiveness, efficiency, as well as user satisfaction, are the most used parameters for determining usability. ISO 9126 defines usability as "the ability of the software product to be understood, learned, used and attractive to the user, when used under specified conditions".
A major revision that emerged from the revised standard was the need for specific user goals. Therefore, the revised versions of the standard have four main aspects, Effectiveness, Efficiency, Satisfaction and Context of use. This is achieved through providing precise tasks and having users verbalize their process and task completion (Tullis, & Albert, B., 2008).
Theoretical framework
Zoom in to record users to better record time taken without distracting users with stop and start timers. The time taken will mainly depend on the time when the user decides that the task is finished, after which he will answer the corresponding questions. The ideal form of this is Kaitiaki where the Maori communities involved are given control over the research.
Due to time and resource constraints, this paper will refer to the Māori-centred engagement approach of the diagram. Within a Māori-centred framework, Mana whenua is the prescribed criterion for minimal considerations under Tika. Manaakitanga is important to both the authors and the users involved in this research.
Manaakitanga can include the giving of kai (food) and koha (gifts) (Kennedy, Vivienne et al. 2015). Mana is closely related to the concept of Tino Rangatiratanga or self-determination, control and cultural aspirations (Foster.
Data collection
This paper will collect data through an initial think-aloud usability test (Appendix 1.1) followed by a semi-structured interview (Appendix 1.2) to better understand the user's thoughts and actions. The think-aloud method, also known as the 'verbal protocol' method (Brown, 8, 2002), was developed by Ericsson and Simon in relation to memory research. Jakob Nielsen (2012) defines the method as having users verbalize “their thoughts as they move through the user interface”.
In theory, this method informs researchers of users' honest thoughts in real time as they use the site. Think-aloud methods have their limitations and problems, for example Nielsen notes that the method requires users to perform "a very unnatural activity, namely verbally discharging a stream of consciousness while interacting with a system". Thus, it may be difficult for users to maintain concentration and perform tasks as they would normally while speaking (Danielson.
Bill Albert and Tom Tullis (2010) argue that the think-aloud method is the best way to understand problems and processes. The moderator can observe whether users seem confident or confused about their actions and nonverbal facial cues (103). In this study, qualitative research methods will be used in combination with a Māori-oriented framework.
This will ask users to elaborate on their experience with the database as well as any suggestions and issues they came across. This also provides context for actions taken during the test and to measure satisfaction.
Population and samples
Rosaline (2008) states that the strength of qualitative research is its ability to provide an understanding of how official figures are created through social processes. Due to time and resource constraints, this paper will only deal with six participants.
Data analysis
Ethical considerations
I also previously worked with Chris Thomson and Bridget Underhill on the Kōmako project as a student assistant editing some of the site's content. Privacy and intellectual property are also important ethical issues to consider in relation to this document. Information on how the information will be used and when it will be destroyed should also be included.
This will be used flexibly, as Hudson's et al. n.a) states, to maintain transparency and fair practices as needed (11). Other considerations include disclosure of the researcher's own background and the identity of those involved at all levels of the research.
Limitations
Findings
Success was recorded when the user found the answer or completed the task with little or no difficulty. This task had the most "partial successes" because even though the user found relevant results that could satisfy their hypothetical search needs, the results were themselves in some cases. In the third task, the outcome depended heavily on the user's Iwi, and in this case the failures appear to be due to the use of tohutō (macron), alternative spellings, and the inability of the search to distinguish between iwi texts or author biographical information.
Tasks that all failed were measured by the user abandoning the search before any satisfactory results were found. Many of these tasks required the user to complete tasks that were based on features that the site had in previous iterations but have since stopped working or been removed. The inability of users to complete these tasks does not necessarily affect the usability of the site, but it does limit the methods that users can use to find information.
Performance was measured by the number of search revisions the user made before reaching a satisfactory answer (Appendix 2.2). The second task that prompted the most query reformulations was task seven, which asked the user to submit an author. Performance in this study was largely a measure of how well users were able to understand the site's layout and functionality by the end of the test.
For the majority of users, the layout of the site was simple and straightforward. On the other hand, lower-scoring users also noted that the score was the result of a desire to see the problems resolved because the site was really useful to them in their work.
Issues and bugs found
Therefore, users generally found the site easy to navigate and learn, but some functions difficult to use. One user commented "I found the search functionality very mysterious". This also emerged during the first task which asked users to find the oldest text listed on the website. Regarding the inconsistent search results, one user also commented that a relative they knew was on the site was not returned when they searched for their iwi in task three.
One user looked to the FAQ page for search tips because they couldn't figure out what functions as the site's wild card. When asked if searching with an empty search bar returns any results, the site will return an error message or in other cases the site will simply show a loading symbol. One user who had not previously used the site also reported that they thought it was useful and expressed their intention to use it for their work in the future.
The feature they used the most was the iwi search feature that appeared on the site but has since been removed. Research papers were also listed by another user as the main reasons they previously used the site. Another user said they had recently used the site to confirm iwi and hapu affiliations for records they were cataloging.
When asked what they liked about the site, one user said they liked “the breadth. Because the site's design is simple and straightforward, users quickly looked through their options before finding an answer or understanding a task.
Discussion and recommendations
Recommendation: Fixing the issue of inaccurate or confusing search criteria can be reviewed by the site's developer. The issue of missing metadata is more straightforward, as data simply needs to be added back to the site. Some aspects of Kōmako, such as the inclusion of iwi affiliations and the use of mihi, have been commented on as significant attractions for the site.
Recommendation: It was noted that there used to be a feature on the site that allowed users to search for iwi affiliation instead of relying on a generic keyword search. Users who had previous experience using the site cited this as a major draw of the site. There were several examples of using the iwi search to find family members on the site and new users there.
Comments by users about the scope of the site pointed out two criteria that were contradictory. Users also questioned whether more te reo writings could be included in the site to make it more inclusive and give the site more cultural value. Studies into other aspects of the site would also be useful, for example a deeper look at site analytics or broader surveys on how the site is used would add more useful information to the site.
This study was conducted to better understand how well users think the site achieves its goals and how it can be improved. The simplicity of the site layout makes it easy to navigate and, as a result, users quickly completed tasks or realized that a task was impossible.
Brown, D (2016) "Te Ahu Hiko: theorizing digital cultural heritage and indigenous objects, people and environments" Cameron, Fiona, and Kenderdine, Sarah. 2013) "Bicultural Evaluation of New Zealand Public Library Websites". http://ndhadeliver.natlib.govt.nz/delivery/DeliveryManagerServlet?dps_pid=IE22384711. A Research Ethics for Studying Māori and iwi Provider Success.’ Social Policy Journal of New Zealand.
Te huarahi tika: Nga ingoa kaupapa Maori: purongo tuatoru, Kupu Aratohu: Nga upoko kaupapa Maori Kaupapa: wahanga 3 purongo rangahau Te Rōpū Whare Pukapuka me nga Korero o Aotearoa me Te Ropu Whakahau Library and Information Workers Association Maori. Wellington, N.Z.: Toi History, School of Art History, Classics and Religious Studies, Victoria University of Wellington.
1988) 'Nga Whare Taonga me te Iwi Maori o Aotearoa.'. 2015) "He Matapihi Mā Mua, Mō Muri: Matatika, Tukatuka me nga Tikanga e Pa ana ki te Whakarorohikotanga o te Matauranga Taketake - Te Kohinga Pei Jones" Cataloging and Classification Quarterly.
Research tasks
Survey questions
