HCI Project Part 4

"Project Part 4" 

Prototyping & Evaluation

Introduction 

The prototype serves as an immersive simulation, offering a glimpse into the comprehensive mobile app designed for the school Riyadatul A'mal. Crafted with precision using Figma, this prototype meticulously captures the essence of the envisioned school management system, showcasing a rich interactivity that mirrors the intended final product.

Distinctly tailored for the three key users - teachers, students, and parents - the prototype seamlessly encapsulates the user experience for each interface. The culmination of these interfaces mirrors the dynamic interaction among the identified users, presenting a harmonious blend of functionality and usability.

At its current stage, the prototype adeptly facilitates the execution of the system's core tasks, emphasizing the four pivotal functions: disseminating homework notifications, sharing notification about materials, providing feedback, and distributing extra exercise links. For the purposes of testing presented in this blog post, only three tasks have been examined closely: material notifications, feedback uploads, and targeted distribution of extra exercise questions.

Within the prototype, every component essential for task completion has been meticulously rendered functional. This deliberate approach not only enhances the immersive quality of the user experience but also ensures a heightened level of accuracy in the testing and observation processes. The result is a prototype that goes beyond a mere representation, offering a true-to-life simulation of the envisioned school management system mobile app for Riyadatul A'mal.

For all the user testing sessions, Radowan acted as the facilitator, briefing the users about the prototype and the tasks. This crucial role ensured that participants were well-informed and guided throughout the testing process.

Try out our prototype

Teacher's interface

Student's interface

Parent's interface

Screenshots of the prototype 

Teacher's Interface

Homepage

Materials page

Feedback page

Extra Exercises page

Student's Interface

Homepage

Materials page

Feedback page

Extra Exercises page

Parent's Interface

Homepage

Materials page

Feedback page

Extra Exercises page

Briefing notes – by Radowan 

Introduction to the system given to all testers:

"This app is for the school Riadhatul A'mal. They want a system where the teacher can upload homework notification, materials notification, give feedback to students as well as upload extra exercise questions link for a subject to certain selected students who are academically weak. 

The students and parents will have their own interface, where they can look at the homework and materials notification the teachers have uploaded, and the feedback a teacher has given to the student. As for the extra exercise, the selected students can access the questions and the parents can look at their children's results."

Briefings for task 1: Materials Updates

Given to the "Teacher" user:

"Upload a material notification. This is a notification about what materials to bring (such as books, calculators, etc.) in the next class of a specific subject. 

You have to send the notification to students of Year 2 (T2), taking the subject 'Math'. They have to bring the material on the date 31st January 2024.

Note: To write "Description" on the prototype, simply click again on the box."

Given to the "Student" user:

"You have to check the material notification sent to you from your teacher.

Display the notification for the subject which has a notification."

Given to the "Parent" user:

"You have to check the material notification sent to your child by their teacher. 

Display the notification for the subject which has a notification."

Briefings for task 2: Sending or receiving feedback

Given to the "Teacher" user:

"Upload a feedback for a certain student. 

You have to send a feedback to Ahmad, a student of year 3 (T3), who is taking the 'English' subject."

Given to the "Student" user:

"You have to check the feedback sent to you from your teacher of a specific subject.

Display the feedback for the subject which has a notification." 

Given to the "Parent" user:

"You have to check the feedback sent to your child from their teacher of a specific subject.

Display the feedback for the subject which has a notification." 

Briefings for task 3: Uploading or taking extra-exercise

Given to the "Teacher" user:

"Upload an extra exercise. This exercise can only be attempted by a selected number of students that you consider to be weak academically. 

Upload the extra exercise link to students of year 4 (T4) for the subject 'sains'. Assume the link has been already copied. You can choose any of the students as weak students.

Note: To upload the link in the prototype, simply click on the box again." 

Given to the "Student" user:

"You have to check and attempt the extra exercise given to you by your teacher. 

Then view your score."

Given to the "Parent" user:

"You have to check the extra exercise notification you have received. This notification is about the recent extra exercise your child attempted for a specific subject. 

View your child's score, and then view the details of their exercise."

Interview questions asked to all testers:

1. What was difficult?
2. What would the reasons be for you to would use this system?
3. How well would this system fit into your life?
4. What would you comment about the user interface of this system?
5. What could be improved about this system?

Testing with users 

Task 1: Materials Updates

    Ahmad testing as the 'Teacher' 

    Sawaiz testing as the 'Student'

    

    Rafi testing as the 'Parent'

Task 2: Sending or receiving feedback

    Ahmad testing as the 'Teacher' 

    

    Sawaiz testing as the 'Student'

    Rafi testing as the 'Parent'

Task 3: Uploading or taking extra-exercise

    Ahmad testing as the 'Teacher' 

    

    Sawaiz testing as the 'Student'

    

    Rafi extra testing as the 'Parent'

Interviews

Interview of Ahmed (The Teacher)

Interview of Sawaiz (The Student)

Interview of Rafi (The Parent)

Observations – by Radowan, Tuhin, Sami, Mouaz & Taimon 

Task 1

Observations

For teacher: The teacher easily navigated the materials tab, appreciating its clarity. Upon discovering the year buttons and subjects drop-down menu, he quickly recognized their functions. Without hesitation, he selected "T2" for year 2 students and chose "Matematik" from the subjects menu. Intuitively, he entered the material update in the "Description" box and effortlessly added the date by identifying the calendar symbol's purpose. After selecting the appropriate date, he completed the process by clicking "Post" and confirming with an "OK" in response to the notification, expressing his understanding that the task was successfully completed.

Time of completion = 55s (~1 minute)

For student: The student pointed out the visibility of the main screen with notifications, indicating that there were notifications on their interface, and the design effectively conveyed this information. He noted the clarity of the "Materials" heading, signifying that the materials tab was appropriately sized and designed. Reading the "Subject list" heading on the "materials updates" page, he grasped that the presented buttons represented various subjects, although he assumed the subject names were in Malay, being an international student. Noticing the '1' symbol on the "Matematik" tab, he intuited a notification for that subject and clicked on it to discover a message from Ustaz Usman. Identifying the text in the description, he comprehended it as a reminder from the teacher about materials for the next class. After clicking 'ok' to close the notification, he revisited the same button to find no new notifications for that subject. Realizing there was nothing else to do on that screen, he clicked the home button, noticing that the '1' symbol on the "Materials" tab had disappeared, signaling the completion of his task.

Time of completion = 71s (~1 minute)

For parent: The parent quickly identified the tab leading to the materials section. Recognizing the list as a collection of subject buttons, he assumed that clicking on the "Matematik" subject, marked with a notification symbol, was the next step. Upon clicking, he found a clear notification from the teacher, which he read thoroughly, confirming his understanding of its source. Clicking "OK" closed the notification, and he realized that returning to the homepage required clicking the 'Home' button. On the homepage, he noticed the absence of a notification symbol on the materials tab, concluding that he had successfully checked the notification for that section.

Time of completion = ~30s 

Task 2

Observations:

For teacher: The teacher quickly grasped the process of uploading feedback, realizing that clicking on the "Give Feedback" tab in the menu was the key step. Efficiently navigating the interface, he filtered the feedback by selecting the year 3 button, smoothly maneuvering through the dropdown menus to choose the English subject and the correct student. Understanding that the "Feedback" text box was where he needed to input the feedback information, he proceeded to do so. Concluding the task, he clicked on the "POST" button and then promptly pressed "OK," expressing satisfaction that he had successfully completed the feedback submission.

Time of completion = 52s (~1 minute)

For student: The student, starting from the familiar main page from task one, follows the clear instructions to check feedback by navigating to the "See Feedback" tab. Impressed by the straightforward guidance, he clicks on the tab and is directed to the "Feedback" page, encountering the subject list similar to the one in task 1. Recognizing the notification symbol on the "Matematik" button, he quickly clicks on it, reads the teacher's notification effortlessly, and observes the slide option, correctly inferring the ability to view multiple feedback entries. Closing the notification with a click on "Ok," he revisits the subject button, receiving a "no new notifications" message. After clicking the "Home" button to return to the main page, he notes the absence of the notification symbol on the 'See Feedback' tab, confidently stating that he has completed task 2.

Time of completion = 52s (~1 minute)

For parent: The parent observes the clarity of the instruction as "See Feedback" is prominently written on the corresponding tab, aligning perfectly with his task of reviewing feedback from the teacher. With a click on the tab, he accesses the subject lists, noticing that the "English" subject bears a notification. Clicking on it, he effortlessly reads the teacher's name and the accompanying notification. After clicking 'OK,' he navigates back to the 'Home' button. Confirming the absence of the notification on the "See Feedback" tab, he confidently states that he has completed the task.

Time of completion = 21s

Task 3

Observations:

For teacher: The teacher promptly identifies the "Extra Exercise" tab as the avenue for uploading additional exercises, navigating to the corresponding screen. Enthusiastically, he appreciates the presence of year buttons, selecting year 4 and opting for "Sains" from the dropdown menu. Although there's a slight pause in realizing he needs to click on the "View Student List" button to designate weak students, he does so without difficulty or errors. The subsequent student list form allows him to effortlessly choose two students. Clicking on the 'Upload question link' box, he seamlessly uploads the extra exercise link. With a final click on "POST," he easily reads the task completion message and clicks "OK," successfully concluding his task.

Time of completion = 62s (~1 Minute)

For student: The student notes the recurrence of the familiar main screen and, when searching for extra exercises, appreciates the clarity of the "Extra Exercises" tab. Recognizing the notification symbol, he correctly infers the presence of unfinished exercises. Clicking on the tab, he encounters the subject list and identifies the second subject with a notification, prompting him to click on it. Navigating to the extra exercise website, he experiences a moment of confusion upon being redirected from the prototype but quickly adapts to understand the completion process. After finishing the exercise and returning to the prototype, he realizes that clicking "Yes" on the presented message is necessary. Subsequently, a message appears, indicating he can view his score. Intuitively clicking on the highlighted text, he reviews his exercise results, expressing appreciation for the prototype's interactive nature. Returning to the prototype's screen, he clicks "OK" on the message box and confirms the absence of further notifications, prompting him to navigate back to the home page. Observing the disappearance of the notification symbol from the "Extra Exercises" tab, he confidently declares the completion of his task.

Time of completion = 119s (~2minutes)

For parent: The parent initially notes the notification on the "Extra Exercise" tab and promptly clicks on it. From the presented subject list, they identify a notification on the "Matematik" subject and proceed to read the message. Clicking on the highlighted text, they access their child's detailed results, mirroring the process seen in task 3 testing for students. Despite some initial disorientation transitioning from the prototype to a different website for result details, the parent successfully checks the information and returns to the prototype. Clicking "Ok" to close the message box, they observe the disappearance of the notification on the subject. Clicking the "Home" button to return to the home screen, they notice the absence of the notification symbol on the "Extra Exercise" tab and affirm that they have completed their task.

Time of completion = 43s

Interview Results Summaries

For teacher: 

The teacher shared a positive overall experience with the system, highlighting its consistency in design and the absence of any difficulties during use. However, he offered constructive criticism regarding the student list interface, finding it a bit confusing and suggesting a different organization where students are designated first before selecting the subject. Additionally, he pointed out that the font sizes appeared too large, contributing to a cluttered interface and the perception of excessive information on the same page. Despite these critiques, he expressed confidence that the system would simplify his tasks, saving valuable time by eliminating traditional, time-consuming methods. He also noted the seamless integration of the system into his daily routine. An aspect he appreciated was the similarity in interfaces for various tasks, emphasizing the system's user-friendly nature with a gentle learning curve.

For student: 

The student found most tasks on the system to be straightforward but suggested that integrating the extra exercises directly within the app would be more convenient than accessing a separate website. He highlighted the ease with which he could check notifications as they appear, emphasizing the app's convenience for managing his student life without relying on other social media platforms for teacher communication. Furthermore, he mentioned the potential for the school's management team to monitor the app, fostering increased teacher responsibility. While considering the user interface as straightforward, he recommended placing the back button (referring to the home button) on the left side of the screen. Additionally, he noted that notifications disappear once viewed and proposed the idea of a separate tab for accessing previous notifications.

For parent:

The parent found most aspects of the system easy to navigate, but he encountered a challenge when clicking on the link to view his child's score, as it redirected him outside the prototype to another website for result details. Despite this issue, he expressed that the app would be highly convenient for his life as a parent, allowing him to easily check on his child's progress within a few minutes amid a busy schedule. He appreciated the clear interface with distinct displays of notifications and subjects, emphasizing its user-friendly design. He commended the well-thought-out user interface, particularly acknowledging the helpful icons on the tabs for easier recognition. Lastly, he suggested potential improvements in the color scheme, finding the use of blue on top of blue a bit odd, but overall reassured that the system is very good.

Percentage of task completion: 100%

Findings – by Radowan, Tuhin, Sami, Mouaz & Taimon