We are going to evaluate user experience using an eye tracking device. For the purposes of this assignment we have need to choose a product that we can evaluate and tasks to follow. We have chosen www.eesti.ee – Estonia’s e-Government portal. The public and government services for citizens, officials and entrepreneurs are available through eesti.ee. Over 200 services are available online on one website. From applying for study allowance to booking permits to public events and from ordering your health card to search for company names – its ALL done online! Its a fantastic model of egovernance that represents an advanced civilization. We are using a combination of Emotiv EEG gear with a software called Neulog to evaluate the biometrics of the user.
We have chosen two tasks for the tester to complete the following tasks:
Task 1: Find the service page that allows you to check for checking or registering a company name in Estonia.
Task 2: Perform the actual search for company name of your choice.
Observation and Findings
The user searches for “company name” in the search bar and is lead to company name search page.
Between 1.20 to 1.40 there was a spike. This was because the search form for company names was not available in English.
The user tries to input a company name in one of the fields and it works.
We are going to evaluate user experience using an eye tracking device. For the purposes of this assignment we have need to choose a product that we can evaluate and tasks to follow. We have chosen www.eesti.ee – Estonia’s e-Government portal. The public and government services for citizens, officials and entrepreneurs are available through eesti.ee. Over 200 services are available online on one website. From applying for study allowance to booking permits to public events and from ordering your health card to search for company names – its ALL done online! Its a fantastic model of egovernance that represents a super civilization
We have chosen two tasks for the tester to complete the following tasks:
1. Find information on the study based allowance (and apply for it).
Reading Assignment 2: Evaluating the User Experience
I wanted to evaluate the user experience of single web based service on different platforms. In this instance, I wanted evaluate Video Chat facility provider – Skype. Skype services are present on multiple platforms like iOS, Android, Windows Mobile, Mac OS, Windows OS for PC and so on. I wanted to use a single method by which user experience can be evaluated across all of these platforms. Although are a many methods that can evaluate user experience across different platform, I wanted a qualitative analysis where by people can discuss the experiences freely in a non serious format. For the above mentioned reasons, I chose to read 3E – Expressing Experiences and Emotions UX evaluation method by Marika Tähti (Medici Data oy , Finland) and Marketta Niemelä (VTT Technical Research Centre, Finland)
3E is a projective method combining verbal and non-verbal user feedback of feelings and experience in a usage situation.
The name of the evaluation method that I am studying (and applying) is called 3E – Expressing Emotions and Experiences. The authors of the paper, Marika Tähti and Marketta Niemelä, introduce us to this method of evaluation by emphasizing on the importance of applications and being more emotionally appealing to move towards a future of Ambient Intelligence. They mention how technology of the future will silent and how its important for technology to not be “socially clumsy”.
A new kind of interaction design, that takes the holistic nature of the human user into account, is needed.
Traditional SAM methods and Emocards for evaluating user experience aren’t very effective as they have a very limited scope. The 3E is a different kind of a self report method that uses pictorial templates of the human body for expressing emotions and experience, and users can even draw expressions on the face or fill out their thoughts on a comic speech bubble. This enables them to not select from a pre-list of emotions, but in-fact add their subjective inputs thereby allowing users to express themselves by drawing and writing.
What’s noteworthy about this method is that it can be used for first time usage, an episode or usage over a period of time. However, this method can be time consuming as it’s open and may require the users imagination to depict his/her experience. The equipment needed her is just a simple pen and paper thereby allowing many small businesses, websites, applications etc to avail and utilize this method with ease.
In my opinion, the fact that 3E can be used to evaluate cross channel user experience makes it a desirable method for UX designers to use while evaluating the experience of a product or service over many channels. For instance, traveling by plane is a a multichannel experience – from booking online to check in through smart phone, from online, telephone and web customer support to scan-able b and printable boarding passes.(Source: UXmatters). For products and services of this sort – an evaluation method like 3E is important in designing better over-all human (emotional) experiences with products/services.
The noun ‘user experience’ refers to an encounter with a system that has a beginning and an end. It refers to an overall designation of how people have experienced (verb) a period of encountering a system. This view emphasizes the outcome and memories of an experience rather than its dynamic nature. It does not specifically emphasize its individual nature because ‘a user experience’ can refer to either an individual or a group of people encountering a system together. (Nigel Bevan Professional Usability Services UK, February, 2011)
The definition of UX has rather been streamlined after the result from Dagstuhl Seminar on Demarcating User Experience in September, 2010. The article has systematically covered all notable aspects of defining the term and understanding what is User Experience? It gives as an insight from multiple points of view; from the perspective of general users, experts, students and academicians. My personal insights what is user experience as as follows:
In my opinion, which was mainly formed after reading the white paper on UX, UX is a very huge term. There are numerous different types of users having varied experiences at a particular point of time. To understand User Experience, one must think of it as a general experience faced by the user while he/she has actively or passive engaged with an environment, product or service.
In order to evaluate consistency in UX we need to understand what usability metrics are. Tom Tullis and Bill Albert, in their book called Measuring the User Experience, write “User experience, or UX as it’s often abbreviated, refers to all aspects of someone’s interaction with a product, application, or system. User experience can be qualified and quantified. Task success rates, task times, number of mouse clicks or keystrokes, self-reported ratings of frustration or delight, and even the number of visual fixations on a link on a web page are all examples of usability metrics. And these metrics can give you invaluable insight into the user experience.” (Tullis & Bill, 2008)
Evaluating user experience can help us identify broken experiences and improve the usability of products. User experience does not only focus user interfaces or usability. It’s an overall experience that a user faces and from a business perspective, having a good UX for customers is an absolute must for survival.
Content, User and Context are the the 3 fundamental things that are looked out for while designing UX. Every UX design is dependent on studying a user under a context and with the specific content. This also means that the user experience is fundamentally focused humans and not technology. As a phenomenon, UX is always measured with respect to duration of use, task time or repeated tasks over time or a one time event.
There is still much for me to learn about User Experience and more importantly explore it huge scope from multiple perspectives – as a professional, a student, a user and an academician. The best way to more forward, is by understanding how to evaluate user experience.