September 13, 2016October 30, 2016 by Creative Digital Ideas

User Experience Research: Evaluation

Usability Evaluation assesses the extent to which an interactive system is easy and pleasant to use.

It is generally defined as:

Formative evaluation: when conducted early on in the design process with low fidelity prototypes – this evaluation required the designer to collect the data (e.g. time to complete the task, clicks, etc…).
Summative evaluation: when conducted with high fidelity prototypes or a near final interface – this evaluation might produce data on how the user interacted with the system (e.g. log data)

The type of prototype affects the environment where the testing takes place:

Low fidelity prototypes require testing in a controlled environment (e.g. a lab)
High Fidelity prototype can be tested in the wild (e.g. the user’s phone or a kiosk)

A thorough evaluation requires that we consider if the design is usable. This means that we measure to what degree the goals of the task are met. This can be accomplished by collecting quantitative data in the form of questionnaires, or log data of the path the user traversed while completing the task. Or it can be qualitative data in the form of user interviews.

We will be able to ascertain if the design is efficient by evaluating various task completion measures. These include time to completion of the task, number of clicks, or number of errors while performing a task.

Notice that we can infer learnability and memorability by using some of the same measures I just mentioned.

Learnability refers to how easy it is to complete a task successfully. We can get an objective measure of this by looking at the data for number of clicks to complete a task, or amount of time to complete a task, and then compare these to expert performance.

Memorability refers to how easy it is to remember how to use a product, or more specifically, how to perform a given task on an interface after repeated trials.

We can measure amount of time or number of clicks to complete a task over repeated trials to get a measure of memorability.

We also need to have indicators of the subjective user satisfaction while executing the task.

These can be both cognitive or emotional aspects of the task completion. We are going to refer to cognitive measures as those that relate to the mental effort it required to complete the task. For example, were the steps required to complete the task intuitive?

For the emotional component, we want to have a sense of the feelings that the user experienced as she completed the task. These two might be correlated. It might be that a task that was unintuitive will lead to the user feeling frustrated.

Here’s a sample of the kind of data matrix you might collect after a usability session. This is not exhaustive. It’s just an example.

It’s important to remember that the usability measures we just discussed must be considered in relation to either the values rate using the status quo interface, right, the current practices of the user.

Or if were designing a completely new interaction, we can compare the user’s values to some other objective measures of success. For example, the values that are obtained when the design team, you might consider these people experts, use a novel design.

Advance evaluation techniques are:

Heuristic Evaluation
Cognitive walk trough

Once the evaluation data is collected and analyzed, the designer is in a position to iterate on the design. This may lead to another round of alternative designs. It might lead to prototype building and more evaluation. When do you stop? Well, one rule of thumb is that you stop when you have met your design objectives. And this translates to an evaluation cycle that shows that the user can interact with your design in an effortless and enjoyable manner.

To learn more, check on:

Usability Evaluation 101 by Usability.Gov

Interaction Design – Chapter 15 – Usability Evaluation.

WQUsability – More than Easy to use.

Measuring Usability: Are Effectiveness, Efficiency, and Satisfaction Really Correlated? by CHI 2000.

Usability 101 – Introduction to Usability – by Nielsen Norman Group

September 9, 2016September 9, 2016 by Creative Digital Ideas

How to generate product ideas: a practical example

Opportunity Statement

“Teenagers who like to sleep in late need an easy way to eat breakfast on the go because they don’t have time to eat breakfast before leaving their home and yet breakfast is the most important meal of the day.”

First list as many ideas cross your mind

Listing ideas

Healthy smoothie hold the backpack/car/scooter/etc… drinking holder.
Breakfast bars that attached to the phone arm holder.
Frozen nutty fruits licorice sticks to be consumed on the go.
Yogurt easily resealable with a stick attached.
Granola in a top zip bag easy mixer.

Then, remove any physical constraint limiting the flow of ideas.

Eliminating a constraint

The teens consume breakfast by themselves at home.

Mini muffin sandwiches in a top zip bag for easy sharing.
Mini sharer plate for bus/car consumption (with friends).
Music food-box container with the latest hits for impromptu parties.
Friends-sharing application for a healthy lifestyle (exercise counts, calories counts, track of eating habit).
VR Breakfast Go app.

Then, make an association with any event related to the target audience.

Make an analogy

If eating breakfast on the go was like having a fun party.

Bright colorful breakfast food and drinks.
Carillon type food boxes.
Friends having breakfast together at each home on rotation.
Friends bringing breakfast food to share.
Theme breakfast parties on the go.

Then, go for the maximum.

Exaggerate

Teenagers need to eat 10 apples every morning for breakfast to be healthy

Large apple juice made of 10 apples.
An apple pie to be eaten daily.
10 apple/peanut butters sandwiches.
A 10 apples waist holder for an easy eat on a go.
A waist that includes holders for: a. A medium juice cup; B. An apple/peanut butter sandwich; C. an apple pie slice.

Is the writer block still impacting your flow of ideas? Then list those you will never recommend.

Get in the garbage

Breakfast electronic dispenser in the teen’s room.
Breakfast’s substitute energy pills.
Gwyneth Paltrow style daily £400 energy smooth.
Music cup that activates on drinking.
Kick-off bed to ensure the teen is not late.

Finally, select the best idea based on well determined criteria.

Most useful idea

Healthy smoothie hold the backpack/car/scooter/etc… drinking holder – it uses existing gadgets, no risk for spilling the content, easy to prepare, fast to consume, full of healthy benefits.

Most Desirable idea

VR Breakfast GO app – apart from encouraging kids having breakfast by sharing their experience online with friends, it could promote a healthier lifestyle by imitation – e.g. advocating walking to school, additional activities, healthy breakfast/lunch/dinner/…

Easiest Idea

The mini sharer plate for easy consumption with friends – almost every household has a sharer plate, alternately buying one is not expensive. Sharing breakfast with friends should improve the overall experience.

Most functional

Breakfast bars that attached to the phone arm holder – because it uses the unexplored and hidden functionality of an existing gadget.

Most Sustainable idea

Frozen nutty fruits licorice sticks to be consumed on the go – no waste produced, all are eatable pieces.

September 8, 2016March 12, 2017 by Creative Digital Ideas

Other prototyping techniques

Other prototyping techniques that do not fit into the definition of High or Low fidelity categories are:

Wizard of Oz technique: Used to model/mimic functionality of a product by having a human perform the task usually performed by the computer. The user is unaware that the product is not functional. Usually the “wizard” sits in a back room, observes the user’s actions, and simulates the system’s responses in real-time. For input device testing the “wizard” will typically watch live video feeds from cameras trained on the participant’s hand(s), and simulate the effects of the observed manipulations. Often users are unaware (until after the experiment) that the system was not real.

Advantages:

Saves time and money when compared to building a functional system.

Disadvantages:

Setting the stage time.
Required multiple well trained people
The user might then have unrealistic expectations.

http://www.usabilitynet.org/tools/wizard.htm

Proof of Concept Video Technique: fictional video that shows a “working system” in a variety of scenarios.

Metaphor Technique: is meant to help the user build a relevant mental model of how a new design functions. The metaphor communicates the functionality of the novel design compared to systems that the user already knows and is familiar with.

September 8, 2016 by Creative Digital Ideas

Low Fidelity Prototypes notes

Low Fidelity Prototypes include:

Sketching;
Storyboard;
Card-Based.

Sketching – is a free-hand depiction of images related to the final design.

sketching

Storyboards – are common way to provide a narrative putting the design into context. It provides an opportunity to see how the user will engage with a given scenario. The below storyboard is from RuoCheng.me.

storyboarding_ruocheng

Card-Based prototype – allows us to see at the sequence of iterations the user might have with the designed interface.

ukbcgphff-cvyivijmnuka_m

Resources:

Usability.com/Prototyping – includes an excellent graph by Tracy Lepore visually showing the evolution from sketch to design.

Lo-Fi vs. Hi-Fi Prototyping: how real does the real thing have to be? by Florian N. Egger on telenovo.com.

High-Fidelity vs. Low-Fidelity prototyping in Web Design and App Development – by Kim Doleatto on http://www.atlargeinc.com/

Tools:

UX Recorder – Good for mobile user testing on iOS

Invision – Free design prototyping tool

Marvel App – Free version – prototyping tool for all type of devices.

Azure – the most used software.

September 7, 2016October 30, 2016 by Creative Digital Ideas

Blockchain and IoT: cool resources

A blockchain is a data structure that makes it possible to create a digital ledger of transactions and share it among a distributed network of computers. It uses cryptography to allow each participant on the network to manipulate the ledger in a secure way without the need for a central authority (source: Steven Norton – WJS blog) .

Here a list a cool resources:

IBM Blockchain Garage: IBM Blockchain has joined the Hyperledger Project to evolve and improve upon earlier forms of blockchain. Instead of having a blockchain that is reliant on the exchange of cryptocurrencies with anonymous users on a public network (e.g. Bitcoin), a blockchain for business provides a permissioned network, with known identities, without the need for cryptocurrencies.
SkuChain: technology based on the ‘Collaborative Commerce’ vision where trade partners can interact in a friction free manner , gain deep visibility into their supply chain so they can make smart forecasting decisions, and not be constrained by cash flow helping them compete. Skuchain applies the cryptographic principles developed in the Bitcoin network to security and visibility for the global supply chain. As goods travel from manufacturers to distributors to consumers, the crucial electronic information of what the item is and where it came from becomes disconnected from the SKU itself. A blockchain offers a universal, secure ledger by which SKUs can attest to digitally to their orgins and attributes. Skuchain is building a system of next generation identifiers in the form of both barcodes and RFID tags to digitally secure the transfer of goods across the entire global economy. While most anti counterfeiting systems rely on copy restistant labels, holograms etc., skuchain relies on the uncopyable nature of a blockchain ledger to solve the problem of supply chain integrity Skuchain’s system will provide cryptographic proof of each SKU’s origin, supply chain than can be verified all the way to the point of consumption.
Z/Yen: Z/Yen is the City of London’s leading commercial think-tank. Z/Yen was founded in 1994 to promote societal advance through better finance and technology. In 2015 Z/Yen launched Distributed Futures, a senior forum dedicated to technology and disruption, for subjects such as mutual distributed ledgers (aka blockchain technology) and artificial intelligence. Current project: MetroGnomo – an open-source experimental timestamping service based on Z/Yen’s ChainZy mutual distributed ledger technology. MetroGnomo’s replicated authoritative immutable ledger provides proof that a given piece of information existed, or event happened, at a given time. The provision of impartial timing information and unique identifiers enables improved coordination, cooperation, integration and dispute resolution between and within firms. More information…
Gemalto: is an international digital security company providing software applications, secure personal devices such as smart cardsand tokens, and managed services. It is the world’s largest manufacturer of SIM cards.