Design an Interactive Kiosk
Design an Interactive Kiosk
Stocklist is a shopping kiosk that could develop a service to help people sell their unwanted electronic possessions or buying cheap second-hand electronic devices by using this new type of interactive kiosk.
Stocklist is a shopping kiosk that could develop a service to help people sell their unwanted electronic possessions or buying cheap second-hand electronic devices by using this new type of interactive kiosk.
JUN, 12, 2019
JUN, 12, 2019
Acerca de
Cooka
Cooka is a gesture controlled recipe app which make cooking progress more convenient and safer.
Yiran Jiang
Nov 20th , 2020~Dec 17th , 2020
Intro
When people are cooking, they often can not touch or tap the phone screen smoothly because they have water in their hands. In this project, I will design gestural control app that enable users to interact with their phones in the previous situation. Cooka is a recipe app that could be controlled by simple gestures. In order to help users navigate Cooka without extra effort, it includes a gestural language that is learnable.
Problem Finding
In life, most people who have experienced cooking must have encountered these problems: over cook the food while checking recipe, a cut from knife which comes from into his a little distraction, or the hands are soaked in water and sauce and there is no way to tap the screen to answer the phone smoothly. In these cases, the need to interact with screen will increase the occurrence of these accidents.
Cooking Injures
SECONDARY RESEARCH
Not to be the bearer of bad news, but your kitchen is a landmine of disaster. Two thirds of home fires start in the kitchen, 480 people die a year in kitchen fires, and 350,000 people are injured by kitchen knives each year. The most common injuries are burns, fires and lacerations.
PRIMARY INTERVIEWS
Alana
36yrs
Cook everyday
Use recipe app twice a week
I rarely if ever cut myself, but burns can be somewhat frequent. Just a few weeks ago I had placed a skillet in the oven to broil something to finish it off then grabbed it out forgetting an oven mitt.
Because the words on the screen are so small, it takes a long time for me to see them clearly. Because of this, I always overcook my dishes.
What I particularly hate is that many recipe software need to constantly turn pages to see the whole process. But it is very difficult when I am in the process of cutting vegetables.
Cathy
20yrs
Cook 3-4 times a week
Use recipe app twice a week
I can’t believe that there is no clock function in most of the recipe app.
Anqu
76yrs
Cook everyday
Use recipe app everyday
LiLi
40yrs
Cook everyday
Use recipe app 3-4 times a week
How Might We
make the recipe app be smoothly integrated into the cooking process without causing any burden？
Features
Advanced Interaction Method
From a simple 2-dimensional plane to an interactive way that uses more sense like gestures and voice.
Friendly Hints
​When dangers may occur, such as cutting or baking, it gives kind and real-time reminders to users.
Whole Process Tracking
All the steps of the cooking process and electronically achievable tools will be included in this app​.
Gestures Design
In order to design a app based on the gesture interaction, I did Gestures Design Research to know more about the connection between micro-expressions and emotion. Also, I need to design the most suitable for user, people in real. First I sketched out 2 possible solutions for 6 functions which are included in the app. After that, I ask people test both of them and choose the best one.
Test Video Link
https://ccarts.hosted.panopto.com/Panopto/Pages/Viewer.aspx?id=0ef57777-ce3e-4bd7-970b-ac7c00dc199a
I want to use a gesture with a strong connection for cooking to enhance the connection between the user and Cooka. I combine A and B together to make the whole motion be more clear
Sliding right represent with user finish one task and ready to move to another task. It’s simple to do as one of the most familiar gesture languages in the world.
Showing one full hand is what people usually do to represent stop. Also, adding a icon could could help explain the function.
For set up a timer, having a timer in the back could help show the idea and show an effective feedback for users.
Clap hands could be different from the stop gesture. Also using the echo feedback could help explain this simple gesture better. Visually icon could make it looks more concise and clean since it has multiple stages.
To represent the meaning of achievement, the gesture could be sum up or check mark. In the test results, check mark is easier to do for testers.
User
Flow
Interfaces
Start & Finish
The beginning and the end are often the most excited moments. Cooka can be triggered through two special gestures at the beginning and the end.
During Cooking
In the middle stage of the cooking progress, there are more gestures control opportunities like start/stop the video, set up timer, ect.
Reflection
CHALLENGE
How to find the simplest and clearest way without using a lot of words？
Do more tests to find the gestures that are most suitable for the user for each function, so that they can immediately reflect the corresponding function when they see the relevant animation representing the gesture.
How to make user testing effective enough to make them feel like their gestures has been recognized ?
One of the biggest problems I encountered in this project is I can't easily do user testing as before because of technical limitations. The prototype-creating software I use currently only supports the "clicks" interaction. But in this project I used gesture recognition as my interaction method and it is not possible to be prototyped by current software.
​
This problem really triggered me, because in real life, a lot of design ideas can not be achieved because of the technical limitations. So how should designers deal with this situation in these circumstances? If what our design ideas all end up as a conceptual project, we will lose the practical significance of design in the real world. At this stage, this question is still unresolved, and I hope that as my interaction experience accumulates, I could find the answer.
I LEARN...
-
I learned how to translate gesture languages which is in 3D into 2D screen.
-
I learned the skills of using interactive elements which is filming with real people to make videos make more sense for viewer to help show my ideas.
​
-
I learned the relationship between the cause and effect. I understood how feedback play an important role in interactive system and tried to implement it in my work.
FURTHER DEVELOPMENT
-
If I had more time, I want to further improve the functions of the whole app in the whole stages，not just onboarding stage.
​
-
Because artificial intelligence recognition technology is still in the process of development, real-life artificial intelligence recognition rate is not able to reach 100%. So what if the machine recognizes the wrong gesture, or if the user made the wrong gesture in the process? I need to consider these situations to perfect Cooka to make it capable to undo or go back.