Knowledge Base

Step 1: Requirements

To get to a good start, a detailed description will help you choose the equipment you need in your lab, and which physical environment would best suit this observational research. In general, the description should answer the following questions:

Participants

• How many participants need to be recorded at the same time?
• What kind of participants are observed (age, gender, etc.)?
• Do consumer goods, products, food items need to be tested? Do participants need to walk around in the lab?
• Are children involved in the observation? Children require different camera positions than adults to have good view of their faces, posture, and expressions.

Equipment

• Is audio and video of all participants needed?
• Does the observation involve working at a computer? If so, should the computer screen of the participant(s) be captured and recorded?
• Are specific devices present, such as mobile phones, tablets? If so, should the screens be recorded?

Location

• Are participants being invited to visit the lab? Is on-site research going to be performed? Or both?
• Should there be a separate room for participants to wait before an observation?
• How many observations are expected to be performed and are observations carried out simultaneously (in different rooms)?
• How many rooms are required? A one room lab can be used for one focus group, but if you have more groups coming in, a two-room observation lab with two one-way mirrors is more convenient. Depending on your research, it could even be advisable to have more rooms available. Multiple rooms can be managed from a single control room with the software tool Viso.

Technical Specifications

• What quality of video is needed? Most observation labs use hard discs or NAS (Network Attached Storage, also for backup) in combination with MPEG4 media files. Recording in HD guarantees excellent video quality, with videos stored in a compatible format.
• How many video streams need to be recorded simultaneously? Many Consumer Experience Labs use multiple video streams that are recorded in sync, and there are labs that use one video stream that consists of a mixed image.
• How is security of video material guaranteed? Storing the videos on an external hard drive is insecure (possibility of theft). Storing the videos on a server is more secure. Special attention should also be paid to protecting the video material.
• Are there other data modalities which need to be included in the test, such as measuring heart rate or galvanic skin conductance?

Housing of a Consumer Experience Lab - Tips

• Where and in which room(s) should the lab be built? How big are the rooms? Does the building have special aspects (i.e. is it a monument)? You can also build a lab in an existing restaurant or cafeteria, making it into a "living lab".
• Is air circulation guaranteed? It can become rather hot in the control room due to computers and more than one observer. Ideally both rooms can be controlled (heat/cold) independently.
• Ensure that there are no unwanted noises in the rooms. For example, the noise of an air vent can disturb the observation.
• Take into account that the rooms should be soundproof or near to soundproof. Insulated walls are essential. A normal conversation can generate 40 to 70 dB and the test participant should not be disturbed during the observation. Think also about the negative effect incidental laughter and conversations of observers, or test leader, can have on an observation.
• The minimal dimensions of a one-way mirror are approximately 2 by 0.8 meters. From experience, three mirrors (2 meters each) are much cheaper than one mirror of 6 meters.
• A one-way mirror only works when the light intensity in the control room is lower than in the observation room. This light intensity can easily be adjusted by actively controlling (dimming) the lights in the control room.
• Light intensity in the control and observation room is approximately 1500 Lux (lower by dimming it).
• It can be practical to add a warning sign outside the test facilities when an observation is in progress. This ensures that unexpected visitors will not disturb any observations.
• Video and audio cables have to connect the control room with the observation room. The cables can be hidden in a double ceiling or floor, or by using cable gutters.
• The observation lab should have a constant source of electricity (220V, 50 Hz or 120V, 60Hz). The lab can be protected against extreme power and voltage fluctuations by using one or more UPS devices (Uninterrupted Power Supplies).
• Cater to the needs of both testers and participants by providing enough drinks and/or food.
• A rest room close to the observation and control room can prove to be very handy.
• In a living lab set up (restaurant), make sure the counters and/or tables can be easily moved about in order to better facilitate different set-ups.

Step 2: Equipment

A Consumer Experience Lab is designed to allow you to observe consumer actions unobtrusively, in an environment similar to their natural surroundings. Equipment varies from cabinets, one-way mirrors, test counters, and tables, to fully integrated high-tech recording devices, data acquisition systems, and computers.

Equipment Used in the Observation Room

A wide range of equipment is available. Depending on your research needs, you can choose between the following components:

• IP camera (integrated pan/tilt/zoom) - IP cameras may be installed in the ceiling. However, it may be more practical to connect them to a vertical rail, to enable height adjustment. Especially if you work with a combination of adults and children, make sure the height of the cameras is adjustable. This way the faces, expressions, and body language of all test participants can be recorded well.
• Small IP cameras on tripods - Can be positioned anywhere needed.
• Mini camera mounted on a device (Mobile Device Camera) - An ideal option for testing mobile phones, tablets, or other small devices.
• Webcam - To record facial expressions.
• Microphone - The exact number depends on the number of participants per observation. There are several unique devices that can be used in the observation room.
• Speakers - The test leader can easily give instructions, ask questions, or provide assistance when participants don't know how to proceed. Keep in mind that sometimes an earpiece may be a better choice than a ceiling speaker system. For example, with multiple consumers in one room, you can choose who to talk to.
• Telephone - For example for calling the front desk to let new participants in.
• Participants' PC - If participants need to work at a computer (with monitor, keyboard, mouse, printer, internet connection, etc.).
• Eye tracker - For tracking the eye movement of the participant. A large choice of different brands can be integrated in the total solution.
• Data acquisition systems - To measure heart rate, skin resistance, skin temperature, muscle tension, or neuronal activity.
• Splitters/mixers/amplifiers - For splitting, mixing, and amplification of signals.

Equipment Used in the Control Room

A wide range of equipment is available. Depending on your research needs, you can choose between the following software components:

• Multi-room audio and video recording - Viso records from multiple cameras and rooms simultaneously. Provided all rooms are housed on the same local network, recordings can occur across multiple buildings at once.
• Event logging and video analysis software - The Observer XT. This software is the ideal integration platform. It allows you to synchronize videos, audio, physiological data, and more.
• Media Recorder - Record with up to 8 filming devices (analog or digital cameras or screen capture devices).
• Facial expression analysis software - FaceReader. This software automatically analyzes facial expressions and gives you insight into affective states: boredom, interest, and confusion. It saves valuable time when analyzing videos for emotional responses.
• Screen Captures - Capture and record the screen the participant is looking at and combine this on the test leader computer to have both the participant and their screen for analysis.
• Joystick controller - To control the video cameras from the control room.
• Optional: Network Attached Storage - 4TB for storage of 1000 hours of video material and backup. Storage space can be increased.

The following hardware can be chosen from:

• PC - For event logging and analysis of an observation, or to produce reports. Depending on media type, the following equipment may be integrated: MPEG encoder, decoder, audio board, and large hard disc.
• Monitor - To view camera images. The number and size of monitors depends on the number of people in the observer/control room.
• Screen splitter and multiple other monitors - Necessary when a larger number of people have to see the actual PC screen of the participant live on a monitor.
• Microphone - For the test leader.
• Large monitor or projector - For debriefing and discussing results. Live images can also be shown on this monitor for a larger group without having them enter the observation room.
• Microphone amplifier - For signal of participants and test leader.
• Speakers or headphones - For hearing the participant(s).
• 19" Rack with glass door - For mounting of the equipment.
• Internet connection - For website evaluations and remote observation of tests, or to control the test PC remotely.

Other parts that are necessary in the lab include closets/cabinets for storage, a refrigerator in an adjacent room for refreshments, chairs, and tables for putting the monitors on. These tables can range from simple straightforward tables to custom prepared PC or monitor tables.

Step 3: Installation and Start

To achieve the best result, the lab should be installed and tested by a qualified engineer. Depending on the complexity of the lab, this installation could take several days.

Before installing the lab at your location, it can be fully integrated and tested at a headquarters facility by professionals. Training in the lab from a professional trainer on how to use the software and hardware is a very valuable step. You will quickly learn how to get the most out of your lab. A training course usually takes one or two days and is totally adjustable.

Support and Service

Ongoing service and support ensures continuous use of the lab. This includes technical support, updates and upgrades of the software, full professional support via phone and email, and onsite maintenance visits. Hardware replacements can also be delivered onsite to minimize downtime due to unexpected equipment failure.

• Technical support - Expert support staff can respond to questions within 24 hours.
• Software updates and upgrades - Updates, upgrades, and new releases include new features and functionality based on input from a worldwide customer base. Update meetings allow you to discuss new features with a consultant.
• Extended hardware warranty - When hardware breaks down due to defective materials or workmanship, it will be repaired or replaced. Note that for some third-party hardware, other rules may apply.

Step 4: Performing Observations

All observations have in common that one or more consumers are observed, and that important events are coded in professional research software. For some target groups, for example elderly people living in a nursing home, transfer to a stationary lab can be stressful or even impossible. In such a case, a portable observation lab is needed. Behavioral observations systematically uncover behavioral patterns that can be turned into actionable results.

Roles in a Consumer Experience Test

Five roles can be distinguished:

• Test leader - The person managing the observation, creating the study design, communicating with the participants, carrying out the analysis, and writing the report.
• Researcher - The person looking for insights during and after the observations. The roles of test leader and researcher can be held by the same person.
• Lab technician - The person responsible for installing hardware and software, and for maintenance.
• Participant - The consumers in the lab. Note that a participant could also be a pet animal for testing pet food, which may result in additional requirements such as laminate flooring that is easy to clean.
• Client - The person asking for the consumer behavior test. This can be an internal client.

Preparation

The consumer scientist, test leader, or researcher creates the study design. In the coding scheme, the researcher can describe the behaviors that will fill the behavior map. This coding scheme allows for a systematic analysis of behaviors that take place during the observation. The test leader books the observation facilities.

A typical observation can last from less than an hour to several hours. It is possible that the same group is observed several times, for example to determine food preference change over time in older adults.

The Experience

Usually, the researcher creates an experience describing what the participants have to do during the observation, such as bringing specific products together in a test kitchen area and using them to create an end product.

After creating a task list, the researcher determines what has to be coded during the observation and in what detail. A pilot experiment is carried out to determine whether the coding scheme is correct and whether the analysis gives the data the researcher needs to turn behavioral data into actionable results.

Inviting Consumers

Either the client or the test leader recruits the participants. The participant group should form a representative sample from the intended community, with the number of consumers per test varying from 2 to 20.

---

Download the original PDF: How to Build a Consumer Experience Lab (PDF)