Equipment

The activity laboratory is designed as a so-called “smart home” where as many parameters as possible around a person's activity can be followed, with the help of different types of systems.

These systems can be passive, completely hidden from the user in the environment, or active, carried by the user. For this, a video-based system was designed to be able to capture experiments and learning situations on video, as well as be able to use this for distance learning and flexible learning.

Technical equipment

	Vayyar We have two UWB units from Vayyar, one in the bedroom and one in the living room / kitchen, which can most easily be described as an indoor radar that, like a bat, can form a spatial perception. It provides a passive position for several users and can assess whether they are lying down, sitting, standing or walking.
	Z-Wave Each electrical outlet has a unit that can control and measure electricity via Z-Wave. A central unit, the Vera Plus Controller, can then collect, present and control the information. In all doors, for example in the kitchen cupboard doors, there are also binary units that detect whether these are open or closed. In addition to this, there are sensors for motion (IR), temperature, light, etc.
	WideFind This UWB-based system can position units with about 10 cm accuracy, which can be worn by a user or attached to or integrated into objects.
	NUC The ceiling contains three small computers, so-called Network Utility Computers (NUC), for collecting and processing data. Two are used for the Vayyar devices and one is used for WideFind and Z-Wave.
	Shimmer These sensors are worn by a user and can with high precision measure muscle movement (EMG), heart function (ECG), breathing (respiration), movement (3-axis accelerometers), stress (GSR), etc.
	Tobii Pro Glasses 2 These glasses are designed to be able to capture what a user normally sees, through advanced eye-tracking.
	Somnofy This UWB unit encounters passive presence, movement, respiration, heart rate, snoring and sleep cycles. We have two units, one for the bed and one for an armchair in the living room.
	Kardian Kardian UWB units, like those from Vayyar and Somnofy, can detect presence and movement as well as falls, objects, respiration, apnea, etc.
	B-Alert X10 This is a 10-channel system for measuring brain function (EEG), for example for measuring stress and cognitive abilities. Unfortunately, we have not yet had time to try this particular technology in the activity laboratory.
	Oura Ring This ring can actively measure activity and sleep.
	Double Robotics This is a small robot that is controlled via an iPad and mainly works to communicate with sound and image with a user in the activity laboratory.
	MindSpace This video system captures moving images from different positions in the activity laboratory, through mainly two types of cameras. Each room has a high-resolution motion camera that can be remotely controlled, which is complemented by most fixed cameras. Additional sources, such as an image from the Tobii glasses or a map image from a PC, can also be used. An image mixer can then select the source or mix them together into a matrix image (2x2, 3x3, 4x4). The ceiling also has microphones and speakers. The video information can then be stored, such as documentation during experiments, or sent directly online for learning situations. For this, there is a transmission system from Cattura, which can be used with LTU's tools for teaching (Canvas).
	iMotions This system can collect, visualize and analyze data from various sensors that measure parameters such as EEG, ECG, EMG and GSR as well as eye-tracking.

System

Taken together, all of these technical devices provide a large amount of data that should be integrated into a data analysis and control system.

The control room therefore has two computers, one of which is used for the software from iMotions and the other is used for SensorCentral +, a database from Ulster University through the Remind project. We also have a dialogue with several companies about collaboration with commercial and academic platforms such as Tieto eSense SmartCare, SkyResponse, FIWARE, ArrowHead, etc.