Edinburgh office monitoring video dataset

This web page contains video data and ground truth for 20 days of monitoring a person in their office. Twelve days are from one office, with 2 or 3 additional days each in 3 other offices. All people observed in the videos gave their consent to be recorded. This data was recorded Feb 18 - April 29, 2016 in offices in the School of Informatics at The University of Edinburgh.This dataset is low frame rate video of people doing their normal activities in an office setting. The data is acquired using a fixed camera as a set of 1280*720 pixel color images captured at an average of about 1 FPS. Typical frames from two offices are shown here, and two typical frames with no people. Mainly the images show one person working, or an empty office. However, occasionally there are several other people in the office for a meeting.This dataset is interesting because there are about 450K labeled frames of people doing standard office activities. This allows analysis of normal activities, and thus monitoring for interesting events, such as a person falling down, or being in a position without moving for a long period time (e.g. unconscious). Other interesting aspects of the dataset are:Four different participants in 4 different settings Most frames have either 0 people, or a single person in largely the same position all the time, with a maximum of 3 people in a frame. The video is taken over a significant period of time, so the lighting can change considerably, and there are times when the external lighting entering the scene is quite strong. There is colored lighting of varying hues contributing to the lighting in the first 12 days. We attempted to mark the position of each person in each image with a bounding box and a behavior. Given the number of images, not all marks are guarenteed to be correct. If errors are found, please let us know: (day,frame,person,bounding box upper left position, bounding box height, width, behavior). Thanks.The groundtruth for each individual day video is saved in a mat file with the name of that day. The ground truth file dayN.mat contains a structure 'labels' (N=01...20). NumFrames = length(labels) gives the number of frames recorded for day N. The order of the bounding boxes is the same as the order of the image frames. 'labels{x}' is a 3x5 matrix for video frame x. There is one row for each person in the room (at maximum, there are three people present in a room). In each row in the 3x5 matrix, the first four values contain information about a bounding box around the person while the 5th value contains the behavior label. The first two values in a row are the column and row coordinates of the pixel at the top left of a bounding box around the person. The 3rd and 4th values in a row contain the width and height of the bounding box. If there is no person (or second/third person) present, then all values on that row are 0.