Recent advances in sensors have mad

Recent advances in sensors have made it possible to collect hyperspectral sequences at video rates. In our study, we used a snapshot mosaic hyperspectral camera 2 to collect video. The camera can get up to 180 hyperspectral cubes of video per second, each containing 512 × 256 pixels and 16 bands with wavelengths from 470nm to 620nm. In our data collection, we capture video at the rate of 25 frames per second, one of which is a three-dimensional hyperspectral cube, two-dimensional index spatial position and three-dimensional index spectral band. In order to make a fair comparison with the color based tracking method, RGB video is also obtained at the same frame rate as hyperspectral video at a very close viewing angle. The preprocessing steps include spectral calibration, image registration and color conversion. Their details are described in the appendix.