Welcome to the PRISM data sets server

This site contains data sets recorded by the CSIR's Optronic Sensor Systems group for image processing research. The data is made available under the PRISM part of the Armscor LEDGER project.

Previews (reduced frame rate and dimensions as well as highly compressed) of the currently available videos are available here.

Uncompressed videos with metadata can be found in the data folder. To obtain a username and password for access, please send an email to zhattingh at the csir co za part of the web site address.

The fiducial marker calibration and verification datasets can be found here.

Tracking Research

The following videos are mainly aimed at tracking research, but can also be used for detection or image stabilisation research. The data was recorded using a Prosilica GC1380 camera with a Nikon AF-S Nikkor 300mm f/4D IF-ED lens mounted on a pan-tilt unit.

Thumbnail	Raw File	Description
	2010-10-05_14h44m32s_tracker_01	Jet ski rotating and moving away.
	2010-10-07_10h40m52s_tracker_01	Low contrast trawler passing behind light house.
	2010-10-14_11h05m36s_tracker_01	Small craft moving close to the shore.
	2010-10-14_11h20m56s_tracker_01	Rigid-hulled inflatable boat (RHIB) moving through birds.
	2010-10-14_11h26m52s_tracker_01	Rigid-hulled inflatable boat (RHIB) passing behind rock.

Detection and Tracking Research (Stationary Camera)

The following videos can be used to develop vision algorithms for background modeling, segmentation and target detection and tracking. The file names generally reflect a particular type of event in the video. The videos have been compressed using the FFmpeg lossless codec.

Thumbnail	Raw File	Description
	bird_intersection_with_boat [496MB]	Two slow moving targets on the ocean. A seagull flies across the targets at some point in the video.
	intersection_birds_nama [268MB]	Single target with a panning camera. A large flock of birds is seen flying across the target.
	intersection_nama_and_small_boat [427MB]	Two slow moving targets on the ocean with intersecting paths.
	intersection_nama_sail [201MB]	Contains a boat and a sailboat with intersecting paths in the video.
	jetski_fig_8_low [1200MB]	Jetski doing a zig-zag motion across the camera field of view.
	jetski_stealth_zaggy_attack [745MB]	Fast moving jetski moving in a stealthy zig-zag fashion.
	namacura_25knots [410MB]	Boat moving across the camera field of view.
	nama_intersection_glint [384MB]	Two boats (silhouettes) with intersecting paths. The ocean contains large amounts of glint.
	nama_intersection_large_boat [254MB]	Two boats (a small boat and a frigate) with intersecting paths.
	nama_jetski_intersection [114MB]	A boat and a jetski with intersecting paths. These 2 targets are very small.
	nama_low_and_large_boat_intersection [363MB]	A boat and a frigate on the ocean. The boat is extremely small.
	nama_intersection [404MB]	Two small boats are shown on the ocean. Their paths intersect right at the start of the video but it is a very short event. There is another intersection later on.
	nama_rhib [496MB]	Two targets are shown in the video. There is a very small target far away from the camera near the horizon. A rigid hull inflatable boat is also present.
	nama_small_rhib [404MB]	Two targets are shown in the video. There is a very small target and a rigid hull inflatable boat.
	nama_rocks_splashes [206MB]	A small target is shown on the ocean. The ocean is fast moving with lots of splashes against rocks and the lighthouse.
	two_boats [113MB]	Two boats are shown that are moving towards the camera. The targets are small.

Detection and Tracking Research: Synthetic Targets

The following videos can be used to develop small target detection and tracking algorithms. The first video contains a small boat and a frigate crossing. Two small synthetic targets have been injected into each of the other videos.

Thumbnail	Raw File	Description
	nama_low_and_large_boat_intersection	A very small boat and a frigate on the ocean.
	nama_low_and_large_boat_intersection_ti_255	A very small boat and a frigate on the ocean with two synthetic targets of brightness 255.
	nama_low_and_large_boat_intersection_ti_180	A very small boat and a frigate on the ocean with two synthetic targets of brightness 180.
	nama_low_and_large_boat_intersection_ti_150	A very small boat and a frigate on the ocean with two synthetic targets of brightness 150.
	nama_low_and_large_boat_intersection_ti_127	A very small boat and a frigate on the ocean with two synthetic targets of brightness 127.
	nama_low_and_large_boat_intersection_ti_100	A very small boat and a frigate on the ocean with two synthetic targets of brightness 100.
	nama_low_and_large_boat_intersection_ti_75	A very small boat and a frigate on the ocean with two synthetic targets of brightness 75.

Detection and Tracking Research

The following videos are stitched together using images from 3 Prosilica cameras to form a 180 degree view. The challenge is to detect and track the vessels in the video.

Thumbnail	Raw File	Description
	2010-10-05_09h54m58s_half_stitch	Jet ski decelerating.
	2010-10-05_14h12m13s_half_stitch	Jet ski and ski boat circling.
	2010-10-05_14h49m43s_half_stitch	Patrol vessel
	2010-10-12_14h49m01s_half_stitch	Rigid-hulled inflatable boat (RHIB)

Scintillation Mitigation Research

The following videos are aimed at scintillation mitigation research. The data was recorded using a camera built by CSIR Optronic Sensor Systems. The camera contains a Prosilica GE1900 sensor and was stationary during recording.

Thumbnail	Raw File	Description
	2011-04-14_12h32m57s_mfovc_01	High-definition scene showing mild scintillation effects.
	2011-04-14_12h33m32s_mfovc_01	High-definition scene showing mild scintillation effects.
	2011-04-14_12h40m23s_mfovc_01	High-definition scene showing mild scintillation effects.
	2011-04-14_13h41m04s_mfovc_01	High-definition scene showing mild scintillation effects.

The following videos were recorded over a one day period with the CSIR Optronic Sensor Systems Cyclone long range surveillance camera. All camera parameters were fixed for the duration of the day, except for allowing automatic exposure changes. The range to the advertisement board is approximately 7km.

Thumbnail	Raw File	Description
	2011-12-21_06h55m22s_cyclone_01	Early morning after some rain. Light cloud cover and the sun not fully out.
	2011-12-21_07h24m48s_cyclone_01	Still a bit overcast, but heating up.
	2011-12-21_08h07m03s_cyclone_01	Sun starting to come out behind the clouds.
	2011-12-21_08h33m02s_cyclone_01	Sun almost out.
	2011-12-21_08h58m54s_cyclone_01	Sun out, scintillation getting already quite severe.
	2011-12-21_09h28m39s_cyclone_01
	2011-12-21_10h05m26s_cyclone_01
	2011-12-21_10h31m04s_cyclone_01
	2011-12-21_11h03m18s_cyclone_01
	2011-12-21_11h30m30s_cyclone_01	Very low contrast, because of sun position.
	2011-12-21_12h00m08s_cyclone_01
	2011-12-21_12h32m22s_cyclone_01
	2011-12-21_13h01m05s_cyclone_01
	2011-12-21_13h30m38s_cyclone_01
	2011-12-21_14h01m59s_cyclone_01
	2011-12-21_14h34m56s_cyclone_01
	2011-12-21_15h01m06s_cyclone_01	Some scattered clouds appearing.
	2011-12-21_15h22m49s_cyclone_01	Rain at the camera location. Abrupt change in scintillation effects.
	2011-12-21_15h34m14s_cyclone_01	Wider rain present.
	2011-12-21_16h01m40s_cyclone_01	Rain stopped, but sun behind clouds.
	2011-12-21_16h30m57s_cyclone_01	Sun hidden behind clouds. Exposure increases.
	2011-12-21_17h01m09s_cyclone_01	Sun hidden behind clouds. Exposure increases further.

Passive Ranging: Depth from Defocus

The following images are aimed at passive ranging research. Both the input and the output files used in the paper *insert link* are available here. Please contact us for other window sizes or more information.

Laboratory Experiment Results
Thumbnail	Description
	DFD Input Image. Large aperture (F1.8) blurry lab scene. Captured using an Allied vision GT1920 camera with Schneider Cinegon 4.8mm lens.
	DFD Input Image. Small aperture (F16.0) sharp lab scene. Captured using an Allied vision GT1920 camera with Schneider Cinegon 4.8mm lens.
	DFD Output Image. Pentland Spatial Domain Algorithm output with window size of 8 pixels.
	DFD Output Image. Pentland Frequency Domain Algorithm output with window size of 16 pixels.
	DFD Output Image. Bove's Algorithm output with window size of 16 pixels.
	DFD Output Image. Watanabe-Nayar Algorithm output with window size of 8 pixels.

Mid Range Experiment Results
Thumbnail	Description
	DFD Input Image. Large aperture (F1.8) blurry lab scene. Captured using custom 185mm F2.0 optics with Alled vision GE1900 camera.
	DFD Input Image. Small aperture (F16.0) sharp lab scene. Captured using custom 185mm F2.0 optics with Alled vision GE1900 camera.
	DFD Output Image. Pentland Spatial Domain Algorithm output with window size of 16 pixels.
	DFD Output Image. Pentland Frequency Domain Algorithm output with window size of 16 pixels.
	DFD Output Image. Bove's Algorithm output with window size of 16 pixels.
	DFD Output Image. Watanabe-Nayar Algorithm output with window size of 16 pixels.

Long Range (550Meter) Experiment Results
Thumbnail	Description
	DFD Input Image. Large aperture (F1.8) blurry lab scene. Captured using custom 185mm F2.0 optics with Alled vision GE1900 camera.
	DFD Input Image. Small aperture (F16.0) sharp lab scene. Captured using custom 185mm F2.0 optics with Alled vision GE1900 camera.
	DFD Output Image. Pentland Spatial Domain Algorithm output with window size of 16 pixels.
	DFD Output Image. Pentland Frequency Domain Algorithm output with window size of 16 pixels.
	DFD Output Image. Bove's Algorithm output with window size of 16 pixels.
	DFD Output Image. Watanabe-Nayar Algorithm output with window size of 16 pixels.

Long Range (1150Meter) Experiment Results
Thumbnail	Description
	DFD Input Image. Large aperture (F1.8) blurry lab scene. Captured using custom 185mm F2.0 optics with Alled vision GE1900 camera.
	DFD Input Image. Small aperture (F16.0) sharp lab scene. Captured using custom 185mm F2.0 optics with Alled vision GE1900 camera.
	DFD Output Image. Pentland Spatial Domain Algorithm output with window size of 16 pixels.
	DFD Output Image. Pentland Frequency Domain Algorithm output with window size of 16 pixels.
	DFD Output Image. Bove's Algorithm output with window size of 16 pixels.
	DFD Output Image. Watanabe-Nayar Algorithm output with window size of 16 pixels.

Passive Ranging: Depth from Focus

The following images are aimed at passive ranging research. Only the output files used in the paper *insert link* are available here. Please contact us for other window sizes, the input videos or more information.

Laboratory Experiment Results
Thumbnail	Description
	Representative DFF Input Image. Large aperture (F1.8) close focused lab scene. Captured using an Allied vision GT1920 camera with Schneider Cinegon 4.8mm lens.
	Representative DFF Input Image. Large aperture (F1.8) far focused lab scene. Captured using an Allied vision GT1920 camera with Schneider Cinegon 4.8mm lens.
	DFF Output Image. Contrast Metric, Window Size 4
	DFF Output Image. Entropy Metric, Window Size 8.
	DFF Output Image. Standard Deviation Metric, Window Size 64.

Mid Range Experiment Results
Thumbnail	Description
	Representative DFF Input Image. Large aperture (F1.8) close focused lab scene. Captured using an Allied vision GT1920 camera with a Fujinon 75mm lens.
	Representative DFF Input Image. Large aperture (F1.8) far focused lab scene. Captured using an Allied vision GT1920 camera with a Fujinon 75mm lens.
	DFF Output Image. Contrast Metric, Window Size 8
	DFF Output Image. Entropy Metric, Window Size 8.
	DFF Output Image. Standard Deviation Metric, Window Size 8.

Long Range (650m) Experiment Results
Thumbnail	Description
	DFF Output Image. Contrast Metric, Window Size 8
	DFF Output Image. Entropy Metric, Window Size 8.
	DFF Output Image. Standard Deviation Metric, Window Size 8.

Long Range (1050m) Experiment Results
Thumbnail	Description
	DFF Output Image. Contrast Metric, Window Size 8
	DFF Output Image. Entropy Metric, Window Size 8.
	DFF Output Image. Standard Deviation Metric, Window Size 8.

Passive Ranging: Frequency Domain Depth from Defocus v.s. Atmospheric Scintillation

Pentland Frequency Results
Thumbnail	Description
	DFD Output Image at 1150m in low scintillation conditions. Window Size 8
	DFD Output Image at 1150m in medium scintillation conditions. Window Size 8
	DFD Output Image at 1150m in high scintillation conditions. Window Size 8

Bove Results
Thumbnail	Description
	DFD Output Image at 1150m in low scintillation conditions. Window Size 8
	DFD Output Image at 1150m in medium scintillation conditions. Window Size 8
	DFD Output Image at 1150m in high scintillation conditions. Window Size 8