Skip to content

Computer-vision dataset tools that I am using or working on

License

Notifications You must be signed in to change notification settings

martinruenz/dataset-tools

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

11 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Various dataset tools

Installation


Requirements

  • opencv
  • pcl and flann for evaluate_reconstruction
`sudo apt-get install libpcl-dev libflann-dev`
  • glm for trajectory_tool
`sudo apt-get install libglm-dev`
`sudo apt-get install gtk2-engines-pixbuf gnome-themes-standard`

Example

git clone [email protected]:martinruenz/dataset-tools.git
cd dataset-tools
mkdir Release
cd Release
cmake .. && make -j8

# Optionally add to path (assumed in some steps below)
#   Log out and in again afterwards!
echo "PATH=\$PATH:`pwd`" >> ~/.profile

HowTos


  • How to evaluate your object-aware SLAM-method completely automatically? (Analyse segmentation and trajectory quality)

    The script automatisation/cofusion.jl was written for this purpose and evaluates the object-segmentation and trajectory quality of your method. It assumes that you have the following data available:

    • ground-truth segmentation
    • exported segmentation
    • ground-truth trajectories (file-name has to contain corresponding label-id)
    • exported trajectories

    Example using Co-Fusion:
    CoFusion \
      -basedir /path/to/CarScene4/ \
      -dir colour \
      -depthdir depth \
      -cal calibration.txt \
      -exportdir /path/to/export \
      -segMinNew 0.008 \
      -crfSmooth 1 \
      -crfPos 0.51 \
      -es -ep -run -q -keep
    ./cofusion.jl \
      --gt-poses /path/to/CarScene4/trajectories \
      --ex-poses /path/to/export \
      --gt-masks /path/to/CarScene4/masks_id \
      --ex-masks /path/to/export \
      --out /path/to/output
    

    The script automatically tries to perform the steps of the following HowTo by converting the trajectories using the frame with the best intersection-over-union score.

    As a result you will get an intersection-over-union graph, see the following image, as well as a trajectory plot, as in the image of the next HowTo.

    visualisation

  • How to compare an object-trajectory of your non-static SLAM-method with ground-truth data?

    Since your SLAM-method is not aware of the ground-truth coordinate system (the origin) of the given object (your system has to pick a "random" origin), an alignment method has to be used before a meaningful evaluation is possible. Luckily, your system should already align moving objects to the camera, so if you pick a frame which aligns camera and object nicely, it can be used to compute the ground-truth object origin in the reference frame of your object. Subsequently, your and the ground-truth origin coincide and evaluation algorithms can be applied.

    This is how it is done:

    The result should look something like this: visualisation

    • How to create a (SLAM-)dataset using Blender?

    !! TODO !! example blender file, export depth, export segmentation, reference to export poses & calibration

    ... convert depth, convert_depth described below ...

      convert_depth \
        --dir depth_original \
        --outdir depth_converted \
        -cx 320 \
        -cy 240 \
        -fx 360 \
        -fy 480 \
        -z
    

    Also if convert colour-masks to ID-masks

      cp -r maskdir id_masks
      label_finder \
        --dir id_masks \
        --outdir id_masks \
        --prefix Mask \
        --width 4 \
        --starti 1 \
        -c 255,0,0 -r 1,1,1
      # repeat calling label_finder for different colours (-c)
      # and different IDs (-r, where the parameter is id,id,id)
    

Tools


Scripts

Blender

└── io_export_pose.py

Blender addon-script that enables the export of object and camera poses. The exported format is either:

  t x y z qx qy qz qw  

or

  t x y z rx ry rz  

screenrecording

└── get_calibration.py

Script to export intrinsic pinhole-camera parameters from blender. Written by the user rfabbri of http://blender.stackexchange.com.

trajectoryViewer.jl

Simple Julia-script that visualises a list of trajectories in the format:

  t x y z qx qy qz qw  

screenrecording

C++ Tools

convert_depth [Blender]

When extracting depth-maps from blender, the depth values are usually not projective and hence, have to be converted to be used common scenarios. This tool can perform the necessary conversion. It is also able to add noise to depth values.

Input: Depth-map(s) (exr files), + optional parameters
Output: Depth-map(s) (exr files)

visualisation

convert_exrToRGB

Convert exr to RGB image file, usually for visualisation. The floating point input is mapped from 'min-max' to '0-255'.

convert_klgToPly

Allows you to extract colour images, depth images and PLY-point clouds from each each frame of a .klg file.

convert_masks

Convert colour mask images (CV_8UC3) to ID mask images (CV_8UC1). The tool ensures that the re-mapping is consistent throughout a dataset.

convert_poses

Convert the ground-truth origin of an object to world-coordinate poses in your export -- for each frame. (See HowTos)

KlgViewer

View a *.klg file (depth+rgb) like a video

label_associator

Assume you have two subsequent frames with object labels but incoherent label colors. This tool tries to correctly associate labels, in order to make them coherent.

label_finder

Highlight a color in a dataset like CamVid, also allows you to replace that colour. screenrecording

label_merger

Merge labels with certain amount of neighbours.

About

Computer-vision dataset tools that I am using or working on

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published