Skip to content

Latest commit

 

History

History
44 lines (34 loc) · 1.86 KB

File metadata and controls

44 lines (34 loc) · 1.86 KB

candle-segment-anything: Segment-Anything Model

This example is based on Meta AI Segment-Anything Model. This model provides a robust and fast image segmentation pipeline that can be tweaked via some prompting (requesting some points to be in the target mask, requesting some points to be part of the background so not in the target mask, specifying some bounding box).

The default backbone can be replaced by the smaller and faster TinyViT model based on MobileSAM.

Running some example.

cargo run --example segment-anything --release -- \
    --image candle-examples/examples/yolo-v8/assets/bike.jpg
    --use-tiny
    --point 0.6,0.6 --point 0.6,0.55

Running this command generates a sam_merged.jpg file containing the original image with a blue overlay of the selected mask. The red dots represent the prompt specified by --point 0.6,0.6 --point 0.6,0.55, this prompt is assumed to be part of the target mask.

The values used for --point should be a comma delimited pair of float values. They are proportional to the image dimension, i.e. use 0.5 for the image center.

Original image: Leading group, Giro d'Italia 2021

Segment results by prompting with a single point --point 0.6,0.55: Leading group, Giro d'Italia 2021

Segment results by prompting with multiple points --point 0.6,0.6 --point 0.6,0.55: Leading group, Giro d'Italia 2021

Command-line flags

  • --use-tiny: use the TinyViT based MobileSAM backbone rather than the default one.
  • --point: specifies the location of the target points.
  • --threshold: sets the threshold value to be part of the mask, a negative value results in a larger mask and can be specified via --threshold=-1.2.