Segment anything for labeling chunks of embeddings?

[rbnyng]

maybe use segment anything to label chunks of embeddings and just assign labels to all pixels there as an intermediate? not sure how doable, this relies on having a pytorch install which is annoying if we're planning to eventually go wasm/website only with the tool; might be out of scope

[avsm]

There are emerging wasm SAMs https://huggingface.co/spaces/radames/candle-segment-anything-wasm

[rbnyng]

thanks, that looks interesting; seems to work pretty well on the example photos actually, now just need to figure out how to integrate