What algorithms are used for segmentation and classification of non solid regions in an image?


In the process of segmentation, pixels are assigned to regions based on features that distinguishes them from the rest of the image. Value Similarity and Spatial Proximity, for example, are two important principles that assume that points in the same region will have pixels that are spatially close and have similar values.

In lots of situations this is true, but what about regions composed of pixels that are not similar in value? Consider the image below. The same "logical" region is composed of different elements that together represent something meaningful. In the same region there are trees with different sizes and shapes, with shadow over some of them etc. There are different things, with pixels that differ a lot in value, but I still need to group them together in the same region. From the image you can see that I don't care so much with differences in color. In this case texture is the most important attribute. What algorithms are used to do the segmentation and classification in problems like that?

I'm already looking for some algorithms and techniques that focus on texture, but some opinions from the experts will help me a lot. I think I need some orientation. Thanks!



Posted 2017-05-29T18:30:16.880


Before I give some suggestions, I need some clarifications. Do you want the earth pixels to be classified as being the same crop as the surrounding crop? How different do images of different aerial crops look? – JahKnows – 2017-05-29T23:08:25.940

@JahKnows I've made some modifications in my question. I think it is clearer now. – None – 2017-05-31T17:13:55.897

Have you simply googled "texture segmentation"? The results should keep you busy for some time. – Rethunk – 2017-06-02T12:39:55.140

@Rethunk As I said above: I'm already looking for some algorithms and techniques that focus on texture, but some opinions from the experts will help me a lot. – None – 2017-06-02T13:36:32.970

@rrd You haven't made the problem specific enough. As your question stands, it's not easily distinguishable from a request for SO users to help you with the most basic information. Unless you mention some specific texture segmentation technique (e.g. Law's techniques), it doesn't look like you've made an effort. Also, it's not in the spirit of SO to provide general guidance; make your question as specific as possible. In this case, start with the names of specific texture segmentation methods and ask specific questions about how to compare them. – Rethunk – 2017-06-04T13:00:30.557



If you have enough data, you can train a segmentation net example for a specific group of data (i.e. trees). Single DNN with multiple output branches can easily segment & classify the data that you are searching for.

Deniz Beker

Posted 2017-05-29T18:30:16.880

Reputation: 366