learning object recognition of primitive shapes through transfer learning problem


Question on transfer learning object classification (MobileNet_v2 with 75% number of parameters) with my own synthetic data:

I made my own dataset of three shapes: triangles, rectangles and spheres. each category has 460 samples with diferent sizes, dimensions, different wobbles at edges. They look like this:

enter image description here enter image description here enter image description here

I want the network to classify these primitive shapes in other environments as well with different lighting/color conditions and image statistics.

Even though I'm adding random crops, scaling, and brightnesses, at training step 10 it's already at 100% training and validation accuracy. Cross entropy keeps going down though. I'm using tensorflow hub. The performance of the network in the end could be better within other environments (virtual 3d space with such shapes). Also trained and tested for ~ 50 steps to see if the network is overfitting, but that doesn't work too well.

What alterations would you recommend to generalize better? Or shouldn't I train on synthetic data at all to learn primitive shapes? If so, any dataset recommendations?

Thanks in advance


Posted 2019-11-22T10:26:57.503

Reputation: 235

im assuming you dont have labels on the actual data your performing inference on? Also in your case you need to make sure the augmentations cover the difference in domains – mshlis – 2019-11-22T15:58:01.163

I don't necessarily have the labels there no. Any suggestions on how to make the augmentations cover the difference in domains? Thanks! – SumakuTension – 2019-11-22T16:31:27.450

No answers