Modern reference on general Deep Learning theory

2

In the present, Deep Learning is experiencing lightspeed growth, with plethora of new architectures and radiant ideas emerging each month. Since the last few years several influential ideas, applied in different papers have been developed - among which most important are Transformer, EfficientNet, MobileNets. Is there some modern reference, in the spirit of the famous https://www.deeplearningbook.org/, in some way, generalizing the most prominent advances in Deep Learning?

spiridon_the_sun_rotator

Posted 2021-02-22T15:45:54.123

Reputation: 284

Can I know are you looking for Deep Learning latest realized resource? – AIFahim – 2021-02-22T16:48:14.227

@AIFahim as far, as I undestand, the latest edition doesn't contain these topics, and at least I am unaware of plans to include them. I ask, whether there exist a book of similar strucutre, but accounting for the recent advances – spiridon_the_sun_rotator – 2021-02-22T17:05:01.473

Answers

2

For the latest practices of deep learning architectures, I follow the Kaggle latest Competition's notebooks.
Say, for example, In the recent finished Cassava Leaf Deasese Computer Vision Competition, People are sharing the experimental notebooks on different State of the art Architectures Like Vision Transformer(Various versions pretrained - vit_large_patch16_384, vit_base_patch16_384 etc. models), Facebook's Data-efficient Image Transformers , EfficientNet (Noisy Student version, Imagenet Version) and etc.
https://www.deeplearningbook.org/ this book undoubtedly one of the great book. But for the latest practices if you follow the Kaggle notebooks you get a good explanation with codes.

I suggest you, Explore this Notebooks Section of the Casava Leaf Disease Classification Contest to get more Models and Various recent new released Loss Functions and so on.

AIFahim

Posted 2021-02-22T15:45:54.123

Reputation: 249