Survey methodology

We have reviewed the significant research papers in the field published during 2010–2020, mainly from the years of 2020 and 2019 with some papers from 2021. The main focus was papers from the most reputed publishers such as IEEE, Elsevier, MDPI, Nature, ACM, and Springer. Some papers have been selected from ArXiv. We have reviewed more than 300 papers on various DL topics. There are 108 papers from the year 2020, 76 papers from the year 2019, and 48 papers from the year 2018. This indicates that this review focused on the latest publications in the field of DL. The selected papers were analyzed and reviewed to (1) list and define the DL approaches and network types, (2) list and explain CNN architectures, (3) present the challenges of DL and suggest the alternate solutions, (4) assess the applications of DL, (5) assess computational approaches. The most keywords used for search criteria for this review paper are ("Deep Learning"), ("Machine Learning"), ("Convolution Neural Network"), ("Deep Learning" AND "Architectures"), (("Deep Learning") AND ("Image") AND ("detection" OR "classification" OR "segmentation" OR "Localization")), ("Deep Learning" AND "detection" OR "classification" OR "segmentation" OR "Localization"), ("Deep Learning" AND "CPU" OR "GPU" OR "FPGA"), ("Deep Learning" AND "Transfer Learning"), ("Deep Learning" AND "Imbalanced Data"), ("Deep Learning" AND "Interpretability of data"), ("Deep Learning" AND "Overfitting"), ("Deep Learning" AND "Underspecification"). Figure 1 shows our search structure of the survey paper. Table 1 presents the details of some of the journals that have been cited in this review paper.

Fig. 1 Search framework

Fig. 1 Search framework


Table 1 Some of the journals have been cited in this review paper

Journal

IF 2019

CiteScore 2019

Publisher

Journal homepage

Pattern Recognition

7.196

13.1

Elsevier

https://www.journals.elsevier.com/pattern-recognition

Pattern Recognition Letter

3.255

6.3

Elsevier

https://www.journals.elsevier.com/pattern-recognition-letters

Artificial Intelligence Review

5.747

9.1

Springer

https://www.springer.com/journal/10462?referer=www.springeronline.com

Expert Systems with Applications

5.452

11

Elsevier

https://www.sciencedirect.com/journal/expert-systems-with-applications

Neurocomputing

4.438

9.5

Elsevier

https://www.journals.elsevier.com/neurocomputing

Nature Medicine

36.130

45.9

Nature

https://www.nature.com/nm/

Nature

42.779

51

Nature

https://www.nature.com/

Journal of Big Data

–

6.1

Springer

https://journalofbigdata.springeropen.com/

Multimedia Tools and Applications

2.313

3.7

Springer

https://www.springer.com/journal/11042

Computer Methods and Programs in Biomedicine

3.632

7.5

Elsevier

https://www.journals.elsevier.com/computer-methods-and-programs-in-biomedicine

Machine Learning

2.672

5.0

Springer

https://www.springer.com/journal/10994

Machine Vision and Applications

1.605

4.2

Springer

https://www.springer.com/journal/138

Medical Image Analysis

11.148

17.2

Elsevier

https://www.sciencedirect.com/journal/medical-image-analysis

IEEE Access

3.745

3.9

IEEE

https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=6287639

IEEE Transactions on Knowledge and Data Engineering

4.935

12.0

IEEE

https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=69

Nature Communications

12.121

18.1

Nature

https://www.nature.com/ncomms/

IEEE Transactions on Intelligent Transportation Systems

6.319

12.7

IEEE

https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=6979

Methods

3.812

8.0

Elsevier

https://www.journals.elsevier.com/methods

ACM Journal on Emerging Technologies in Computing Systems

1.652

4.3

ACM

https://dl.acm.org/journal/jetc

ACM Computing Surveys

6.319

12.7

ACM

https://dl.acm.org/journal/csur

Applied Soft Computing

5.472

10.2

Elsevier

https://www.journals.elsevier.com/applied-soft-computing

Electronics

2.412

1.9

MDPI

https://www.mdpi.com/journal/electronics

Applied Sciences

2.474

2.4

MDPI

https://www.mdpi.com/journal/applsci

IEEE Transactions on Industrial Informatics

9.112

13.9

IEEE

https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=9424