Neural Networks: Types and Applications
Survey methodology
We have reviewed the significant research papers in the field published during 2010–2020, mainly from the years of 2020 and 2019 with some papers from 2021. The main focus was papers from the most reputed publishers such as IEEE, Elsevier, MDPI, Nature, ACM, and Springer. Some papers have been selected from ArXiv. We have reviewed more than 300 papers on various DL topics. There are 108 papers from the year 2020, 76 papers from the year 2019, and 48 papers from the year 2018. This indicates that this review focused on the latest publications in the field of DL. The selected papers were analyzed and reviewed to (1) list and define the DL approaches and network types, (2) list and explain CNN architectures, (3) present the challenges of DL and suggest the alternate solutions, (4) assess the applications of DL, (5) assess computational approaches. The most keywords used for search criteria for this review paper are ("Deep Learning"), ("Machine Learning"), ("Convolution Neural Network"), ("Deep Learning" AND "Architectures"), (("Deep Learning") AND ("Image") AND ("detection" OR "classification" OR "segmentation" OR "Localization")), ("Deep Learning" AND "detection" OR "classification" OR "segmentation" OR "Localization"), ("Deep Learning" AND "CPU" OR "GPU" OR "FPGA"), ("Deep Learning" AND "Transfer Learning"), ("Deep Learning" AND "Imbalanced Data"), ("Deep Learning" AND "Interpretability of data"), ("Deep Learning" AND "Overfitting"), ("Deep Learning" AND "Underspecification"). Figure 1 shows our search structure of the survey paper. Table 1 presents the details of some of the journals that have been cited in this review paper.
Fig. 1 Search framework
Table 1 Some of the journals have been cited in this review paper
|
Journal |
IF 2019 |
CiteScore 2019 |
Publisher |
Journal homepage |
|---|---|---|---|---|
|
Pattern Recognition |
7.196 |
13.1 |
Elsevier |
https://www.journals.elsevier.com/pattern-recognition |
|
Pattern Recognition Letter |
3.255 |
6.3 |
Elsevier |
https://www.journals.elsevier.com/pattern-recognition-letters |
|
Artificial Intelligence Review |
5.747 |
9.1 |
Springer |
https://www.springer.com/journal/10462?referer=www.springeronline.com |
|
Expert Systems with Applications |
5.452 |
11 |
Elsevier |
https://www.sciencedirect.com/journal/expert-systems-with-applications |
|
Neurocomputing |
4.438 |
9.5 |
Elsevier |
https://www.journals.elsevier.com/neurocomputing |
|
Nature Medicine |
36.130 |
45.9 |
Nature |
https://www.nature.com/nm/ |
|
Nature |
42.779 |
51 |
Nature |
https://www.nature.com/ |
|
Journal of Big Data |
– |
6.1 |
Springer |
https://journalofbigdata.springeropen.com/ |
|
Multimedia Tools and Applications |
2.313 |
3.7 |
Springer |
https://www.springer.com/journal/11042 |
|
Computer Methods and Programs in Biomedicine |
3.632 |
7.5 |
Elsevier |
https://www.journals.elsevier.com/computer-methods-and-programs-in-biomedicine |
|
Machine Learning |
2.672 |
5.0 |
Springer |
https://www.springer.com/journal/10994 |
|
Machine Vision and Applications |
1.605 |
4.2 |
Springer |
https://www.springer.com/journal/138 |
|
Medical Image Analysis |
11.148 |
17.2 |
Elsevier |
https://www.sciencedirect.com/journal/medical-image-analysis |
|
IEEE Access |
3.745 |
3.9 |
IEEE |
https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=6287639 |
|
IEEE Transactions on Knowledge and Data Engineering |
4.935 |
12.0 |
IEEE |
https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=69 |
|
Nature Communications |
12.121 |
18.1 |
Nature |
https://www.nature.com/ncomms/ |
|
IEEE Transactions on Intelligent Transportation Systems |
6.319 |
12.7 |
IEEE |
https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=6979 |
|
Methods |
3.812 |
8.0 |
Elsevier |
https://www.journals.elsevier.com/methods |
|
ACM Journal on Emerging Technologies in Computing Systems |
1.652 |
4.3 |
ACM |
https://dl.acm.org/journal/jetc |
|
ACM Computing Surveys |
6.319 |
12.7 |
ACM |
https://dl.acm.org/journal/csur |
|
Applied Soft Computing |
5.472 |
10.2 |
Elsevier |
https://www.journals.elsevier.com/applied-soft-computing |
|
Electronics |
2.412 |
1.9 |
MDPI |
https://www.mdpi.com/journal/electronics |
|
Applied Sciences |
2.474 |
2.4 |
MDPI |
https://www.mdpi.com/journal/applsci |
|
IEEE Transactions on Industrial Informatics |
9.112 |
13.9 |
IEEE |
https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=9424 |