DC Field | Value | Language |
---|---|---|
dc.contributor.author | GIL, YOONHEE | - |
dc.contributor.author | PARK, JONG HYEOK | - |
dc.contributor.author | BAEK, JONGCHAN | - |
dc.contributor.author | HAN, SOOHEE | - |
dc.date.accessioned | 2022-03-05T06:40:13Z | - |
dc.date.available | 2022-03-05T06:40:13Z | - |
dc.date.created | 2022-03-04 | - |
dc.date.issued | 2022-03 | - |
dc.identifier.issn | 0278-0046 | - |
dc.identifier.uri | https://oasis.postech.ac.kr/handle/2014.oak/110555 | - |
dc.description.abstract | In this study, we propose a simple and effective quantization-aware neural network pruning method to prune and quantize deep neural networks and then run them on lightweight and cost-effective embedded industrial devices. The proposed pruning method provides a suitable pruning strategy for a given bit precision before performing the subsequent quantization. In particular, the dropout rate is set to be bounded below by the maximum number of quantization levels, which enables the regulation of the tradeoff between sparsity and performance loss. The Kullback-Leibler divergence term of the evidence lower bound is also weighted for adjusting the performance loss. From learned dropout rates, efficient bit allocation is provided to maintain randomness even through the quantization step. In supervised and reinforcement learning applications, the proposed quantization-aware pruning method was proven to be successful in obtaining sparse and lightweight neural networks while maintaining their performance even after quantization. In particular, a real inverted pendulum system was used to determine whether the proposed method works well for actual physical control systems. | - |
dc.language | English | - |
dc.publisher | Institute of Electrical and Electronics Engineers | - |
dc.relation.isPartOf | IEEE Transactions on Industrial Electronics | - |
dc.title | Quantization-Aware Pruning Criterion for Industrial Applications | - |
dc.type | Article | - |
dc.identifier.doi | 10.1109/TIE.2021.3070517 | - |
dc.type.rims | ART | - |
dc.identifier.bibliographicCitation | IEEE Transactions on Industrial Electronics, v.69, no.3, pp.3203 - 3213 | - |
dc.identifier.wosid | 000728182300101 | - |
dc.citation.endPage | 3213 | - |
dc.citation.number | 3 | - |
dc.citation.startPage | 3203 | - |
dc.citation.title | IEEE Transactions on Industrial Electronics | - |
dc.citation.volume | 69 | - |
dc.contributor.affiliatedAuthor | GIL, YOONHEE | - |
dc.contributor.affiliatedAuthor | PARK, JONG HYEOK | - |
dc.contributor.affiliatedAuthor | BAEK, JONGCHAN | - |
dc.contributor.affiliatedAuthor | HAN, SOOHEE | - |
dc.identifier.scopusid | 2-s2.0-85103876354 | - |
dc.description.journalClass | 1 | - |
dc.description.journalClass | 1 | - |
dc.description.isOpenAccess | N | - |
dc.type.docType | Article | - |
dc.subject.keywordAuthor | Network compression | - |
dc.subject.keywordAuthor | network pruning | - |
dc.subject.keywordAuthor | sparse variational dropout | - |
dc.subject.keywordAuthor | uniform scalar quantization | - |
dc.relation.journalWebOfScienceCategory | Automation & Control Systems | - |
dc.relation.journalWebOfScienceCategory | Engineering, Electrical & Electronic | - |
dc.relation.journalWebOfScienceCategory | Instruments & Instrumentation | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
dc.relation.journalResearchArea | Automation & Control Systems | - |
dc.relation.journalResearchArea | Engineering | - |
dc.relation.journalResearchArea | Instruments & Instrumentation | - |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.
library@postech.ac.kr Tel: 054-279-2548
Copyrights © by 2017 Pohang University of Science ad Technology All right reserved.