Euisuk's Dev Log

ใ€Œ์„œ์ฟ  ๊ฐœ๋ฐœ๋…ธํŠธโญใ€

[ํŒŒ์ดํ† ์น˜] ํŒŒ์ดํ† ์น˜๋กœ CNN ๋ชจ๋ธ์„ ๊ตฌํ˜„ํ•ด๋ณด์ž! (GoogleNetํŽธ)

์•ˆ๋…•ํ•˜์„ธ์š”! ์ง€๋‚œ๋ฒˆ ํฌ์ŠคํŠธ์ธ VGGNet ์ดํ›„๋กœ ์˜ค๋Š˜์€ GoogleNet ๊ด€๋ จ ํฌ์ŠคํŠธ์ž…๋‹ˆ๋‹ค. ๋‹ค์Œ ํฌ์ŠคํŠธ๋Š” ResNet์œผ๋กœ ์ฐพ์•„๋ต™๋„๋ก ํ•˜๊ฒ ์Šต๋‹ˆ๋‹ค. ์ง€๋‚œ๋ฒˆ์—๋„ ์†Œ๊ฐœ๋“œ๋ ธ๋‹ค์‹œํ”ผ ์ปดํ“จํ„ฐ ๋น„์ „ ๋Œ€ํšŒ ์ค‘์— ILSVRC (Imagenet Large Scale Visual Recognition Challenges)์ด๋ผ๋Š” ๋Œ€ํšŒ๊ฐ€ ์žˆ๋Š”๋ฐ, ๋ณธ ๋Œ€ํšŒ๋Š” ๊ฑฐ๋Œ€ ์ด๋ฏธ์ง€๋ฅผ 1...

[ํŒŒ์ดํ† ์น˜] ํŒŒ์ดํ† ์น˜๋กœ CNN ๋ชจ๋ธ์„ ๊ตฌํ˜„ํ•ด๋ณด์ž! (VGGNetํŽธ)

์•ˆ๋…•ํ•˜์„ธ์š”! ์˜ค๋Š˜ ํฌ์ŠคํŒ…๋ถ€ํ„ฐ ๋‹ค์Œ๋‹ค์Œ ํฌ์ŠคํŒ…๊นŒ์ง€๋Š” CNN ๋ชจ๋ธ์˜ ๋ผˆ๋Œ€๊ฐ€ ๋˜๋Š” ๋ชจ๋ธ๋“ค์ธ VGGNet, GoogleNet, ResNet์„ ์†Œ๊ฐœํ•˜๊ณ  ์ด๋ฅผ ๊ตฌํ˜„ํ•ด๋ณด๋Š” ์‹œ๊ฐ„์„ ๊ฐ–๋„๋ก ํ•˜๊ฒ ์Šต๋‹ˆ๋‹ค! :) ์ด๋ฒˆ ํฌ์ŠคํŒ…์€ VGGNet ๊ด€๋ จ ํฌ์ŠคํŠธ์ž…๋‹ˆ๋‹ค. ๋จผ์ € ILSVRC (Imagenet Large Scale Visual Recognition Challenges)์ด...

[ํŒŒ์ดํ† ์น˜] ํŒŒ์ดํ† ์น˜๋กœ CNN ๋ชจ๋ธ์„ ๊ตฌํ˜„ํ•ด๋ณด์ž! (๊ธฐ์ดˆํŽธ + DataLoader ์‚ฌ์šฉ๋ฒ•)

MNIST ๋ฐ์ดํ„ฐ - CNN ์‹ค์Šต ์˜ค๋Š˜์€ MNIST ๋ฐ์ดํ„ฐ๋กœ Convolutional Neural Network(์ดํ•˜ CNN)์„ ๊ตฌํ˜„ํ•˜๊ณ  ๋Œ๋ ค๋ณด๋Š” ์‹œ๊ฐ„์„ ๊ฐ–๋„๋ก ํ•˜๊ฒ ์Šต๋‹ˆ๋‹ค! ๋จผ์ €, CNN์€ ํฌ๊ฒŒ ์•„๋ž˜์™€ ๊ฐ™์€ ๊ตฌ์„ฑ์š”์†Œ๋กœ ์ด๋ฃจ์–ด์ ธ ์žˆ์Šต๋‹ˆ๋‹ค. ํ•ฉ์„ฑ๊ณฑ ์—ฐ์‚ฐ(Convolution) : ์ด๋ฏธ์ง€์˜ ํŠน์„ฑ์„ ์ถ”์ถœํ•˜๋Š” ๊ณ„์ธต ๋งฅ์Šคํ’€๋ง(Max Pooling)...

[๋จธ์‹ ๋Ÿฌ๋‹] ์ด์ƒ ํƒ์ง€ ๊ฐœ์š” ๋ฐ ๋ฐ€๋„ ๊ธฐ๋ฐ˜ ์ด์ƒ์น˜ํƒ์ง€

๋ณธ ํฌ์ŠคํŠธ๋Š” ๊ณ ๋ ค๋Œ€ํ•™๊ต ๊ฐ•ํ•„์„ฑ ๊ต์ˆ˜๋‹˜์˜ ๊ฐ•์˜๋ฅผ ์ˆ˜๊ฐ• ํ›„ ์ •๋ฆฌ๋ฅผ ํ•œ ๊ฒƒ์ž…๋‹ˆ๋‹ค. ์ž‘์„ฑ ๋ฐ ์„ค๋ช…์˜ ํŽธ์˜๋ฅผ ์œ„ํ•ด ์•„๋ž˜ ํฌ์ŠคํŠธ๋Š” ๋ฐ˜๋ง๋กœ ์ž‘์„ฑํ•œ ์  ์–‘ํ•ด๋ถ€ํƒ๋“œ๋ฆฝ๋‹ˆ๋‹ค. Abnormal Data๋ž€ Anomaly Data๋Š” ๋‹ค์Œ๊ณผ ๊ฐ™์ด Hawkins์™€ Harmeling์— ์˜ํ•ด ์ •์˜๋œ๋‹ค. Observations that deviate so much f...

[๋จธ์‹ ๋Ÿฌ๋‹] ๊ฑฐ๋ฆฌโ€ข๊ตฐ์ง‘โ€ข์„œํฌํŠธ๋ฒกํ„ฐ ๊ธฐ๋ฐ˜ ์ด์ƒํƒ์ง€ ๊ธฐ๋ฒ•

๋ณธ ํฌ์ŠคํŠธ๋Š” ๊ณ ๋ ค๋Œ€ํ•™๊ต ๊ฐ•ํ•„์„ฑ ๊ต์ˆ˜๋‹˜์˜ ๊ฐ•์˜๋ฅผ ์ˆ˜๊ฐ• ํ›„ ์ •๋ฆฌ๋ฅผ ํ•œ ๊ฒƒ์ž…๋‹ˆ๋‹ค. ์ž‘์„ฑ ๋ฐ ์„ค๋ช…์˜ ํŽธ์˜๋ฅผ ์œ„ํ•ด ์•„๋ž˜ ํฌ์ŠคํŠธ๋Š” ๋ฐ˜๋ง๋กœ ์ž‘์„ฑํ•œ ์  ์–‘ํ•ด๋ถ€ํƒ๋“œ๋ฆฝ๋‹ˆ๋‹ค. ๊ฑฐ๋ฆฌ ๊ธฐ๋ฐ˜ ์ด์ƒ์น˜ํƒ์ง€ K-Nearest Neighbor-based Anomaly Detection ๊ฐ ๋ฐ์ดํ„ฐ์— ๋Œ€ํ•œ Anomaly Score๋ฅผ K๊ฐœ์˜ ๊ทผ์ ‘ ์ด์›ƒ๊นŒ์ง€์˜ ๊ฑฐ๋ฆฌ๋ฅผ ์ด์šฉํ•˜์—ฌ ๊ณ„์‚ฐ...

[Paper Review] An Image Is Worth 16x16 Words : Transformers for Image Recognition at Scale (Vision Transformer)

์„ ์ • ์ด์œ  ์•ˆ๋…•ํ•˜์„ธ์š”! ์˜ค๋Š˜ ๋…ผ๋ฌธ๋ฆฌ๋ทฐ, ์ฝ”๋“œ๋ฆฌ๋ทฐํ•ด๋ณผ ๋…ผ๋ฌธ์€ โ€œAn Image Is Worth 16x16 Words: Transformers for Image Recognition at Scaleโ€ ๋กœ, ์ปดํ“จํ„ฐ ๋น„์ „์—์„œ Transformer์™€ Attention์ด ์“ฐ์ด๊ฒŒ ๋œ ๊ฒฐ์ •์  ๊ณ„๊ธฐ(?)๊ฐ€ ๋œ ๋…ผ๋ฌธ์ž…๋‹ˆ๋‹ค. ์ตœ๊ทผ ์ด์ชฝ ๋ถ„์•ผ์— ๊ด€์‹ฌ์ด ๋งŽ๋‹ค ๋ณด๋‹ˆ ์˜ค๋Š˜์€ ...

[Paper Review] An Architecture Combining Convolutional Neural Network(CNN) and Support Vector Machine(SVM) for Image Classification

์˜ค๋Š˜ ๋ฆฌ๋ทฐ/๋ฒˆ์—ญ/๊ตฌํ˜„ํ•  ๋…ผ๋ฌธ์€ โ€œAbien Fred M. Agarapโ€ ์ €์ž๊ฐ€ ์“ด ๋…ผ๋ฌธ์œผ๋กœ, โ€œYichuan Tangโ€์˜ โ€œDeep Learning using Linear Support Vector Machinesโ€์„ ๋ณด๊ณ  inspired๋˜์–ด ์—ฐ๊ตฌํ•˜๊ฒŒ ๋˜์—ˆ๋‹ค๊ณ  ํ•œ๋‹ค. ํ•˜๋‹จ์˜ ์ฐธ๊ณ  ๋…ผ๋ฌธ ์†Œ์Šค์— ํ•ด๋‹น ๋…ผ๋ฌธ ๋งํฌ์™€ ์ด๋ฒˆ ๋…ผ๋ฌธ์˜ ๋งํฌ๋ฅผ ์ฒจ๋ถ€์˜€๋‹ค. (์ฐธ๊ณ ) ...

[์•Œ๊ณ ๋ฆฌ์ฆ˜] ๊ทธ๋ž˜ํ”„

์˜ค๋Š˜์€ ์•Œ๊ณ ๋ฆฌ์ฆ˜/์ž๋ฃŒ๊ตฌ์กฐ๋ฅผ ๊ณต๋ถ€ํ•˜๋ฉด์„œ ํ‰์†Œ ๋‘๋ ค์›€์— ๋–จ๋ฉฐ ์ œ๋Œ€๋กœ ๊ณต๋ถ€ํ•˜์ง€ ๋ชปํ–ˆ๋˜ ๊ทธ๋ž˜ํ”„์— ๋Œ€ํ•ด ๊ณต๋ถ€๋ฅผ ํ•˜๋ฉฐ ์ •๋ฆฌํ•ด๋ณด์•˜์Šต๋‹ˆ๋‹ค. ๊ณต๋ถ€ํ•˜๋ฉฐ ์ž‘์„ฑํ•œ ๊ธ€์ด๋ฏ€๋กœ ๋ฐ˜๋ง์ด์–ด๋„ ์–‘ํ•ด๋ถ€ํƒ๋“œ๋ฆฝ๋‹ˆ๋‹ค. ๊ทธ๋ž˜ํ”„ 1. ๊ทธ๋ž˜ํ”„๋ž€? ๊ทธ๋ž˜ํ”„๋Š” ๊ฐ€์žฅ ์ผ๋ฐ˜ํ™”๋œ ์ž๋ฃŒ๊ตฌ์กฐ๋กœ, ์—ฐ๊ฒฐ๋œ ๊ฐ์ฒด๋“ค ์‚ฌ์ด์˜ ๊ด€๊ณ„๋ฅผ ์ž˜ ํ‘œํ˜„ํ•จ. ๊ทธ๋ž˜ํ”„ ์ด๋ก  ์ผ๋ฐ˜์ ์œผ๋กœ ๊ทธ๋ž˜ํ”„์™€ ๊ด€๋ จ๋œ ๋‹ค์–‘ํ•œ ๋ฌธ์ œ๋ฅผ...

[๋จธ์‹ ๋Ÿฌ๋‹][์‹œ๊ณ„์—ด] AR, MA, ARMA, ARIMA์˜ ๋ชจ๋“  ๊ฒƒ - ์‹ค์ŠตํŽธ

๋ณธ ํฌ์ŠคํŒ…์€ ์‹ค์ œ ๋ฐ์ดํ„ฐ๋ฅผ ํ™œ์šฉํ•œ ์‹œ๊ณ„์—ด ๋ถ„์„์˜ ์ „๋ฐ˜์ ์ธ ํ”„๋กœ์„ธ์Šค ๊ณผ์ •์„ ๋‹ด๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. ๋ถ„์„ ํŒ์ด๋‚˜ ํ”ผ๋“œ๋ฐฑ์€ ์–ธ์ œ๋‚˜ ํ™˜์˜์ž…๋‹ˆ๋‹ค!! ๐Ÿ™‡โ€โ™‚๏ธ ๋ถ„์„์˜ ์ˆœ์„œ๋Š” ์•„๋ž˜์™€ ๊ฐ™์Šต๋‹ˆ๋‹ค. ํ•ด๋‹น ๋ถ„์„์€ ์•ž์—์„œ ๋‹ค๋ฃฌ ์‹œ๊ณ„์—ด ๊ฐœ๋…์„ ๊ธฐ๋ฐ˜์œผ๋กœ ๋ถ„์„์„ ์ˆ˜ํ–‰ํ•œ ๊ฒƒ์ด๋ฏ€๋กœ ๊ฐœ๋…์„ ์ฐพ์•„๋ณด๊ณ  ์‹ถ๋‹ค๋ฉด ์ œ ์ด์ „ ํฌ์ŠคํŠธ์—์„œ ํ™•์ธํ•˜์‹ค ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ์ฐธ๊ณ  ๋ฐ์ดํ„ฐ ์„ ์ • ๋ฐ ์ „์ฒ˜๋ฆฌ ...

[๋จธ์‹ ๋Ÿฌ๋‹][์‹œ๊ณ„์—ด] AR, MA, ARMA, ARIMA์˜ ๋ชจ๋“  ๊ฒƒ - ๊ฐœ๋…ํŽธ

์˜ค๋Š˜์€ ๋จธ์‹ ๋Ÿฌ๋‹ ์‹œ๊ณ„์—ด์—์„œ ๊ฐ€์žฅ ๋งŽ์ด ์“ฐ์ด๋Š” AR, MA, ARMA, ARIMA์— ๋Œ€ํ•ด ์ •๋ฆฌํ•ด๋ณด๋Š” ์‹œ๊ฐ„์„ ๊ฐ€์ง€๋ ค๊ณ  ํ•ฉ๋‹ˆ๋‹ค. ํ•ด๋‹น ํฌ์ŠคํŠธ๋Š” ๊ณ ๋ ค๋Œ€ํ•™๊ต ๊น€์„ฑ๋ฒ” ๊ต์ˆ˜๋‹˜์˜ ๊ฐ•์˜๋ฅผ ๋ฐ”ํƒ•์œผ๋กœ ์ œ์ž‘๋˜์—ˆ์Šต๋‹ˆ๋‹ค. ๋ชฉ์ฐจ ์ •์ƒ ํ”„๋กœ์„ธ์Šค์™€ ๋น„์ •์ƒ ํ”„๋กœ์„ธ์Šค Autoregressive (AR) Models Moving Average (MA) Models A...