Euisuk's Dev Log

ใ€Œ์„œ์ฟ  ๊ฐœ๋ฐœ๋…ธํŠธโญใ€

[๋จธ์‹ ๋Ÿฌ๋‹][์‹œ๊ณ„์—ด] AR, MA, ARMA, ARIMA์˜ ๋ชจ๋“  ๊ฒƒ - ๊ฐœ๋…ํŽธ

์˜ค๋Š˜์€ ๋จธ์‹ ๋Ÿฌ๋‹ ์‹œ๊ณ„์—ด์—์„œ ๊ฐ€์žฅ ๋งŽ์ด ์“ฐ์ด๋Š” AR, MA, ARMA, ARIMA์— ๋Œ€ํ•ด ์ •๋ฆฌํ•ด๋ณด๋Š” ์‹œ๊ฐ„์„ ๊ฐ€์ง€๋ ค๊ณ  ํ•ฉ๋‹ˆ๋‹ค. ํ•ด๋‹น ํฌ์ŠคํŠธ๋Š” ๊ณ ๋ ค๋Œ€ํ•™๊ต ๊น€์„ฑ๋ฒ” ๊ต์ˆ˜๋‹˜์˜ ๊ฐ•์˜๋ฅผ ๋ฐ”ํƒ•์œผ๋กœ ์ œ์ž‘๋˜์—ˆ์Šต๋‹ˆ๋‹ค. ๋ชฉ์ฐจ ์ •์ƒ ํ”„๋กœ์„ธ์Šค์™€ ๋น„์ •์ƒ ํ”„๋กœ์„ธ์Šค Autoregressive (AR) Models Moving Average (MA) Models A...

[๋จธ์‹ ๋Ÿฌ๋‹][์ฐจ์›์ถ•์†Œ] ๋ณ€์ˆ˜ ์ถ”์ถœ๋ฒ• - Principal Component Analysis (PCA)

๋ณธ ํฌ์ŠคํŠธ๋Š” ๊ณ ๋ ค๋Œ€ํ•™๊ต ๊ฐ•ํ•„์„ฑ ๊ต์ˆ˜๋‹˜์˜ ๊ฐ•์˜๋ฅผ ์ˆ˜๊ฐ• ํ›„ ์ •๋ฆฌ๋ฅผ ํ•œ ๊ฒƒ์ž…๋‹ˆ๋‹ค. ์ž‘์„ฑ ๋ฐ ์„ค๋ช…์˜ ํŽธ์˜๋ฅผ ์œ„ํ•ด ์•„๋ž˜๋Š” ํŽธํ•˜๊ฒŒ ์ž‘์„ฑํ•œ ์  ์–‘ํ•ด๋ถ€ํƒ๋“œ๋ฆฝ๋‹ˆ๋‹ค. Dimensionality Reduction Supervised Variable Extraction ์ฐจ์›์ถ•์†Œ๋Š”, ๋ชจ๋ธ๋ง์„ ํ•˜๊ธฐ ์œ„ํ•ด ๋‚ด๊ฐ€ ๊ฐ€์ง„ ๋ฐ์ดํ„ฐ์˜ ์ •๋ณด๋ฅผ ์ตœ๋Œ€ํ•œ ๋ณด์กดํ•˜๋ฉด์„œ, ํ›จ์”ฌ ๋” compa...

[๋จธ์‹ ๋Ÿฌ๋‹][์ฐจ์›์ถ•์†Œ] ๋ณ€์ˆ˜ ์„ ํƒ๋ฒ•

๋ณธ ํฌ์ŠคํŠธ๋Š” ๊ณ ๋ ค๋Œ€ํ•™๊ต ๊ฐ•ํ•„์„ฑ ๊ต์ˆ˜๋‹˜์˜ ๊ฐ•์˜๋ฅผ ์ˆ˜๊ฐ• ํ›„ ์ •๋ฆฌ๋ฅผ ํ•œ ๊ฒƒ์ž…๋‹ˆ๋‹ค. ์ž‘์„ฑ ๋ฐ ์„ค๋ช…์˜ ํŽธ์˜๋ฅผ ์œ„ํ•ด ์•„๋ž˜ ํฌ์ŠคํŠธ๋Š” ๋ฐ˜๋ง๋กœ ์ž‘์„ฑํ•œ ์  ์–‘ํ•ด๋ถ€ํƒ๋“œ๋ฆฝ๋‹ˆ๋‹ค. Dimensionality Reduction Curse of dimensionality ์ •์˜ ์ด๋ก ์ (theory)์œผ๋กœ๋Š” ๋ณ€์ˆ˜์˜ ๊ฐœ์ˆ˜๊ฐ€ ์ฆ๊ฐ€ํ•  ๋•Œ ๋ชจ๋ธ์˜ ์„ฑ๋Šฅ๋„ ์ฆ๊ฐ€ํ•œ๋‹ค. ํ•˜์ง€๋งŒ, ํ˜„์‹ค...

[ํŒŒ์ดํ† ์น˜] ํŒŒ์ดํ† ์น˜ ๊ธฐ์ดˆ ์š”์†Œ (Autograd๋ž€)

์ˆœ์ „ํŒŒ์™€ ์—ญ์ „ํŒŒ ์‹ ๊ฒฝ๋ง(Neural Network)์€ ์–ด๋–ค ์ž…๋ ฅ ๋ฐ์ดํ„ฐ์— ๋Œ€ํ•ด ์‹คํ–‰๋˜๋Š” ์ค‘์ฒฉ๋œ ํ•จ์ˆ˜๋“ค์˜ ์ง‘ํ•ฉ์ฒด์ž…๋‹ˆ๋‹ค. ์‹ ๊ฒฝ๋ง์„ ์•„๋ž˜ 2๋‹จ๊ณ„๋ฅผ ๊ฑฐ์ณ ํ•™์Šต๋ฉ๋‹ˆ๋‹ค : ์ˆœ์ „ํŒŒ(Forward Propagation) ์—ญ์ „ํŒŒ(Backward Propagation) Forward Propagation (์ˆœ์ „ํŒŒ) Forward Propagatio...

[๊ฟ€ํŒ] Velog ๊ธ€์”จ๋ฅผ ๋‚ด ๋งˆ์Œ๋Œ€๋กœ ๋ฐ”๊ฟ”๋ณด์ž! (์ƒ‰์ƒ, ํ˜•๊ด‘ํŽœ) ๐Ÿ”†

๐Ÿ’Œ Velog๋ฅผ ์—ด์‹ฌํžˆ ์ž‘์„ฑํ•˜๋˜ ๋„์ค‘ ๋ฌธ๋œฉ UI์—์„œ ์ œ๊ณต๋˜๋Š” ๊ธฐ๋Šฅ๋ง๊ณ  ๊ธ€์ž ์ƒ‰์ด๋‚˜ ํ˜•๊ด‘ํŽœ ๊ธฐ๋Šฅ์€ ์‚ฌ์šฉํ•  ์ˆ˜ ์—†์„๊นŒ ๊ณ ๋ฏผํ•˜๋˜ ์ค‘ ์ข‹์€ ๋ฐฉ๋ฒ•์„ ์ฐพ๊ฒŒ ๋˜์–ด ๊ฟ€ํŒ๐Ÿ ํ•œ๋ฒˆ ์ž‘์„ฑํ•ด๋ณด์•˜์Šต๋‹ˆ๋‹ค. ๊ธ€์ž ์ƒ‰์ƒ ๋ฐ”๊พธ๊ธฐ ๊ธ€์ž์˜ ์ƒ‰์ƒ์„ ๋ฐ”๊ฟ”์ฃผ๊ณ  ์‹ถ์„๋• ์•„๋ž˜์™€ ๊ฐ™์ด ๋ฐ”๊ฟ”์ค„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ๐Ÿ’ก **** ์•„๋ž˜์™€ ๊ฐ™์ด ์‚ฌ๊ณผ๋ฅผ ๋นจ๊ฐ›๊ฒŒ ๋ฌผ๋“ค์ด๊ณ  ์‹ถ๋‹ค๋ฉด! ์˜ค...

[ํŒŒ์ดํ† ์น˜] ํŒŒ์ดํ† ์น˜ ๊ธฐ์ดˆ ์š”์†Œ (ํ…์„œํŽธ)

์˜ค๋Š˜์€ ํŒŒ์ดํ† ์น˜๋ฅผ ๋‹ค๋ฃจ๊ธฐ ์œ„ํ•ด ์ค‘์š”ํ•œ ๊ธฐ์ดˆ ์ง€์‹๋“ค ์ค‘ ํ…์„œ์— ๋Œ€ํ•ด ๋‹ค๋ฃจ์–ด๋ณผ ์˜ˆ์ •์ž…๋‹ˆ๋‹ค. Source : https://hadrienj.github.io/posts/Deep-Learning-Book-Series-2.1-Scalars-Vectors-Matrices-and-Tensors/ ํ…์„œ ํ…์„œ๋Š” โ€˜๋ฐ์ดํ„ฐ๋ฅผ ํ‘œํ˜„ํ•˜๋Š” ๋‹จ์œ„โ€™์ž…๋‹ˆ๋‹ค. ...

[Paper Review] Transferring Inductive Bias Through Knowledge Distillation - (3/3)

์•ˆ๋…•ํ•˜์„ธ์š” :) ์˜ค๋Š˜์€ ์ง€๋‚œ๋ฒˆ ํฌ์ŠคํŒ…์— ์ด์–ด์„œ โ€œTransferring Inductive Bias Through Knowledge Distillationโ€ ๋…ผ๋ฌธ์— ๋Œ€ํ•œ ์ •๋ฆฌ๋ฅผ ์ด์–ด๋‚˜๊ฐ€ ๋ณด๋„๋ก ํ•˜๊ฒ ์Šต๋‹ˆ๋‹ค. ์ด์ „ ํฌ์ŠคํŒ…์—์„œ ๋ณธ ๋…ผ๋ฌธ์—์„œ ๋‹ค๋ฃจ๊ฒŒ ๋  ์ฃผ์š” ๊ฐœ๋…๋“ค์ธ Knowledge Distillation๊ณผ Inductive Bias์— ๋Œ€ํ•œ ์„ค๋ช…๊ณผ RNNs v...

[๊ฐœ๋…] CPU, GPU, ๊ทธ๋ฆฌ๊ณ  GPU ์›๋ฆฌ

CPU์™€ GPU ๋”ฅ๋Ÿฌ๋‹๊ณผ ๋จธ์‹ ๋Ÿฌ๋‹์„ ํ•™์Šตํ•˜๊ฑฐ๋‚˜ ์ž‘์—…ํ•  ๋•Œ GPU๋ฅผ ์‚ฌ์šฉํ•˜๋Š” ๊ฒƒ์€ ์ด์ œ ๋‹น์—ฐํ•˜๊ฒŒ ์—ฌ๊ฒจ์ง‘๋‹ˆ๋‹ค. ์‹ค์ œ๋กœ ์•„๋ž˜์™€ ๊ฐ™์€ ์ฝ”๋“œ๋กœ GPU๋‚˜ CPU๋ฅผ ์†์‰ฝ๊ฒŒ ์„ ํƒํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. 1 2 3 4 5 6 7 8 import torch # CUDA ์‚ฌ์šฉ ์—ฌ๋ถ€ ํ™•์ธ USE_CUDA = torch.cuda.is_available() print(USE_C...

[Paper Review] Visualizing Data using t-SNE

์„ ์ • ์ด์œ  ์˜ค๋Š˜ ๋ฆฌ๋ทฐ/๋ฒˆ์—ญ/๊ตฌํ˜„ํ•  ๋…ผ๋ฌธ์€ Visualizing Data using t-SNE์œผ๋กœ, 2008๋…„์— Geoffrey Hinton์ด ์ €์ž์ธ ๋…ผ๋ฌธ์ž…๋‹ˆ๋‹ค. t-SNE(t-Stochastic Nearest Neighbor)์€ ์ง€๊ธˆ๊นŒ์ง€๋„ ์‹œ๊ฐํ™”๋ฅผ ํ•˜๋Š” ๋ฐ ์ž์ฃผ ์‚ฌ์šฉ๋˜๋Š” ์•Œ๊ณ ๋ฆฌ์ฆ˜์ž…๋‹ˆ๋‹ค. ์ด๋Š” ๊ณ ์ฐจ์›์˜ ๋ฒกํ„ฐ๋กœ ํ‘œํ˜„๋˜๋Š” ๋ฐ์ดํ„ฐ ๊ฐ„์˜ neighbor st...

[Paper Review] Transferring Inductive Bias Through Knowledge Distillation - (2/3)

์•ˆ๋…•ํ•˜์„ธ์š” :) ์˜ค๋Š˜์€ ์ง€๋‚œ๋ฒˆ ํฌ์ŠคํŒ…์— ์ด์–ด์„œ โ€œTransferring Inductive Bias Through Knowledge Distillationโ€ ๋…ผ๋ฌธ์— ๋Œ€ํ•œ ์ •๋ฆฌ๋ฅผ ์ด์–ด๋‚˜๊ฐ€ ๋ณด๋„๋ก ํ•˜๊ฒ ์Šต๋‹ˆ๋‹ค. ์ด์ „ ํฌ์ŠคํŒ…์—์„œ ๋ณธ ๋…ผ๋ฌธ์—์„œ ๋‹ค๋ฃจ๊ฒŒ ๋  ์ฃผ์š” ๊ฐœ๋…๋“ค์ธ Knowledge Distillation๊ณผ Inductive Bias์— ๋Œ€ํ•œ ์„ค๋ช…์„ ํ•ด๋ณด์•˜๋Š”๋ฐ์š”...