Euisuk's Dev Log

ใ€Œ์„œ์ฟ  ๊ฐœ๋ฐœ๋…ธํŠธโญใ€

[๋จธ์‹ ๋Ÿฌ๋‹][์‹œ๊ณ„์—ด] AR, MA, ARMA, ARIMA์˜ ๋ชจ๋“  ๊ฒƒ - ๊ฐœ๋…ํŽธ

[๋จธ์‹ ๋Ÿฌ๋‹][์‹œ๊ณ„์—ด] AR, MA, ARMA, ARIMA์˜ ๋ชจ๋“  ๊ฒƒ - ๊ฐœ๋…ํŽธ ์˜ค๋Š˜์€ ๋จธ์‹ ๋Ÿฌ๋‹ ์‹œ๊ณ„์—ด์—์„œ ๊ฐ€์žฅ ๋งŽ์ด ์“ฐ์ด๋Š” AR, MA, ARMA, ARIMA์— ๋Œ€ํ•ด ์ •๋ฆฌํ•ด๋ณด๋Š” ์‹œ๊ฐ„์„ ๊ฐ€์ง€๋ ค๊ณ  ํ•ฉ๋‹ˆ๋‹ค. ํ•ด๋‹น ํฌ์ŠคํŠธ๋Š” ๊ณ ๋ ค๋Œ€ํ•™๊ต ๊น€์„ฑ๋ฒ” ๊ต์ˆ˜๋‹˜์˜ ๊ฐ•์˜๋ฅผ ๋ฐ”ํƒ•์œผ๋กœ ์ œ์ž‘๋˜์—ˆ์Šต๋‹ˆ๋‹ค. ๋ชฉ์ฐจ ์ •์ƒ ํ”„๋กœ์„ธ์Šค์™€ ๋น„์ •์ƒ ํ”„๋กœ์„ธ์Šค Autoregressive...

[๋จธ์‹ ๋Ÿฌ๋‹][์ฐจ์›์ถ•์†Œ] ๋ณ€์ˆ˜ ์ถ”์ถœ๋ฒ• - Principal Component Analysis (PCA)

[๋จธ์‹ ๋Ÿฌ๋‹][์ฐจ์›์ถ•์†Œ] ๋ณ€์ˆ˜ ์ถ”์ถœ๋ฒ• - Principal Component Analysis (PCA) ๋ณธ ํฌ์ŠคํŠธ๋Š” ๊ณ ๋ ค๋Œ€ํ•™๊ต ๊ฐ•ํ•„์„ฑ ๊ต์ˆ˜๋‹˜์˜ ๊ฐ•์˜๋ฅผ ์ˆ˜๊ฐ• ํ›„ ์ •๋ฆฌ๋ฅผ ํ•œ ๊ฒƒ์ž…๋‹ˆ๋‹ค. ์ž‘์„ฑ ๋ฐ ์„ค๋ช…์˜ ํŽธ์˜๋ฅผ ์œ„ํ•ด ์•„๋ž˜๋Š” ํŽธํ•˜๊ฒŒ ์ž‘์„ฑํ•œ ์  ์–‘ํ•ด๋ถ€ํƒ๋“œ๋ฆฝ๋‹ˆ๋‹ค. Dimensionality Reduction Supervised Variable Extracti...

[๋จธ์‹ ๋Ÿฌ๋‹][์ฐจ์›์ถ•์†Œ] ๋ณ€์ˆ˜ ์„ ํƒ๋ฒ•

[๋จธ์‹ ๋Ÿฌ๋‹][์ฐจ์›์ถ•์†Œ] ๋ณ€์ˆ˜ ์„ ํƒ๋ฒ• ๋ณธ ํฌ์ŠคํŠธ๋Š” ๊ณ ๋ ค๋Œ€ํ•™๊ต ๊ฐ•ํ•„์„ฑ ๊ต์ˆ˜๋‹˜์˜ ๊ฐ•์˜๋ฅผ ์ˆ˜๊ฐ• ํ›„ ์ •๋ฆฌ๋ฅผ ํ•œ ๊ฒƒ์ž…๋‹ˆ๋‹ค. ์ž‘์„ฑ ๋ฐ ์„ค๋ช…์˜ ํŽธ์˜๋ฅผ ์œ„ํ•ด ์•„๋ž˜ ํฌ์ŠคํŠธ๋Š” ๋ฐ˜๋ง๋กœ ์ž‘์„ฑํ•œ ์  ์–‘ํ•ด๋ถ€ํƒ๋“œ๋ฆฝ๋‹ˆ๋‹ค. Dimensionality Reduction Curse of dimensionality ์ •์˜ ์ด๋ก ์ (theory)์œผ๋กœ๋Š” ๋ณ€์ˆ˜์˜ ๊ฐœ์ˆ˜๊ฐ€ ์ฆ๊ฐ€ํ•  ๋•Œ ...

[ํŒŒ์ดํ† ์น˜] ํŒŒ์ดํ† ์น˜ ๊ธฐ์ดˆ ์š”์†Œ (Autograd๋ž€)

[ํŒŒ์ดํ† ์น˜] ํŒŒ์ดํ† ์น˜ ๊ธฐ์ดˆ ์š”์†Œ (Autograd๋ž€) ์ˆœ์ „ํŒŒ์™€ ์—ญ์ „ํŒŒ ์‹ ๊ฒฝ๋ง(Neural Network)์€ ์–ด๋–ค ์ž…๋ ฅ ๋ฐ์ดํ„ฐ์— ๋Œ€ํ•ด ์‹คํ–‰๋˜๋Š” ์ค‘์ฒฉ๋œ ํ•จ์ˆ˜๋“ค์˜ ์ง‘ํ•ฉ์ฒด์ž…๋‹ˆ๋‹ค. ์‹ ๊ฒฝ๋ง์„ ์•„๋ž˜ 2๋‹จ๊ณ„๋ฅผ ๊ฑฐ์ณ ํ•™์Šต๋ฉ๋‹ˆ๋‹ค : ์ˆœ์ „ํŒŒ(Forward Propagation) ์—ญ์ „ํŒŒ(Backward Propagation) Forward Propag...

[๊ฟ€ํŒ] Velog ๊ธ€์”จ๋ฅผ ๋‚ด ๋งˆ์Œ๋Œ€๋กœ ๋ฐ”๊ฟ”๋ณด์ž! (์ƒ‰์ƒ, ํ˜•๊ด‘ํŽœ) ๐Ÿ”†

[๊ฟ€ํŒ] Velog ๊ธ€์”จ๋ฅผ ๋‚ด ๋งˆ์Œ๋Œ€๋กœ ๋ฐ”๊ฟ”๋ณด์ž! (์ƒ‰์ƒ, ํ˜•๊ด‘ํŽœ) ๐Ÿ”† ๐Ÿ’Œ Velog๋ฅผ ์—ด์‹ฌํžˆ ์ž‘์„ฑํ•˜๋˜ ๋„์ค‘ ๋ฌธ๋œฉ UI์—์„œ ์ œ๊ณต๋˜๋Š” ๊ธฐ๋Šฅ๋ง๊ณ  ๊ธ€์ž ์ƒ‰์ด๋‚˜ ํ˜•๊ด‘ํŽœ ๊ธฐ๋Šฅ์€ ์‚ฌ์šฉํ•  ์ˆ˜ ์—†์„๊นŒ ๊ณ ๋ฏผํ•˜๋˜ ์ค‘ ์ข‹์€ ๋ฐฉ๋ฒ•์„ ์ฐพ๊ฒŒ ๋˜์–ด ๊ฟ€ํŒ๐Ÿ ํ•œ๋ฒˆ ์ž‘์„ฑํ•ด๋ณด์•˜์Šต๋‹ˆ๋‹ค. ๊ธ€์ž ์ƒ‰์ƒ ๋ฐ”๊พธ๊ธฐ ๊ธ€์ž์˜ ์ƒ‰์ƒ์„ ๋ฐ”๊ฟ”์ฃผ๊ณ  ์‹ถ์„๋• ์•„๋ž˜์™€ ๊ฐ™์ด ๋ฐ”๊ฟ”์ค„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ...

[ํŒŒ์ดํ† ์น˜] ํŒŒ์ดํ† ์น˜ ๊ธฐ์ดˆ ์š”์†Œ (ํ…์„œํŽธ)

[ํŒŒ์ดํ† ์น˜] ํŒŒ์ดํ† ์น˜ ๊ธฐ์ดˆ ์š”์†Œ (ํ…์„œํŽธ) ์˜ค๋Š˜์€ ํŒŒ์ดํ† ์น˜๋ฅผ ๋‹ค๋ฃจ๊ธฐ ์œ„ํ•ด ์ค‘์š”ํ•œ ๊ธฐ์ดˆ ์ง€์‹๋“ค ์ค‘ ํ…์„œ์— ๋Œ€ํ•ด ๋‹ค๋ฃจ์–ด๋ณผ ์˜ˆ์ •์ž…๋‹ˆ๋‹ค. Source : https://hadrienj.github.io/posts/Deep-Learning-Book-Series-2.1-Scalars-Vectors-Matrices-and-Tensors/ ํ…์„œ ...

[Paper Review] Transferring Inductive Bias Through Knowledge Distillation - (3/3)

[Paper Review] Transferring Inductive Bias Through Knowledge Distillation - (3/3) ์•ˆ๋…•ํ•˜์„ธ์š” :) ์˜ค๋Š˜์€ ์ง€๋‚œ๋ฒˆ ํฌ์ŠคํŒ…์— ์ด์–ด์„œ โ€œTransferring Inductive Bias Through Knowledge Distillationโ€ ๋…ผ๋ฌธ์— ๋Œ€ํ•œ ์ •๋ฆฌ๋ฅผ ์ด์–ด๋‚˜๊ฐ€ ๋ณด๋„๋ก ํ•˜๊ฒ ์Šต๋‹ˆ๋‹ค. ...

[๊ฐœ๋…] CPU, GPU, ๊ทธ๋ฆฌ๊ณ  GPU ์›๋ฆฌ

[๊ฐœ๋…] CPU, GPU, ๊ทธ๋ฆฌ๊ณ  GPU ์›๋ฆฌ CPU์™€ GPU ๋”ฅ๋Ÿฌ๋‹๊ณผ ๋จธ์‹ ๋Ÿฌ๋‹์„ ํ•™์Šตํ•˜๊ฑฐ๋‚˜ ์ž‘์—…ํ•  ๋•Œ GPU๋ฅผ ์‚ฌ์šฉํ•˜๋Š” ๊ฒƒ์€ ์ด์ œ ๋‹น์—ฐํ•˜๊ฒŒ ์—ฌ๊ฒจ์ง‘๋‹ˆ๋‹ค. ์‹ค์ œ๋กœ ์•„๋ž˜์™€ ๊ฐ™์€ ์ฝ”๋“œ๋กœ GPU๋‚˜ CPU๋ฅผ ์†์‰ฝ๊ฒŒ ์„ ํƒํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. 1 2 3 4 5 6 7 8 import torch # CUDA ์‚ฌ์šฉ ์—ฌ๋ถ€ ํ™•์ธ USE_CUDA = torch.cuda...

[Paper Review] Visualizing Data using t-SNE

[Paper Review] Visualizing Data using t-SNE ์„ ์ • ์ด์œ  ์˜ค๋Š˜ ๋ฆฌ๋ทฐ/๋ฒˆ์—ญ/๊ตฌํ˜„ํ•  ๋…ผ๋ฌธ์€ Visualizing Data using t-SNE์œผ๋กœ, 2008๋…„์— Geoffrey Hinton์ด ์ €์ž์ธ ๋…ผ๋ฌธ์ž…๋‹ˆ๋‹ค. t-SNE(t-Stochastic Nearest Neighbor)์€ ์ง€๊ธˆ๊นŒ์ง€๋„ ์‹œ๊ฐํ™”๋ฅผ ํ•˜๋Š” ๋ฐ ์ž์ฃผ ์‚ฌ์šฉ๋˜๋Š”...

[Paper Review] Transferring Inductive Bias Through Knowledge Distillation - (2/3)

[Paper Review] Transferring Inductive Bias Through Knowledge Distillation - (2/3) ์•ˆ๋…•ํ•˜์„ธ์š” :) ์˜ค๋Š˜์€ ์ง€๋‚œ๋ฒˆ ํฌ์ŠคํŒ…์— ์ด์–ด์„œ โ€œTransferring Inductive Bias Through Knowledge Distillationโ€ ๋…ผ๋ฌธ์— ๋Œ€ํ•œ ์ •๋ฆฌ๋ฅผ ์ด์–ด๋‚˜๊ฐ€ ๋ณด๋„๋ก ํ•˜๊ฒ ์Šต๋‹ˆ๋‹ค. ...