๋จธ์‹ ๋Ÿฌ๋‹

๋จธ์‹ ๋Ÿฌ๋‹ ์•Œ๊ณ ๋ฆฌ์ฆ˜, ๋ชจ๋ธ ํ‰๊ฐ€, ์‹ค์ „ ์ ์šฉ์„ ๋‹ค๋ฃฌ ๊ธ€.

๋จธ์‹ ๋Ÿฌ๋‹ ์•Œ๊ณ ๋ฆฌ์ฆ˜, ๋ชจ๋ธ ํ‰๊ฐ€, ์‹ค์ „ ์ ์šฉ์„ ๋‹ค๋ฃฌ ๊ธ€.

25 posts · ์•„์นด์ด๋ธŒ์—์„œ ํ•„ํ„ฐ๋กœ ๋ณด๊ธฐ

[๋จธ์‹ ๋Ÿฌ๋‹] ๋กœ์ง€์Šคํ‹ฑ ํšŒ๊ท€ ๋ชจ๋ธ (Logistic Regression)

1. ๊ฐœ์š” ์•ˆ๋…•ํ•˜์„ธ์š”! ์ด๋ฒˆ ๊ธ€์—์„œ๋Š” ๋จธ์‹ ๋Ÿฌ๋‹์˜ ์ฃผ์š” ๊ฐœ๋…์ธ ๋กœ์ง€์Šคํ‹ฑ ํšŒ๊ท€(Logistic Regression) ๋ชจ๋ธ๊ณผ ์˜ค์ฆˆ ๋น„(Odds Ratio)์— ๋Œ€ํ•ด์„œ ์‰ฝ๊ฒŒ ์ •๋ฆฌํ•ด๋ณด์•˜์Šต๋‹ˆ๋‹ค. ์นœ๊ตฌ์—๊ฒŒ ์ œ๋Œ€๋กœ ๋ฉ‹์ง€๊ฒŒ ์„ค๋ช…ํ•˜๊ณ  ์‹ถ์—ˆ๋Š”๋ฐ, ๋ญ”๊ฐ€ ๋‹ค์‹œ ํ•œ๋ฒˆ ์ •๋ฆฌ๊ฐ€ ํ•„์š”ํ•  ๊ฒƒ ๊ฐ™๋”๋ผ๊ณ ์š” ใ…Žใ…Ž ^^7 ๋กœ์ง€์Šคํ‹ฑ ํšŒ๊ท€ ๋ชจ๋ธ์€ ๋ฒ”์ฃผํ˜• ๋ฐ์ดํ„ฐ๋ฅผ ์˜ˆ์ธกํ•  ๋•Œ ์‚ฌ์šฉํ•˜๋Š” ํ†ต๊ณ„...

Unlearning : ๋จธ์‹ ๋Ÿฌ๋‹ ๋ชจ๋ธ๋„ '์žŠ์„ ์ˆ˜ ์žˆ๋‹ค'

๋”ฅ๋Ÿฌ๋‹๊ณผ ๋จธ์‹ ๋Ÿฌ๋‹์€ ์˜ค๋Š˜๋‚  ๋‹ค์–‘ํ•œ ๋ถ„์•ผ์—์„œ ๋†€๋ผ์šด ์„ฑ๊ณผ๋ฅผ ๊ฑฐ๋‘๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. ํ•˜์ง€๋งŒ ๋ชจ๋ธ์ด ํ•™์Šตํ•œ ์ •๋ณด ์ค‘ ๋ถˆํ•„์š”ํ•˜๊ฑฐ๋‚˜ ๋ฏผ๊ฐํ•œ ์ •๋ณด๋ฅผ ์‚ญ์ œํ•ด์•ผ ํ•˜๋Š” ์ƒํ™ฉ๋„ ๋ฐœ์ƒํ•ฉ๋‹ˆ๋‹ค. ์˜ˆ๋ฅผ ๋“ค์–ด, ๊ฐœ์ธ์ •๋ณด ๋ณดํ˜ธ ๊ทœ์ •์— ๋”ฐ๋ผ ๋ชจ๋ธ์ด ํŠน์ • ์‚ฌ์šฉ์ž์˜ ๋ฐ์ดํ„ฐ๋ฅผ ์‚ญ์ œํ•ด์•ผ ํ•˜๊ฑฐ๋‚˜, ํ•™์Šต ๊ณผ์ •์—์„œ ๋ฐœ์ƒํ•œ ํŽธํ–ฅ(Bias)์„ ๊ต์ •ํ•ด์•ผ ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ์ด๋Ÿฌํ•œ ํ•„์š”๋ฅผ ์ถฉ์กฑ...

[CS294] Deep Unsupervised Learning: Introduction

๋‹ค์Œ์€ ์•„๋ž˜ โ€œBerkeley CS294 ๊ฐ•์˜โ€์— ๋Œ€ํ•œ ์š”์•ฝ ๋ฐ ํ•„๊ธฐ ๋‚ด์šฉ์„ ์ •๋ฆฌํ•œ ๊ฒƒ์ž…๋‹ˆ๋‹ค. ํ‹€๋ฆฐ ๋‚ด์šฉ์ด ์žˆ๋‹ค๋ฉด ๋Œ“๊ธ€ ๋ถ€ํƒ๋“œ๋ฆฝ๋‹ˆ๋‹ค ๐Ÿ™Œ Course : CS294-158 SP24 Deep Unsupervised Learning Instructor: Pieter Abbeel Lecture # : L1. Introduction ๋ณธ ๊ฐ•์˜๋Š”...

[NLP] 2. Steps of Text Analytics

Steps of Text Analytics ํ…์ŠคํŠธ ๋ถ„์„์€ ๋น„์ •ํ˜• ํ…์ŠคํŠธ ๋ฐ์ดํ„ฐ๋ฅผ ๊ตฌ์กฐํ™”ํ•˜๊ณ  ์œ ์˜๋ฏธํ•œ ์ •๋ณด๋ฅผ ์ถ”์ถœํ•˜๊ธฐ ์œ„ํ•œ ์ผ๋ จ์˜ ๊ณผ์ •์ž…๋‹ˆ๋‹ค. ํ•ด๋‹น ํฌ์ŠคํŠธ์—์„œ๋Š” ํ…์ŠคํŠธ ๋ถ„์„์˜ ์ฃผ์š” ๋‹จ๊ณ„๋ฅผ ์ˆœ์ฐจ์ ์œผ๋กœ ์†Œ๊ฐœํ•˜์—ฌ, ๊ฐ ๋‹จ๊ณ„์—์„œ ์ˆ˜ํ–‰๋˜๋Š” ์ž‘์—…๊ณผ ๊ทธ ์ค‘์š”์„ฑ์„ ์„ค๋ช…ํ•˜๊ฒ ์Šต๋‹ˆ๋‹ค. โ‘  STEP 1. ์ •์˜ ๋ฐ ๋ฐ์ดํ„ฐ ์ˆ˜์ง‘(Define & Collect) ...

[NLP] 1. Introduction to Text Analytics

Introduction to Text Analytics Text Analytics๋Š” ๋ฌธ์„œ(text)์™€ ๊ฐ™์€ ๋น„์ •ํ˜• ๋ฐ์ดํ„ฐ๋ฅผ ๋ถ„์„ํ•˜์—ฌ ๊ทธ ์†์— ํฌํ•จ๋œ ์˜๋ฏธ ์žˆ๋Š” ์ •๋ณด๋ฅผ ์ถ”์ถœํ•˜๋Š” ๊ณผ์ •์„ ์˜๋ฏธํ•ฉ๋‹ˆ๋‹ค. ์ด๋Š” ์ž์—ฐ์–ด ์ฒ˜๋ฆฌ(Natural Language Processing, NLP) ๊ธฐ์ˆ ์„ ํ™œ์šฉํ•˜์—ฌ ๋‹ค์–‘ํ•œ ํ˜•ํƒœ์˜ ํ…์ŠคํŠธ ๋ฐ์ดํ„ฐ๋ฅผ ์ฒ˜๋ฆฌํ•˜๊ณ  ๋ถ„์„ํ•จ์œผ๋กœ์จ ...

Prophet์„ ํ™œ์šฉํ•œ ์‹œ๊ณ„์—ด ์˜ˆ์ธก๐Ÿ”ญ

Prophet ์†Œ๊ฐœ Facebook Prophet์€ ์‹œ๊ณ„์—ด ๋ฐ์ดํ„ฐ์˜ ์˜ˆ์ธก์„ ์œ„ํ•ด Facebook์—์„œ ๊ฐœ๋ฐœํ•œ ์˜คํ”ˆ์†Œ์Šค ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ์ž…๋‹ˆ๋‹ค. Prophet์€ ์ž๋™ํ™”๋œ ์ด์ƒ ํƒ์ง€ ๋ฐ ๊ณ„์ ˆ์„ฑ ๋ถ„์„์„ ์ง€์›ํ•˜๋ฉฐ, ํŠนํžˆ ๋น„์ฆˆ๋‹ˆ์Šค ์˜ˆ์ธก(์˜ˆ: ๋งค์ถœ, ์‚ฌ์šฉ์ž ์ˆ˜, ์›น ํŠธ๋ž˜ํ”ฝ ๋“ฑ)์— ์œ ์šฉํ•ฉ๋‹ˆ๋‹ค. ๋งํฌ: https://facebook.github.io/prophe...

[๊ฐœ๋…์ •๋ฆฌ] ์‹œ๊ณ„์—ด ์ธ๊ณผ๊ด€๊ณ„ ๋ถ„์„: Granger Causality

์•ˆ๋…•ํ•˜์„ธ์š”๐Ÿ˜Š ์ง€๋‚œ ๋ฒˆ ํฌ์ŠคํŠธ์—์„œ โ€œ์ธ๊ณผ๊ด€๊ณ„์™€ ์ƒ๊ด€๊ด€๊ณ„์˜ ๊ฐœ๋…โ€(๋งํฌ)์— ๋Œ€ํ•ด์„œ ์‚ดํŽด๋ณด์•˜๋Š”๋ฐ์š”. ์˜ค๋Š˜์€ ์‹œ๊ณ„์—ด ๋ถ„์„์˜ ํ•ต์‹ฌ ๊ฐœ๋… ์ค‘ ํ•˜๋‚˜์ธ โ€˜๊ทธ๋žœ์ € ์ธ๊ณผ๊ด€๊ณ„(Granger causality)โ€™์— ๋Œ€ํ•ด ์•Œ์•„๋ณด๊ณ , ์ด๋ฅผ ์‹ค์ œ ๋ฐ์ดํ„ฐ์— ์ ์šฉํ•ด๋ณด๋Š” ์‹œ๊ฐ„์„ ๊ฐ€์ ธ๋ณด๊ฒ ์Šต๋‹ˆ๋‹ค. ์‹ค์Šต์— ์‚ฌ์šฉํ•  ๋ฐ์ดํ„ฐ๋Š” Kaggle ๋ฐ์ดํ„ฐ ์ค‘ ํ•˜๋‚˜์ธ Advertising Sales ...

[๊ฐœ๋…์ •๋ฆฌ] ๋นˆ๋„์ฃผ์˜(Frequentist) vs ๋ฒ ์ด์ง€์•ˆ(Bayesian)

Bayesian ํ™•๋ฅ ๊ณผ Frequentist ํ™•๋ฅ  ์•ˆ๋…•ํ•˜์„ธ์š”!๐Ÿ™Œ ์˜ค๋Š˜์€ ํ†ต๊ณ„ํ•™์˜ ๋‘ ๊ฐ€์ง€ ์ฃผ์š” ์ ‘๊ทผ๋ฒ•์ธ Bayesian ํ™•๋ฅ ๊ณผ Frequentist ํ™•๋ฅ ์— ๋Œ€ํ•ด ์ž์„ธํžˆ ์•Œ์•„๋ณด๊ฒ ์Šต๋‹ˆ๋‹ค. ์ด ๊ฐœ๋…๋“ค์€ ๋จธ์‹ ๋Ÿฌ๋‹๊ณผ ๋”ฅ๋Ÿฌ๋‹์—์„œ ์ค‘์š”ํ•œ ์—ญํ• ์„ ํ•˜๋ฏ€๋กœ, ๊นŠ์ด ์žˆ๋Š” ์ดํ•ด๊ฐ€ ํ•„์š”ํ•ฉ๋‹ˆ๋‹ค. 0. ํ™•๋ฅ  (Probability) ๊ฐœ๋… ํ™•๋ฅ ์€ ๋ถˆํ™•์‹คํ•œ ์‚ฌ๊ฑด์˜ ๋ฐœ์ƒ ๊ฐ€๋Šฅ์„ฑ...

[ํŠธ๋ฆฌ] ํŠธ๋ฆฌ ๊ธฐ๋ฐ˜ ML ์•Œ๊ณ ๋ฆฌ์ฆ˜

ํŠธ๋ฆฌ ๊ธฐ๋ฐ˜ ML ์•Œ๊ณ ๋ฆฌ์ฆ˜ ํŠธ๋ฆฌ ๊ธฐ๋ฐ˜ ๋จธ์‹ ๋Ÿฌ๋‹(ML) ์•Œ๊ณ ๋ฆฌ์ฆ˜์€ ๋ฐ์ดํ„ฐ์˜ ํŠน์ง•์„ ๊ธฐ๋ฐ˜์œผ๋กœ ํŠธ๋ฆฌ๋ฅผ ์ƒ์„ฑํ•˜์—ฌ ์˜ˆ์ธก(Regression) ๋˜๋Š” ๋ถ„๋ฅ˜(Classification)๋ฅผ ์ˆ˜ํ–‰ํ•˜๋Š” ๋ฐฉ๋ฒ•์ž…๋‹ˆ๋‹ค. ์ด ์•Œ๊ณ ๋ฆฌ์ฆ˜์€ ๋ฃจํŠธ ๋…ธ๋“œ์—์„œ ์‹œ์ž‘ํ•˜์—ฌ ๋‚ด๋ถ€ ๋…ธ๋“œ์—์„œ ๋ฐ์ดํ„ฐ๋ฅผ ๋ถ„ํ• ํ•˜๊ณ , ๋ฆฌํ”„ ๋…ธ๋“œ์—์„œ ์ตœ์ข… ์˜ˆ์ธก๊ฐ’์„ ์‚ฐ์ถœํ•ฉ๋‹ˆ๋‹ค. ํŠธ๋ฆฌ ๊ธฐ๋ฐ˜ ์•Œ๊ณ ๋ฆฌ์ฆ˜์€ ๋ฐ์ดํ„ฐ์˜ ๊ตฌ์กฐ๋ฅผ ์‹œ๊ฐ์ ์œผ...

[์ดํƒ] ํ†ต๊ณ„ ๊ธฐ๋ฐ˜ ์ด์ƒํƒ์ง€ ์•Œ๊ณ ๋ฆฌ์ฆ˜

ํ†ต๊ณ„ ๊ธฐ๋ฐ˜ ์ด์ƒํƒ์ง€ ํ†ต๊ณ„์  ์ ‘๊ทผ ๋ฐฉ์‹์„ ์‚ฌ์šฉํ•˜์—ฌ ๋ชจ๋ธ์ด ๋ฐ์ดํ„ฐ์˜ โ€˜์ •์ƒ์ ์ธโ€™ ํ–‰๋™์„ ํ•™์Šตํ•˜๊ณ  ํ†ต๊ณ„์ ์œผ๋กœ ์ด๋ก€์ ์ธ ํ–‰๋™์„ ๋ณด์ด๋Š” ๋ฐ์ดํ„ฐ ํฌ์ธํŠธ๋ฅผ ์ด์ƒ์น˜๋กœ ์‹๋ณ„ํ•ฉ๋‹ˆ๋‹ค. GMM (Gaussian Mixture Models) ๋งํฌ: https://scikit-learn.org/stable/modules/generated/sklearn.mixture...

[์ดํƒ] ์•™์ƒ๋ธ” ๊ธฐ๋ฐ˜ ์ด์ƒํƒ์ง€ ์•Œ๊ณ ๋ฆฌ์ฆ˜

์•™์ƒ๋ธ” ๊ธฐ๋ฐ˜ ์ด์ƒํƒ์ง€ ์•™์ƒ๋ธ” ๊ธฐ๋ฐ˜ ์•Œ๊ณ ๋ฆฌ์ฆ˜์€ ์—ฌ๋Ÿฌ ๊ฐœ์˜ ์˜์‚ฌ๊ฒฐ์ • ๊ธฐ๋ฐ˜ ๋ชจ๋ธ์„ ์กฐํ•ฉํ•˜์—ฌ ์ด์ƒ์น˜๋ฅผ ํƒ์ง€ํ•ฉ๋‹ˆ๋‹ค. ์ด ๋ฐฉ๋ฒ•์€ ์ผ๋ฐ˜์ ์œผ๋กœ ๋†’์€ ์ •ํ™•๋„๋ฅผ ์ œ๊ณตํ•ฉ๋‹ˆ๋‹ค. Isolation Forest ๋งํฌ: https://scikit-learn.org/stable/modules/generated/sklearn.ensemble.IsolationForest....

[์ดํƒ] ๋ฐ€๋„ ๊ธฐ๋ฐ˜ ์ด์ƒํƒ์ง€ ์•Œ๊ณ ๋ฆฌ์ฆ˜

๋ฐ€๋„ ๊ธฐ๋ฐ˜ ์ด์ƒํƒ์ง€ ๋ฐ€๋„ ๊ธฐ๋ฐ˜ ์•Œ๊ณ ๋ฆฌ์ฆ˜์€ ๋ฐ์ดํ„ฐ ํฌ์ธํŠธ ๊ฐ„์˜ ์ง€์—ญ์  ๋ฐ€๋„๋ฅผ ๊ธฐ๋ฐ˜์œผ๋กœ ์ด์ƒ์น˜๋ฅผ ํƒ์ง€ํ•ฉ๋‹ˆ๋‹ค. ์ด๋Ÿฌํ•œ ์•Œ๊ณ ๋ฆฌ์ฆ˜์€ ๋ฐ์ดํ„ฐ ๋ถ„ํฌ๊ฐ€ ๋ถˆ๊ท ์ผํ•œ ๊ฒฝ์šฐ์—๋„ ์ž˜ ์ž‘๋™ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. DBSCAN ๋งํฌ: https://scikit-learn.org/stable/modules/generated/sklearn.cluster.DBSCAN.html ...

[์ดํƒ] ๋‚ด๊ฐ€ ๋ณด๋ ค๊ณ  ์ •๋ฆฌํ•œ ML ์ด์ƒํƒ์ง€

์ด์ƒํƒ์ง€ ์ด์ƒํƒ์ง€๋Š” ๋ฐ์ดํ„ฐ์…‹์—์„œ ์ •์ƒ์ ์ธ ํŒจํ„ด์—์„œ ๋ฒ—์–ด๋‚œ ๋ฐ์ดํ„ฐ ํฌ์ธํŠธ๋ฅผ ์‹๋ณ„ํ•˜๋Š” ๊ณผ์ •์ž…๋‹ˆ๋‹ค. ์ด๋Ÿฌํ•œ ์ด์ƒ์น˜๋Š” ๋ฐ์ดํ„ฐ์˜ ๋ถ„ํฌ๋‚˜ ํŠน์„ฑ์—์„œ ๋ˆˆ์— ๋„๊ฒŒ ๋‹ค๋ฅธ ์ ๋“ค์„ ๋‚˜ํƒ€๋‚ด๋ฉฐ, ์ข…์ข… ์˜ค๋ฅ˜, ์‚ฌ๊ธฐ, ๊ฒฐํ•จ ๋“ฑ์˜ ๋ฌธ์ œ๋ฅผ ๋‚˜ํƒ€๋‚ผ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ๋”ฐ๋ผ์„œ ์ด์ƒํƒ์ง€๋Š” ๋ฐ์ดํ„ฐ ๋ถ„์„, ํ’ˆ์งˆ ๊ด€๋ฆฌ, ๋ณด์•ˆ ๋“ฑ ๋‹ค์–‘ํ•œ ๋ถ„์•ผ์—์„œ ์ค‘์š”ํ•œ ์—ญํ• ์„ ํ•ฉ๋‹ˆ๋‹ค. ์ด์ƒํƒ์ง€ ๋ฐฉ๋ฒ•๋ก ์— ๋”ฐ๋ฅธ ...

[์ดํƒ] ๊ฒฐ์ • ๊ฒฝ๊ณ„ ๊ธฐ๋ฐ˜ ์ด์ƒํƒ์ง€ ์•Œ๊ณ ๋ฆฌ์ฆ˜

๊ฒฐ์ • ๊ฒฝ๊ณ„ ๊ธฐ๋ฐ˜ ์ด์ƒํƒ์ง€ ๊ฒฐ์ • ๊ฒฝ๊ณ„ ๊ธฐ๋ฐ˜ ์•Œ๊ณ ๋ฆฌ์ฆ˜์€ ๋ฐ์ดํ„ฐ์˜ ๋ถ„ํฌ๋ฅผ ํ•™์Šตํ•˜์—ฌ ๋ช…ํ™•ํ•œ ๊ฒฝ๊ณ„๋ฅผ ํ˜•์„ฑํ•˜๊ณ , ์ด ๊ฒฝ๊ณ„๋ฅผ ๋ฒ—์–ด๋‚˜๋Š” ์ ๋“ค์„ ์ด์ƒ์น˜๋กœ ๊ฐ„์ฃผํ•ฉ๋‹ˆ๋‹ค. OCSVM (One-Class SVM) ๋งํฌ: https://scikit-learn.org/stable/modules/generated/sklearn.svm.OneClassSVM.html ...

[์ดํƒ] ๊ฑฐ๋ฆฌ ๊ธฐ๋ฐ˜ ์ด์ƒํƒ์ง€ ์•Œ๊ณ ๋ฆฌ์ฆ˜

๊ฑฐ๋ฆฌ ๊ธฐ๋ฐ˜ ์•Œ๊ณ ๋ฆฌ์ฆ˜ ๊ฑฐ๋ฆฌ ๊ธฐ๋ฐ˜ ์•Œ๊ณ ๋ฆฌ์ฆ˜์€ ๋ฐ์ดํ„ฐ ํฌ์ธํŠธ ๊ฐ„์˜ ๊ฑฐ๋ฆฌ๋ฅผ ๊ธฐ๋ฐ˜์œผ๋กœ ์ด์ƒ์น˜๋ฅผ ํƒ์ง€ํ•ฉ๋‹ˆ๋‹ค. ๋ฐ์ดํ„ฐ ํฌ์ธํŠธ๊ฐ€ ๋‹ค๋ฅธ ํฌ์ธํŠธ์™€์˜ ๊ฑฐ๋ฆฌ๊ฐ€ ๋ฉ€๋‹ค๋ฉด ์ด์ƒ์น˜๋กœ ๊ฐ„์ฃผ๋ฉ๋‹ˆ๋‹ค. K-Means Clustering ๊ธฐ๋ฐ˜ ์ด์ƒํƒ์ง€ ๋งํฌ: https://scikit-learn.org/stable/modules/generated/sklearn.cluster.K...

[๊ฐœ๋…] MLOps vs AIOps

MLOps๋ž€ ๋ฌด์—‡์ธ๊ฐ€? MLOps๋Š” ๊ธฐ๊ณ„ ํ•™์Šต(ML) ์‹œ์Šคํ…œ์˜ ๊ฐœ๋ฐœ๊ณผ ๋ฐฐํฌ๋ฅผ ํ†ตํ•ฉํ•˜๋Š” ํ”„๋ ˆ์ž„์›Œํฌ์ž…๋‹ˆ๋‹ค. ์ด๋Š” ML ๋ชจ๋ธ์„ ์ง€์†์ ์œผ๋กœ ์ƒ์‚ฐ์— ํˆฌ์ž…ํ•˜๊ธฐ ์œ„ํ•ด ํ‘œ์ค€ํ™”ํ•˜๊ณ  ๊ฐ„์†Œํ™”ํ•˜๋Š” ์—ญํ• ์„ ํ•ฉ๋‹ˆ๋‹ค. MLOps์˜ ์ฃผ์š” ๋‹จ๊ณ„๋Š” ๋‹ค์Œ๊ณผ ๊ฐ™์Šต๋‹ˆ๋‹ค: ๋ฐ์ดํ„ฐ ์ถ”์ถœ: ๋‹ค์–‘ํ•œ ์ถœ์ฒ˜์—์„œ ๋ฐ์ดํ„ฐ ํ†ตํ•ฉ ํƒ์ƒ‰์  ๋ฐ์ดํ„ฐ ๋ถ„์„: ๋ฐ์ดํ„ฐ์˜ ๊ธฐ๋ณธ ์†์„ฑ ์ดํ•ด ๋ฐ์ดํ„ฐ ์ค€๋น„:...

[๋จธ์‹ ๋Ÿฌ๋‹][์ฐจ์›์ถ•์†Œ] ๋ณ€์ˆ˜ ์ถ”์ถœ๋ฒ• - Multi-Dimensional Scaling (MDS)

๋ณธ ํฌ์ŠคํŠธ๋Š” ๊ณ ๋ ค๋Œ€ํ•™๊ต ๊ฐ•ํ•„์„ฑ ๊ต์ˆ˜๋‹˜์˜ ๊ฐ•์˜๋ฅผ ์ˆ˜๊ฐ• ํ›„ ์ •๋ฆฌ๋ฅผ ํ•œ ๊ฒƒ์ž…๋‹ˆ๋‹ค. ์ž‘์„ฑ ๋ฐ ์„ค๋ช…์˜ ํŽธ์˜๋ฅผ ์œ„ํ•ด ์•„๋ž˜๋Š” ํŽธํ•˜๊ฒŒ ์ž‘์„ฑํ•œ ์  ์–‘ํ•ด๋ถ€ํƒ๋“œ๋ฆฝ๋‹ˆ๋‹ค. Dimensionality Reduction Supervised Variable Extraction ์ฐจ์›์ถ•์†Œ๋Š”, ๋ชจ๋ธ๋ง์„ ํ•˜๊ธฐ ์œ„ํ•ด ๋‚ด๊ฐ€ ๊ฐ€์ง„ ๋ฐ์ดํ„ฐ์˜ ์ •๋ณด๋ฅผ ์ตœ๋Œ€ํ•œ ๋ณด์กดํ•˜๋ฉด์„œ, ํ›จ์”ฌ ๋” compac...

[๋จธ์‹ ๋Ÿฌ๋‹] ์ด์ƒ ํƒ์ง€ ๊ฐœ์š” ๋ฐ ๋ฐ€๋„ ๊ธฐ๋ฐ˜ ์ด์ƒ์น˜ํƒ์ง€

๋ณธ ํฌ์ŠคํŠธ๋Š” ๊ณ ๋ ค๋Œ€ํ•™๊ต ๊ฐ•ํ•„์„ฑ ๊ต์ˆ˜๋‹˜์˜ ๊ฐ•์˜๋ฅผ ์ˆ˜๊ฐ• ํ›„ ์ •๋ฆฌ๋ฅผ ํ•œ ๊ฒƒ์ž…๋‹ˆ๋‹ค. ์ž‘์„ฑ ๋ฐ ์„ค๋ช…์˜ ํŽธ์˜๋ฅผ ์œ„ํ•ด ์•„๋ž˜ ํฌ์ŠคํŠธ๋Š” ๋ฐ˜๋ง๋กœ ์ž‘์„ฑํ•œ ์  ์–‘ํ•ด๋ถ€ํƒ๋“œ๋ฆฝ๋‹ˆ๋‹ค. Abnormal Data๋ž€ Anomaly Data๋Š” ๋‹ค์Œ๊ณผ ๊ฐ™์ด Hawkins์™€ Harmeling์— ์˜ํ•ด ์ •์˜๋œ๋‹ค. Observations that deviate so much f...

[๋จธ์‹ ๋Ÿฌ๋‹] ๊ฑฐ๋ฆฌโ€ข๊ตฐ์ง‘โ€ข์„œํฌํŠธ๋ฒกํ„ฐ ๊ธฐ๋ฐ˜ ์ด์ƒํƒ์ง€ ๊ธฐ๋ฒ•

๋ณธ ํฌ์ŠคํŠธ๋Š” ๊ณ ๋ ค๋Œ€ํ•™๊ต ๊ฐ•ํ•„์„ฑ ๊ต์ˆ˜๋‹˜์˜ ๊ฐ•์˜๋ฅผ ์ˆ˜๊ฐ• ํ›„ ์ •๋ฆฌ๋ฅผ ํ•œ ๊ฒƒ์ž…๋‹ˆ๋‹ค. ์ž‘์„ฑ ๋ฐ ์„ค๋ช…์˜ ํŽธ์˜๋ฅผ ์œ„ํ•ด ์•„๋ž˜ ํฌ์ŠคํŠธ๋Š” ๋ฐ˜๋ง๋กœ ์ž‘์„ฑํ•œ ์  ์–‘ํ•ด๋ถ€ํƒ๋“œ๋ฆฝ๋‹ˆ๋‹ค. ๊ฑฐ๋ฆฌ ๊ธฐ๋ฐ˜ ์ด์ƒ์น˜ํƒ์ง€ K-Nearest Neighbor-based Anomaly Detection ๊ฐ ๋ฐ์ดํ„ฐ์— ๋Œ€ํ•œ Anomaly Score๋ฅผ K๊ฐœ์˜ ๊ทผ์ ‘ ์ด์›ƒ๊นŒ์ง€์˜ ๊ฑฐ๋ฆฌ๋ฅผ ์ด์šฉํ•˜์—ฌ ๊ณ„์‚ฐ...

[๋จธ์‹ ๋Ÿฌ๋‹][์‹œ๊ณ„์—ด] AR, MA, ARMA, ARIMA์˜ ๋ชจ๋“  ๊ฒƒ - ์‹ค์ŠตํŽธ

๋ณธ ํฌ์ŠคํŒ…์€ ์‹ค์ œ ๋ฐ์ดํ„ฐ๋ฅผ ํ™œ์šฉํ•œ ์‹œ๊ณ„์—ด ๋ถ„์„์˜ ์ „๋ฐ˜์ ์ธ ํ”„๋กœ์„ธ์Šค ๊ณผ์ •์„ ๋‹ด๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. ๋ถ„์„ ํŒ์ด๋‚˜ ํ”ผ๋“œ๋ฐฑ์€ ์–ธ์ œ๋‚˜ ํ™˜์˜์ž…๋‹ˆ๋‹ค!! ๐Ÿ™‡โ€โ™‚๏ธ ๋ถ„์„์˜ ์ˆœ์„œ๋Š” ์•„๋ž˜์™€ ๊ฐ™์Šต๋‹ˆ๋‹ค. ํ•ด๋‹น ๋ถ„์„์€ ์•ž์—์„œ ๋‹ค๋ฃฌ ์‹œ๊ณ„์—ด ๊ฐœ๋…์„ ๊ธฐ๋ฐ˜์œผ๋กœ ๋ถ„์„์„ ์ˆ˜ํ–‰ํ•œ ๊ฒƒ์ด๋ฏ€๋กœ ๊ฐœ๋…์„ ์ฐพ์•„๋ณด๊ณ  ์‹ถ๋‹ค๋ฉด ์ œ ์ด์ „ ํฌ์ŠคํŠธ์—์„œ ํ™•์ธํ•˜์‹ค ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ์ฐธ๊ณ  ๋ฐ์ดํ„ฐ ์„ ์ • ๋ฐ ์ „์ฒ˜๋ฆฌ ...

[๋จธ์‹ ๋Ÿฌ๋‹][์‹œ๊ณ„์—ด] AR, MA, ARMA, ARIMA์˜ ๋ชจ๋“  ๊ฒƒ - ๊ฐœ๋…ํŽธ

์˜ค๋Š˜์€ ๋จธ์‹ ๋Ÿฌ๋‹ ์‹œ๊ณ„์—ด์—์„œ ๊ฐ€์žฅ ๋งŽ์ด ์“ฐ์ด๋Š” AR, MA, ARMA, ARIMA์— ๋Œ€ํ•ด ์ •๋ฆฌํ•ด๋ณด๋Š” ์‹œ๊ฐ„์„ ๊ฐ€์ง€๋ ค๊ณ  ํ•ฉ๋‹ˆ๋‹ค. ํ•ด๋‹น ํฌ์ŠคํŠธ๋Š” ๊ณ ๋ ค๋Œ€ํ•™๊ต ๊น€์„ฑ๋ฒ” ๊ต์ˆ˜๋‹˜์˜ ๊ฐ•์˜๋ฅผ ๋ฐ”ํƒ•์œผ๋กœ ์ œ์ž‘๋˜์—ˆ์Šต๋‹ˆ๋‹ค. ๋ชฉ์ฐจ ์ •์ƒ ํ”„๋กœ์„ธ์Šค์™€ ๋น„์ •์ƒ ํ”„๋กœ์„ธ์Šค Autoregressive (AR) Models Moving Average (MA) Models A...

[๋จธ์‹ ๋Ÿฌ๋‹][์ฐจ์›์ถ•์†Œ] ๋ณ€์ˆ˜ ์ถ”์ถœ๋ฒ• - Principal Component Analysis (PCA)

๋ณธ ํฌ์ŠคํŠธ๋Š” ๊ณ ๋ ค๋Œ€ํ•™๊ต ๊ฐ•ํ•„์„ฑ ๊ต์ˆ˜๋‹˜์˜ ๊ฐ•์˜๋ฅผ ์ˆ˜๊ฐ• ํ›„ ์ •๋ฆฌ๋ฅผ ํ•œ ๊ฒƒ์ž…๋‹ˆ๋‹ค. ์ž‘์„ฑ ๋ฐ ์„ค๋ช…์˜ ํŽธ์˜๋ฅผ ์œ„ํ•ด ์•„๋ž˜๋Š” ํŽธํ•˜๊ฒŒ ์ž‘์„ฑํ•œ ์  ์–‘ํ•ด๋ถ€ํƒ๋“œ๋ฆฝ๋‹ˆ๋‹ค. Dimensionality Reduction Supervised Variable Extraction ์ฐจ์›์ถ•์†Œ๋Š”, ๋ชจ๋ธ๋ง์„ ํ•˜๊ธฐ ์œ„ํ•ด ๋‚ด๊ฐ€ ๊ฐ€์ง„ ๋ฐ์ดํ„ฐ์˜ ์ •๋ณด๋ฅผ ์ตœ๋Œ€ํ•œ ๋ณด์กดํ•˜๋ฉด์„œ, ํ›จ์”ฌ ๋” compa...

[๋จธ์‹ ๋Ÿฌ๋‹][์ฐจ์›์ถ•์†Œ] ๋ณ€์ˆ˜ ์„ ํƒ๋ฒ•

๋ณธ ํฌ์ŠคํŠธ๋Š” ๊ณ ๋ ค๋Œ€ํ•™๊ต ๊ฐ•ํ•„์„ฑ ๊ต์ˆ˜๋‹˜์˜ ๊ฐ•์˜๋ฅผ ์ˆ˜๊ฐ• ํ›„ ์ •๋ฆฌ๋ฅผ ํ•œ ๊ฒƒ์ž…๋‹ˆ๋‹ค. ์ž‘์„ฑ ๋ฐ ์„ค๋ช…์˜ ํŽธ์˜๋ฅผ ์œ„ํ•ด ์•„๋ž˜ ํฌ์ŠคํŠธ๋Š” ๋ฐ˜๋ง๋กœ ์ž‘์„ฑํ•œ ์  ์–‘ํ•ด๋ถ€ํƒ๋“œ๋ฆฝ๋‹ˆ๋‹ค. Dimensionality Reduction Curse of dimensionality ์ •์˜ ์ด๋ก ์ (theory)์œผ๋กœ๋Š” ๋ณ€์ˆ˜์˜ ๊ฐœ์ˆ˜๊ฐ€ ์ฆ๊ฐ€ํ•  ๋•Œ ๋ชจ๋ธ์˜ ์„ฑ๋Šฅ๋„ ์ฆ๊ฐ€ํ•œ๋‹ค. ํ•˜์ง€๋งŒ, ํ˜„์‹ค...

[Paper Review] Visualizing Data using t-SNE

์„ ์ • ์ด์œ  ์˜ค๋Š˜ ๋ฆฌ๋ทฐ/๋ฒˆ์—ญ/๊ตฌํ˜„ํ•  ๋…ผ๋ฌธ์€ Visualizing Data using t-SNE์œผ๋กœ, 2008๋…„์— Geoffrey Hinton์ด ์ €์ž์ธ ๋…ผ๋ฌธ์ž…๋‹ˆ๋‹ค. t-SNE(t-Stochastic Nearest Neighbor)์€ ์ง€๊ธˆ๊นŒ์ง€๋„ ์‹œ๊ฐํ™”๋ฅผ ํ•˜๋Š” ๋ฐ ์ž์ฃผ ์‚ฌ์šฉ๋˜๋Š” ์•Œ๊ณ ๋ฆฌ์ฆ˜์ž…๋‹ˆ๋‹ค. ์ด๋Š” ๊ณ ์ฐจ์›์˜ ๋ฒกํ„ฐ๋กœ ํ‘œํ˜„๋˜๋Š” ๋ฐ์ดํ„ฐ ๊ฐ„์˜ neighbor st...

[๋”ฅ๋Ÿฌ๋‹][๊ฐœ๋…์ •๋ฆฌ] Inductive Bias๋ž€?

Inductive Bias Overview Inductive Bias๋ž€ ๋ฌด์—‡์ผ๊นŒ์š”? ์ตœ๊ทผ ๋…ผ๋ฌธ๋“ค์„ ๋ณด๋ฉด ๊ทธ๋ƒฅ Bias๋„ ์•„๋‹ˆ๊ณ  Inductive Bias๋ผ๋Š” ๋ง์ด ์ž์ฃผ ๋‚˜์˜ค๋Š” ๊ฒƒ์„ ํ™•์ธํ•  ์ˆ˜ ์žˆ๋Š”๋ฐ์š”! ์˜ค๋Š˜์€ ํ•ด๋‹น ๊ฐœ๋…์— ๋Œ€ํ•ด ์ •๋ฆฌํ•ด๋ณด๋Š” ์‹œ๊ฐ„์„ ๊ฐ€์ง€๋ ค๊ณ  ํ•ฉ๋‹ˆ๋‹ค. ๊ณต๋ถ€ํ•˜๋ฉด์„œ ์ž‘์„ฑํ•œ ๊ธ€์ด๋ฏ€๋กœ ํ‹€๋ฆฐ ๊ฐœ๋…์ด ์žˆ๋‹ค๋ฉด ์–ธ์ œ๋“  ํ”ผ๋“œ๋ฐฑ ํ™˜์˜ํ•ฉ๋‹ˆ๋‹ค. Bias(ํŽธ...