Euisuk's Dev Log

ใ€Œ์„œ์ฟ  ๊ฐœ๋ฐœ๋…ธํŠธโญใ€

Unlearning : ๋จธ์‹ ๋Ÿฌ๋‹ ๋ชจ๋ธ๋„ '์žŠ์„ ์ˆ˜ ์žˆ๋‹ค'

๋”ฅ๋Ÿฌ๋‹๊ณผ ๋จธ์‹ ๋Ÿฌ๋‹์€ ์˜ค๋Š˜๋‚  ๋‹ค์–‘ํ•œ ๋ถ„์•ผ์—์„œ ๋†€๋ผ์šด ์„ฑ๊ณผ๋ฅผ ๊ฑฐ๋‘๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. ํ•˜์ง€๋งŒ ๋ชจ๋ธ์ด ํ•™์Šตํ•œ ์ •๋ณด ์ค‘ ๋ถˆํ•„์š”ํ•˜๊ฑฐ๋‚˜ ๋ฏผ๊ฐํ•œ ์ •๋ณด๋ฅผ ์‚ญ์ œํ•ด์•ผ ํ•˜๋Š” ์ƒํ™ฉ๋„ ๋ฐœ์ƒํ•ฉ๋‹ˆ๋‹ค. ์˜ˆ๋ฅผ ๋“ค์–ด, ๊ฐœ์ธ์ •๋ณด ๋ณดํ˜ธ ๊ทœ์ •์— ๋”ฐ๋ผ ๋ชจ๋ธ์ด ํŠน์ • ์‚ฌ์šฉ์ž์˜ ๋ฐ์ดํ„ฐ๋ฅผ ์‚ญ์ œํ•ด์•ผ ํ•˜๊ฑฐ๋‚˜, ํ•™์Šต ๊ณผ์ •์—์„œ ๋ฐœ์ƒํ•œ ํŽธํ–ฅ(Bias)์„ ๊ต์ •ํ•ด์•ผ ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ์ด๋Ÿฌํ•œ ํ•„์š”๋ฅผ ์ถฉ์กฑ...

[๊ฐ•์˜๋…ธํŠธ] LangChain Academy : Introduction to LangGraph (Module 4)

๋žญ์ฒด์ธ(LangChain)๊ณผ ๋žญ๊ทธ๋ž˜ํ”„(LangGraph)๋Š” ๋Œ€๊ทœ๋ชจ ์–ธ์–ด ๋ชจ๋ธ(LLM)์„ ํ™œ์šฉํ•œ ์• ํ”Œ๋ฆฌ์ผ€์ด์…˜ ๊ฐœ๋ฐœ์„ ์œ„ํ•œ ๋„๊ตฌ๋“ค์ž…๋‹ˆ๋‹ค. ์œ„ ๊ฐ•์˜๋Š” LangChain์—์„œ ์šด์˜ํ•˜๋Š” LangChain Academy์—์„œ ์ œ์ž‘ํ•œ โ€œIntroduction to LangGraphโ€ ๊ฐ•์˜์˜ ๋‚ด์šฉ์„ ์ •๋ฆฌ ๋ฐ ์ถ”๊ฐ€ ์„ค๋ช…ํ•œ ๋‚ด์šฉ์ž…๋‹ˆ๋‹ค. ๊ฐ•์˜ ๋งํฌ : https://...

[๊ฐ•์˜๋…ธํŠธ] LangChain Academy : Introduction to LangGraph (Module 3)

๋žญ์ฒด์ธ(LangChain)๊ณผ ๋žญ๊ทธ๋ž˜ํ”„(LangGraph)๋Š” ๋Œ€๊ทœ๋ชจ ์–ธ์–ด ๋ชจ๋ธ(LLM)์„ ํ™œ์šฉํ•œ ์• ํ”Œ๋ฆฌ์ผ€์ด์…˜ ๊ฐœ๋ฐœ์„ ์œ„ํ•œ ๋„๊ตฌ๋“ค์ž…๋‹ˆ๋‹ค. ์œ„ ๊ฐ•์˜๋Š” LangChain์—์„œ ์šด์˜ํ•˜๋Š” LangChain Academy์—์„œ ์ œ์ž‘ํ•œ โ€œIntroduction to LangGraphโ€ ๊ฐ•์˜์˜ ๋‚ด์šฉ์„ ์ •๋ฆฌ ๋ฐ ์ถ”๊ฐ€ ์„ค๋ช…ํ•œ ๋‚ด์šฉ์ž…๋‹ˆ๋‹ค. ๊ฐ•์˜ ๋งํฌ : https://...

[๊ฐ•์˜๋…ธํŠธ] LangChain Academy : Introduction to LangGraph (Module 2)

๋žญ์ฒด์ธ(LangChain)๊ณผ ๋žญ๊ทธ๋ž˜ํ”„(LangGraph)๋Š” ๋Œ€๊ทœ๋ชจ ์–ธ์–ด ๋ชจ๋ธ(LLM)์„ ํ™œ์šฉํ•œ ์• ํ”Œ๋ฆฌ์ผ€์ด์…˜ ๊ฐœ๋ฐœ์„ ์œ„ํ•œ ๋„๊ตฌ๋“ค์ž…๋‹ˆ๋‹ค. ์œ„ ๊ฐ•์˜๋Š” LangChain์—์„œ ์šด์˜ํ•˜๋Š” LangChain Academy์—์„œ ์ œ์ž‘ํ•œ โ€œIntroduction to LangGraphโ€ ๊ฐ•์˜์˜ ๋‚ด์šฉ์„ ์ •๋ฆฌ ๋ฐ ์ถ”๊ฐ€ ์„ค๋ช…ํ•œ ๋‚ด์šฉ์ž…๋‹ˆ๋‹ค. ๊ฐ•์˜ ๋งํฌ : https://...

[๊ฐœ๋…] GLU์™€ ๊ทธ ๋ณ€ํ˜•๋“ค: ์—ญ์‚ฌ์™€ ์ฃผ์š” ๊ฐœ๋… ์ •๋ฆฌ

๋”ฅ๋Ÿฌ๋‹ ๋ถ„์•ผ์—์„œ ํ™œ์„ฑํ™” ํ•จ์ˆ˜๋Š” ์‹ ๊ฒฝ๋ง ๋ชจ๋ธ์ด ํ•™์Šตํ•  ๋•Œ ์ค‘์š”ํ•œ ์—ญํ• ์„ ํ•ฉ๋‹ˆ๋‹ค. ์ด ์ค‘์—์„œ๋„ GLU(Gated Linear Unit)๋Š” ๊ณ ๊ธ‰ ๋ชจ๋ธ์—์„œ ์ž์ฃผ ์‚ฌ์šฉ๋˜๋Š” ํ™œ์„ฑํ™” ํ•จ์ˆ˜ ์ค‘ ํ•˜๋‚˜์ž…๋‹ˆ๋‹ค. ํŠนํžˆ ์ž์—ฐ์–ด ์ฒ˜๋ฆฌ(NLP)์™€ ๊ฐ™์€ ๋ถ„์•ผ์—์„œ ๋›ฐ์–ด๋‚œ ์„ฑ๋Šฅ์„ ๋ฐœํœ˜ํ•˜๋ฉฐ, ์ด ํ™œ์„ฑํ™” ํ•จ์ˆ˜์—์„œ ํŒŒ์ƒ๋œ ์—ฌ๋Ÿฌ ๋ณ€ํ˜•๋“ค์ด ์—ฐ๊ตฌ๋˜์—ˆ์Šต๋‹ˆ๋‹ค. ์ด๋ฒˆ ๊ธ€์—์„œ๋Š” GLU์™€ ๊ทธ ๋ณ€ํ˜•๋“ค,...

[๊ฟ€ํŒ] .bashrc๋กœ ๋กœ์ปฌ์—์„œ ALIAS๋ฅผ ํ™œ์šฉํ•œ ์—ฌ๋Ÿฌ ์ฟ ๋‹ค ํ™œ์šฉํ•˜๊ธฐ

Introduction ์—ฌ๋Ÿฌ ๋ช…์ด ํ•จ๊ป˜ ์‚ฌ์šฉํ•˜๋Š” ์„œ๋ฒ„ ํ™˜๊ฒฝ์—์„œ CUDA ๋ฒ„์ „์„ ๊ด€๋ฆฌํ•˜๋Š” ๊ฒƒ์€ ๊นŒ๋‹ค๋กœ์šด ์ผ์ž…๋‹ˆ๋‹ค. ์‹œ์Šคํ…œ ์ „์—ญ์— ์˜ํ–ฅ์„ ์ฃผ์ง€ ์•Š๊ณ , ๋ณธ์ธ์˜ ๊ฐœ๋ฐœ ํ™˜๊ฒฝ์—์„œ๋งŒ CUDA ๋ฒ„์ „์„ ๋ฐ”๊พธ์–ด ์‚ฌ์šฉํ•˜๊ณ  ์‹ถ๋‹ค๋ฉด ์–ด๋–ป๊ฒŒ ํ•ด์•ผ ํ• ๊นŒ์š”? ํŠนํžˆ, ์„œ๋กœ ๋‹ค๋ฅธ ํ”„๋กœ์ ํŠธ์—์„œ ๊ฐ๊ฐ ๋‹ค๋ฅธ CUDA ๋ฒ„์ „์„ ์š”๊ตฌํ•  ๋•Œ๋Š” ๋”์šฑ ๋ณต์žกํ•ด์ง‘๋‹ˆ๋‹ค. ์ด ๊ธ€์—์„œ๋Š” CUDA๋ฅผ ์‹œ...

[๊ฐ•์˜๋…ธํŠธ] LangChain Academy : Introduction to LangGraph (Module 1)

๋žญ์ฒด์ธ(LangChain)๊ณผ ๋žญ๊ทธ๋ž˜ํ”„(LangGraph)๋Š” ๋Œ€๊ทœ๋ชจ ์–ธ์–ด ๋ชจ๋ธ(LLM)์„ ํ™œ์šฉํ•œ ์• ํ”Œ๋ฆฌ์ผ€์ด์…˜ ๊ฐœ๋ฐœ์„ ์œ„ํ•œ ๋„๊ตฌ๋“ค์ž…๋‹ˆ๋‹ค. ์œ„ ๊ฐ•์˜๋Š” LangChain์—์„œ ์šด์˜ํ•˜๋Š” LangChain Academy์—์„œ ์ œ์ž‘ํ•œ โ€œIntroduction to LangGraphโ€ ๊ฐ•์˜์˜ ๋‚ด์šฉ์„ ์ •๋ฆฌ ๋ฐ ์ถ”๊ฐ€ ์„ค๋ช…ํ•œ ๋‚ด์šฉ์ž…๋‹ˆ๋‹ค. ๊ฐ•์˜ ๋งํฌ : https:...

[Paper Review] NLP ๊ณต๋ถ€ํ•˜๋Š” ์‚ฌ๋žŒ์ด๋ผ๋ฉด ๊ผญ ์ฝ์–ด์•ผํ•˜๋Š” ๋…ผ๋ฌธ ๋Œ€์‹  ์ •๋ฆฌํ•ด๋“œ๋ฆฝ๋‹ˆ๋‹ค

โœ๏ธ ์ž์—ฐ์–ด ์ฒ˜๋ฆฌ(NLP)๋Š” ๋น ๋ฅด๊ฒŒ ๋ฐœ์ „ํ•˜๊ณ  ์žˆ๋Š” ๋ถ„์•ผ๋กœ, ์ˆ˜๋งŽ์€ ํš๊ธฐ์ ์ธ ์—ฐ๊ตฌ ๋…ผ๋ฌธ๋“ค์ด ๋งค๋…„ ๋ฐœํ‘œ๋˜๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. ๋งŒ์•ฝ ์—ฌ๋Ÿฌ๋ถ„์ด NLP์— ์ฒ˜์Œ ๋ฐœ์„ ๋“ค์ด๊ฑฐ๋‚˜, ์—ฐ๊ตฌ๋ฅผ ๋” ๊นŠ์ด ์ดํ•ดํ•˜๊ณ ์ž ํ•œ๋‹ค๋ฉด, ๋‹ค์Œ์— ์†Œ๊ฐœํ•  ๋…ผ๋ฌธ๋“ค์ด ํ•ต์‹ฌ ๊ฐœ๋…๊ณผ ์ตœ๊ทผ ๋ฐœ์ „ ๋™ํ–ฅ์„ ํŒŒ์•…ํ•˜๋Š” ๋ฐ ํฐ ๋„์›€์ด ๋  ๊ฒƒ์ž…๋‹ˆ๋‹ค. ๋‹ค์Œ์€ ํ•ด๋‹น ๋ธ”๋กœ๊ทธ์—์„œ ์†Œ๊ฐœํ•˜๋Š” โ€œMust-Read Res...

[ํŠธ๋ Œ๋“œ] 2025๋…„ ํŠธ๋ Œ๋“œ : LMM, LAM, AGENT, ๊ทธ๋ฆฌ๊ณ  FMOps

Introduction 2023๋…„ ChatGPT๋กœ ์ธํ•ด LLM(Large Language Model)์˜ ์‹œ๋Œ€๊ฐ€ ์—ด๋ฆฌ๋ฉด์„œ, 2024๋…„์€ LLM์ด ๋ณด๋‹ค ๊ณ ๋„ํ™”๋˜๋ฉด์„œ RAG, LLMOps ๋“ฑ ๋งŽ์€ ์‹œ์žฅ ๋ฐ AI์—ฐ๊ตฌ์— ๋ณ€ํ™”๋ฅผ ์ฃผ๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. ๋งˆ์ฐฌ๊ฐ€์ง€๋กœ, 2025๋…„์ด ๋‹ค๊ฐ€์˜ค๋ฉด์„œ IT ์‚ฐ์—…์€ ๋‹ค์‹œ ํ•œ๋ฒˆ ๊ธ‰๊ฒฉํ•œ ๋ณ€ํ™”๋ฅผ ๋งž์ดํ•˜๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. ์ด๋ฒˆ ๊ธ€์—์„œ๋Š” ๋‹ค๊ฐ€์˜ฌ ...

[Paper Review] Mamba2 - Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality

๋งํฌ : https://arxiv.org/pdf/2405.21060 ๋‹ค์Œ์€ ๋…ผ๋ฌธ โ€œTransformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualityโ€์˜ ๊ฐ ์ฑ•ํ„ฐ๋ณ„๋กœ ์ž์„ธํ•œ ๋ฆฌ๋ทฐ ๋ฐ ์ •๋ฆฌ์ž…๋‹ˆ๋‹ค. 1. Introdu...