Euisuk's Dev Log

ใ€Œ์„œ์ฟ  ๊ฐœ๋ฐœ๋…ธํŠธโญใ€

[ํŠธ๋ Œ๋“œ] 2025๋…„ ํŠธ๋ Œ๋“œ : LMM, LAM, AGENT, ๊ทธ๋ฆฌ๊ณ  FMOps

[ํŠธ๋ Œ๋“œ] 2025๋…„ ํŠธ๋ Œ๋“œ : LMM, LAM, AGENT, ๊ทธ๋ฆฌ๊ณ  FMOps Introduction 2023๋…„ ChatGPT๋กœ ์ธํ•ด LLM(Large Language Model)์˜ ์‹œ๋Œ€๊ฐ€ ์—ด๋ฆฌ๋ฉด์„œ, 2024๋…„์€ LLM์ด ๋ณด๋‹ค ๊ณ ๋„ํ™”๋˜๋ฉด์„œ RAG, LLMOps ๋“ฑ ๋งŽ์€ ์‹œ์žฅ ๋ฐ AI์—ฐ๊ตฌ์— ๋ณ€ํ™”๋ฅผ ์ฃผ๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. ๋งˆ์ฐฌ๊ฐ€์ง€๋กœ, 2025๋…„์ด ๋‹ค๊ฐ€์˜ค๋ฉด...

[Paper Review] Mamba2 - Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality

[Paper Review] Mamba2 - Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality ๋งํฌ : https://arxiv.org/pdf/2405.21060 ๋‹ค์Œ์€ ๋…ผ๋ฌธ โ€œTransformers ...

[Paper Review] A COMPREHENSIVE REVIEW OF YOLO ARCHITECTURES IN COMPUTER VISION: FROM YOLOV1 TO YOLOV8 AND YOLO-NAS

[Paper Review] A COMPREHENSIVE REVIEW OF YOLO ARCHITECTURES IN COMPUTER VISION: FROM YOLOV1 TO YOLOV8 AND YOLO-NAS YOLO ๋ชจ๋ธ ์„œ๋ฒ ์ด ํŽ˜์ดํผ ๋งํฌ : https://www.mdpi.com/2504-4990/5/4/83 ๐Ÿ“– (์ฐธ๊ณ ) YOLO ๋ฒ„...

[Paper Review] Mamba: Linear-Time Sequence Modeling with Selective State Spaces

[Paper Review] Mamba: Linear-Time Sequence Modeling with Selective State Spaces ์ตœ๊ทผ ๋”ฅ๋Ÿฌ๋‹ ์•„ํ‚คํ…์ฒ˜์˜ ์ค‘์‹ฌ์—๋Š” ํŠธ๋žœ์Šคํฌ๋จธ๊ฐ€ ์ž๋ฆฌ ์žก๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. ๋Œ€๊ทœ๋ชจ ์–ธ์–ด ๋ชจ๋ธ(LLM)๋ฟ๋งŒ ์•„๋‹ˆ๋ผ, ๊ทธ๋ฆผ์„ ์ƒ์„ฑํ•˜๋Š” ๋ฐ ์“ฐ์ด๋Š” ๋””ํ“จ์ „ ๋ชจ๋ธ ๋˜ํ•œ ํŠธ๋žœ์Šคํฌ๋จธ ๊ตฌ์กฐ๋ฅผ ํ™œ์šฉํ•˜๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. ์ด์™ธ์—๋„ ์‹œ๊ณ„์—ด ๋ถ„์„...

[Paper Review] Structured State Space Models for Deep Sequence Modeling

[Paper Review] Structured State Space Models for Deep Sequence Modeling ์‹œ๊ณ„์—ด ๋ฐ์ดํ„ฐ๋ฅผ ํšจ์œจ์ ์œผ๋กœ ์ฒ˜๋ฆฌํ•˜๋Š” ๋ฐฉ๋ฒ•์€ ์ง€๋‚œ ๋ช‡ ๋…„ ๋™์•ˆ ๋น ๋ฅด๊ฒŒ ๋ฐœ์ „ํ–ˆ์Šต๋‹ˆ๋‹ค. ํŠนํžˆ, CMU์— ๊ณ„์‹  Albert Gu ๊ต์ˆ˜๋‹˜์€ ๊ธด ์‹œ๊ณ„์—ด ์˜์กด์„ฑ(Long-Range Dependencies, LRDs)์„ ์ฒ˜๋ฆฌํ•˜๋Š” ๋ฐ ์ง‘์ค‘...

[๊ฐœ๋…] ์ธ๊ณต์ง€๋Šฅ์„ ์œ„ํ•œ ์„ ํ˜•๋Œ€์ˆ˜ : ํ–‰๋ ฌํŽธ

[๊ฐœ๋…] ์ธ๊ณต์ง€๋Šฅ์„ ์œ„ํ•œ ์„ ํ˜•๋Œ€์ˆ˜ : ํ–‰๋ ฌํŽธ ํ–‰๋ ฌ(Matrix)์˜ ์ •์˜ ์ธ๊ณต์ง€๋Šฅ ๋ฐ ๊ธฐ๊ณ„ ํ•™์Šต์—์„œ ํ–‰๋ ฌ(matrix)์€ ๋ฐ์ดํ„ฐ๋ฅผ ์ฒ˜๋ฆฌํ•˜๊ณ  ํ‘œํ˜„ํ•˜๋Š” ์ค‘์š”ํ•œ ๋„๊ตฌ์ž…๋‹ˆ๋‹ค. ํ–‰๋ ฌ์€ ์ˆ˜๋ฅผ ์ง์‚ฌ๊ฐํ˜• ํ˜•ํƒœ๋กœ ๋ฐฐ์—ดํ•œ ๊ฒƒ์œผ๋กœ, ๋ฐ์ดํ„ฐ๋ฅผ ์ˆ˜ํ•™์ ์œผ๋กœ ๋‹ค๋ฃจ๊ธฐ ์œ„ํ•ด ํ•„์ˆ˜์ ์ž…๋‹ˆ๋‹ค. ํ–‰๋ ฌ์„ ์‚ฌ์šฉํ•˜๋ฉด ๋Œ€๊ทœ๋ชจ ๋ฐ์ดํ„ฐ๋ฅผ ํšจ์œจ์ ์œผ๋กœ ๊ด€๋ฆฌํ•˜๊ณ  ๊ณ„์‚ฐํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค...

[Paper Review] Resurrecting Recurrent Neural Networks for Long Sequences

[Paper Review] Resurrecting Recurrent Neural Networks for Long Sequences ๋…ผ๋ฌธ โ€œResurrecting Recurrent Neural Networks for Long Sequencesโ€๋Š” 25 Apr 2023์— publish๋˜์—ˆ์œผ๋ฉฐ, ICML 2023 OralPoster์— ๋ฐœํ‘œ๋œ ๋…ผ๋ฌธ์ž…๋‹ˆ๋‹ค. ...

[๊ฐœ๋…] ์‹œ์Šคํ…œ, ๋ฏธ๋ถ„๋ฐฉ์ •์‹, ๊ทธ๋ฆฌ๊ณ  ์ƒํƒœ ๊ณต๊ฐ„ ๋ชจ๋ธ

[๊ฐœ๋…] ์‹œ์Šคํ…œ, ๋ฏธ๋ถ„๋ฐฉ์ •์‹, ๊ทธ๋ฆฌ๊ณ  ์ƒํƒœ ๊ณต๊ฐ„ ๋ชจ๋ธ ์šฐ๋ฆฌ๋Š” ์ผ์ƒ์ƒํ™œ์—์„œ ๋‹ค์–‘ํ•œ ์‹œ์Šคํ…œ๊ณผ ์ƒํ˜ธ์ž‘์šฉํ•˜๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. ๋™์  ์‹œ์Šคํ…œ์€ ๊ทธ์ค‘ ํ•˜๋‚˜๋กœ, ์‹œ๊ฐ„์ด ์ง€๋‚จ์— ๋”ฐ๋ผ ์ƒํƒœ๊ฐ€ ๋ณ€ํ™”ํ•˜๋Š” ์‹œ์Šคํ…œ์„ ์˜๋ฏธํ•ฉ๋‹ˆ๋‹ค. ์ƒํƒœ ๊ณต๊ฐ„(State Space) ๋ชจ๋ธ์€ ๋ณต์žกํ•œ ๋™์  ์‹œ์Šคํ…œ์„ ์ดํ•ดํ•˜๊ณ  ๋ถ„์„ํ•˜๋Š”๋ฐ ์ค‘์š”ํ•œ ๋„๊ตฌ์ž…๋‹ˆ๋‹ค. ์ด ๋ชจ๋ธ์€ ์‹œ์Šคํ…œ์„ ์ƒํƒœ(state)๋ผ๋Š” ๊ฐœ๋…์œผ๋กœ ...

[์ •๋ฆฌ] OpenAI API Document

[์ •๋ฆฌ] OpenAI API Document OpenAI๋Š” ์ตœ์‹  ์ธ๊ณต์ง€๋Šฅ(AI) ๋ชจ๋ธ๊ณผ API๋ฅผ ์ œ๊ณตํ•˜์—ฌ ๊ฐœ๋ฐœ์ž๋“ค์ด ๋‹ค์–‘ํ•œ AI ๊ธฐ๋Šฅ์„ ์‰ฝ๊ฒŒ ์• ํ”Œ๋ฆฌ์ผ€์ด์…˜์— ํ†ตํ•ฉํ•  ์ˆ˜ ์žˆ๋„๋ก ์ง€์›ํ•ฉ๋‹ˆ๋‹ค. ๋‹ค์Œ์€ ์•„๋ž˜ platform.openai.com์—์„œ ์ œ๊ณตํ•˜๋Š” ๋ฌธ์„œ๋ฅผ ํ›‘์–ด๋ณด๋ฉด์„œ ์ •๋ฆฌํ•œ ๋‚ด์šฉ์ž…๋‹ˆ๋‹ค. ์ฐธ๊ณ  ๋ฌธ์„œ: https://platform.openai.co...

[IT] LLMOps์™€ RAG

[IT] LLMOps์™€ RAG ์ตœ๊ทผ ๋ช‡ ๋…„๊ฐ„ ๋Œ€๊ทœ๋ชจ ์–ธ์–ด ๋ชจ๋ธ(LLM)์˜ ๋ฐœ์ „์€ ๋‹ค์–‘ํ•œ ์‚ฐ์—…์—์„œ ํฐ ๋ณ€ํ™”๋ฅผ ์ผ์œผํ‚ค๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. LLM์€ ์‚ฌ๋žŒ๊ณผ ์œ ์‚ฌํ•œ ๋ฐฉ์‹์œผ๋กœ ํ…์ŠคํŠธ๋ฅผ ์ƒ์„ฑํ•˜๊ฑฐ๋‚˜ ์งˆ๋ฌธ์— ๋‹ต๋ณ€ํ•  ์ˆ˜ ์žˆ์œผ๋ฉฐ, ๊ณ ๊ฐ ์ง€์›, ์˜๋ฃŒ, ๋ฒ•๋ฅ , ์ฝ˜ํ…์ธ  ์ƒ์„ฑ ๋“ฑ ์ˆ˜๋งŽ์€ ๋ถ„์•ผ์—์„œ ๋„๋ฆฌ ํ™œ์šฉ๋˜๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. ๊ทธ๋Ÿฌ๋‚˜ LLM์˜ ์„ฑ๋Šฅ์„ ๊ทน๋Œ€ํ™”ํ•˜๊ณ  ์ง€์†์ ์œผ๋กœ ๊ฐœ์„ ํ•˜๊ธฐ ์œ„ํ•ด์„œ๋Š”...