LangChain

LangChain์œผ๋กœ LLM ์• ํ”Œ๋ฆฌ์ผ€์ด์…˜์„ ๊ตฌ์„ฑํ•˜๋Š” ๋ฐฉ๋ฒ•.

LangChain์œผ๋กœ LLM ์• ํ”Œ๋ฆฌ์ผ€์ด์…˜์„ ๊ตฌ์„ฑํ•˜๋Š” ๋ฐฉ๋ฒ•.

14 posts · ์•„์นด์ด๋ธŒ์—์„œ ํ•„ํ„ฐ๋กœ ๋ณด๊ธฐ

[๊ฐ€์ด๋“œ] Ollama + LangChain ์‹ค์ „ ๊ฐ€์ด๋“œ - ChatOllama ์‚ฌ์šฉํ•˜๊ธฐ

์ด์ „ ํฌ์ŠคํŠธ์—์„œ๋Š” Python ์ฝ”๋“œ์—์„œ Ollama ๋ช…๋ น์–ด๋ฅผ ํ™œ์šฉํ•˜์—ฌ ๋กœ์ปฌ์—์„œ LLM์„ ํ˜ธ์ถœํ•˜๋Š” ๋ฐฉ๋ฒ•์„ ์•Œ์•„๋ณด์•˜์Šต๋‹ˆ๋‹ค. [์ด์ „ ํฌ์ŠคํŠธ ๋ณด๋Ÿฌ๊ฐ€๊ธฐ](https://velog.io/@euisuk-chung/%EA%B0%80%EC%9D%B4%EB%93%9C-Python%EC%97%90%EC%84%9C-Ollama-%EC%82%AC%EC%9A%A9...

[์ž๋ฃŒ] KT ์‚ฌ๋‚ด ์ง์› ๋Œ€์ƒ RAG ๊ต์•ˆ ๋Œ€๋ฐฉ์ถœ?!

์˜ค๋Š˜๋„ RAG์— ๋Œ€ํ•œ ์ž๋ฃŒ๋ฅผ ์ฐพ์•„๋ณด๋˜ ์ค‘, KT DS์˜ ๊น€์„ฑ์šฐ ๊ธฐ์ˆ ํ˜์‹ ๋‹จ์žฅ๋‹˜๊ป˜์„œ ๊ณต์œ ํ•˜์‹  RAG ๊ด€๋ จ ์ž๋ฃŒ๋ฅผ ๋ฐœ๊ฒฌํ–ˆ์Šต๋‹ˆ๋‹ค. ์ถœ์ฒ˜ : LinkedIn - KTDS ๊น€์„ฑ์šฐ ๊ธฐ์ˆ ํ˜์‹ ๋‹จ์žฅ KT ์‚ฌ๋‚ด ์ง์› RAG ๊ต์•ˆ์ด๋ผ๋Š” ๋ง์— ์–ด๋–ค ๋‚ด์šฉ์ผ์ง€ ๊ถ๊ธˆํ•˜์—ฌ, ์ด๋ฒˆ ํฌ์ŠคํŒ…์—์„œ๋Š” ํ•ด๋‹น ์ž๋ฃŒ๋ฅผ ์ž์„ธํ•˜๊ฒŒ ๊ณต๋ถ€ํ•˜๋ฉฐ ๋‚ด์šฉ์„ ์ •๋ฆฌํ•ด๋ณด์•˜์œผ๋‹ˆ ํ•จ๊ป˜ ์‚ดํŽด๋ณด์‹œ์ฃ . ...

[๊ฐ•์˜๋…ธํŠธ] LangChain Academy : Introduction to LangGraph (Module 4)

๋žญ์ฒด์ธ(LangChain)๊ณผ ๋žญ๊ทธ๋ž˜ํ”„(LangGraph)๋Š” ๋Œ€๊ทœ๋ชจ ์–ธ์–ด ๋ชจ๋ธ(LLM)์„ ํ™œ์šฉํ•œ ์• ํ”Œ๋ฆฌ์ผ€์ด์…˜ ๊ฐœ๋ฐœ์„ ์œ„ํ•œ ๋„๊ตฌ๋“ค์ž…๋‹ˆ๋‹ค. ์œ„ ๊ฐ•์˜๋Š” LangChain์—์„œ ์šด์˜ํ•˜๋Š” LangChain Academy์—์„œ ์ œ์ž‘ํ•œ โ€œIntroduction to LangGraphโ€ ๊ฐ•์˜์˜ ๋‚ด์šฉ์„ ์ •๋ฆฌ ๋ฐ ์ถ”๊ฐ€ ์„ค๋ช…ํ•œ ๋‚ด์šฉ์ž…๋‹ˆ๋‹ค. ๊ฐ•์˜ ๋งํฌ : https://...

[๊ฐ•์˜๋…ธํŠธ] LangChain Academy : Introduction to LangGraph (Module 3)

๋žญ์ฒด์ธ(LangChain)๊ณผ ๋žญ๊ทธ๋ž˜ํ”„(LangGraph)๋Š” ๋Œ€๊ทœ๋ชจ ์–ธ์–ด ๋ชจ๋ธ(LLM)์„ ํ™œ์šฉํ•œ ์• ํ”Œ๋ฆฌ์ผ€์ด์…˜ ๊ฐœ๋ฐœ์„ ์œ„ํ•œ ๋„๊ตฌ๋“ค์ž…๋‹ˆ๋‹ค. ์œ„ ๊ฐ•์˜๋Š” LangChain์—์„œ ์šด์˜ํ•˜๋Š” LangChain Academy์—์„œ ์ œ์ž‘ํ•œ โ€œIntroduction to LangGraphโ€ ๊ฐ•์˜์˜ ๋‚ด์šฉ์„ ์ •๋ฆฌ ๋ฐ ์ถ”๊ฐ€ ์„ค๋ช…ํ•œ ๋‚ด์šฉ์ž…๋‹ˆ๋‹ค. ๊ฐ•์˜ ๋งํฌ : https://...

[๊ฐ•์˜๋…ธํŠธ] LangChain Academy : Introduction to LangGraph (Module 2)

๋žญ์ฒด์ธ(LangChain)๊ณผ ๋žญ๊ทธ๋ž˜ํ”„(LangGraph)๋Š” ๋Œ€๊ทœ๋ชจ ์–ธ์–ด ๋ชจ๋ธ(LLM)์„ ํ™œ์šฉํ•œ ์• ํ”Œ๋ฆฌ์ผ€์ด์…˜ ๊ฐœ๋ฐœ์„ ์œ„ํ•œ ๋„๊ตฌ๋“ค์ž…๋‹ˆ๋‹ค. ์œ„ ๊ฐ•์˜๋Š” LangChain์—์„œ ์šด์˜ํ•˜๋Š” LangChain Academy์—์„œ ์ œ์ž‘ํ•œ โ€œIntroduction to LangGraphโ€ ๊ฐ•์˜์˜ ๋‚ด์šฉ์„ ์ •๋ฆฌ ๋ฐ ์ถ”๊ฐ€ ์„ค๋ช…ํ•œ ๋‚ด์šฉ์ž…๋‹ˆ๋‹ค. ๊ฐ•์˜ ๋งํฌ : https://...

[๊ฐ•์˜๋…ธํŠธ] LangChain Academy : Introduction to LangGraph (Module 1)

๋žญ์ฒด์ธ(LangChain)๊ณผ ๋žญ๊ทธ๋ž˜ํ”„(LangGraph)๋Š” ๋Œ€๊ทœ๋ชจ ์–ธ์–ด ๋ชจ๋ธ(LLM)์„ ํ™œ์šฉํ•œ ์• ํ”Œ๋ฆฌ์ผ€์ด์…˜ ๊ฐœ๋ฐœ์„ ์œ„ํ•œ ๋„๊ตฌ๋“ค์ž…๋‹ˆ๋‹ค. ์œ„ ๊ฐ•์˜๋Š” LangChain์—์„œ ์šด์˜ํ•˜๋Š” LangChain Academy์—์„œ ์ œ์ž‘ํ•œ โ€œIntroduction to LangGraphโ€ ๊ฐ•์˜์˜ ๋‚ด์šฉ์„ ์ •๋ฆฌ ๋ฐ ์ถ”๊ฐ€ ์„ค๋ช…ํ•œ ๋‚ด์šฉ์ž…๋‹ˆ๋‹ค. ๊ฐ•์˜ ๋งํฌ : https:...

[๊ฐ•์˜๋…ธํŠธ] Text Splitting For Retrieval

Introduction ๋Œ€๊ทœ๋ชจ ์–ธ์–ด ๋ชจ๋ธ(LLM, Large Language Model)์„ ์ด์šฉํ•œ ์• ํ”Œ๋ฆฌ์ผ€์ด์…˜์˜ ์„ฑ๋Šฅ์„ ํ–ฅ์ƒ์‹œํ‚ค๋Š” ๊ฐ€์žฅ ํšจ๊ณผ์ ์ธ ์ „๋žต ์ค‘ ํ•˜๋‚˜๋Š” ํฐ ํ…์ŠคํŠธ ๋ฐ์ดํ„ฐ๋ฅผ ๋” ์ž‘์€ ์กฐ๊ฐ์œผ๋กœ ๋ถ„ํ• ํ•˜๋Š” ๊ฒƒ์ž…๋‹ˆ๋‹ค. LLM์—๊ฒŒ ํ•„์š”ํ•œ ์ •๋ณด๋งŒ์„ ์ œ๊ณตํ•จ์œผ๋กœ์จ ๋ชจ๋ธ์˜ ์ž‘์—… ํšจ์œจ์„ฑ์„ ๊ทน๋Œ€ํ™”ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ์ด๋Ÿฌํ•œ ํ…์ŠคํŠธ ๋ถ„ํ•  ๊ธฐ์ˆ ์€ ๋‹จ์ˆœํ•œ ๋ฐฉ๋ฒ• ๊ฐ™์ง€๋งŒ...

[๊ฐ•์˜๋…ธํŠธ] RAG From Scratch : RAG for long context LLMs

RAG for long context LLMs Introduction ์ตœ๊ทผ LLM(Long Large Models)์˜ ๊ธ‰๊ฒฉํ•œ ๋ฐœ์ „์œผ๋กœ ์ธํ•ด ๊ฑฐ๋Œ€ํ•œ ์–‘์˜ ๋ฐ์ดํ„ฐ๋ฅผ ํ•œ ๋ฒˆ์— ์ฒ˜๋ฆฌํ•  ์ˆ˜ ์žˆ๋Š” ๊ฐ€๋Šฅ์„ฑ์ด ์—ด๋ฆฌ๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. ํŠนํžˆ, 100๋งŒ ํ† ํฐ ์ด์ƒ์˜ ์ •๋ณด๋ฅผ ํ•œ ๋ฒˆ์— ์ฒ˜๋ฆฌํ•  ์ˆ˜ ์žˆ๋Š” ๋ชจ๋ธ๋“ค์ด ๋“ฑ์žฅํ•˜๋ฉด์„œ, ๊ณผ์—ฐ RAG(Retrieval-Augmented G...

[๊ฐ•์˜๋…ธํŠธ] RAG From Scratch : Query Translation

ํ•ด๋‹น ๋ธ”๋กœ๊ทธ ํฌ์ŠคํŠธ๋Š” RAG From Scratch : Coursework ๊ฐ•์˜ ํŒŒํŠธ 5 - 9 ๋‚ด์šฉ์„ ๋‹ค๋ฃจ๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. ๋น„๋””์˜ค ์š”์•ฝ ๊ฐ•์˜ ๋งํฌ ์Šฌ๋ผ์ด๋“œ Part 5 (๋‹ค์ค‘ ์ฟผ๋ฆฌ) ๋‹ค์–‘ํ•œ ๋ฌธ์„œ ๊ฒ€์ƒ‰์„ ์œ„ํ•ด ์ฟผ๋ฆฌ ์žฌ์ž‘์„ฑ ๊ธฐ๋ฒ•์„ ์„ค๋ช…ํ•ฉ...

[๊ฐ•์˜๋…ธํŠธ] RAG From Scratch : Query Routing & Structuring

ํ•ด๋‹น ๋ธ”๋กœ๊ทธ ํฌ์ŠคํŠธ๋Š” RAG From Scratch : Coursework ๊ฐ•์˜ ํŒŒํŠธ 10 - 11 ๋‚ด์šฉ์„ ๋‹ค๋ฃจ๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. ๋น„๋””์˜ค ์š”์•ฝ ๊ฐ•์˜ ๋งํฌ ์Šฌ๋ผ์ด๋“œ Part 10 (๋ผ์šฐํŒ…) ์ฟผ๋ฆฌ๋ฅผ ๊ด€๋ จ ๋ฐ์ดํ„ฐ ์†Œ์Šค๋กœ ์œ ๋„ํ•˜๊ธฐ ์œ„ํ•œ ๋…ผ๋ฆฌ์  ...

[๊ฐ•์˜๋…ธํŠธ] RAG From Scratch : Query Retrieval ๊ธฐ๋ฒ•

ํ•ด๋‹น ๋ธ”๋กœ๊ทธ ํฌ์ŠคํŠธ๋Š” RAG From Scratch : Coursework ๊ฐ•์˜ ํŒŒํŠธ 15 - 18 ๋‚ด์šฉ์„ ๋‹ค๋ฃจ๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. ๋ณ„๋„์˜ ๊ฐ•์ขŒ ๋‚ด์šฉ์ด ๋ณด์ด์ง€ ์•Š์•„์„œ ์‹ค์Šต ์ฝ”๋“œ๋ฅผ ๋ฐ”ํƒ•์œผ๋กœ Reverse Enginneeringํ•ด์„œ ์ž๋ฃŒ๋ฅผ ์ •๋ฆฌํ•œ ๋‚ด์šฉ์ž…๋‹ˆ๋‹ค. ์ฐธ๊ณ  ๋ถ€ํƒ๋“œ๋ฆฝ๋‹ˆ๋‹ค! 1. Re-ranking (์žฌ์ •๋ ฌ) Re-ranking์€ ...

[๊ฐ•์˜๋…ธํŠธ] RAG From Scratch : Query Indexing ๊ธฐ๋ฒ•

ํ•ด๋‹น ๋ธ”๋กœ๊ทธ ํฌ์ŠคํŠธ๋Š” RAG From Scratch : Coursework ๊ฐ•์˜ ํŒŒํŠธ 12 - 14 ๋‚ด์šฉ์„ ๋‹ค๋ฃจ๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. ๋น„๋””์˜ค ์š”์•ฝ ๊ฐ•์˜ ๋งํฌ ์Šฌ๋ผ์ด๋“œ Part 12 (๋‹ค์ค‘ ํ‘œํ˜„ ์ธ๋ฑ์‹ฑ) ํšจ์œจ์ ์ธ ๊ฒ€์ƒ‰์„ ์œ„ํ•ด ๋ฌธ์„œ ์š”์•ฝ์„ ์ธ๋ฑ...

[๊ฐ•์˜๋…ธํŠธ] RAG From Scratch : Overview

ํ•ด๋‹น ๋ธ”๋กœ๊ทธ ํฌ์ŠคํŠธ๋Š” RAG From Scratch : Coursework ๊ฐ•์˜ ํŒŒํŠธ 1 - 4 ๋‚ด์šฉ์„ ๋‹ค๋ฃจ๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. ๋น„๋””์˜ค ์š”์•ฝ ๊ฐ•์˜ ๋งํฌ ์Šฌ๋ผ์ด๋“œ Part 1 (๊ฐœ์š”) RAG๋ฅผ ์†Œ๊ฐœํ•˜๋ฉฐ, ์‹œ๋ฆฌ์ฆˆ๊ฐ€ ๊ธฐ๋ณธ ๊ฐœ๋…๋ถ€ํ„ฐ ๊ณ ๊ธ‰ ๊ธฐ์ˆ ๊นŒ์ง€ ๋‹ค...

[๊ฐ•์˜๋…ธํŠธ] RAG From Scratch : Coursework

์†Œ๊ฐœ ์˜ค๋Š˜๋‚ ์˜ Generative AI๋Š” ๊ธฐ๋ณธ์ ์ธ ๋Œ€ํ˜• ์–ธ์–ด ๋ชจ๋ธ(LLM)์„ ๋„˜์–ด, ์ •๋ณด ํ™œ์šฉ์˜ ๋ฐฉ์‹์„ ํš๊ธฐ์ ์œผ๋กœ ๋ณ€ํ™”์‹œํ‚ค๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. ๊ทธ ์ค‘์—์„œ๋„ RAG, Retrieval-Augmented Generation์€ ์™ธ๋ถ€ ๋ฐ์ดํ„ฐ ์†Œ์Šค๋ฅผ ํ™œ์šฉํ•˜์—ฌ ๋”์šฑ ์ •๊ตํ•˜๊ณ  ๋„๋ฉ”์ธ์— ํŠนํ™”๋œ ์ •๋ณด๋ฅผ ์ œ๊ณตํ•จ์œผ๋กœ์จ, AI์™€์˜ ์ƒํ˜ธ์ž‘์šฉ ๋ฐฉ์‹์„ ์ƒˆ๋กญ๊ฒŒ ์ •์˜ํ•˜๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค....