Euisuk's Dev Log

ใ€Œ์„œ์ฟ  ๊ฐœ๋ฐœ๋…ธํŠธโญใ€

[ํŒŒ์ด์ฌ] multiprocessing์˜ Pool ํด๋ž˜์Šค

[ํŒŒ์ด์ฌ] multiprocessing์˜ Pool ํด๋ž˜์Šค multiprocessing.Pool์€ Python์˜ ๋ฉ€ํ‹ฐํ”„๋กœ์„ธ์‹ฑ ๋ชจ๋“ˆ์—์„œ ์ œ๊ณตํ•˜๋Š” ๋งค์šฐ ์œ ์šฉํ•œ ํด๋ž˜์Šค๋กœ, ๋ณ‘๋ ฌ ์ฒ˜๋ฆฌ๋ฅผ ์œ„ํ•œ ํ”„๋กœ์„ธ์Šค ํ’€์„ ๊ด€๋ฆฌํ•ฉ๋‹ˆ๋‹ค. ์ด ํด๋ž˜์Šค๋ฅผ ์‚ฌ์šฉํ•˜๋ฉด ์—ฌ๋Ÿฌ ํ”„๋กœ์„ธ์Šค์—์„œ ๋™์‹œ์— ์ž‘์—…์„ ์‹คํ–‰ํ•˜๋Š” ๋ณต์žกํ•œ ๋กœ์ง์„ ๊ฐ„๋‹จํ•˜๊ฒŒ ์ฒ˜๋ฆฌํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ๋ณธ ๋ธ”๋กœ๊ทธ ํฌ์ŠคํŠธ์—์„œ๋Š” Pool์˜...

[ํŒŒ์ด์ฌ] Multiprocessing, Multithreading ์ž์› ๋ถ„ํ•  ๋ฐ ํ• ๋‹น

[ํŒŒ์ด์ฌ] Multiprocessing, Multithreading ์ž์› ๋ถ„ํ•  ๋ฐ ํ• ๋‹น ๋ฉ€ํ‹ฐํ”„๋กœ์„ธ์‹ฑ๊ณผ ๋ฉ€ํ‹ฐ์Šค๋ ˆ๋”ฉ์—์„œ ์ž์› ๋ถ„ํ• ๊ณผ ์ž‘์—… ํ• ๋‹น์€ ๊ฐ๊ฐ ๋‹ค๋ฅด๊ฒŒ ์ด๋ฃจ์–ด์ง‘๋‹ˆ๋‹ค. ์ด ๊ณผ์ •์„ ์ดํ•ดํ•˜๊ธฐ ์œ„ํ•ด์„œ๋Š” ๋จผ์ €, ์ปดํ“จํ„ฐ์˜ ์ž์›(ํŠนํžˆ CPU์™€ ๋ฉ”๋ชจ๋ฆฌ) ์‚ฌ์šฉ ๋ฐฉ์‹๊ณผ ์ž‘์—…์˜ ์ข…๋ฅ˜(์˜ˆ: CPU ์ง‘์•ฝ์  vs. I/O ์ง‘์•ฝ์ )๋ฅผ ๊ณ ๋ คํ•ด์•ผ ํ•ฉ๋‹ˆ๋‹ค. ๋ฉ€ํ‹ฐํ”„๋กœ์„ธ์‹ฑ(Mult...

[ํŒŒ์ด์ฌ] Multiprocessing, Multithreading ์‚ฌ์šฉ ์‹œ ๊ณ ๋ ค ์‚ฌํ•ญ

[ํŒŒ์ด์ฌ] Multiprocessing, Multithreading ์‚ฌ์šฉ ์‹œ ๊ณ ๋ ค ์‚ฌํ•ญ ๋ฉ€ํ‹ฐํ”„๋กœ์„ธ์‹ฑ๊ณผ ๋ฉ€ํ‹ฐ์Šค๋ ˆ๋”ฉ์„ ์„ ํƒํ•  ๋•Œ ๊ณ ๋ คํ•ด์•ผ ํ•˜๋Š” ์ž‘์—…์˜ ํŠน์„ฑ์— ๋Œ€ํ•ด ๋” ์ž์„ธํžˆ ์„ค๋ช…ํ•˜๊ฒ ์Šต๋‹ˆ๋‹ค. ์ž์› ๋ถ„ํ•  ๋ฐ ํ• ๋‹น์— ๋Œ€ํ•ด์„œ ๊ถ๊ธˆํ•˜์‹  ๋ถ„์„ ๋‹ค์Œ ๊ฒŒ์‹œ๊ธ€์—์„œ ํ™•์ธํ•˜์‹ค ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ๋ฉ€ํ‹ฐํ”„๋กœ์„ธ์‹ฑ(Multiprocessing) ๋ฉ€ํ‹ฐํ”„๋กœ์„ธ์‹ฑ์€ ์ฃผ๋กœ CPU ์ง‘์•ฝ์ ์ธ ...

[Linux] ํŒŒ์ผ ๊ถŒํ•œ๊ณผ ์“ฐ๊ธฐ ์ž‘์—…

[Linux] ํŒŒ์ผ ๊ถŒํ•œ๊ณผ ์“ฐ๊ธฐ ์ž‘์—… Linux ํŒŒ์ผ ๊ถŒํ•œ๊ณผ ์“ฐ๊ธฐ ์ž‘์—… ๋ฆฌ๋ˆ…์Šค ์‹œ์Šคํ…œ์—์„œ ํŒŒ์ผ ์ž‘์—…์„ ์ˆ˜ํ–‰ํ•˜๊ธฐ ์œ„ํ•ด์„œ๋Š” ์ ์ ˆํ•œ ๊ถŒํ•œ์ด ํ•„์š”ํ•ฉ๋‹ˆ๋‹ค. ์‚ฌ์šฉ์ž๋Š” ํŒŒ์ผ์ด๋‚˜ ๋””๋ ‰ํ† ๋ฆฌ์— ๋Œ€ํ•ด ์ฝ๊ธฐ(read), ์“ฐ๊ธฐ(write), ์‹คํ–‰(execute) ๊ถŒํ•œ์„ ๊ฐ€์งˆ ์ˆ˜ ์žˆ์œผ๋ฉฐ, ์ด ๊ถŒํ•œ๋“ค์€ ํŒŒ์ผ ์†Œ์œ ์ž(owner), ๊ทธ๋ฃน(group), ๊ทธ๋ฆฌ๊ณ  ๊ธฐํƒ€ ์‚ฌ์šฉ์ž(oth...

[Linux] ์‚ฌ์šฉ์ž ๊ณ„์ • ๋ฐ ๊ทธ๋ฃน ๊ด€๋ฆฌ ๊ฐ€์ด๋“œ

[Linux] ์‚ฌ์šฉ์ž ๊ณ„์ • ๋ฐ ๊ทธ๋ฃน ๊ด€๋ฆฌ ๊ฐ€์ด๋“œ Linux ์‚ฌ์šฉ์ž ๊ณ„์ • ๋ฐ ๊ทธ๋ฃน ๊ด€๋ฆฌ ๊ฐ€์ด๋“œ ๋ฆฌ๋ˆ…์Šค์—์„œ ์‚ฌ์šฉ์ž ๊ณ„์ •์„ ๊ด€๋ฆฌํ•˜๋Š” ๊ฒƒ์€ ์‹œ์Šคํ…œ ๋ณด์•ˆ๊ณผ ์ ‘๊ทผ ์ œ์–ด์— ๋งค์šฐ ์ค‘์š”ํ•ฉ๋‹ˆ๋‹ค. ์ด ๊ธ€์—์„œ๋Š” ๊ณ„์ • ์ƒ์„ฑ, ์‚ญ์ œ, ๊ถŒํ•œ ๋ถ€์—ฌ, ๊ทธ๋ฃน ๊ด€๋ฆฌ ๋“ฑ ๊ณ„์ •๊ณผ ๊ด€๋ จ๋œ ๋‹ค์–‘ํ•œ ๋ช…๋ น์–ด์™€ ์‹ค์Šต ๊ฐ€๋Šฅํ•œ ์Šค๋‹ˆํŽซ์„ ํ•จ๊ป˜ ์•Œ์•„๋ณด๊ฒ ์Šต๋‹ˆ๋‹ค. 1. ์‚ฌ์šฉ์ž ๊ณ„์ • ์ถ”๊ฐ€ ์ƒˆ๋กœ์šด ์‚ฌ...

[๊ฐœ๋…] MLOps vs AIOps

[๊ฐœ๋…] MLOps vs AIOps MLOps๋ž€ ๋ฌด์—‡์ธ๊ฐ€? MLOps๋Š” ๊ธฐ๊ณ„ ํ•™์Šต(ML) ์‹œ์Šคํ…œ์˜ ๊ฐœ๋ฐœ๊ณผ ๋ฐฐํฌ๋ฅผ ํ†ตํ•ฉํ•˜๋Š” ํ”„๋ ˆ์ž„์›Œํฌ์ž…๋‹ˆ๋‹ค. ์ด๋Š” ML ๋ชจ๋ธ์„ ์ง€์†์ ์œผ๋กœ ์ƒ์‚ฐ์— ํˆฌ์ž…ํ•˜๊ธฐ ์œ„ํ•ด ํ‘œ์ค€ํ™”ํ•˜๊ณ  ๊ฐ„์†Œํ™”ํ•˜๋Š” ์—ญํ• ์„ ํ•ฉ๋‹ˆ๋‹ค. MLOps์˜ ์ฃผ์š” ๋‹จ๊ณ„๋Š” ๋‹ค์Œ๊ณผ ๊ฐ™์Šต๋‹ˆ๋‹ค: ๋ฐ์ดํ„ฐ ์ถ”์ถœ: ๋‹ค์–‘ํ•œ ์ถœ์ฒ˜์—์„œ ๋ฐ์ดํ„ฐ ํ†ตํ•ฉ ํƒ์ƒ‰์  ๋ฐ์ดํ„ฐ ๋ถ„์„: ๋ฐ์ด...

[Linux] ์—ด๋ ค ์žˆ๋Š” ํŒŒ์ผ ๋ฐ ๋ฆฌ์†Œ์Šค ๊ด€๋ฆฌ์˜ ํ•„์ˆ˜ ๋„๊ตฌ(lsof)

[Linux] ์—ด๋ ค ์žˆ๋Š” ํŒŒ์ผ ๋ฐ ๋ฆฌ์†Œ์Šค ๊ด€๋ฆฌ์˜ ํ•„์ˆ˜ ๋„๊ตฌ(lsof) Linux lsof ๋ช…๋ น์–ด ๋ฆฌ๋ˆ…์Šค ์‹œ์Šคํ…œ์—์„œ ํŒŒ์ผ์ด๋‚˜ ๋””๋ ‰ํ† ๋ฆฌ๋ฅผ ์‚ญ์ œํ•˜๋ ค๊ณ  ํ•  ๋•Œ โ€œ๋””๋ ‰ํ† ๋ฆฌ๊ฐ€ ๋น„์–ด ์žˆ์ง€ ์•Š๋‹คโ€œ๋Š” ์˜ค๋ฅ˜๋ฅผ ๋งˆ์ฃผ์นœ ๊ฒฝํ—˜์ด ์žˆ์„ ๊ฒ๋‹ˆ๋‹ค. ์ด๋Š” ๋Œ€๊ฐœ ํ•ด๋‹น ๋””๋ ‰ํ† ๋ฆฌ ๋‚ด์˜ ํŒŒ์ผ๋“ค์ด ์—ฌ์ „ํžˆ ์–ด๋–ค ํ”„๋กœ์„ธ์Šค์— ์˜ํ•ด ์‚ฌ์šฉ๋˜๊ณ  ์žˆ๊ธฐ ๋•Œ๋ฌธ์— ๋ฐœ์ƒํ•ฉ๋‹ˆ๋‹ค. ์ด ๊ธ€์—์„œ๋Š” lsof...

[์ปจํผ][OpenAI] 2023 Techniques for Maximizing LLM Performance ์š”์•ฝ

[์ปจํผ][OpenAI] 2023 Techniques for Maximizing LLM Performance ์š”์•ฝ Techniques for Maximizing LLM Performance ์œ ํŠœ๋ธŒ ๋งํฌ ์ด ์˜์ƒ์—์„œ๋Š” OpenAI์˜ ๊ฐœ๋ฐœ์ž ์ปจํผ๋Ÿฐ์Šค์—์„œ โ€œA Survey of Techniques for Maximizing LLM Performanc...

[์ปจํผ][OpenAI] 2023 DevDay Opening KeyNote ์š”์•ฝ

[์ปจํผ][OpenAI] 2023 DevDay Opening KeyNote ์š”์•ฝ OpenAI DevDay Opening KeyNote ์œ ํŠœ๋ธŒ ๋งํฌ โ€ป ํด๋ฆญ ์‹œ ํ•ด๋‹น ์˜์ƒ์œผ๋กœ ์ด๋™ํ•ฉ๋‹ˆ๋‹ค. ์ฃผ์š” ๋ฐœํ‘œ ์š”์•ฝ ์‚ฌ์ง„1. GPT4 - Turbo GPTs: ๋งž์ถคํ˜• ์ฑ—๋ด‡ ์ƒ์„ฑ ๋„๊ตฌ ์‚ฌ์ง„2. Creating Own Gpt ๊ฐœ์š”: OpenA...

[์ปจํผ][OpenAI] 2023 DevDay New Products: A Deep Dive ์š”์•ฝ

[์ปจํผ][OpenAI] 2023 DevDay New Products: A Deep Dive ์š”์•ฝ OpenAI DevDay: ์ƒˆ๋กœ์šด API์™€ ๊ธฐ๋Šฅ ์†Œ๊ฐœ ์œ ํŠœ๋ธŒ ๋งํฌ ์˜์ƒ ์š”์•ฝ ์ด ์˜์ƒ์€ OpenAI์˜ DevDay ํ–‰์‚ฌ์—์„œ ๋ฐœํ‘œ๋œ ์ƒˆ๋กœ์šด API์™€ ๊ธฐ๋Šฅ๋“ค์— ๋Œ€ํ•œ ์†Œ๊ฐœ๋ฅผ ๋‹ด๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. ์ฃผ์š” ๋‚ด์šฉ์€ ๋‹ค์Œ๊ณผ ๊ฐ™์Šต๋‹ˆ๋‹ค. 1. Assistants AP...