{"id":10979,"date":"2024-11-07T18:34:12","date_gmt":"2024-11-07T09:34:12","guid":{"rendered":"https:\/\/www.stechstar.com\/user\/wordpress\/?p=10979"},"modified":"2026-08-17T09:34:18","modified_gmt":"2026-08-17T00:34:18","slug":"%ec%9d%b8%ea%b3%b5%ec%a7%80%eb%8a%a5-%ea%b8%b0%ec%88%a0-webllm-%ec%86%8c%ea%b0%9c%ec%99%80-%ea%b5%ac%ec%a1%b0-%eb%b6%84%ec%84%9d","status":"publish","type":"post","link":"https:\/\/www.stechstar.com\/user\/wordpress\/%ec%9d%b8%ea%b3%b5%ec%a7%80%eb%8a%a5-%ea%b8%b0%ec%88%a0-webllm-%ec%86%8c%ea%b0%9c%ec%99%80-%ea%b5%ac%ec%a1%b0-%eb%b6%84%ec%84%9d\/","title":{"rendered":"[\uc778\uacf5\uc9c0\ub2a5 \uae30\uc220] WebLLM \uc18c\uac1c\uc640 \uad6c\uc870 \ubd84\uc11d"},"content":{"rendered":"

[\uc778\uacf5\uc9c0\ub2a5 \uae30\uc220] WebLLM \uc18c\uac1c\uc640 \uad6c\uc870 \ubd84\uc11d<\/h1>\n
\n

WebLLM \uc18c\uac1c\uc640 \uad6c\uc870 \ubd84\uc11d<\/h1>\n
\n
\n
\n
\n
\n
\n
\n
\n
\n
\"\uae40\ub355\ud604\"<\/a><\/p>\n
 <\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n
\n
\n
\n
\n
\n
\n
\n

\uae40\ub355\ud604<\/a><\/span><\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n

\n
\n
\n
\n
 <\/div>\n<\/div>\n<\/div>\n
\n
\n
\n
 <\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n

2022\ub144 11\uc6d4 ChatGPT\uac00 \ucd08\uae30 \ubca0\ud0c0\ubc84\uc804\uc744 \ucd9c\uc2dc\ud55c \uc774\ud6c4 \ub9ce\uc740 \uc0ac\uc6a9\uc790\ub4e4\uc774 \uc774\ub7ec\ud55c \uc5b8\uc5b4 \ubaa8\ub378\uc5d0 \uad00\uc2ec\uc744 \uac00\uc9c0\uace0 \ud55c\ub3d9\uc548 \ud3ed\ubc1c\uc801\uc778 \ubc18\uc751\uacfc \uc2dc\uc7a5\uc758 \ubcc0\ud654\ub97c \uac00\uc838\uc624\uba74\uc11c \uad00\uc2ec\uc774 \uc9d1\uc911\ub418\uace0 \uc788\uc2b5\ub2c8\ub2e4.<\/p>\n

\ud55c\ubc88\ucbe4 \uc0ac\uc6a9\ud574 \ubcf4\uc168\uc744(\ud639\uc740 \ub4e4\uc5b4 \ubcf4\uc168\uc744) LLM\uacfc \ucef4\ud30c\uc77c, \ube4c\ub4dc \uacfc\uc815\uc5d0 \ub300\ud574 \uac04\ub2e8\ud788 \uc18c\uac1c\ud558\uace0 \ucd5c\uadfc \ud06c\ub86c\uc5d0 \uc815\uc2dd \ud0d1\uc7ac\ub41c WebGPU\ub97c \uc0ac\uc6a9\ud55c WebLLM\uc758 \uad6c\uc870 \ud615\ud0dc\ub97c \uac00\ubccd\uac8c \ubd84\uc11d\ud574\ubcf4\uace0\uc790 \ud569\ub2c8\ub2e4.<\/p>\n

\uad00\ub828 \uc6a9\uc5b4\uc640 \uac1c\ub150 \uc18c\uac1c<\/h1>\n

\uc77c\ubc18\uc801\uc778 \uc5b4\ud50c\ub9ac\ucf00\uc774\uc158 \uc704\uc8fc\uc758 \uac1c\ubc1c\uc744 \uc218\ud589\ud574\uc628 \uc800\ub294 \uc0c8\ub85c\uc6b4 \ub3c4\uba54\uc778\uc774\uc790 \uc5d4\uc9c0\ub2c8\uc5b4\ub9c1 \uc601\uc5ed\uc774\uae30\ub3c4 \ud55c AI \ubc0f Machine learning\uc5d0 \ub300\ud574 \ud559\uc2b5\ud558\uba74\uc11c \ub2e4\uc591\ud55c \uc6a9\uc5b4\uc640 \uac1c\ub150\ub4e4\uc744 \uc0c8\ub85c \ud559\uc2b5\ud574\uc57c \ud588\uc2b5\ub2c8\ub2e4. \uc774\uc640 \uac19\uc740 \ubd84\ub4e4\uc744 \uc704\ud574 WebLLM\uc758 \uad6c\uc870\uc5d0 \ub300\ud574 \uc774\uc57c\uae30\ud558\uae30 \uc804\uc5d0 \uba3c\uc800 \uc6a9\uc5b4\uc640 \uae30\ubc18 \uac1c\ub150\ub4e4\uc744 \uc18c\uac1c\ud558\uace0\uc790 \ud569\ub2c8\ub2e4.<\/p>\n

LLM<\/h1>\n
\n
\n
\"\"<\/picture><\/div>\n<\/div>
https:\/\/twitter.com\/akshay_pachaar\/status\/1667147092614336512<\/a><\/figcaption><\/figure>\n

\ub300\ud615 \uc5b8\uc5b4 \ubaa8\ub378(Large Language Model)\uc774\ub77c\uace0\ub3c4 \ubd88\ub9ac\ub294 LLM\uc740 ChatGPT \ubca0\ud0c0 \ucd9c\uc2dc \uc774\ud6c4\ub85c \ub354\uc6b1 \uc720\uba85\ud574\uc9c4 \ub525\ub7ec\ub2dd \ubaa8\ub378\uc785\ub2c8\ub2e4. \uae30\ubcf8\uc801\uc778 \uac1c\ub150\uc73c\ub85c\ub294 \uc785\ub825\uac12\uc73c\ub85c \ub4e4\uc5b4\uc624\ub294 \uc790\uc5f0\uc5b4\ub97c \uae30\ubc18\uc73c\ub85c, \ud1b5\uacc4\ud559\uc801\uc73c\ub85c \uac00\uc7a5 \uc801\uc808\ud55c \ucd9c\ub825\uac12\uc744 \ub0b4\ub294 \uc6d0\ub9ac\ub85c \ub418\uc5b4 \uc788\uc2b5\ub2c8\ub2e4. \uac04\ub2e8\ud558\uac8c \uc774\uc57c\uae30\ud558\uc790\uba74 \ub2e4\uc74c \ub2e8\uc5b4\uac00 \ub098\uc62c \ud655\ub960\uc744 \uacc4\uc0b0\ud558\uc5ec \uadf8\ub7f4\ub4ef\ud55c \ubb38\uc7a5\uc744 \ub9cc\ub4e4\uc5b4\ub0b4\ub294 \uac83\uc774\ub77c\uace0 \ud560 \uc218 \uc788\uc2b5\ub2c8\ub2e4.<\/p>\n

MLC-LLM \ud504\ub85c\uc81d\ud2b8<\/h1>\n
\n
\n
\"\"<\/picture><\/div>\n<\/div>
MLC LLM\uc758 \uc138 \uac00\uc9c0 \ub3c5\ub9bd \ud558\uc704 \ubaa8\ub4c8: <\/span>https:\/\/llm.mlc.ai\/docs\/get_started\/project_overview.html<\/a><\/figcaption><\/figure>\n

MLC-LLM \ud504\ub85c\uc81d\ud2b8\ub294 LLM\uc744 \ub2e4\uc591\ud55c \ud658\uacbd\uc5d0\uc11c \ubc30\ud3ec\ud558\uace0 \ubc94\uc6a9 API\ub97c \ud1b5\ud574 \uc27d\uac8c \uc0ac\uc6a9\ud560 \uc218 \uc788\ub3c4\ub85d \ub3d5\ub294 \ubc30\ud3ec \uc194\ub8e8\uc158\uc785\ub2c8\ub2e4. \uc704 \uc774\ubbf8\uc9c0\uc640 \uac19\uc740 \uc77c\ub828\uc758 \uacfc\uc815\uc744 \ud1b5\ud574 \ubaa8\ub378\uc744 \uc815\uc758\ud558\uace0 \ucef4\ud30c\uc77c\ud55c \ud6c4 \uac01 \ub514\ubc14\uc774\uc2a4 \ud50c\ub7ab\ud3fc\ubcc4 \ub7f0\ud0c0\uc784\uc5d0\uc11c LLM\uc744 \uc2e4\ud589\ud560 \uc218 \uc788\ub3c4\ub85d \uad6c\uc131\ub418\uc5b4 \uc788\uc2b5\ub2c8\ub2e4.<\/p>\n

    \n
  1. MLC\uc5d0\uc11c \ubbf8\ub9ac \uc815\uc758\ud574 \ub454 \ubaa8\ub378(Llama2 \ub4f1)\uc744 \uc0ac\uc6a9\ud558\uac70\ub098, TVM Unity \uc778\ud130\ud398\uc774\uc2a4 \uae30\ubc18\uc758 \ud30c\uc774\uc36c\uc73c\ub85c \uc791\uc131\ub41c \ubaa8\ub378\uc744 \uad6c\ud604\ud574\uc57c \ud569\ub2c8\ub2e4.<\/li>\n
  2. \ud6c4\uc220\ud560 TVM Unity\ub97c \ud1b5\ud574 \ucef4\ud30c\uc77c\ub418\uba70, \uc774 \ub54c model lib, weights, config \uacb0\uacfc\ubb3c\uc774 export\ub429\ub2c8\ub2e4. \uc6b0\ub9ac\uac00 \uc0ac\uc6a9\ud558\uac8c \ub420 \uc6f9 \ube0c\ub77c\uc6b0\uc800\uc758 \ub77c\uc774\ube0c\ub7ec\ub9ac(WebAssembly)\ub294 .wasm\uc758 \ud615\ud0dc\ub85c \ub5a8\uc5b4\uc9c0\uac8c \ub429\ub2c8\ub2e4.<\/li>\n
  3. \uac01 \ub514\ubc14\uc774\uc2a4 \ud50c\ub7ab\ud3fc\ubcc4 \ub7f0\ud0c0\uc784\uc5d0\uc11c \ucef4\ud30c\uc77c\ub41c \ubaa8\ub378 \ub77c\uc774\ube0c\ub7ec\ub9ac\uc640 \uac00\uc911\uce58(weights), \uc124\uc815 \ub4f1\uc744 \ub85c\ub4dc\ud558\uc5ec \uc2e4\ud589\ub418\uba70, \uac01 \ub7f0\ud0c0\uc784\ubcc4 API\uac00 \uc81c\uacf5\ub429\ub2c8\ub2e4.<\/li>\n<\/ol>\n

    TVM<\/h1>\n
    \n
    \n
    \"\"<\/picture><\/div>\n<\/div>
    TVM\uc758 \ucef4\ud30c\uc77c\ub7ec \uc2a4\ud0dd\uacfc \ub7f0\ud0c0\uc784: https:\/\/www.kc-ml2.com\/posts\/blog_TVM<\/a><\/figcaption><\/figure>\n

    \uc774\ub7ec\ud55c LLM \ub4f1\uc758 AI \uc5b4\ud50c\ub9ac\ucf00\uc774\uc158\uc744 \uc0dd\uc131\ud558\uace0 \ud558\ub4dc\uc6e8\uc5b4 \uc7a5\uce58\uc5d0\uc11c \uc2e4\ud589\ud558\uae30 \uc704\ud574\uc11c\ub294 \uc6b0\ub9ac\uac00 \uc5b4\ud50c\ub9ac\ucf00\uc774\uc158\uc744 \ub9cc\ub4e4 \ub54c\uc640 \ub3d9\uc77c\ud558\uac8c \uc18c\uc2a4 \ucf54\ub4dc\ub97c \ubcc0\ud658\ud558\uc5ec \uc800\uc218\uc900\uc758 layer\uc5d0\uc11c \uc778\uc2dd\ud560 \uc218 \uc788\ub294 \ucf54\ub4dc\ub85c \ubcc0\ud658\ud558\uace0 \uc2e4\ud589\ud558\ub294 \uacfc\uc815\uc774 \ud544\uc694\ud569\ub2c8\ub2e4. \uc608\ub97c \ub4e4\uc5b4 \uc708\ub3c4\uc6b0 \ud658\uacbd\uc758 Nvidia \uadf8\ub798\ud53d \uc5f0\uc0b0 \uce74\ub4dc\uc5d0\uc11c AI \uc5b4\ud50c\ub9ac\ucf00\uc774\uc158\uc744 \uad6c\ub3d9\ud574\uc57c \ud560 \uacbd\uc6b0, python\uc73c\ub85c \uc124\uacc4\ud55c \ubaa8\ub378 \ucf54\ub4dc\ub294 C++ \ubc0f CUDA \ucf54\ub4dc\ub85c \ubcc0\ud658\ub418\uace0 \ucd5c\uc885\uc801\uc73c\ub85c \uac01 \ud558\ub4dc\uc6e8\uc5b4\ub97c \uc704\ud55c \uc5b4\uc148\ube14\ub9ac \uc5b8\uc5b4\ub85c\uc368 \ubcc0\ud658\ub429\ub2c8\ub2e4.<\/p>\n

    Apache TVM\uc774\ub77c\ub294 end-to-end \uc624\ud508\uc18c\uc2a4 \ucef4\ud30c\uc77c\ub7ec\uc5d0\uc11c\ub294 \uc774\ub7ec\ud55c \uacfc\uc815(\ub525\ub7ec\ub2dd \uc2dc\uc2a4\ud15c \uc2a4\ud0dd)\uc5d0 \ub300\ud574 \uc778\ud130\ud398\uc774\uc2a4\ub97c \uc81c\uacf5\ud558\uba70 \uc544\ub798\uc5d0\uc11c \uc0b4\ud3b4\ubcfc WebLLM\uc744 \uc704\ud55c WebAssembly \ub7f0\ud0c0\uc784 \ub610\ud55c \uc81c\uacf5\ub429\ub2c8\ub2e4.<\/p>\n

    WebLLM<\/h1>\n

    MLC\uc5d0\uc11c\ub294 TVM\uc5d0\uc11c \uc81c\uacf5\ud558\ub294 WebAssembly \ub7f0\ud0c0\uc784 \ubc0f \uc790\ubc14\uc2a4\ud06c\ub9bd\ud2b8 \uc778\ud130\ud398\uc774\uc2a4\ub97c \uc751\uc6a9\ud558\uc5ec Chat \ud615\uc2dd\uc73c\ub85c \uad6c\uc131\ub41c WebLLM\uc744 \ubc30\ud3ec\ud588\uc2b5\ub2c8\ub2e4. \uc774\ub97c \uc0ac\uc6a9\ud558\uba74 \uc11c\ubc84\uc640\uc758 \ud1b5\uc2e0 \uc5c6\uc774 \uc624\ub85c\uc9c0 \uc6f9 \ube0c\ub77c\uc6b0\uc800\uc5d0\uc11c WebGPU\uc758 \uac00\uc18d\uc744 \uc0ac\uc6a9\ud558\uc5ec LLM\uc744 \uad6c\ub3d9\ud560 \uc218 \uc788\uc2b5\ub2c8\ub2e4.<\/p>\n

    WebGPU<\/h1>\n

    WebGPU\ub294 WebGL\uc758 \ud6c4\uc18d \ubc84\uc804 API\uc785\ub2c8\ub2e4. \uc774\ubbf8\uc9c0 \ub4f1 \uadf8\ub798\ud53d \uc5f0\uc0b0\uc5d0 \uc9d1\uc911\ub418\ub358 WebGL\uacfc\ub294 \ub2e4\ub974\uac8c GPU\uc5d0\uc11c \uc77c\ubc18\uc801\uc778 \uacc4\uc0b0\uc744 \uc218\ud589\ud558\ub294 \ub370 \ub354 \ucd5c\uc801\ud654\ub418\uc5b4 \uc788\uc2b5\ub2c8\ub2e4. \ub610\ud55c \ub124\uc774\ud2f0\ube0c API\ub97c \uc9c1\uc811 \ubbf8\ub7ec\ub9c1\ud558\uc9c0 \uc54a\uace0 \uc790\uccb4\uc801\uc778 \ucd94\uc0c1\ud654\ub97c \ub3c4\uc785\ud558\uc5ec \uc6f9\uc6a9 API\uc5d0 \uc801\ud569\ud558\uc9c0 \uc54a\uc740 \uac1c\ub150\ub4e4(\uc800\uc218\uc900\uc758 \uba54\ubaa8\ub9ac \uad00\ub9ac \ub4f1)\uc744 \uc228\uae30\uace0 \ud3b8\ud558\uac8c \uc0ac\uc6a9\ub420 \uc218 \uc788\ub3c4\ub85d \uc124\uacc4\ub418\uc5c8\uc2b5\ub2c8\ub2e4.<\/p>\n

    \n
    \n
    \"\"<\/picture><\/div>\n<\/div>
    \ub2e4\ub9cc \ud604\uc7ac(2023.10)\ub294 \ud06c\ub86c 113 \uc774\uc0c1(Windows, MacOS, ChromeOS)\uc5d0\uc11c\ub9cc \uc9c0\uc6d0\ud558\uace0 \uc788\uc2b5\ub2c8\ub2e4: https:\/\/caniuse.com\/?search=webgpu<\/a><\/figcaption><\/figure>\n

    WebLLM \ud658\uacbd \uad6c\ucd95\ud558\uae30<\/h1>\n
    ???? \uc21c\uc11c: emscripten \uc124\uce58 \u2192 tvmjs \ucef4\ud30c\uc77c \u2192 web-llm \ube4c\ub4dc<\/span><\/pre>\n
    WebLLM\uc744 \ub85c\uceec\uc5d0\uc11c \ube4c\ub4dc\ud558\uace0 \ud328\ud0a4\uc9d5\ud558\uae30 \uc704\ud574\uc11c\ub294 \uba87 \uac00\uc9c0 \uc791\uc5c5\uc774 \ud544\uc694\ud569\ub2c8\ub2e4. WebLLM \ube4c\ub4dc\uc5d0 \uc55e\uc11c \uc758\uc874\uc131 \ud328\ud0a4\uc9c0\ub97c \uc0b4\ud3b4\ubcf4\uba74, tvmjs\ub9cc \uc720\uc77c\ud558\uac8c \ud328\ud0a4\uc9c0\ub85c \uc81c\uacf5\ub418\uc9c0 \uc54a\uace0 \uc18c\uc2a4 \ucef4\ud30c\uc77c\uc774 \ud544\uc694\ud569\ub2c8\ub2e4.<\/p>\n
    tvmjs \ucef4\ud30c\uc77c\uc744 \uc704\ud574\uc11c\ub294 emscripten\uc744 \uba3c\uc800 \uc124\uce58\ud574\uc57c \ud569\ub2c8\ub2e4. emscripten\uc740 LLVM\uc744 \uc0ac\uc6a9\ud558\ub294 \uc5b8\uc5b4(C\/C++)\ub97c \uc6f9 \uc5b4\uc148\ube14\ub9ac\ub85c \ucef4\ud30c\uc77c\ud560 \uc218 \uc788\ub3c4\ub85d \uc81c\uacf5\ud558\ub294 \ud234\uccb4\uc778\uc774\uba70, TVM\uc758 WebAssembly \ub7f0\ud0c0\uc784\uc744 \ucef4\ud30c\uc77c\ud558\uace0 \uc2dc\uc2a4\ud15c \ub77c\uc774\ube0c\ub7ec\ub9ac \uc9c0\uc6d0\uc744 \uc81c\uacf5\ud558\uae30 \uc704\ud574 \ud544\uc694\ud569\ub2c8\ub2e4.<\/p>\n
    \n
    \n
    \"\"<\/picture><\/div>\n<\/div>
    emscripten SDK \uc124\uce58 \uacfc\uc815: https:\/\/emscripten.org\/docs\/getting_started\/downloads.html#installation-instructions-using-the-emsdk-recommended<\/a><\/figcaption><\/figure>\n
    emscripten \uc124\uce58\uac00 \uc644\ub8cc\ub418\uc5c8\ub2e4\uba74, WebLLM repo<\/a>\uc758 \uc2a4\ud06c\ub9bd\ud2b8(scripts\/prep_deps.sh<\/em>)\ub97c \uc2e4\ud589\ud558\uc5ec \uc21c\uc11c\ub300\ub85c tvmjs\ub97c \ucef4\ud30c\uc77c\ud558\uace0 \ud328\ud0a4\uc9c0\ub97c \ube4c\ub4dc\ud560 \uc218 \uc788\uc2b5\ub2c8\ub2e4.<\/p>\n
    \n
    \n
    \"\"<\/picture><\/div>\n<\/div>
    script\/prep_deps.sh<\/figcaption><\/figure>\n
    \n
    \n
    \"\"<\/picture><\/div>\n<\/div>
    script\/prep_deps.sh \uc2e4\ud589 \uacb0\uacfc<\/figcaption><\/figure>\n
    WebLLM \uad6c\uc870<\/h1>\n
    WebLLM\uc758 Javascript\ub2e8 API \uad6c\uc870\ub294 \uc0c1\ub300\uc801\uc73c\ub85c \ub2e8\uc21c\ud558\uac8c \uad6c\uc131\ub418\uc5b4 \uc788\uc2b5\ub2c8\ub2e4. \uc6b0\ub9ac\uac00 \ud754\ud788 \uc811\ud574\uc654\ub358 ChatGPT\uc640 \uac19\uc740 \ud615\ud0dc\uc758 LLM\uc744 \uc11c\ud3ec\ud2b8\ud558\uae30 \uc704\ud574\uc11c \uc544\ub798\uc640 \uac19\uc774 chat \uc11c\ube44\uc2a4\uc5d0 \ucd08\uc810\uc774 \ub9de\ucdb0\uc9c4 \ud575\uc2ec \ubaa8\ub4c8\ub4e4\ub85c \uad6c\uc131\ub418\uc5b4 \uc788\uc2b5\ub2c8\ub2e4.<\/p>\n