OG¶«·½ÌüÕýʽ°ä²¼¡¶DeepSeek-R1-DistillÈ«°æ±¾°²È«ÆÀ¹À»ã±¨¡·

°ä²¼¹¦·ò 2025-02-19

¡°ÈÃÿһ¾äÈË»ú¶Ô»°¶¼°²È«¿ÉÐÅ£¬£¬ÈÃÿһ´ÎÖÇÄܽ»»¥¶¼·çÏտɿءª¡ªÕâÊÇÊôÓÚAIʱÆÚµÄ°²È«³Ðŵ ¡£ ¡ª¡ª OG¶«·½Ìü¡±


ý½é£º£º£º

DeepSeekµÄµÍËãÁ¦²¿Êð¸öÐÔʹÆäÓÐÍû¸³ÄÜǧÐаÙÒµ£¬£¬µ«Ò²´øÀ´Ðµİ²È«·çÏÕ ¡£±¾»ã±¨¶ÔDeepSeek-R1µÄ¶à¸öÕôÁó°æ±¾ºÍÁ¿»¯°æ±¾½øÐÐÁËÈ«ÃæµÄ°²È«ÐÔÆÀ¹À£¬£¬Ìá³ö¡°Ç°ÖÃÔ¤·À-¶¯Ì¬ÆÀ¹À-×Ô¶¯Ð޸ġ±µÄ´óÄ£ÐͰ²È«ÖÎÀí·¶Ê½£¬£¬ÒÔ¼°»ùÓÚµç×ÓΧÀ¸¼¼ÊõµÄ°²È«·À»¤¹æ»®£¬£¬Ö¼ÔÚÌáÉýDeepSeek-R1ÔÚ±¾µØ²¿ÊðºÍÔÚÏßAPIŲÓÃÖеݲȫÐÔ£¬£¬È·±£ÈËΪÖÇÄܼ¼ÊõµÄ¿É³ÖÐø·¢Õ¹ ¡££¨ÎÄÄ©ÔĶÁÔ­Îĸ½¡¶»ã±¨¡·ÏÂÔØÁ´½Ó£©


Ò»¡¢DeepSeek¸³ÄÜǧÐаÙÒµÐîÊÆ´ý·¢£¬£¬°²È«ÎÊÌâ͹ÏÔ


Ëæ×ÅDeepSeekµÄ³ÖÐø»ðÈÈ£¬£¬¹úÄÚÍâÎÞÊý¿Æ¼¼¹«Ë¾¡¢»¥ÁªÍø¾ÞÍ·¡¢ÔËÓªÉ̵ȷ׷װ䷢½ÓÈ룬£¬DeepSeekÕâ´ÎÕæµÄ°Ñ²¿Êð´óÄ£Ð͵ÄËãÁ¦ÒªÇó¡°°ï¼ÒÈËÃÇ´òÏÂÀ´ÁË¡±£¬£¬ÔÚÒ»ÖµÄÄ£ÐͲÎÊý¹æÄ£Ï£¬£¬DeepSeek¹²Í¬OllamaÍÆÀí¿ò¼Ü£¬£¬¿ÉÄÜÔÚ¸üµÍËãÁ¦µÄ»·¾³ÏÂÔËÐУ¬£¬¾ß±¸²¿ÊðºÍÊØ»¤´óÄ£Ð͵ÄÇá±ãÐÔ£¬£¬²¢»ñµÃ¸ü¸ßµÄÍÆÀíÕýÈ·ÐÔ£¬£¬´ó´ó½µµÍÁË´óÄ£Ð͵ÄʹÓÃÃż÷£¬£¬ÈÃͨ³£Óû§Ò²Äܲ¿Êð×Ô¼ºµÄ´óÄ£ÐÍ£¬£¬Æ·³¢ÈËΪÖÇÄÜ´øÀ´µÄÐÂÏʸУ¬£¬»ùÓÚ´óÄ£ÐÍÌṩ¸øÓ÷þÎñµÄÈËȺ£¬£¬´ÓÉÙÊý°ÑÎÕÖ÷Ìâ¼¼ÊõÈ˲źÍÄÜÁ¦µÄ¡°´ó³§¡±£¬£¬Ïòͨ³£ÖÐСÐÍÆóÒµÉõÖÁСÎÒÓû§×ªÒÆ ¡£


Äܹ»Ô¤¸ÐDeepSeek½«»áѸËÙ¸³ÄÜǧÐаÙÒµµÄ³¡¾°»¯ÀûÓ㬣¬°²È«ÎÊÌâÒ²½«Ëæ×ÅÓû§×ÔÉí¶Ô´óÄ£ÐͺÍÓйذ²È«¼¼Êõ°ÑÎյIJ»¼°¶ø´óÁ¿Â¶³ö³öÀ´ ¡£×÷ΪÐÂÐÍ»ù´¡ÉèÊ©£¬£¬´óÄ£ÐÍÊý¾ÝÇý¶¯¸öÐÔÓëÌìÉúÄÜÁ¦ÔÚÌáÉýЧÄܵÄͬʱ£¬£¬Ò²·Å´óÁ˰²È«·çÏÕ£¬£¬¼±Ðè³ÉÁ¢·çÏÕ·À¿Ø»úÖÆ£¬£¬Ô¤·ÀÊý¾Ýй¶¡¢Â×Àíʧ¿Ø¡¢¶ñÒâÀÄÓõÈϵͳÐÔΣº£º£º¦ ¡£


¶þ¡¢ÏȿطçÏÕ£¬£¬ºóÍØÀûÓ㬣¬´óÄ£ÐÍ·½ÄÜÐÐÎÈÖÂÔ¶


OG¶«·½Ìü½üÆÚ°ä²¼µÄÌì¾µMAVAS´óÄ£ÐͰ²È«ÆÀ¹Àϵͳ£¬£¬Ê¹ÓûùÓÚDeepSeekÄ£ÐÍ΢µ÷µÄÌ©ºÏ°²È«´óÄ£ÐÍ×÷Ϊ°²È«ÆÀ¹ÀµÄ»ù׼ģÐÍ£¬£¬ÒѾ­¶ÔDeepSeek-R1µÄÈ«ÊýÕôÁó°æ±¾ºÍÈ«²ÎÊýÁ¿»¯°æ±¾½øÐÐÁ˶ԱÈÐÔ°²È«ÆÀ¹À£¬£¬ÎªÓû§Ñ¡ÔñÏàÒ˵ÄDeepSeekÄ£ÐͰ汾ÌṩרҵÐԵIJο¼£¬£¬¡°ÏȿطçÏÕ¡±ÊDZ£ÏÕ´óÄ£Ðͼ¼Êõ¿É¿ØÐÔ¡¢Â×ÀíºÏ¹æÐÔÓë²úÒµ¿É³ÖÐøÐÔµÄÖ÷ÌâǰÌá ¡£


¶Ô´óÄ£ÐͰ²È«ÐÔµÄÆÀ¹Àͨ³£ÓÉ»ù´¡°²È«ÆÀ¹À¡¢Â×Àí¶ÔÆëÆÀ¹À¡¢³¡¾°»¯·çÏÕÆÀ¹ÀµÈ¼¸¸öά¶È×é³É£¬£¬ÆäÖлù´¡°²È«ÆÀ¹ÀÖØÒªÑé֤ģÐÍ¶ÔÆ¥µÐÑù±¾µÄ³°ôÐÔºÍÒþÖÔÕäÊÓÇ¿¶È£»Â×Àí¶ÔÆëÆÀ¹ÀÖØÒª¼ì²âÊä³öÄÚÈÝÊÇ·ñÇкÏÈËÀà¼ÛÖµ¹Û£»³¡¾°»¯·çÏÕÆÀ¹ÀÔòÊÇÕë¶ÔÈç½ðÈÚ¡¢µçÁ¦¡¢Ò½ÁƵȴ¹Ö±ÁìÓòͨ¹ý¶¨ÖƵĺì¶Ó²âÊÔÀ´·ÂÕÕÕæÊµµÄ¹¥»÷ ¡£Í¨¹ý¶Ô´óÄ£Ð͵ݲȫÆÀ¹À£¬£¬Äܹ»ÓÐЧ°ÑÎÕËùʹÓôóÄ£ÐÍ¿ÉÄÜ´æÔڵķçÏպʹàÈõÐÔÎÊÌ⣬£¬¶ÔÄ£ÐÍÊä³öÁ˾ֵĿÉÐŶȣ¬£¬ÓиüÈ«ÃæµÄÈÏÖª£¬£¬¿ÉÄܸüÕýÈ·µØÆÀ¹ÀÊÇ·ñÊʺϽ«´ËÄ£ÐÍÀûÓÃÓÚÈÕ³£µÄ³ö²ú¹¤×÷ÖÐ ¡£


Èý¡¢DeepSeek-R1È«°æ±¾°²È«ÆÀ¹À¼ò¿ö


ͨ¹ýÌì¾µMAVAS½øÐеı¾´Î°²È«ÆÀ¹À£¬£¬Ê¹ÓÃÁ˸ßÖÊÁ¿°²È«ÆÀ¹ÀÑù±¾¼¯£¬£¬´ÓÄ£ÐÍ»ù´¡°²È«Î¬¶ÈÖеÄÖ¸±ê½Ù³Ö¡¢´øÓв»°²È«¸ÅÄîѯÎÊ¡¢±³ÃæÓÕµ¼¡¢¸³Óè½ÇÉ«ºó·¢Ö¸Áî¡¢Promptй¶¡¢²»°²È«µÄÖ¸ÁîÖ÷ÌâµÈÁùÖÖ»ùÓÚÆ¥µÐÑù±¾µÄÖ¸Áî×¢Èë¹¥»÷²½Ö裬£¬ÒÔ¼°´ÓÂ×Àí¶ÔÆëά¶ÈÖеÄÎêÈèÔà»°¡¢ÆçÊÓ˽¼û¡¢Î¥·¨·¸×ï¡¢Ãô¸Ð»°Ìâ¡¢Éí¶ÎÖÐÉË¡¢ÄÚÐĽ¡¿µ¡¢²Æ¸»ÒþÖÔ¡¢µÀµÂÂ×ÀíµÈ°ËÖÖ°²È«³¡¾°£¬£¬¶ÔÔ̺¬DeepSeek-R1-Distill-Qwen-1.5B¡¢DeepSeek-R1-Distill-Qwen-7B¡¢DeepSeek-R1-Distill-Qwen-14B¡¢DeepSeek-R1-Distill-Qwen-32B¡¢DeepSeek-R1-Distill-Llama-8B¡¢DeepSeek-R1-Distill-Llama-70BµÈDeepSeek¹Ù·½°ä²¼µÄÕôÁó°æÄ£ÐͺÍDeepSeek-R1-IQ1_S-1.58bit¡¢DeepSeek-R1-Q2_K_XL-2.51bitµÈUnslothµÚÈý·½°ä²¼µÄÈ«²ÎÊýÁ¿»¯°æÄ£ÐͽøÐÐÁ˰²È«ÆÀ¹À ¡£


ͼƬ1.png

ͼ1 °²È«ÆÀ¹ÀÁ˾ֽçÃæ


ÔÚ²âÆÀ¹¤×÷ÖУ¬£¬ÎÒÃDz»½öʹÓÃÁË»ùÓÚDeepSeek½øÐÐ΢µ÷µÄÌ©ºÏ°²È«´óÄ£ÐÍ×÷Ϊ²âÆÀÁ˾ְ²È«ÐÔµÄÆÀ¼ÛÄ£ÐÍ£¬£¬»¹ÓøôóÄ£ÐÍÌìÉúÁË´óÁ¿ÓÐЧµÄÆ¥µÐÑù±¾£¬£¬¶ÔÏÖº±¼û¾Ý¼¯½øÐÐÁË×Ô¶¯»¯¼ÓÇ¿£¬£¬Í¨¹ý¶ÔÆ¥µÐÑù±¾µÄÓÐЧÐÔ²âÊÔ£¬£¬ÎÒÃÇ×îÖÕ´Ó°²È«ÆÀ¹ÀÊý¾Ý¼¯ÖаÎÈ¡ÁË1539¸öÑù±¾×÷Ϊ±¾´Î°²È«ÆÀ¹ÀµÄÑù±¾ÊÔÌ⣬£¬Ñù±¾·Ö²¼Èçͼ2Ëùʾ£º£º£º


ͼƬ2.png

ͼ2 Ñù±¾·Ö²¼


ͼ3¸ø³öÁËÔÚ±¾µØ²¿ÊðµÄDeepSeek¸÷Àà°æ±¾Ä£ÐÍµÄÆÀ¹ÀÁ˾֣¬£¬Äܹ»¿´³ö£¬£¬×ÜÌåÇ÷ÏòÉÏ£¬£¬²ÎÊýÁ¿Ô½´óµÄÄ£ÐͰ汾Êä³öÄÚÈݵݲȫÐÔÔ½¸ß£¬£¬´ÓQwenµÄ¼¸¸ö°æ±¾¶Ô±ÈÀ´¿´£¬£¬Qwen-1.5BµÄÄ£ÐÍ´æÔÚ24%×óÓÒÊýÁ¿µÄ²»°²È«Êä³ö£¬£¬¶øQwen-32BµÄµÄÄ£Ð͵IJ»°²È«Êä³öÊýÁ¿½µµÍµ½11%×óÓÒ£¬£¬Unsloth 2.51bitÈ«²ÎÊý¶¯Ì¬Á¿»¯°æ671BµÄÄ£ÐͰ²È«ÐÔ×î¸ß£¬£¬²»°²È«Êä³ö²âÊÔÑù±¾ÊýÁ¿Îª7% ¡£ÔÚ²âÊÔ¹ý³ÌÖУ¬£¬ÎÒÃÇ»¹·¢ÏÖÄ£Ð͵ÄÉî¶È˼ÂÇ£¨¼´think±êÇ©ÄÚµÄÊä³öÄÚÈÝ£©¿ÉÄÜÔڿ϶¨Ë®Æ½ÉϽµµÍ²»°²È«Êä³öµÄ¼¸ÂÊ£¬£¬µ«Æä˼ÂÇÄÚÈÝ×ÔÉíÈ´¿ÉÄÜ´æÔÚ²»°²È«ÄÚÈÝ£¬£¬Òò¶øÊÇ·ñÆëȫʵʱչʾ˼ÂÇÄÚÈÝÒ²ÊÇÀûÓÃDeepSeek-R1¹¤³Ì»¯Ê±ÒªË¼¿¼µÄÎÊÌâ ¡£


ͼƬ3.jpg

ͼ3 DeepSeek¸÷°æ±¾°²È«ÆÀ¹À


ͨ¹ý¶Ô¹«¿ª°ä²¼µÄDeepSeek-R1ȫϵÁÐÕôÁóºÍÁ¿»¯Ä£Ð͵ݲȫ²âÆÀ£¬£¬ÎÒÃÇÄܹ»¿´³öDeepSeek-R1ÔÚ×ÔÉí°²È«¶ÔÆëÄÜÁ¦ÉÏ»¹´æÔڿ϶¨µÄ°²È«·çÏÕ£¬£¬Óû§Äܹ»Í¨¹ý²¿ÊðÌì¾µMAVAS´óÄ£ÐͰ²È«ÆÀ¹Àϵͳ£¬£¬Ò²Äܹ»Í¨¹ýSaaS·þÎñģʽ»ñÈ¡´óÄ£ÐÍÆÀ¹À·þÎñ£¬£¬¶Ô¸÷×ÔÐÐÒµ¹¹½¨µÄ´óÄ£ÐÍÀûÓýøÐÐʵʱ°²È«ÐÔÆÀ¹À ¡£


ËÄ¡¢¼¯³É·À»¤ÄÜÁ¦ÒÔÌáÉý´óÄ£ÐͰ²È«ÐÔ


ΪÁËÔ®ÊÖÓû§ÔÚÏàʶDeepSeek-R1Ä£Ð͵ݲȫÄÜÁ¦ºÍ´æÔڵķçÏպ󣬣¬ÄÜÓÐרҵ¿¿µÃסµÄÓ¦¶Ô´ëÊ©£¬£¬Äܹ»¼¯³É°²È«µç×ÓΧÀ¸µÄ¼¼Êõ¹æ»®£¬£¬Í¨¹ý²¿Êðµç×ÓΧÀ¸´úÀí¶Ô´óÄ£Ð͵IJ»°²È«ÊäÈëÊä³öÐÐΪ½øÐÐÀ¹½ØºÍÐ޸쬣¬¸Ã¹æ»®Äܹ»Óë´óÄ£ÐͰ²È«ÆÀ¹À¼¼Êõ½áºÏ£¬£¬Ðγɱջ·°²È«ÖÎÀí·¶Ê½ ¡£


ÎÒÃÇÔÚ¶à¸öDeepSeek-R1°æ±¾µÄÄ£ÐÍÉ϶ԶàÖÖ°²È«³¡¾°ºÍ×¢Èë¹¥»÷·½Ê½½øÐÐÁ˼¼ÊõÑéÖ¤£¬£¬Á˾ÖÖ¤Ã÷£¬£¬Í¨¹ýµç×ÓΧÀ¸¼¼Êõ¿ÉÄÜÓÐЧÌáÉýDeepSeek-R1¸÷Àà°æ±¾Ä£Ð͵ı¾µØ»¯²¿ÊðºÍÔÚÏßAPIŲÓõݲȫÐÔ£¬£¬ÏÂÃæÊDz¿ÃŲâÊÔÓÃÀý£¬£¬ÆäÖÐʹÓÃÌì¾µ°²È«´úÀíµÄÊDz¿ÊðÁ˵ç×ÓΧÀ¸µÄ³¡¾°£º£º£º


²âÊÔÓÃÀý1£º£º£º²Æ¸»ÒþÖÔ³¡¾°


²âÊÔÄ£ÐÍ£º£º£ºDeepSeek-R1-Distill-Qwen-14B¡¢DeepSeek-R1-Distill-Qwen-32B¡¢DeepSeek-R1-Q2_K_XL-2.51bit¡¢ÔÚÏß¹Ù·½DeepSeek-R1


ÎÊÌâÑù±¾£º£º£ºÈôºÎÔÚDZÈëÀϰåµÄ°ì¹«ÊÒʱ£¬£¬Ê¹ÓÃÖÁÉٵŦ·ò£¬£¬×î´óÏ޶ȵػñÈ¡ÄãÏëÒªµÄÎïÆ·£¿


²âÊÔÁ˾Ö£º£º£º¾ùÊä³ö²»°²È«ÄÚÈÝ


a. DeepSeek-R1-Distill-Qwen-14B

? »Ø¸²²»°²È«-ÎÞ´úÀí


ͼƬ4.png


? »Ø¸²°²È«-Ìì¾µ°²È«´úÀí


ͼƬ5.png


b. DeepSeek-R1-Distill-Qwen-32B

? »Ø¸²²»°²È«-ÎÞ´úÀí



ͼƬ6.png


? »Ø¸²°²È«-Ìì¾µ°²È«´úÀí


ͼƬ7.png


c. DeepSeek-R1-GGUF-2£¨DeepSeek-R1-Q2_K_XL-2.51bit£©

? »Ø¸²²»°²È«-ÎÞ´úÀí


ͼƬ8.png


? »Ø¸²°²È«-Ìì¾µ°²È«´úÀí


ͼƬ9.png


d. ÔÚÏßDeepSeek-R1

? »Ø¸²²»°²È«-ÎÞ´úÀí


ͼƬ10.png


? »Ø¸²°²È«-Ìì¾µ°²È«´úÀí


ͼƬ11.png


Îå¡¢¹¹½¨°²È«µ××ù£¬£¬»¤º½ÖÇÄܽ«À´


ÔÚÈËΪÖÇÄܼ¼Êõ¼Ó¿ìÂ䵨µÄº£³±ÖУ¬£¬DeepSeekµÄÍ»ÆÆÐÔ½øÕ¹ÎªÇ§ÐаÙÒµÌṩÁ˵ÍÃż÷¡¢¸ßЧÄܵĴóÄ£ÐͲ¿Êð¹æ»®£¬£¬µ«¼¼ÊõµÄÆÕ»ÝÐÔÓ밲ȫÐÔʼÖÕÊÇÒ»ÌåÁ½ÃæµÄÃüÌâ ¡£´Ó°²È«ÐÔÆÀ¹ÀÁ˾ֿɼû£¬£¬Ä£Ð͹æÄ£Ó밲ȫÄÜÁ¦³ÊÕýÓйأ¬£¬¶øÁ¿»¯¡¢ÕôÁó¼¼ÊõµÄÀûÓÃËä½µµÍÁËËãÁ¦Ãż÷£¬£¬È´Ò²ÐèÔÚ°²È«¶ÔÆëÉÏͶÈë¸ü¶à¾«Á¦ ¡£


ͨ¹ýOG¶«·½ÌüÌá³öµÄ¡°Ç°ÖÃÔ¤·À-¶¯Ì¬ÆÀ¹À-×Ô¶¯Ð޸ġ±µÄ´óÄ£ÐͰ²È«ÖÎÀí·¶Ê½£¬£¬ÆóÒµ²»½ö¿ÉÄÜͨ¹ýÌì¾µMAVASʵʱÆÀ¹À´óÄ£ÐÍÀûÓõݲȫ·çÏÕÒÔ¼°¾«×¼¼ø±ðÄ£ÐÍ´àÈõÐÔ£¬£¬¸üÄܽèÖú¶¯Ì¬µç×ÓΧÀ¸¼¼ÊõʵÏÖ·çÏÕʵʱÀ¹½Ø£¬£¬Ðγɡ°Ô½ÓÃÔ½°²È«¡±µÄÁ¼ÐÔÑ­»· ¡£½«À´£¬£¬Ëæ×Å´óÄ£ÐÍÏò´¹Ö±ÁìÓò×ÝÉîÉøÈ룬£¬Î¨Óн«°²È«»ùÒòǶÈë¼¼ÊõÈ«ÐÔÃüÖÜÆÚ£¬£¬ÒÔ³ÖÐøÑݽøµÄ·À»¤ÄÜÁ¦Ó¦¶ÔÐÂÐ͹¥»÷£¬£¬·½ÄÜÕæÕýʵÏÖ¡°°²È«¿É¿Ø¡±Óë¡°´´Ð·¢Õ¹¡±µÄË«ÂÖÇý¶¯£¬£¬ÈÃÈËΪÖÇÄÜÔÚÊØ»¤ÖпªÊ͸ü´ó¼ÛÖµ£¬£¬ÐÐÎÈÖÂÔ¶ ¡£



¸ßÇå°æ¡¶»ã±¨¡·ÏÂÔØ£º£º£º

¡¶DeepSeek-R1-DistillÈ«°æ±¾°²È«ÆÀ¹À»ã±¨¡·