

çŽç²ãªKeras 3ã§æ§ç¯ãããäºååŠç¿æžã¿ãã©ã³ã¹ãã©ãŒããŒã¢ãã«ãJAXãPyTorchãTensorFlowäžã§å®è¡å¯èœã§ãã
Loading commentsâŠ
ã¡ãŒã«ãŒ
sleepyfox
ãŠã§ããµã€ããèŠã
imvision12.github.io/KerasFormers/
ãããžã§ã¯ãæ å ±
補åããŒã¯ãŒã
KerasFormersã¯ãçŽç²ãªKeras 3ã§æ§ç¯ãããäºååŠç¿æžã¿ãã©ã³ã¹ãã©ãŒããŒã¢ãã«ã®ã©ã€ãã©ãªã§ãéã¿ã¯å
ã®ãã§ãã¯ãã€ã³ããã倿ãããŠããŸããç©äœæ€åºãã»ã°ã¡ã³ããŒã·ã§ã³ããé³å£°èªèãå€§èŠæš¡èšèªã¢ãã«ãŸã§ã118ã®ã¢ãã«ãã¡ããªãŒãã«ããŒããJAXãPyTorchãTensorFlowããã¯ãšã³ãã§åãã³ãŒããåäœããŸããå®è¡æã«transformersãtorchã®äŸåé¢ä¿ã¯äžèŠã§ãææ°ã®ã¢ãŒããã¯ãã£ãæ±ãããã®è»œéã§ãã¬ãŒã ã¯ãŒã¯ã«äŸåããªãä»£æ¿ææ®µãæäŸããŸãã
ãã¹ãŠã®ã¢ãã«ã¯from_weightsã§æ§ç¯ããããã®åŸããã»ããµãçæãããã®ãå
¥åãšããŠåãåããŸããæ€åºåšã深床æšå®åšãLLMã®ããããå®è¡ããå Žåã§ããã¯ãŒã¯ãããŒã¯åäžã§ãããã®ãããã¿ã¹ã¯ãåãæ¿ããŠãåŠç¿æ²ç·ãã³ãŒã倿Žã®ã³ã¹ãã¯ããããŸããã
from_weightsã¯èªåçã«ãã£ã¹ãããããŸããHubäžã®äºå倿æžã¿Kerasãªããžããªãã¢ããã¹ããªãŒã ã®ãã§ãã¯ãã€ã³ãããã®å Žã§å€æãããã¢ããªã¢ã³ãåããŸãã¯hf:ãã¬ãã£ãã¯ã¹ãæã€äºææ§ã®ããHugging Faceãªããžããªãåãå
¥ããŸããã¯ã©ã¹æ°ãªã©ã®ã¢ãŒããã¯ãã£è©³çްã¯ãªããžããªèšå®ããèªã¿åãããããããã¡ã€ã³ãã¥ãŒãã³ã°æžã¿ã¢ãã«ã远å èšå®ãªãã§åäœããŸãã
éã¿ã®ã¿ã®int8ãint4ãfp8ãmxfp4ã¯ãä»»æã®ã¢ãã«ã§åãfrom_weightsåŒã³åºãã®åŒæ°ã§ããGPT-OSS 120Bã®ãããªå€§èŠæš¡ãã§ãã¯ãã€ã³ãã¯ãMoEãšãã¹ããŒããMXFP4ã«ããã¯ãããã®å Žã§ééååããŠbfloat16ã§èªã¿èŸŒãŸããã¡ã¢ãªãfp32ã®çŽ130 GBã§ã¯ãªãçŽ66 GBã«æããŸãã
ã¢ãã«ããŒãžã®ãã¹ãŠã®å³ãšå°å·çµæã¯ããã®é£ã®ã¹ãããããå®éã«è¡šç€ºãããŠããå®ç»åãŸãã¯é³å£°ã¯ãªããã§å®è¡ããçµæã§ãããã£ãšããããèŠããããã«ææžãããããã®ã¯äžåãªããèªãã å 容ã¯èªåã§å®è¡ãããšãã«åŸãããçµæãšæ£ç¢ºã«äžèŽããŸãã
ãããããã¢ãã«ããããããããã¯ãšã³ãã§å®è¡ãã
ããã¯ããŒã±ãã£ã³ã°ã®èªåŒµã§ã¯ãããŸãããKerasFormersã¯ã118ã®ã¢ãã«ãã¡ããªãŒã倿æžã¿ã®éã¿ãæã€çŽç²ãªKeras 3ã«ç§»æ€ããåäžã®ç°å¢å€æ°ã§JAXãPyTorchãTensorFlowãåãæ¿ããããããã«ããããšã§ããããå®çŸããŠããŸãããã®åºããããã¯ãšã³ãã®æè»æ§ããããŠèª å®ã§åçŸå¯èœãªããã¥ã¡ã³ãã®çµã¿åããã¯ãMLã©ã€ãã©ãªã®åéã§ã¯çãããã®ã§ãã
Kerasã§æ§ç¯ããŠããŠããšã³ã·ã¹ãã ãé¢ããã«ææ°ã®ãã©ã³ã¹ãã©ãŒããŒã«ã¢ã¯ã»ã¹ãããå ŽåããŸãã¯ç§»æ€æ§ã®ããã«è€æ°ã®ããã¯ãšã³ãã§åäœããåäžã®ã³ãŒãããŒã¹ãå¿ èŠãªå Žåã§ãããŸããå€§èŠæš¡ã¢ãã«ãæ±ã£ãŠããŠãç°¡åãªéååãªãã·ã§ã³ãæ±ããå Žåããæäœãã®äŸã§ã¯ãªãå®éã®å®è¡å¯èœãªçµæãåæ ããããã¥ã¡ã³ããéèŠããå Žåã«ãæé©ã§ãã
æ€èšãã¹ãä»ã®ããŒã«