銆銆銆怚T168 璧勮銆戞ｅ傛墍鏈夋暟鎹绉戝﹀剁晠瑷鐨勯偅鏍凤紝鏁版嵁闆嗘槸浜哄伐鏅鸿兘鐨勭敓鍛界嚎锛岃繖瀵规墍鏈夊勭悊涓浜鸿韩浠戒俊鎭(濡傚尰鐤椾繚鍋)鐨勮屼笟鏋勬垚浜嗗浐鏈夌殑鎸戞垬锛屼絾浠や汉娆ｅ枩鐨勬槸锛屽逛簬妯℃嫙璁缁冪殑鍖垮悕鍔犲瘑鏂规硶宸茬粡鍙栧緱浜嗕护浜洪紦鑸炵殑杩涘睍銆

銆銆

銆銆12 鏈3鏃ュ湪鍔犳嬁澶ц挋鐗瑰埄灏斿彫寮鐨凬eurIPS 2018浼氳涓 锛岃嫳鐗瑰皵瀹ｅ竷鎺ㄥ嚭寮婧愮増 HE-Transformer 锛岃繖鏄涓绉嶅厑璁窤I绯荤粺瀵规晱鎰熸暟鎹杩涜屾搷浣滅殑宸ュ叿銆傚紑婧愮増 HE-Transformer 鍩轰簬绠鍗曞姞瀵嗙畻娉曞簱( SEAL )锛屾槸鑻辩壒灏旂炵粡缃戠粶缂栬瘧鍣╪Graph鐨勫悓鎬佸姞瀵(HE)鍚庣锛孒E鍏佽稿瑰姞瀵嗘暟鎹杩涜岃＄畻銆

銆銆寰杞鐮旂┒闄㈡湰鍛ㄤ篃鍦ㄥ紑婧愯蒋浠朵腑鍙戝竷杩囥備袱瀹跺叕鍙稿皢 HE-Transformer 鎻忚堪涓衡滈殣绉佷繚鎶も濇満鍣ㄥ︿範鐨勫吀鑼冦

銆銆鈥滃畠鍏佽稿瑰姞瀵嗘暟鎹杩涜岃＄畻銆傚綋搴旂敤浜庢満鍣ㄥ︿範鏃讹紝瀹冭兘澶熻╂暟鎹鎵鏈夎呰幏寰椾环鍊间俊鎭鐨勫悓鏃朵笉鏆撮湶鍩虹鏁版嵁銆傚苟涓旓紝璇ュ伐鍏峰彲浠ヤ娇AI妯″瀷鎵鏈夎呴氳繃浠ュ姞瀵嗗舰寮忛儴缃叉潵淇濇姢浠栦滑鐨勬ā鍨 銆傗 鑻辩壒灏旂爺绌剁戝﹀禙abian Boemer鍜岃嫳鐗瑰皵鐮旂┒楂樼骇涓荤Casimir Wierzynski鍦ㄤ竴绡囧崥瀹㈡枃绔犱腑鍐欓亾銆

銆銆HE-Transformer 涓鐨勨淗E鈥濇槸鍚屾佸姞瀵嗙殑缂╁啓锛屾槸涓绉嶅姞瀵嗗舰寮忥紝鍙浠ュ熀浜庡瘑鏂(琚绠楁硶鍔犲瘑鐨勬槑鏂囨垨鏂囦欢鍐呭)涓婅繘琛岃＄畻 锛岀敓鎴愪竴涓鍔犲瘑缁撴灉 銆傚苟涓斿湪瑙ｅ瘑鏃讹紝涓庢湭鍔犲瘑鏂囨湰涓婃墽琛岀殑鎿嶄綔缁撴灉瀹屽叏鍖归厤銆

銆銆HE 鏄涓椤硅緝鏂扮殑鎶鏈 锛孖BM鐮旂┒鍛楥raig Gentry鍦2009骞村紑鍙戜簡绗涓涓狧E鏂规堛傛ｅ侭oemer鍜學ierzynski璁や负鐨勯偅鏍凤紝璁捐′竴娆続I妯″瀷涓嶄粎闇瑕佹満鍣ㄥ︿範锛岃繕闇瑕佸姞瀵嗗拰杞浠跺伐绋嬫柟闈㈢殑涓撲笟鐭ヨ瘑銆

銆銆HE-Transformer 閫氳繃鎻愪緵涓涓鎶借薄灞傛潵鏀鎸佸紑鍙戣繃绋嬶紝璇ユ娊璞″眰鍙浠ュ簲鐢ㄤ簬寮婧愭嗘灦(濡傝胺姝岀殑TensorFlow銆丗acebook鐨凱yTorch鍜孧XNet)涓婄殑绁炵粡缃戠粶銆傚畠涓嶉渶瑕佹墜宸ュ皢妯″瀷闆嗘垚鍒板瘑鐮佸簱涓銆

銆銆HE-Transformer 缁撳悎浜咰heon-Kim-Kim-Song(CKKS)鍔犲瘑鏂规堜互鍙婂姞娉曞拰涔樻硶杩愮畻锛屼緥濡傚姞娉曪紝骞挎挱锛屽父鏁帮紝鍗风Н锛岀偣锛屼箻锛屽惁瀹氾紝濉鍏咃紝鏁村舰锛岀粨鏋滐紝鍒囩墖鍜屽噺娉曘傛ゅ栵紝瀹冭繕鏀鎸丠E鐗瑰畾鎶鏈锛屽傛槑鏂囧兼梺璺锛孲IMD鎵撳寘锛孫penMP骞惰屽寲鍜屾槑鏂囨搷浣溿

銆銆鑻辩壒灏斿０绉帮紝E-Transformer浣跨敤鍦═ensorFlow涓璁缁冪殑娴鐐规ā鍨嬶紝鍦ㄥ彲鐢ㄤ簬鍔犲瘑鏁版嵁鐨勭炵粡缃戠粶涓婃彁渚涙渶鍏堣繘鐨勬ц兘銆

銆銆寰杞鐮旂┒闄㈤栧腑鐮旂┒鍛樺吋瀵嗙爜瀛︾爺绌剁粡鐞 Kristin Lauter琛ㄧず锛氣滄垜浠寰堥珮鍏翠笌鑻辩壒灏斿悎浣滐紝涓烘洿澶氱殑鏁版嵁绉戝﹀跺拰闅愮佷繚鎶ゆ満鍣ㄥ︿範绯荤粺寮鍙戜汉鍛樺甫鏉ュ悓鎬佸姞瀵嗐傗

銆銆鐩鍓嶏紝HE-Transformer鐩存帴涓嶵ensorFlow鐨刵Graph缂栬瘧鍣 鍜岃繍琛屾椂闆嗘垚锛屽筆yTorch 鐨勬敮鎸佷篃鍗冲皢鎺ㄥ嚭銆傚逛簬閭ｄ簺鑳藉熷皢绁炵粡缃戠粶瀵煎嚭鍒癘NXX鐨勬繁搴﹀︿範妗嗘灦锛屼緥濡侾yTorch锛孋NTK鍜孧XNet锛屽彲浠ラ氳繃灏嗘ā鍨嬪煎叆ONXX涓鐨刵Graph骞朵互搴忓垪鍖栨牸寮忓煎嚭瀹冧滑鏉ヤ娇鐢ㄨ繖浜涙嗘灦銆

銆銆Boemer 鍜學ierzynski琛ㄧず锛屾湭鏉ョ増鏈鐨凥E-Transformer灏嗘敮鎸佹洿澶氱嶇被鐨勭炵粡缃戠粶妯″瀷銆

銆銆浠栦滑鍐欓亾锛氣滃熀浜庢渶鏂扮殑杩涘睍鎴愭灉锛孒E宸茬粡鎴愪负浜嗕竴绉嶆湁浠峰肩殑娣卞害瀛︿範宸ュ叿銆傗 鈥滅爺绌朵汉鍛樺彲浠ュ埄鐢═ensorFlow蹇閫熷紑鍙戞柊鐨凥E娣卞害瀛︿範鎷撴墤銆傗