Master (software)
Master is a version of DeepMind's Go software AlphaGo, named after the account name (originally Magister/Magist) used online, which won 60 straight online games against human professional Go players from 29 December 2016 to 4 January 2017. This version was also used in the Future of Go Summit in May 2017.[1][2] It used four TPUs on a single machine with Elo rating 4,858.[3] DeepMind claimed that AlphaGo Master was 3-stone stronger than the version used in AlphaGo v. Lee Sedol.[4]
DeepMind released a version of AlphaGo Master in December 2017 that serves as a teaching tool analyzing the win rates of 6,000 Go openings from 230,000 human games.[5][6]
Matches
Online games
The software was first used to play games against professional players on 29 December 2016 on the Tygem Go server, under the account name 'Magister' (shown as 'Magist' at the server's Chinese version). The account name was changed to 'Master' on 30 December. After playing 30 games on Tygem, it was moved to the FoxGo server on 1 January 2017.
Master played at the pace of 10 games per day. Many quickly suspected it to be an AI player due to little or no resting between games. After winning its 59th game it was revealed in the chatroom that Master was controlled by Aja Huang of the DeepMind team.[7] On 4 January 2017, after these games were completed, Demis Hassabis, the co-founder of DeepMind, confirmed that Magister and Master both played using an updated version of AlphaGo[8][9] and said, "We're looking forward to playing some official, full-length games later [in 2017] in collaboration with Go organizations and experts".[8][9]
Gu Li, a 9-dan player and co-founder of FoxGo, offered a bounty of 100,000 RMB (14,400 USD) to the first human player who could defeat Master.[9] However, no one took the bounty since Master's final online record was 60 wins and 0 losses,[10] including three victories over Go's top ranked player, Ke Jie,[11] who had been quietly briefed in advance that Master was a version of AlphaGo.[10]
Master's adversaries included many world champions such as Ke Jie, Park Jeong-hwan, Yuta Iyama, Tuo Jiaxi, Mi Yuting, Shi Yue, Chen Yaoye, Li Qincheng, Gu Li, Chang Hao, Tang Weixing, Fan Tingyu, Zhou Ruiyang, Jiang Weijie, Chou Chun-hsun, Kim Ji-seok, Kang Dong-yun, Park Yeong-hun, and Won Seong-jin, and also included national champions or world championship runners-up such as Lian Xiao, Tan Xiao, Meng Tailing, Dang Yifei, Huang Yunsong, Yang Dingxin, Gu Zihao, Shin Jinseo, Cho Han-seung, and An Sungjoon.[12] All 60 games except one were fast-paced games with three 20 or 30 seconds byo-yomi. Master offered to extend the byo-yomi to one minute when playing with Nie Weiping due to his old age.
| No. | Date | Player (dan during the game) | Time control | Moves | Master color and result |
|---|---|---|---|---|---|
| 1 | 29 December 2016 |  Pan Tingyu (1 dan) | three 20-second byo-yomi | 146 | White won by resignation |
| 2 | 29 December 2016 | Zhang Ziliang (1 dan) | three 20-second byo-yomi | 174 | White won by resignation |
| 3 | 29 December 2016 | Ding Shixiong (3 dan) | three 20-second byo-yomi | 151 | Black won by resignation |
| 4 | 29 December 2016 | Xie Erhao (4 dan) | three 20-second byo-yomi | 222 | White won by resignation |
| 5 | 29 December 2016 | Yu Zhiying (5 dan) | three 20-second byo-yomi | 113 | Black won by resignation |
| 6 | 29 December 2016 | Li Xiangyu (3 dan) | three 20-second byo-yomi | 131 | Black won by resignation |
| 7 | 29 December 2016 | Qiao Zhijian (4 dan) | three 20-second byo-yomi | 163 | Black won by resignation |
| 8 | 29 December 2016 | Han Yizhou (5 dan) | three 20-second byo-yomi | 104 | White won by resignation |
| 9 | 29 December 2016 | Meng Tailing (6 dan) | three 20-second byo-yomi | 275 | Black won by 4.5 points |
| 10 | 29 December 2016 | Meng Tailing (6 dan) | three 20-second byo-yomi | 148 | White won by resignation |
| 11 | 30 December 2016 | Chen Hao (5 dan) | three 20-second byo-yomi | 170 | White won by resignation |
| 12 | 30 December 2016 |  Ryu Suhang (5 dan) | three 20-second byo-yomi | 144 | White won by resignation |
| 13 | 30 December 2016 | Wang Haoyang (6 dan) | three 20-second byo-yomi | 136 | White won by resignation |
| 14 | 30 December 2016 | Yan Zaiming (3 dan) | three 20-second byo-yomi | 129 | Black won by resignation |
| 15 | 30 December 2016 | Park Junghwan (9 dan) | three 20-second byo-yomi | 150 | White won by time |
| 16 | 30 December 2016 | Lian Xiao (7 dan) | three 20-second byo-yomi | 122 | White won by resignation |
| 17 | 30 December 2016 | Lian Xiao (7 dan) | three 20-second byo-yomi | 164 | White won by resignation |
| 18 | 30 December 2016 | Ke Jie (9 dan) | three 20-second byo-yomi | 228 | Black won by 5.5 points |
| 19 | 30 December 2016 | Ke Jie (9 dan) | three 20-second byo-yomi | 128 | White won by resignation |
| 20 | 30 December 2016 | Park Junghwan (9 dan) | three 20-second byo-yomi | 255 | Black won by 5.5 points |
| 21 | 31 December 2016 | Chen Yaoye (9 dan) | three 20-second byo-yomi | 270 | White won by 5.5 points |
| 22 | 31 December 2016 | Chen Yaoye (9 dan) | three 20-second byo-yomi | 277 | White won by 4.5 points |
| 23 | 31 December 2016 | Kim Jung-hyun (6 dan) | three 20-second byo-yomi | 135 | Black won by resignation |
| 24 | 31 December 2016 | Park Junghwan (9 dan) | three 20-second byo-yomi | 223 | Black won by resignation |
| 25 | 31 December 2016 | Park Junghwan (9 dan) | three 20-second byo-yomi | 261 | White won by 0.5 points |
| 26 | 31 December 2016 | Yun Chanhee (6 dan) | three 20-second byo-yomi | 217 | Black won by resignation |
| 27 | 31 December 2016 | Fan Tingyu (9 dan) | three 30-second byo-yomi | 215 | Black won by resignation |
| 28 | 31 December 2016 | Meng Tailing (6 dan) | three 20-second byo-yomi | 163 | Black won by resignation |
| 29 | 31 December 2016 | Mi Yuting (9 dan) | three 30-second byo-yomi | 311 | White won by 0.5 points |
| 30 | 31 December 2016 | Tang Weixing (9 dan) | three 30-second byo-yomi | 186 | White won by resignation |
| 31 | 1 January 2017 | Li Qincheng (9 dan) | 1 minute + three 20-second byo-yomi | 179 | Black won by resignation |
| 32 | 2 January 2017 | Gu Li (9 dan) | 1 minute + three 30-second byo-yomi | 154 | White won by resignation |
| 33 | 2 January 2017 | Gu Li (9 dan) | 1 minute + three 30-second byo-yomi | 191 | Black won by resignation |
| 34 | 2 January 2017 | Dang Yifei (9 dan) | 1 minute + three 30-second byo-yomi | 149 | Black won by resignation |
| 35 | 2 January 2017 | Jiang Weijie (9 dan) | 1 minute + three 30-second byo-yomi | 280 | White won by 1.5 points |
| 36 | 2 January 2017 | Gu Zihao (5 dan) | 1 minute + three 30-second byo-yomi | 209 | Black won by resignation |
| 37 | 2 January 2017 | Park Yeong-hun (9 dan) | 1 minute + three 30-second byo-yomi | 173 | Black won by resignation |
| 38 | 2 January 2017 | Tuo Jiaxi (9 dan) | 1 minute + three 30-second byo-yomi | 239 | Black won by resignation |
| 39 | 2 January 2017 |  Yuta Iyama (9 dan) | 1 minute + three 30-second byo-yomi | 135 | Black won by resignation |
| 40 | 2 January 2017 | Meng Tailing (6 dan) | 1 minute + three 30-second byo-yomi | 274 | White won by 2.5 points |
| 41 | 2 January 2017 | Kim Ji-seok (9 dan) | 1 minute + three 30-second byo-yomi | 170 | White won by resignation |
| 42 | 3 January 2017 | Yang Dingxin (4 dan) | 1 minute + three 30-second byo-yomi | 125 | Black won by resignation |
| 43 | 3 January 2017 | Kang Dong-yun (9 dan) | 1 minute + three 30-second byo-yomi | 165 | Black won by resignation |
| 44 | 3 January 2017 | An Sung-joon (7 dan) | 1 minute + three 30-second byo-yomi | 260 | White won by 2.5 points |
| 45 | 3 January 2017 | Shi Yue (9 dan) | 1 minute + three 30-second byo-yomi | 167 | Black won by resignation |
| 46 | 3 January 2017 | Lian Xiao (7 dan) | 1 minute + three 30-second byo-yomi | 144 | White won by resignation |
| 47 | 3 January 2017 | Tan Xiao (7 dan) | 1 minute + three 30-second byo-yomi | 191 | Black won by resignation |
| 48 | 3 January 2017 | Park Junghwan (9 dan) | 1 minute + three 30-second byo-yomi | 270 | White won by 1.5 points |
| 49 | 3 January 2017 | Won Seong-jin (9 dan) | 1 minute + three 30-second byo-yomi | 222 | White won by resignation |
| 50 | 3 January 2017 | Ke Jie (9 dan) | 1 minute + three 30-second byo-yomi | 178 | White won by resignation |
| 51 | 4 January 2017 |  Chou Chun-hsun (9 dan) | 1 minute + three 30-second byo-yomi | 118 | White won by resignation |
| 52 | 4 January 2017 | Fan Tingyu (9 dan) | 1 minute + three 30-second byo-yomi | 202 | White won by resignation |
| 53 | 4 January 2017 | Huang Yunsong (5 dan) | 1 minute + three 30-second byo-yomi | 133 | Black won by resignation |
| 54 | 4 January 2017 | Nie Weiping (9 dan) | 1 minute + three 60-second byo-yomi | 254 | Black won by 7.5 points |
| 55 | 4 January 2017 | Chen Yaoye (9 dan) | 1 minute + three 30-second byo-yomi | 267 | White won by 1.5 points |
| 56 | 4 January 2017 | Cho Han-seung (9 dan) | 1 minute + three 30-second byo-yomi | 171 | Black won by resignation |
| 57 | 4 January 2017 | Shin Jin-seo (6 dan) | 1 minute + three 30-second byo-yomi | 139 | Black won by resignation |
| 58 | 4 January 2017 | Chang Hao (9 dan) | 1 minute + three 30-second byo-yomi | 178 | White won by resignation |
| 59 | 4 January 2017 | Zhou Ruiyang (9 dan) | 1 minute + three 30-second byo-yomi | 161 | Black won by resignation |
| 60 | 4 January 2017 | Gu Li (9 dan) | 1 minute + three 30-second byo-yomi | 235 | White won by 2.5 points |
Future of Go Summit
The Master version also participated in the Future of Go summit in May 2017.[1] It defeated Ke Jie in a three-game match by three to zero and beat a human team with five top Go professionals.
Innovative moves
Go experts were extremely impressed by Master's performance and by its non-human play style in its online games. Ke Jie stated, "After humanity spent thousands of years improving our tactics, computers tell us that humans are completely wrong... I would go as far as to say not a single human has touched the edge of the truth of Go".[10]
Master played many innovative moves and inspired professional players.[13][14][15][16][17][18][19]
In the 23rd online game Master invaded the 3-3 point at a very early stage.[20]
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Online game 23, Master (black) v. Kim Jung-hyun |
In the 24th online game Master played six stones along the second line.[20]
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Online game 24 Master (black) v Park Junghwan |
Operator errors
On 20 January 2017, DeepMind team members Fan Hui[21] and Aja Huang[22] disclosed that Master's operator accidentally entered a move other than AlphaGo's choice in two situations during the online games.
In the 9th online game, Master recommended point a for Move 107.
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Online game 9, Master (black) vs. Meng Tailing. |
In the 39th online game, Master recommended point a for Move 99.
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Online game 39, Master (black) vs Yuta Iyama |
Example game
Online game 30: Master (white) v. Tang Weixing (31 December 2016), Master won by resignation. White 36 was widely praised.[23]
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| First 99 moves |
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Moves 100-186 (149 at 131, 150 at 130) |
References
- "AlphaGo官方解读让三子 对人类高手没这种优势" (in Chinese). Sina. 25 May 2017. Retrieved 1 June 2017.
- "各版alphago实力对比 master能让李世石版3子" (in Chinese). Sina. 24 May 2017. Retrieved 2 June 2017.
- Silver, David; Schrittwieser, Julian; Simonyan, Karen; Antonoglou, Ioannis; Huang, Aja; Guez, Arthur; Hubert, Thomas; Baker, Lucas; Lai, Matthew; Bolton, Adrian; Chen, Yutian; Lillicrap, Timothy; Fan, Hui; Sifre, Laurent; Driessche, George van den; Graepel, Thore; Hassabis, Demis (19 October 2017). "Mastering the game of Go without human knowledge" (PDF). Nature. 550 (7676): 354–359. doi:10.1038/nature24270. ISSN 0028-0836. PMID 29052630. S2CID 205261034.
- "AlphaGo棋力比去年涨三子 柯洁想赢它可能只剩一招" (in Chinese). Sina. 25 May 2017. Retrieved 1 June 2017.
- "AlphaGo teaching tool". DeepMind.
- "AlphaGo教学工具上线 樊麾：使用Master版本" (in Chinese). Sina.com.cn. 11 December 2017. Retrieved 11 December 2017.
- "横扫中日韩棋手斩获59胜的Master发话：我是阿尔法狗". 澎湃新闻. 2017-01-04.
- Demis Hassabis (4 January 2017). "Demis Hassabis on Twitter: "Excited to share an update on #AlphaGo!"". Demis Hassabis's Twitter account. Retrieved 4 January 2017.
- Elizabeth Gibney (4 January 2017). "Google reveals secret test of AI bot to beat top Go players". Nature. Retrieved 4 January 2017.
- "Humans Mourn Loss After Google Is Unmasked as China's Go Master". Wall Street Journal. 5 January 2017. Retrieved 6 January 2017.
- "The world's best Go player says he still has "one last move" to defeat Google's AlphaGo AI". Quartz. 4 January 2017. Retrieved 6 January 2017.
- "Full list of human players participating in the 60 games" (in Chinese). Sohu. 13 February 2017. Retrieved 23 April 2017.
- Nie Weiping (3 January 2017). "神秘高手Master颠覆了围棋传统，这更证明了藤泽秀行那句话" (in Chinese). Toutiao. Retrieved 24 April 2017.
- "韩国研究新版AlphaGo：穿越而来展示未来围棋" (in Chinese). Sina.com. 11 January 2017. Retrieved 24 April 2017.
- "金成龙分析AlphaGo：愿你为人类划开围棋的新天地" (in Chinese). Sina.com. 28 January 2017. Retrieved 24 April 2017.
- "韩国家队分析AlphaGo60局1 很强但不"完美"" (in Chinese). Sina.com. 31 January 2017. Retrieved 24 April 2017.
- "韩国家队分析AlphaGo60局2 井山一局最有机会" (in Chinese). Sina.com. 2 February 2017. Retrieved 24 April 2017.
- "阿法狗最令人感动一手 王铭琬：推波助澜" (in Chinese). Sina.com. 6 February 2017. Retrieved 24 April 2017.
- Nie Weiping (19 January 2017). "李昌镐学习"阿法狗流"，日本棋手放下包袱仍有一战" (in Chinese). Toutiao. Retrieved 24 April 2017.
- "Innovations of AlphaGo". DeepMind. Retrieved 23 April 2017.
- "Clarification". Fan Hui's Sina Weibo. 20 January 2017. Retrieved 11 May 2017.
- "Clarification". Aja Huang's Facebook. 20 January 2017. Retrieved 11 May 2017.
- "高手战Master技术分析：人类仍有机会赢AI？" (in Chinese). QQ.com. 2 May 2017. Retrieved 13 May 2017.