Computers Are Learning to Read—But They’re *Still* Not So Smart

The Mad-Libs-esque pretraining task that BERT uses — called masked-language modeling — isn’t new. In fact, it’s been used as a tool for assessing language comprehension in humans for decades. For Google, it also offered a practical way of enabling bidirectionality in neural networks, as […]

In a big reversal, Libra reportedly could peg its cryptocurrencies to national currencies

Facebook is willing to reverse course on its plans to tie its digital currency project to a synthetic currency tied to a basket of global currencies. Reuters is reporting that Facebook’s head of the Libra project, David Marcus, told a group of bankers that the […]