This section lists all blog posts, regardless of topic.
10x Jump in GPU PerformanceOctober 22, 2015
I heard today (probably not new news) that Nvidia has said that next year's GPUs will have a 10x increase in neural network performance over today's hardware. That stopped me in my tracks.
The combination of being able to use massive cloud based computation (not needing fancy hardware on your desk that sits inactive most of the time), and having a 10x decrease in the cost per FLOP for doing neural net training, will be a pretty incredible thing. We've already seen some incredible demos of this technology, so imagine what folks will be able to do as the cost/FLOP falls dramatically.
Semantics in Generative GrammarOctober 12, 2015
I'm reading this book right now:
http://ca.wiley.com/WileyCDA/WileyTitle/productCd-0631197133,subjectCd-PLD0.htmlSo far I'm quite enjoying it. Wish I had found resources like this a few years ago, but still good for me to read.
Generating Almost GibberishOctober 12, 2015
An interesting thing I saw today:
http://www.relativelyinteresting.com/the-labyrinthine-library-of-babel/Kind of silly, but after some further thought, it would be interesting if you created a semantic and syntactic model of the world that was rich enough such that you could run a "parser" backwards and generate sentences that were both semantically and grammatically sound, and yet random... and then to use a probabilistic model to generate a second sentence based on the first, and so on and so forth, until you had written an entire page.
If your system was strong enough, then it might be the case that 1 out of 1,000,000 generate pages would be a bit creepy in terms of its sensibility, right?
As it stands, this 100% random approach comes off as 1% interesting and 99% "sigh".
older >>
