Daniel Reeves
Abstract
Suppose I owe you n payments of S/n dollars---total owed is S if there were no time-discounting---spread evenly over an amount of time t, at interest rate r per unit time. For example, I might owe you $120 in three payments over the coming year: $40 three months from now, another $40 in six months, and another $40 in nine months. If I wanted to instead just pay you once, a full $120, when should I do so to be perfectly equivalent to the three spread-out payments, given the interest rate?
Index Terms
- Borrowing in the limit as our nerdiness goes to infinity
Recommendations
ZeRO-infinity: breaking the GPU memory wall for extreme scale deep learning
SC '21: Proceedings of the International Conference for High Performance Computing, Networking, Storage and AnalysisIn the last three years, the largest dense deep learning models have grown over 1000x to reach hundreds of billions of parameters, while the GPU memory has only grown by 5x (16 GB to 80 GB). Therefore, the growth in model scale has been supported ...
When Tiny Goes Big: A Computer Architect's View of the Emerging Internet of Tiny Things
I believe that the Internet of Tiny Things (IoTT) will be the next big driver of the computing and semiconductor industry - imagine applications such as smart city, home sensors, wearables, implantables, single-use electronic tags for pharmaceuticals ...
Comments