Tata Institute of Fundamental Research
Bring Down the Walls!: Why this is the right time for Theoreticians and Computer Architects to Talk
STCS Colloquium
Speaker:
Dipankar Das, Bharat Kaul, Abhisek Kundu (Intel Labs)
Organiser:
Sandeep K Juneja
Date:
Monday, 18 Mar 2019, 11:00 to 12:00
Venue:
A-201 (STCS Seminar Room)
(Scan to add to calendar)
Abstract:
Abstract: Deep Learning has witnessed a 300,000X growth in compute demand in the last 6 years, matched equally by a growth in hardware capability – primarily riding on half precision compute and systolic arrays. Compute architects are now looking for the next 10-100X architectural opportunity, and there are no easy answers. This is where a theoretical understanding of how deep-learning compute manipulates probability distributions is necessary. We hope that this understanding will lead to ways for reducing compute and bandwidth needs and deliver the next 10X performance. We will talk about some empirical results and directions which look promising (LSH, projections, matrix factorization, sub-8b precision compute, and others), and try to motivate the TIFR community to delve into these problems.
| Speaker: | Dipankar Das, Bharat Kaul, Abhisek Kundu (Intel Labs) |
| Organiser: | Sandeep K Juneja |
| Date: | Monday, 18 Mar 2019, 11:00 to 12:00 |
| Venue: | A-201 (STCS Seminar Room) |
(Scan to add to calendar)
Abstract:
Abstract: Deep Learning has witnessed a 300,000X growth in compute demand in the last 6 years, matched equally by a growth in hardware capability – primarily riding on half precision compute and systolic arrays. Compute architects are now looking for the next 10-100X architectural opportunity, and there are no easy answers. This is where a theoretical understanding of how deep-learning compute manipulates probability distributions is necessary. We hope that this understanding will lead to ways for reducing compute and bandwidth needs and deliver the next 10X performance. We will talk about some empirical results and directions which look promising (LSH, projections, matrix factorization, sub-8b precision compute, and others), and try to motivate the TIFR community to delve into these problems.