How much memory does Longformer use?

Yannic Kilcher

arxiv attention attention mechanism deep learning machine learning machine translation natural language processing nlp recurrent rnn seq2seq tensor2tensor transformer

description

A calculation of the memory requirements of the Longformer.

Original video: https://youtu.be/_8KNb5iqblE Paper: https://arxiv.org/abs/2004.05150

Links: YouTube: https://www.youtube.com/c/yannickilcher Twitter: https://twitter.com/ykilcher BitChute: https://www.bitchute.com/channel/yannic-kilcher Minds: https://www.minds.com/ykilcher ... https://www.youtube.com/watch?v=gJR28onlqzs

created

2021-03-01

staked

0.0 LBC

license

Copyrighted (contact publisher)

File size

54830083 Bytes