How does AI understand text: a review of "Longformer: The Long-Document Transformer"
Longformer: The Long-Document Transformer
An engineer by training, I rigorously track the cool things happening in the technology world. A strategy Consultant by profession, I am a deep believer in the power of AI & ML in changing the world!
Longformer: The Long-Document Transformer
Brown, T., Mann, B., Ryder, N., Subbiah, M., Kaplan, J.D., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A. and Agarwal, S., 2020. Language models are few-shot learners. Advances in neural information processing systems, 33, pp.1877-1901.