Guu, Kelvin, et al. "Realm: Retrieval-augmented language model pre-training." arXiv preprint arXiv:2002.08909 (2020).
Lee, Kenton, Ming-Wei Chang, and Kristina Toutanova. "Latent retrieval for weakly supervised open domain question answering." arXiv preprint arXiv:1906.00300 (2019).
Karpukhin, Vladimir, et al. "Dense passage retrieval for open-domain question answering." arXiv preprint arXiv:2004.04906 (2020).
Borgeaud, Sebastian, et al. "Improving language models by retrieving from trillions of tokens." arXiv preprint arXiv:2112.04426 (2021).
Nakano, Reiichiro, et al. "WebGPT: Browser-assisted question-answering with human feedback." arXiv preprint arXiv:2112.09332 (2021).
Wang, Shuohang, et al. "Training data is more valuable than you think: A simple and effective method by retrieving from training data." arXiv preprint arXiv:2203.08773 (2022).
Yao, Yunzhi, et al. "Kformer: Knowledge Injection in Transformer Feed-Forward Layers." arXiv preprint arXiv:2201.05742 (2022).
Dai, Damai, et al. "Knowledge neurons in pretrained transformers." arXiv preprint arXiv:2104.08696 (2021).