MASS, UniLM, XLNet, BERTSum, SpanBERT, RoBERTa, BART

[Paper Review] Transformer to T5 (XLNet, RoBERTa, MASS, BART, MT-DNN,T5)
https://youtu.be/v7diENO2mEA

 

[NLP 논문 리뷰] MASS: Masked Sequence To Sequence Pre Training For Language Generation
https://cpm0722.github.io/paper-review/mass-masked-sequence-to-sequence-pre-training-for-language-generation

 

MASS: Masked Sequence to Sequence Pre-training for Language Generation
https://github.com/noowad93/ml-paper-summaries/issues/1

 

 

UniLM Review
https://baekyeongmin.github.io/paper-review/unilm-review/

 

Unified Language Model Pre-training for Natural Language Understanding and GenerationPermalink
https://soyoung97.github.io/%EB%85%BC%EB%AC%B8-%EB%A6%AC%EB%B7%B0_unilm/#unified-language-model-pre-training-for-natural-language-understanding-and-generation

 

 

XLNet
https://ratsgo.github.io/natural%20language%20processing/2019/09/11/xlnet/

 

 

[논문리뷰] SpanBERT: Improving Pre-training by Representing and Predicting Spans
https://jeonsworld.github.io/NLP/spanbert/

 

 

SpanBert 와 RoBERTa 리뷰
https://vanche.github.io/spanbert_roberta/

 

 

4. BertSum: Text Summarization with Pretrained Encoders 논문 리뷰
https://kubig-2021-2.tistory.com/53

 

Text Summarization with Pretrained Encoders (BERTSUM)
https://velog.io/@tobigs-nlp/Text-Summarization-with-Pretrained-Encoders-BERTSUM

 

 

 

BART: Denoising Sequence to Sequence Pre-training for Natural Language Generation, Translation, and Comprehension
https://velog.io/@tobigs-nlp/BART-Denoising-Sequence-to-Sequence-Pre-training-for-Natural-Language-Generation-Translation-and-Comprehension

 

BART 논문 설명(BART - Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension)
 https://greeksharifa.github.io/nlp(natural%20language%20processing)%20/%20rnns/2022/08/09/BART/ 

 

[논문리뷰] BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension
https://chloelab.tistory.com/34

 

3. BART: Denoising SequencetoSequence Pretraining for Natural Language Generation Translation and Comprehension 논문 리뷰
https://kubig-2021-2.tistory.com/50

 

 

[모델] Transformer 의 BART 모델

https://velog.io/@chjy100418/%EB%AA%A8%EB%8D%B8-Transformer-%EC%9D%98-BART-%EB%AA%A8%EB%8D%B8