The design learns by having a bit of text from the information (say, the opening sentence of the Wikipedia article) and looking to forecast another token during the sequence. It then compares its output with the actual text during the education corpus and adjusts its parameters to accurate any mista