DataPalooza 2022

Explaining the B: “Bidirectional” “bank account” vs “bank of the river” Context-free model: “bank” has the same representation, no matter the words before or after it “I accessed the bank account” Typical context-based model: “bank” meaning is based on either “I accessed the” or “account”, but not both “I accessed the bank account” BERT (bidirectional) context model: “bank” meaning is found based on each side of the word “I accessed the … account”

This is very complicated and takes a lot of computing power!

Question/Answer system under BERT BERT is designed to support a question and answer system, like the Google search engine:

User asks this question to model

This text is in the model’s database

Model makes prediction based on question