Hello Frindou,
You will need to provide a context and ask question from that context only. It is called closed-domain QnA. If you don’t provide context and ask question then it will become an open domain QnA which is not what BERT does.
Get more details about Closed-domain Chatbot using BERT from our case-study: https://www.pragnakalp.com/case-study/chatbot-using-bert-in-python/
Hope this helps!