How to generate question answer data set like babi from books

2

I wanted to train a chat bot for answering questions from books. I am trying to use Dynamic Memory Networks to do so.

  • How can I generate a data set like facebook did in case of babi tasks so that it can tackle a variety of questions on the data set.

Shubham Bhardwaj

Posted 2017-06-05T17:36:55.457

Reputation: 49

Answers

1

This repository maintained by Facebook AI Research talks about how they went about generating QA from stories.

In essence, they try to simulate how a reader reads a story. They also keep track about the knowledge the reader is assimilating when reading. Then they frame a question based on the knowledge assimilated, in order to asses if the reader can perform logical inference given what knowledge is present with him.

Shubham Bhardwaj

Posted 2017-06-05T17:36:55.457

Reputation: 49

2

If you are talking about "generating" in the sense of generative models , it is pretty tough. since we are still far beyond understanding the actual structure of question-answering.

And even state of the art methods for question answering are also not able to score well on datasets like babi , mostly 16 out of 20 tasks can be solved.

riemann77

Posted 2017-06-05T17:36:55.457

Reputation: 920

Thanks a lot for answering @thecomplexitytheorist. I wanted to create BaBI like tasks from a custom dataset - like a book. So it was not exactly like fully generating from scratch. – Shubham Bhardwaj – 2018-11-02T08:15:20.963