Predicting the next word

Written By Pete Sathianathan (Administrator)

Updated at January 20th, 2021

GPT-2 is trained with a simple objective: predict the next word, given all of the previous words within some text. The diversity of the dataset causes this simple goal to contain naturally occurring demonstrations of many tasks across diverse domains. GPT-2 is a direct scale-up of GPT, with more than 10X the parameters and trained on more than 10X the amount of data.

In this example we will look at how to use GPT2 in the low code platform.

Step 1.

Open Http in node and name it /gpt/:gpt also drag and drop http out node.

Step 2.

Open a python 3 function node and name it GPT2-TextGen. Also add the GPT2 code in the function.

Step 3.

Connect the Python 3 Node to console node and http out node. Click on deploy.

Step 4

Open your browser type the interplay url ending /gpt/:gpt. You will see you get different prediction each time you refresh the page.

Step 5.

You can also see that on the terminal debug menu.

Was this article helpful?