Text Generation using Language Models with LSTM

Go to main | Course Page

Section 1: Introduction to Language Modelling

  1. Introduction
  2. Simple RNN Language Model
  3. Training an RNN Language Model

Section 2: State-Of-The-Art Models

  1. Transformer-based Language Models
  2. Example Application: Google's LaMDA

Section 3: Text Generation using Language Models with LSTM (Code Demo)

  1. Setup Environment and Import Data
  2. Helper Function for Creating Corpus
  3. Set Device Configuration
  4. Define Architecture and Hyperparameters
  5. Load Dataset
  6. Initialize Model
  7. Define loss and optimizer
  8. Train Model
  9. Examine Output
  10. Save Model
Report abuse