Bloom (Text Generation Large Language Model - LLM): Step by step implementation
Prodramp
This hands-on programming tutorial with step by step implementation of Bloom Large Language Text Generation Model will guide you building your own text generation application in Google Colab environment.
You will also learn to solve 3 different problems while working on this tutorial:
- RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cpu and cuda:0! (when checking argument for argument index in method wrapper__index_select)
- AttributeError: 'BaseModelOutputWithPastAndCrossAttentions' object has no attribute 'logits'
- GPU Memory Exception.
GitHub Resources:
- https://github.com/prodramp/DeepWorks/tree/main/Bloom-BigScience
- https://huggingface.co/bigscience/bloom-1b7
ā¬ā¬ā¬ā¬ā¬ā¬ ā° TUTORIAL TIME STAMPS ā° ā¬ā¬ā¬ā¬ā¬ā¬
- (00:00) Video Starts
- (01:20) Experimentation Steps
- (02:08) Bloom @ Hugging Face
- (03:48) Testing GPT-2
- (04:30) Testing Neo-GPT-2
- (05:22) Setting Google Colab
- (06:15) Downloading Bloom Model
- (08:10) Setting Text Prompt
- (08:35) Tokenize Text
- (09:20) Applying Bloom Model
- (10:10) GPU/CPU Mixup Error
- (12:25) Correct Model Error
- (13:50) GPU Memory Exception
- (15:12) Encoded Result Output
- (15:35) Decoding Results
- (16:45) Result as Text
- (18:00) Export Notebook to GitHub
Connect
- Prodramp LLC (@prodramp)
- Website - https://prodramp.com
- LinkedIn - https://www.linkedin.com/company/prodramp
- GitHub- https://github.com/prodramp/
- AngelList - https://angel.co/company/prodramp
- Facebook - https://www.facebook.com/Prodramp
Content Creator: Avkash Chauhan (@avkashchauhan)
Tags: #transformers #bloom #ml #cnn #ml #lime #aicloud #h2oai #driverlessai #machinelearning #cloud #mlops #model #collaboration #deeplearning #modelserving #modeldeployment #pytorch #datarobot #datahub #streamlit #modeltesting #codeartifact #dataartifact #modelartifact #onnx #aws #kaggle #mapbox #lightgbm #xgboost #classification #dataengineering #pandas #keras #tensorflow #tensorboard #cnn #prodramp #avkashchauhan #LIME #mli #xai ... https://www.youtube.com/watch?v=HOiBaH9gAlU
127664157 Bytes