Fine Tuning LLM with Custom Data (using OpenAI GPT) in python

LLM can be extended, by fine tuning with custom dataset to provide Q&A, summary and many other ChatGPT like functions. In this video, we are using LlamaIndex (GPT Index) which provides a central interface to connect your LLM's with external data.

Full code discussed in the video can be found here:

• https://github.com/prodramp/DeepWorks/blob/main/ChatGPT/FineTuneLLM.md

== Video Timeline == (00:00) Content Intro (00:59) Gradio UI Demo (04:24) Training LLM - Concepts (12:40) Fine-tuning LLM - Concepts (17:42) Coding Demo (18:40) finetune.py Coding (25:20) queryindex.py (27:29) Results (29:04) Summary

Please visit: https://prodramp.com | @prodramp https://www.linkedin.com/company/prodramp

Content Creator: Avkash Chauhan (@avkashchauhan) https://www.linkedin.com/in/avkashchauhan

Tags: #llm #chatgpt #finetunellm #openai #python #ai ... https://www.youtube.com/watch?v=6aOzoJKNLKQ