Blannk AI Chat - Model Feedback - Anonymous sharing to improve models
Eric David Smith
Hey good people of the internet. If you've been following along, I am making a new app called Blannk AI Chat for macOS. Blannk AI Chat is a powerful native macOS desktop application that enables users to run Large Language Models (LLMs) securely, privately, and without an internet connection (offline). Written in Swift, Metal, LlaMa.cpp, SwiftData, TypeScript, and a bunch of other technologies. The benefits are, it's highly optimized to run models quickly. It is also unregulated, you control the parameters and everything can be customized. The personas add a level of AI power that you will not get from many other services.
In this video, I am presenting a feature that will help improve open source LLM's that are running locally in the Blannk AI Chat app.
The app is scheduled to launch very very very soon. Once available, you will be able to download it for FREE here https://apps.apple.com/us/app/blannk-ai-chat/id6475680321
The app runs any GGUF model - GGUF (GPT-Generated Unified Format), introduced as a successor to GGML (GPT-Generated Model Language), was released on the 21st of August, 2023. This format represents a significant step forward in the field of language model file formats, facilitating enhanced storage and processing of large language models like GPT.
Thanks for watching!
Love, Eric ... https://www.youtube.com/watch?v=AiKpxuX9FYY
27447772 Bytes