fabiomatricardi/OpenVINO-vs-GGGUF-battle fabiomatricardi/OpenVINO-vs-GGGUF-battle

  • Stars
    star
    1
  • Language
    Python
  • Created 2 months ago
  • Updated 2 months ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
fabiomatricardi/OpenVINO-vs-GGGUF-battle
github

fabiomatricardi

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Repo with code in the prompt battle between CPU inference with OpenVINO and llamaCPP

More Repositories

1

GPT4All_Medium

Repo of the code from the Medium article
Python
83
star
2

cdQnA

repository for documents and studies about closed domain question and answering with LLM
Jupyter Notebook
46
star
3

LaMiniPower

The power of a small LLM for your domain knowledge QnA
Jupyter Notebook
25
star
4

ModernFastAPI

Repo of the code from the Medium article - Build a powerful LLM API right on your computer
Python
16
star
5

How-I-Built-a-Chatbot-that-Crushed-ChatGPT

Repo of the code from the Medium article
Jupyter Notebook
16
star
6

ChatBOTMastery

Your Chatbot Mastery: build a super small custom AI assistant with Gradio_client Python and Streamlit - Chapter 1
Python
14
star
7

TiniLlamaGradioChat

Repo for a ChatBot, with Gradio, Streaming TinyLlama1.1BOpenOrca.gguf on CPU only
Python
10
star
8

LaminiChat

Repo of the code from the Medium article Say Goodbye to OpenAI part2
Python
9
star
9

HFChatbot

Repo of the code from the Medium article: Say Goodbye to OpenAI
Python
9
star
10

YourFastAPI

Repo of the code from the Medium article A FastAPI for your Local LLM
Python
7
star
11

RuleThemAll

Repo of the code from the Medium article
Jupyter Notebook
6
star
12

NanollavaCPP

nanollava with virtualenv python3.11 llamacpp-python and streamlit
Python
6
star
13

Gemma2B-ChatAssistant

Maybe Gemma-2B-IT is the smallest and best chat friend you can have
Python
5
star
14

whisperCPP-streamlit

Repo of the code from the Medium article
Python
5
star
15

GradioLangchainCustomLLM

How to build a Custom LLM wrapping a Gradio API call into Langchain
Jupyter Notebook
5
star
16

llmwareSLIMS

Repo of the code from the Medium article
Python
5
star
17

danube3-0.5b-chat

stramlit AI assistant with llamacpp and H2O danube3
Python
4
star
18

135M-you-cannot-go-Smaller

Repo of the code from the Medium article 135M: you cannot go Smaller
Python
4
star
19

Playgrounds

Repo of the code from the Medium article
Python
3
star
20

YourAIPhotoStory

Repo of the code from the Medium article Create your own AI powered Photo story
Python
3
star
21

twitterStoryCreator

Repository for the Article on Medium about Serverless GPU
Python
3
star
22

LlamaFile-4-ALL

A quantized LLM and API webserver in one single executable file
Python
3
star
23

llamaCPP_Agents

Run AI agents with llama-cpp-agents locally
Jupyter Notebook
3
star
24

17megabyteCHATBOT

Repo of the code from the Medium article
Jupyter Notebook
3
star
25

KingOfTheTiny

Repo of the code from the Medium article about TinyVicuna1B GGUF
Python
3
star
26

thePromptBattle

Repo of the code and results from the Medium article Battle of the Prompts: Unveiling the True Capabilities of Open Source Language Models
Python
2
star
27

AI-RewriteText

Medium article repo to use LaMini AI to rewrite text
Jupyter Notebook
2
star
28

llamacppChatDocs

Chat with your documents using only LlamaCPP and Langchain
Jupyter Notebook
2
star
29

ImageUpscaler

Streamlit App to Upscale images and compared visualization - Repo of the code from the Medium article
Python
2
star
30

OpenELM270M-test

Repo of the code from the Medium article
Python
2
star
31

phi-3-miniTEST

Repo of the code from the Medium article
Python
2
star
32

TheRiseOfTheCuriourAI

Repo of the code from the Medium article
Jupyter Notebook
1
star
33

pytubeFix

Python
1
star
34

ZephyrGPT4ALL

Test of Chat with documents and RAG reranking multi-language with Zephyr7b GPTQ
Jupyter Notebook
1
star
35

AItranslationMedium

Repocode for Medium Article
Python
1
star
36

Abstractive-Extractive

Repo on the Medium article about abstractive and extractive summarization
Jupyter Notebook
1
star
37

LLMwantsToBreakFree

Repo of the Medium article LLM wants to break free. Build your own AI
Jupyter Notebook
1
star
38

llamaFile-localtests2

tests with Llamafile and newest GGUF models
Python
1
star
39

TensorOpera-Fox-1-chat

Chat with web-based Document search and TensorOpera Fox-1 LlamaCPP
Python
1
star
40

-LLM-Studies

Collection of Resources, repositories and snippets for LLM and Open source Generative AI
Python
1
star
41

MoonDream2-gradioAPI

Chat with your local images and MoonDream2 using Gradio Client API
Python
1
star
42

AI-ExtractData-NuExtract-tiny

NuExtract-tiny GGUF for data extraction in json format
Python
1
star
43

nanoLlava-cpp

How to run nanollava with llama-cpp-python
Python
1
star
44

Gemma2-2b-it-chatbot

Repo of the code from the Medium article about running Gemma2 2b locally
Python
1
star
45

KS-AI

test full portable llamafile Qwen05bchat with streamlit
Python
1
star
46

OuteWorlderAI

How to run LiteMistral150M on your PC
Python
1
star
47

what-the-hell-is-AI

Repo of the code from the Medium article
Jupyter Notebook
1
star
48

Claude2Alpaca7B-Playgorund

Repo of the code for Gradio Playground with Ctransformers of 7B parameters q4 GGUF model
Python
1
star
49

StableLM-Zephyr3B_Playground

Repo for the code to create a Playground for StablLM-Zephyr-3B GGUF with Gradio
Python
1
star
50

BattleOfTheTiny-part1

Repo of the code from the Medium article
Python
1
star
51

HowSmalltoChatYouCanGo

Repo of the code from the Medium article
Python
1
star
52

MetadataIsAllYouNeed

Repo of the code from the Medium article Metadata Metamorphosis: from plain Data to Enhanced insights with Retrieval Augmented Generation
Jupyter Notebook
1
star