MergeUI is an open-source project that aims to provide a user-friendly interface for discovering and analyzing merged large language models (Merged LLMs) from the Hugging Face Hub. It is particularly focused on models that have been merged using MergeKit.

• 🚀 Try it out
• 👨‍💻 GitHub Repository
• 🤗 Hugging Face Space

To run the project locally, you need to have the following installed:

• Python 3.9+
• Poetry 1.8+
• Graphviz
• Docker with Docker Compose

Once you have the requirements installed, you can set up the project by running the following commands:

poetry install

Once the dependencies are installed, make sure to set up the environment variables by creating a .env file

cp .env.example .env

Next, we need to launch the database and Redis using Docker Compose:

docker compose up -d

Once the setup is complete, we need to index the models from the Hugging Face Hub and store them in the database.

For indexing models we use RQ:

• First we need to launch some workers by running the following command in separate terminal tabs:

  poe worker

• Next, we can start the indexing process by running:

  poe index

• To monitor the indexing process, we can use the RQ dashboard by running:

  rq-dashboard

Once the indexing process is complete, we can start our app using the following command:

uvicorn mergeui.main:app --port 8000 --log-level trace

uvicorn mergeui.main:app --reload --port 8000 --log-level debug

gradio mergeui/web/gradio_app/main.py # with reloading
python mergeui/web/gradio_app/main.py # without reloading

poe bokeh_dev

This project use pytest for testing, you can run the tests using the following command:

poe test

MergeUI is a new project, and any contribution would make a difference! Whether you find a bug, have valuable feedback or suggestions, or simply want to get involved, we would love to hear from you!