My Own Assistant
by Interpause
This project aims to simplify the creation of fully integrated, self-hosted assistants using MCPs. It leverages OpenAI-compatible APIs, specifically to take advantage of models like Qwen3-30B-A3B.
View on GitHub
Last updated: N/A
My Own Assistant
Just gonna see if it is now way easier to make your own fully integrated assistant using MCPs. Fully self-hosted too by bringing your own OpenAI compatible API. Just to take advantage of the fact Qwen3-30B-A3B exists.
TODOs
- [ ] Try switching from poetry to uv.
py-api-template
Template for FastAPI-based API server. Features:
- Supports both CPU/GPU-accelerated setups automatically.
- Poetry for package management.
- Ruff for formatting & linting.
- VSCode debugging tasks.
- Other QoL packages.
Oh yeah, this template should work with the fancy "Dev Containers: Clone Repository in Container Volume..." feature.
Usage Instructions
- Replace all instances of
py-api-template. Optionally, renamesrcto a nicer name.- Tip: Rename the
srcfolder first for auto-refactoring.
- Tip: Rename the
Useful Commands
Ensure the virtual environment is active and poetry install has been run before using the below:
# Launch debugging server, use VSCode's debug task instead by pressing F5.
poe dev
# Run any tests.
poe test
# Build docker image for deployment; will also be tagged as latest.
poe build {insert_version_like_0.1.0}
# Run the latest image locally.
poe prod
# Publish the latest image.
poe publish