Chat Bot App

A simple chat bot application built using Next.js and Ollama.

Description

The Chat Bot App allows users to interact with a chatbot powered by the Ollama. The app provides a user-friendly interface for sending messages and receiving responses from the chatbot.

• Ollama is configured to run in a Docker container.
• Pre-configured with NVIDIA GPU support for better performance.
• By default, it uses the gemma3:1b model, but you can change it to any other model available in the Ollama library.

Technologies Used

• JS Libraries: Ollama-js
• Framework: Next.js
• Fonts: Geist, Geist Mono
• Styling: Tailwind CSS
• Programming Language: TypeScript
• Containerization: Docker

How to use

1. Clone the repository:

git clone [email protected]:jhordyess/chat-bot-ollama.git

2. Open the project folder:

cd chat-bot-ollama

3. Prepare the environment:

• Make sure you have Docker installed and running on your machine.
• Make sure you have Node.js installed on your machine.
• Set up the NVIDIA Container Toolkit for Docker to enable GPU support. Follow the instructions in the NVIDIA documentation to install the NVIDIA Container Toolkit. If you are using Ubuntu, use my custom bash script.

bash ./ollama/nvidia.sh

• (Optional) Set up the environment variables. Create a .env file in the root directory of the project, following the example in .env.example. You can set the MODEL_NAME variable to specify the model you want to use. By default, it uses gemma3:1b.

4. Run the Docker service:

yarn docker

# or
docker compose -f docker-compose.ollama.yml up -d --build

4. Install the dependencies:

yarn install

5. Run the project:

yarn dev

6. Open the browser at http://localhost:3000/

To-Do

• Improve UI/UX design.

Contribution

If you would like to contribute to the project, open an issue or make a pull request on the repository.

License

© 2025> Jhordyess. Under the MIT license. See the LICENSE file for more details.

---

Made with 💪 by Jhordyess