⚙️ Generic (OpenAI Compatible) Provider Setup

Integrate any OpenAI-compatible API provider, such as Ollama, with Flexpilot, an AI code assistant in VS Code. This lightweight setup provides a local, efficient alternative to cloud-based solutions.

🤖 Supported Providers

Any OpenAI-compatible API provider can be configured with Flexpilot. Below are some popular providers:

• Ollama
• KoboldCpp
• text-gen-webui
• FastChat
• LocalAI
• llama-cpp-python
• TensorRT-LLM
• vLLM
• Anyscale Endpoints

Please refer to the respective provider's documentation by clicking on the links above for getting the API key and base URL details.

🛠️ Configuration

1. Access Flexpilot settings from VS Code:

   • Press Ctrl+Shift+P (Windows) or Cmd+Shift+P (Mac).
   • Select Flexpilot: Configure the Language Model Provider.
   • Choose Add New Configuration
   • select OpenAI Compatible (generic-chat) as the provider.

2. Enter a nickname when prompted. Pressing Escape will cancel the model configuration.

3. Enter your API Key when prompted.

4. Enter the base URL when prompted. For eg., http://localhost:11434/v1.

5. Enter the Model Name when prompted. For eg., llama3.2:1b.