GitHub - fauxpilot/fauxpilot: FauxPilot - an open-source alternative to GitHub Copilot server
🚀 Discover FauxPilot - an open-source alternative to GitHub Copilot server! 🤖💻 Utilize SalesForce CodeGen models with NVIDIA's Triton Inference Server for powerful AI assistance. Setup is a breeze with Docker & NVIDIA GPU support. Get creative with AI tech! #AI #GitHub #FauxPilot
- **Repository Description:** FauxPilot is a locally hosted alternative to GitHub Copilot.
- **Technology Stack:** Utilizes the SalesForce CodeGen models within NVIDIA's Triton Inference Server with the FasterTransformer backend.
- **System Requirements:** Requires Docker, docker-compose >= 1.28, an NVIDIA GPU with Compute Capability >= 6.0 and ample VRAM, nvidia-docker, curl, and zstd for model downloads.
- **Support and Warranty Disclaimer:** Limited information available on the wiki and a discussion forum for queries; no formal support or warranty provided.
- **Setup Process:** Involves running a setup script to select and download the model, then converting it for FasterTransformer use.
- **Client Configuration:** Offers various methods to connect to the FauxPilot Server, such as Openai API, Copilot Plugin, and REST API.
- **Terminology Overview:** Defines key terms like API, CC, CUDA, FT, JSON, gRPC, GPT-J, and REST.
- **Resource Metrics:** GitHub repository with 14.1k stars, 121 watchers, and 596 forks.
- **License:** Released under the MIT license.
- **Information Source:** Retrieved from the FauxPilot README on the GitHub repository.