GitHub - fauxpilot/fauxpilot: FauxPilot - an open-source alternative to GitHub Copilot server

GitHub - fauxpilot/fauxpilot: FauxPilot - an open-source alternative to GitHub Copilot server

🚀 Discover FauxPilot - an open-source alternative to GitHub Copilot server! 🤖💻 Utilize SalesForce CodeGen models with NVIDIA's Triton Inference Server for powerful AI assistance. Setup is a breeze with Docker & NVIDIA GPU support. Get creative with AI tech! #AI #GitHub #FauxPilot

  • **Repository Description:** FauxPilot is a locally hosted alternative to GitHub Copilot.
  • **Technology Stack:** Utilizes the SalesForce CodeGen models within NVIDIA's Triton Inference Server with the FasterTransformer backend.
  • **System Requirements:** Requires Docker, docker-compose >= 1.28, an NVIDIA GPU with Compute Capability >= 6.0 and ample VRAM, nvidia-docker, curl, and zstd for model downloads.
  • **Support and Warranty Disclaimer:** Limited information available on the wiki and a discussion forum for queries; no formal support or warranty provided.
  • **Setup Process:** Involves running a setup script to select and download the model, then converting it for FasterTransformer use.
  • **Client Configuration:** Offers various methods to connect to the FauxPilot Server, such as Openai API, Copilot Plugin, and REST API.
  • **Terminology Overview:** Defines key terms like API, CC, CUDA, FT, JSON, gRPC, GPT-J, and REST.
  • **Resource Metrics:** GitHub repository with 14.1k stars, 121 watchers, and 596 forks.
  • **License:** Released under the MIT license.
  • **Information Source:** Retrieved from the FauxPilot README on the GitHub repository.