ITOps Times Open-Source Project of the Week: Llama2 WebUI
With this project, users can run Llama 2 locally with gradio UI on GPU or CPU from anywhere (Linux/Windows/Mac). It supports Llama-2-7B/13B/70B with 8-bit, 4-bit. It also supports GPU inference (6 GB VRAM) and CPU inference. Llama 2 is a collection of pre-trained and fine-tuned generative text models ranging in scale from 7 billion to… … continue reading
