koala

**Koala** is an **instruction-following language model developed by Berkeley AI Research (BAIR) that demonstrated the critical importance of training data quality over quantity** — fine-tuned from LLaMA on carefully curated dialogue data primarily from ShareGPT conversations, Koala showed that a model trained on high-quality human-AI dialogues could match or exceed models trained on much larger but lower-quality datasets, influencing the data curation strategies of subsequent models like Vicuna and Orca. **What Is Koala?** - **Definition**: A fine-tuned LLaMA model (April 2023) from UC Berkeley's BAIR lab — trained on a curated mix of dialogue data from ShareGPT (user-shared ChatGPT conversations), HC3 (human-ChatGPT comparison dataset), and other high-quality conversational sources. - **Data Quality Focus**: Koala's key contribution was demonstrating that carefully curated dialogue data produces better models than larger volumes of lower-quality instruction data — a finding that influenced the entire field's approach to training data. - **ShareGPT Foundation**: Like Vicuna, Koala relied heavily on ShareGPT conversations — real user interactions with ChatGPT that captured the diversity and complexity of actual chatbot use cases. - **Early ChatGPT Clone**: Koala was one of the first wave of "ChatGPT clones" (alongside Alpaca, Vicuna, Dolly) that convinced the community that LLaMA fine-tunes were a viable path to creating useful chat assistants. **Why Koala Matters** - **Data Quality Thesis**: Koala's experiments showed that models trained on high-quality dialogue data (ShareGPT conversations) significantly outperformed models trained on larger volumes of synthetic instruction data (Self-Instruct style) — establishing data quality as the primary driver of model capability. - **Helpfulness Focus**: The training data was curated to emphasize helpfulness and reduce refusals — Koala was designed to actually answer questions rather than deflecting with safety disclaimers, a design choice that influenced subsequent uncensored model development. - **BAIR Credibility**: As a product of UC Berkeley's prestigious AI research lab, Koala's findings carried significant weight in the research community — the data quality insights were widely cited and adopted. - **Methodology Influence**: Koala's approach to data curation (prioritizing real human-AI conversations over synthetic data) directly influenced Vicuna's training strategy and the broader community's shift toward high-quality conversational training data. **Koala is the Berkeley model that established data quality as the key to open-source chat model performance** — by demonstrating that carefully curated dialogue data from real ChatGPT conversations produces better models than larger synthetic datasets, Koala influenced the training strategies of Vicuna, Orca, and the entire open-source LLM ecosystem.