In recent years, the field of conversational AI has been greatly influenced by models such as ChatGPT, characterized by their expansive parameter sizes. However, this approach comes with significant demands on computing resources and memory. A study introduces a new concept: blending multiple smaller AI models to match or surpass the performance of larger models. This approach, called “blending,” integrates multiple chat AIs offering an efficient solution to the computational challenges of large models.
The study, conducted over thirty days with a large user base of the Chai research platform, demonstrated that mixing specific smaller models could potentially outperform or match the capabilities of much larger models such as ChatGPT. For example, integrating just three models with 6B/13B parameters can rival or even surpass the performance of significantly larger models such as ChatGPT with 175B+ parameters.
The increasing reliance on pre-trained large language models (LLM) for various applications, especially in chat AI, led to a surge in the development of models with a huge number of parameters. However, these large models require specialized infrastructure and have significant inference costs, limiting their affordability. A hybrid approach, on the other hand, offers a more efficient alternative without compromising on conversational quality.
The effectiveness of Blended AI is evident in user engagement and retention rates. During large-scale A/B testing on the CHAI platform, mixed ensembles composed of three LLMs with parameter 6-13B outperformed OpenAI’s ChatGPT parameter 175B+, achieving significantly higher user retention and engagement. This shows that users find Blended chat AIs more engaging, fun and useful, while requiring only a fraction of the inference and memory costs of larger models.
The research methodology involves clustering based on Bayesian statistical principles, where the probability of a particular response is conceptualized as a marginal expectation taken over all plausible chat AI parameters. Blended randomly selects the chat AI that generates the current response, allowing different chat AIs to implicitly influence the output. This results in blending the strengths of the individual AI chat, resulting in more engaging and varied responses.
Breakthroughs in AI and machine learning trends for 2024 highlight the shift to more practical, efficient and adaptive AI models. As AI becomes more integrated into business operations, there is a growing demand for models that meet specific needs, offering improved privacy and security. This shift is consistent with the core principles of the blended approach, which emphasizes efficiency, cost-effectiveness, and adaptability.
In conclusion, the mixed method represents a significant step in the development of AI. By combining multiple smaller models, it offers an efficient, cost-effective solution that preserves, and in some cases improves, user engagement and retention compared to larger, more intensive models. This approach not only addresses the practical limitations of large-scale AI, but also opens up new opportunities for AI applications in various sectors.
Image source: Shutterstock