Three Ways of Using Large Language Models to Evaluate Chat logo
AI Tool Profile

Three Ways of Using Large Language Models to Evaluate Chat

This paper describes the systems submitted by team6 for ChatEval, the DSTC 11 Track 4 competition.

Website
github.com
Pricing model
Free
Price start
Free

GitHub Link

The GitHub link is https://github.com/oplatek/chateval-llm

Introduce

Title GitHub - oplatek/chateval-llm Enhancing Chat Evaluation Using Large Language Models Summary The GitHub repository "oplatek/chateval-llm" presents a system description of the Dstc11 Track 4 submission, focusing on three different approaches to leveraging Large Language Models for improved chat evaluation. The repository provides valuable insights into utilizing these methods to enhance the assessment of conversational agents. Three Ways of Using Large Language Models to Evaluate Chat. A system description of Dstc11 Track 4 submission.

Content

A system description of Dstc11 Track 4 submission.

Alternatives & Similar Tools

LongLLaMA-handle very long text contexts, up to 256,000 tokens logo

LongLLaMA is a large language model designed to handle very long text contexts, up to 256,000 tokens. It's based on OpenLLaMA and uses a technique called Focused Transformer (FoT) for training. The repository provides a smaller 3B version of LongLLaMA for free use. It can also be used as a replacement for LLaMA models with shorter contexts.

LAMA: Human motion data to realistic complex 3D model actions logo

LAMA utilizes a reinforcement learning framework combined with a motion matching algorithm. Reinforcement learning helps the model make appropriate decisions in various scenarios, while motion matching algorithms ensure that synthesized actions match real human actions. In addition, LAMA also utilizes the motion editing framework of manifold learning to cover various possible changes in interactions and operations.

Compare Three Ways of Using Large Language Models to Evaluate Chat

Quick compare routes for nearby alternatives.

All compare routes →