OpenBMB/UltraEval

Stars
155
Rank 233,923 (Top 5 %)
Language
Python
License
Apache License 2.0
Created 7 months ago
Updated about 1 month ago

OpenBMB/UltraEval

OpenBMB

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

An open source framework for evaluating foundation models.

ChatDev

Create Customized Software using Natural Language Idea (through LLM-powered Multi-Agent Collaboration)

XAgent

An Autonomous LLM Agent for Complex Task Solving

ToolBench

[ICLR'24 spotlight] An open platform for training, serving, and evaluating large language model for tool learning.

MiniCPM

MiniCPM-2B: An end-side LLM outperforms Llama2-13B.

Jupyter Notebook

AgentVerse

🤖 AgentVerse 🪐 is designed to facilitate the deployment of multiple LLM-based agents in various applications, which primarily provides two frameworks: task-solving and simulation

BMTools

Tool Learning for Big Models, Open-Source Solutions of ChatGPT-Plugins

CPM-Bee

百亿参数的中英文双语基座大模型

MiniCPM-V

MiniCPM-V 2.0: An Efficient End-side MLLM with Strong OCR and Understanding Capabilities

VisCPM

[ICLR'24 spotlight] Chinese and English Multimodal Large Model Series (Chat and Paint) | 基于CPM基础模型的中英双语多模态大模型系列

ProAgent

An LLM-based Agent for the New Automation Paradigm - Agentic Process Automation

BMInf

Efficient Inference for Big Models

BMTrain

Efficient Training (including pre-training and fine-tuning) for Big Models

CPM-Live

Live Training for Open-source Big Models

BMList

A List of Big Models

UltraFeedback

A large-scale, fine-grained, diverse preference dataset (and models).

BMPrinciples

A collection of phenomenons observed during the scaling of big foundation models, which may be developed into consensus, principles, or laws in the future

ModelCenter

Efficient, Low-Resource, Distributed transformer implementation based on BMTrain

RepoAgent

An LLM-powered repository agent designed to assist developers and teams in generating documentation and understanding repositories quickly.

InfiniteBench

100k+ Long-Context Benchmark for Large Language Models (paper upcoming)

DecT

Source code for ACL 2023 paper Decoder Tuning: Efﬁcient Language Understanding as Decoding

OlympiadBench

An Olympiad-level bilingual multimodal scientific benchmark, featuring 8,952 questions from Olympiad-level mathematics and physics competitions, including the Chinese college entrance exam.

XAgent-doc

Document for XAgent.

BMInf-demos

UltraLink

An Open-Source Knowledge-Enhanced Multilingual Supervised Fine-tuning Dataset

General-Model-License