THUDM/CogVLM2 THUDM/CogVLM2

  • Stars
    star
    1,842
  • Rank 24,983 (Top 0.5 %)
  • Language
    Python
  • License
    Apache License 2.0
  • Created 4 months ago
  • Updated 9 days ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
THUDM/CogVLM2
github

THUDM

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

GPT4V-level open-source multi-modal model based on Llama3-8B

More Repositories

1

ChatGLM-6B

ChatGLM-6B: An Open Bilingual Dialogue Language Model | 开源双语对话语言模型
Python
39,910
star
2

ChatGLM2-6B

ChatGLM2-6B: An Open Bilingual Chat LLM | 开源双语对话语言模型
Python
15,602
star
3

ChatGLM3

ChatGLM3 series: Open Bilingual Chat LLMs | 开源双语对话语言模型
Python
12,976
star
4

CodeGeeX

CodeGeeX: An Open Multilingual Code Generation Model (KDD 2023)
Python
7,924
star
5

GLM-130B

GLM-130B: An Open Bilingual Pre-Trained Model (ICLR 2023)
Python
7,646
star
6

CodeGeeX2

CodeGeeX2: A More Powerful Multilingual Code Generation Model
Python
7,545
star
7

CogVLM

a state-of-the-art-level open visual language model | 多模态预训练模型
Python
5,582
star
8

VisualGLM-6B

Chinese and English multimodal conversational language model | 多模态中英双语对话语言模型
Python
4,051
star
9

GLM-4

GLM-4 series: Open Multilingual Multimodal Chat LMs | 开源多语言多模态对话模型
Python
3,600
star
10

CogVideo

Text-to-video generation. The repo for ICLR2023 paper "CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformers"
Python
3,542
star
11

GLM

GLM (General Language Model)
Python
3,093
star
12

AgentBench

A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)
Python
2,081
star
13

P-tuning-v2

An optimized deep prompt tuning strategy comparable to fine-tuning across scales and tasks
Python
1,952
star
14

CogDL

CogDL: A Comprehensive Library for Graph Deep Learning (WWW 2023)
Python
1,710
star
15

CogView

Text-to-Image generation. The repo for NeurIPS 2021 paper "CogView: Mastering Text-to-Image Generation via Transformers".
Python
1,628
star
16

WebGLM

WebGLM: An Efficient Web-enhanced Question Answering System (KDD 2023)
Python
1,532
star
17

AgentTuning

AgentTuning: Enabling Generalized Agent Abilities for LLMs
Python
1,266
star
18

ImageReward

[NeurIPS 2023] ImageReward: Learning and Evaluating Human Preferences for Text-to-image Generation
Python
1,017
star
19

SwissArmyTransformer

SwissArmyTransformer is a flexible and powerful library to develop your own Transformer variants.
Python
950
star
20

CogView2

official code repo for paper "CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformers"
Python
932
star
21

P-tuning

A novel method to tune language models. Codes and datasets for paper ``GPT understands, too''.
Python
911
star
22

LongBench

LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding
Python
533
star
23

AutoWebGLM

An LLM-based Web Navigating Agent (KDD'24)
Python
521
star
24

GATNE

Source code and dataset for KDD 2019 paper "Representation Learning for Attributed Multiplex Heterogeneous Network"
Python
519
star
25

CogQA

Source code and dataset for ACL 2019 paper "Cognitive Graph for Multi-Hop Reading Comprehension at Scale"
Python
454
star
26

GraphMAE

GraphMAE: Self-Supervised Masked Graph Autoencoders in KDD'22
Python
437
star
27

GCC

GCC: Graph Contrastive Coding for Graph Neural Network Pre-Training @ KDD 2020
Python
320
star
28

MathGLM

Official Pytorch Implementation for MathGLM
Python
313
star
29

HGB

Revisiting, benchmarking, and refining Heterogeneous Graph Neural Networks.
Python
298
star
30

Inf-DiT

Official implementation of Inf-DiT: Upsampling Any-Resolution Image with Memory-Efficient Diffusion Transformer
Python
277
star
31

ComiRec

Source code and dataset for KDD 2020 paper "Controllable Multi-Interest Framework for Recommendation"
Python
275
star
32

AlignBench

大模型多维度中文对齐评测基准 (ACL 2024)
Python
247
star
33

RelayDiffusion

The official implementation of "Relay Diffusion: Unifying diffusion process across resolutions for image synthesis" [ICLR 2024 Spotlight]
Python
245
star
34

KOBE

Towards Knowledge-Based Personalized Product Description Generation in E-commerce @ KDD 2019
Python
237
star
35

NLP4Rec-Papers

Paper list of NLP for recommender systems
226
star
36

ProNE

Source code and dataset for IJCAI 2019 paper "ProNE: Fast and Scalable Network Representation Learning"
Python
225
star
37

Chinese-Transformer-XL

Python
214
star
38

GRAND

Source code and dataset of the NeurIPS 2020 paper "Graph Random Neural Network for Semi-Supervised Learning on Graphs"
Python
201
star
39

LongAlign

LongAlign: A Recipe for Long Context Alignment Encompassing Data, Training, and Evaluation
Python
150
star
40

icetk

A unified tokenization tool for Images, Chinese and English.
Python
146
star
41

CogCoM

Jupyter Notebook
140
star
42

KBRD

Towards Knowledge-Based Recommender Dialog System @ EMNLP 2019
Python
134
star
43

GraphMAE2

GraphMAE2: A Decoding-Enhanced Masked Self-Supervised Graph Learner in WWW'23
Python
124
star
44

iPrompt

Code, Data and Demo for Paper: Controllable Generation from Pre-trained Language Models via Inverse Prompting
Python
120
star
45

MCNS

Source code and dataset for KDD 2020 paper "Understanding Negative Sampling in Graph Representation Learning"
Python
111
star
46

ProteinLM

Protein Language Model
Python
108
star
47

grb

Graph Robustness Benchmark: A scalable, unified, modular, and reproducible benchmark for evaluating the adversarial robustness of Graph Machine Learning.
Python
91
star
48

GraphSGAN

Implementation of "GraphSGAN", a GAN-based semi-supervised learning algorithm for graph data.
Python
85
star
49

kgTransformer

kgTransformer: pre-training for reasoning over complex KG queries (KDD 22)
Python
83
star
50

ScenarioMeta

Source code and dataset for KDD 2019 paper "Sequential Scenario-Specific Meta Learner for Online Recommendation"
Python
80
star
51

OAG-BERT

A heterogeneous entity-augmented academic language model based on Open Academic Graph (OAG)
75
star
52

CogKR

Source code and dataset for paper "Cognitive Knowledge Graph Reasoning for One-shot Relational Learning"
Python
71
star
53

ReST-MCTS

ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Search
Python
71
star
54

ChatGLM-Math

Python
67
star
55

SelfKG

Codes for WWW2022 accepted paper: SelfKG: Self-Supervised Entity Alignment in Knowledge Graphs
Python
66
star
56

FewNLU

Python
66
star
57

Multilingual-GLM

The multilingual variant of GLM, a general language model trained with autoregressive blank infilling objective
Python
63
star
58

XDAI

Python
61
star
59

SciGLM

SciGLM: Training Scientific Language Models with Self-Reflective Instruction Annotation and Tuning
Python
59
star
60

OAG

Source code and dataset for KDD 2019 paper "OAG: Toward Linking Large-scale Heterogeneous Entity Graphs"
Python
59
star
61

CogAgent

47
star
62

Graph-Reading-Group

Daily reading group on graphs at KEG
45
star
63

SCR

SCR: Training Graph Neural Networks with Consistency Regularization
Python
38
star
64

NaturalCodeBench

Python
37
star
65

FastLDM

Inference speed-up for stable-diffusion (ldm) with TensorRT.
Python
34
star
66

WhoIsWho

KDD'23 Web-Scale Academic Name Disambiguation: the WhoIsWho Benchmark, Leaderboard, and Toolkit
Python
33
star
67

AutoRE

Python
32
star
68

GRAND-plus

Code and dataset for paper "GRAND+: Scalable Graph Random Neural Networks"
Python
31
star
69

LVBench

LVBench: An Extreme Long Video Understanding Benchmark
Python
30
star
70

GraphCAD

TKDE'22-GraphCAD: https://arxiv.org/pdf/2108.07516.pdf
Python
30
star
71

KDD-Industrial-Papers

A list of recent industrial papers in KDD'16–'18
29
star
72

ApeGNN

ApeGNN: Node-Wise Adaptive Aggregation in GNNs for Recommendation (WWW'23)
Python
22
star
73

GLM-iprompt

Apply Iprompt on GLM with innovative new methods. Currently support Chinese QA, English QA and Chinese poem generation.
Python
21
star
74

GIAAD

Graph Injection Adversarial Attack & Defense Dataset , extracted from KDD CUP 2020 ML2 Track
Python
21
star
75

Tsinghua-ML-Course

Course Materials for ML Course at Tsinghua
HTML
21
star
76

HOSMEL

A task relevant entity linking toolkit
Python
20
star
77

tdgia

code for paper TDGIA:Effective Injection Attacks on Graph Neural Networks (KDD 2021, research track)
Python
18
star
78

BatchSampler

The source code for BatchSampler that accepted in KDD'23
Python
18
star
79

MRT

MRT: Tracing the Evolution of Scientific Publications (TKDE 2021)
17
star
80

eTrust

Source code and dataset for TKDE 2019 paper “Trust Relationship Prediction in Alibaba E-Commerce Platform”
C++
16
star
81

RecDCL

RecDCL: Dual Contrastive Learning for Recommendation (WWW'24, Oral)
Python
16
star
82

LargeScale

Python
15
star
83

Self-Contrast

Extensive Self-Contrast Enables Feedback-Free Language Model Alignment
Python
15
star
84

Efficient-Head-Finetuning

Source code for EMNLP2022 long paper: Parameter-Efficient Tuning Makes a Good Classification Head
Python
14
star
85

whoiswho-top-solutions

Python
14
star
86

MSAGPT

MSAGPT
Python
13
star
87

IGB

Source code and dataset for IJCAI 2022 paper "Rethinking the Setting of Semi-supervised Learning on Graphs"
Python
12
star
88

paper-source-trace

Python
12
star
89

citation-prediction

Python
8
star
90

scholar-profiling

Jupyter Notebook
6
star
91

OAG-AQA

Python
6
star
92

OAG-taxo

Python
5
star
93

Refined-cora-citeseer

5
star
94

DropConn

DropConn: Dropout Connection Based Random GNNs for Molecular Property Prediction (TKDE'24)
Python
5
star
95

OAG-entity-alignment

Python
5
star
96

STAM

Source code and dataset for WWW'22 paper "STAM: A Spatiotemporal Aggregation Method for Graph Neural Network-based Recommendation"
Python
4
star
97

open_clip_pix2struct

pix2struct version of open_clip
Jupyter Notebook
4
star
98

DistAlign-GNNs

Jupyter Notebook
3
star
99

RecNS

Source code and dataset for TKDE'22 paper "Region or Global? A Principle for Negative Sampling in Graph-based Recommendation"
Python
3
star
100

Paper-Rec

Python
2
star