• Stars
    star
    259
  • Rank 156,729 (Top 4 %)
  • Language
    Python
  • License
    Apache License 2.0
  • Created over 2 years ago
  • Updated 10 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

[IJCAI 2022, Official Code] for paper "Rethinking Image Aesthetics Assessment: Models, Datasets and Benchmarks". Official Weights and Demos provided. 首个面向多主题场景的美学评估数据集、算法和benchmark.

License Framework

[国内的小伙伴请看更详细的中文说明]This repo contains the official implementation and the new IAA dataset TAD66K of the IJCAI 2022 paper. Our new work on ICCV2023:Link

Rethinking Image Aesthetics Assessment: Models, Datasets and Benchmarks

Shuai He, Yongchang Zhang, Rui Xie, Dongxiang Jiang, Anlong Ming

Beijing University of Posts and Telecommunications


TAD66K  

Introduction

  • We build a large-scale dataset called the Theme and Aesthetics Dataset with 66K images (TAD66K), which is specifically designed for IAA. Specifically, (1) it is a theme-oriented dataset containing 66K images covering 47 popular themes. All images were carefully selected by hand based on the theme. (2) In addition to common aesthetic criteria, we provide 47 criteria for the 47 themes. Images of each theme are annotated independently, and each image contains at least 1200 effective annotations (so far the richest annotations). These high-quality annotations could help to provide deeper insight into the performance of models.

TAD66K

example3

Download Dataset

  • Download from here google, it contains images with the largest side scaled to 800, and labels categorized by different themes.
  • or here baidu, code: 8888

TANet  

Introduction

We propose a baseline model, called the Theme and Aesthetics Network (TANet), which can maintain a constant perception of aesthetics to effectively deal with the problem of attention dispersion. Moreover, TANet can adaptively learn the rules for predicting aesthetics according to a recognized theme. By comparing 17 methods with TANet on three representative datasets: AVA, FLICKR-AES and the proposed TAD66K, TANet achieves state-of-the-art performance on all three datasets. TANet Performance

Environment Installation

  • pandas==0.22.0
  • nni==1.8
  • requests==2.18.4
  • torchvision==0.8.2+cu101
  • numpy==1.13.3
  • scipy==0.19.1
  • tqdm==4.43.0
  • torch==1.7.1+cu101
  • scikit_learn==1.0.2
  • tensorboardX==2.5

How to Run the Code

  • We used the hyperparameter tuning tool nni, maybe you should know how to use this tool first (it will only take a few minutes of your time), because our training and testing will be in this tool.
  • Train or test, please run: nnictl create --config config.yml -p 8999
  • The Web UI urls are: http://127.0.0.1:8999 or http://172.17.0.3:8999
  • Note: nni is not necessary, if you don't want to use this tool, just make simple modifications to our code, such as changing param_group['lr'] to param_group.lr, etc.
  • PS: The work of train on the FLICKR-AES dataset may not be made public, because we are currently cooperating with a company, and the relevant model has been embedded into the system, and there are some confidentiality requirements.

If you find our work is useful, pleaes cite our paper:

@article{herethinking,
  title={Rethinking Image Aesthetics Assessment: Models, Datasets and Benchmarks},
  author={He, Shuai and Zhang, Yongchang and Xie, Rui and Jiang, Dongxiang and Ming, Anlong},
  journal={IJCAI},
  year={2022},
}

Try!

TANet.real-time.inference.video.1.mp4
TANet.real-time.inference.video.2.mp4
TANet.real-time.inference.video.3.mp4

More Repositories

1

Image-Color-Aesthetics-and-Quality-Assessment

[ICCV 2023, Official Code] for paper "Thinking Image Color Aesthetics Assessment: Models, Datasets and Benchmarks". Official Weights and Demos provided. 首个面向图像色彩主观美学评估的数据集、算法和benchmark.
Python
117
star
2

xiaohe

一个可以用于开发个人博客、门户网站、在线慕课的框架源码。
99
star
3

Image-Aesthetics-and-Quality-Assessment

[ACMMM 2023, Official Code] for paper "EAT: An Enhancer for Aesthetics-Oriented Transformers". Official Weights and Demos provided. 目前是地表最强开源美学评估模型之一.
Python
78
star
4

IAA_Tutorial

实验室【外部】美学课题组入门学习材料,加入课题组后,会有更详细的内部学习资料。
28
star
5

DeT-Plus

Our refined work of [ICCV 2023 "Thinking Image Color Aesthetics Assessment: Models, Datasets and Benchmarks"]
Python
26
star
6

Champion-Solution-for-CVPR-NTIRE-2024-Quality-Assessment-on-AIGC

[1st Official Code] Quality Assessment for AI-Generated Content - Track 1: Image AIGC内容质量评估冠军方案
Python
22
star
7

Long-Tail-image-aesthetics-and-quality-assessment

[ICML 2024, Official Code] First work to propose a solution to the long-tail problem in IAA. 首篇针对IAA中的长尾问题提出解决方案的工作
Python
19
star
8

ITU-Standard-for-IAA

The first international standard for image aesthetics assessment metadata. 首个面向图像美学评估元数据的国际标准.
11
star
9

hadoop-spark

The study of hadoop and spark.
Scala
6
star
10

web

jsp,html,css,JavaScript.....
HTML
4
star
11

Gomoku_IOS-ELM_master

A Python implementation AZ-style-Gomoku with OS-ELM
Python
2
star
12

Struts

DB for GitHub Page!
Java
2
star
13

edudemo

2018现代教育技术
JavaScript
2
star
14

e-language

The programming language of China!
1
star
15

fnnmOS_ELM

Python
1
star
16

woshidandan

1
star