Arbitrary Style Transfer Based on Content Integrity and Style Consistency Enhancement

IEEE International Conference on Acoustics Speech and Signal Processing, pp. 3135–3139

Abstract

The existing arbitrary style transfer methods mainly suffer two challenges. One is content integrity, as most methods focus too much on style, resulting in incomplete content information and missing details. The other is style consistency, which requires more exploration of style information to alleviate pattern and texture inconsistencies. Thus, a framework of Content Integrity and Style Consistency preserving arbitrary style transfer (CISC-ST) is proposed, which consists of a Dual Style Attention (DSA) mechanism and Frequency Domain Enhancement (FDE) architecture. The DSA aims to explore more style information and generate finer-grained style details. The FDE aims to enhance the overall content information to improve content preservation. Qualitative and quantitative experiments show that our method can produce stylized results that are more detailed in content and visually harmonious. The source code of our CISC-ST is available at https://github.com/SWU-CS-MediaLab/CISC-ST.

Authors 4

1. Lu Kang

   Southwest University

   Affiliation as printed

   Southwest University,College of Computer and Information Science,China

   College of Computer and Information Science, Southwest University, China

2. Guoqiang Xiao

   Southwest University

   Affiliation as printed

   Southwest University,College of Computer and Information Science,China

   College of Computer and Information Science, Southwest University, China

3. Michael S. Lew Aachen

   Leiden University

   Affiliation as printed

   Leiden University,LIACS,Netherlands

   LIACS, Leiden University, Netherlands

4. Song Wu

   Southwest University

   Affiliation as printed

   Southwest University,College of Computer and Information Science,China

   College of Computer and Information Science, Southwest University, China