Mitsua-chan's AI is based on the "latent diffusion model" mechanism, and there are three stages in the training process.

• STEP 1

  In the first phase, Mitsua-chan studied the basic concepts of art in an ethical manner by training U-Net and VAE of the model from scratch with over 11 million images of public domain/CC0 or proper license for permission to use. This trained model is published as “Mitsua DiffusionOne”. Please note that this model focuses on solving ethical problems regarding representation of generated images and does not have sophisticated artistic expression yet. At the moment, the text encoder module utilizes pretrained OpenCLIP. Click here for a detailed explanation.

• STEP 2

  In the second phase, images collected from X(Twitter) accounts that have been approved to participate in the training via Opt-in Application and images posted on the Discord server will be included to the training data set, which will be additionally trained together with the images used in phase 1. We will not collect images from accounts other than those approved to participate in the learning process. Please note that we will review your account and may not approve your application if there are any infringements of rights or other concerns.
  There are two ways to participate:
  1. Participate by tweeting with the hashtag "#みつあ勉強用" on your X(Twitter) account
  2. Participate with all of the images posted on your X(Twitter) account from the past.
  Please refer to the Opt-in Application page for details on how to participate in each of the above.
  There are rules that we ask you to follow for these images submission, so please refer to the Training Image Guidelines for details.
  Once your account has been approved, you will be able to join the dedicated Discord server, and you may also post images for training in batches within Discord.
  It is also possible to opt-out (not participate in the training) even after you participate in the training. The training process from the second stage onward will be executed from scratch each time, and the effect of the excluded data will not remain in the trained model. All participants in the training will be rewarded according to the number of images and their quality in return for their contribution to Elan Mitsua's painting ability.
  ->Opt-in Application

• STEP 3

  Finally, in the third phase, Elan Mitsua's AI will be fine-tuned with a dataset of images from "#みつあ勉強用" tweets. Images added to this dataset will have a significant impact on Elan Mitsua's painting style and artistic concept development. We are also pleased to list the credits of all the participants for the training on the Contributor Credits page.
  Please note that the model trained using those submitted images will be used only for Elan Mitsua's social channels and research and development relating to the Elan Mitsua Project, as described in the Training Image Guidelines, and will not be used for any other purpose. We are also preparing a trial function of the image generation for non-commercial use within a Discord server exclusively for training participants. The trained model itself will not be released to the public because it will be impossible to properly manage the model and its right holders. Please check here for our policy on releasing models in the future.