Skip to content
Clothsy AI Talk to us

RESEARCH

We work on problems where vision meets reality.

Generative models can make almost any image look plausible. We study what it takes to make them faithful: to people, to materials and to the physical world. Our first focus is photorealistic virtual try-on.

THE CORE PROBLEM

Show a person wearing something they have never worn.

From one photo of a person and one photo of a product, generate an image of that person wearing that product. It sounds like one task. It is really several: understanding the photo, moving the garment onto a body, preserving every detail of the fabric, and doing it fast enough to use.

Each of those pieces is an open research question, and each maps to one of our research areas below.

Person photo (input)
Person photo
Product photo of a garment (input)
Product photo
Generated try-on result (output)
Generated try-on

Keep from the personFace and identity, pose, body shape, skin, hair, background.

Take from the productGarment shape, colour, fabric texture, print, logos, details like buttons and seams.

Figure 1The task. A person photo and a product photo go in; a new image of that person wearing that product comes out. Images: the Clothsy AI demo set.

OPEN PROBLEMS

What we are working on now.

Read the full problem statements
  1. Fabric fidelity through warping

    Keeping texture, print and logos intact while a garment is warped onto a body.

  2. Drape and folds

    Realistic drape, folds and fit across different body shapes.

  3. Pose and camera consistency

    The same garment, consistent across poses and camera angles.

  4. Fast, affordable inference

    Generation fast and cheap enough to run on a live storefront.

HOW WE WORK

Measured before it is shipped.

  1. Start from what people see

    A research question should begin with a failure someone would notice in a real image, not with a metric.

  2. Build the benchmark before the model

    Decide how success is measured, on data the model has never seen, before trying to fix anything.

  3. Change one thing at a time

    Ablations over intuition. If we cannot say which change helped, we do not ship it.

  4. Report what we find, including what failed

    Negative results and limitations go in the write-up next to the wins.

  5. Ship it, then keep measuring

    Work that holds up goes into production, where real use tells us what to study next.

DATA AND RESPONSIBILITY

Where the data comes from matters.

Most public try-on datasets are licensed for research only. A model that people and businesses can rely on has to be built on data with clear rights and clear consent.

SourcesClear rightsCatalogue images licensed for training, commissioned shoots, synthetic renders.
ChecksLicence and consentConfirm commercial-use terms, and a signed release for every person shown.
RecordPer-sample lineageWhere each image came from and under what terms, kept with the data.
UseTraining setOnly samples that pass every check.

Never in trainingPhotos shoppers upload to try something on.

Figure 2Clean-provenance data. Every training sample should be traceable to a source we have the right to use, and shopper photos stay out of training entirely.
Clean data
Every training sample should come from a source we have the right to use, with a record of where it came from.
Consent
Anyone shown in a training image should have agreed to that use in a signed release.
Privacy
Photos shoppers upload to try something on are never used for training.
Transparency
A try-on is a generated image, and it should be presented as one, never as a photograph of a real fitting.
Read: Where training data comes from

JOIN THE RESEARCH TEAM

Work on the open problems with us.

Students, researchers and engineers. The application takes about two minutes.