Show HN: Feedback on Sketch Colourisation https://ift.tt/Bfj38VG

Show HN: Feedback on Sketch Colourisation Hi I am looking for some feedback on our new project "Sketch Colourisation". The envisioned UI and objectives are -- * An artist should have greater control on how to colour a sketch. While a text-to-image model lacks this fine-grained control, a per-pixel colourisation pipeline makes sketch colourisation a laborious process with high-entry barrier. * What if an artist only draws a mask for a local region and specifies the colour palette for that local region? Then a neural network figures out how to colour the overall sketch -- while maintaining those local colour palette. [I would really like a feedback if the above UI (i.e., mask and local colour palette) makes sense to users/designers. As researchers, we often have the wrong idea of what is desired by end-users.] * On the exact implementation of the above concept, we designed a no-training based neural network framework -- and also make sure it runs on a Nvidia 4090. In other words, I will try to avoid any expensive training or inference -- which defeats the purpose of being useful to people (not just some research labs). * Note, I am not so bothered about the exact implementation (or whether it is "novel") -- as long as it is useful. * A shameless advertisement: The codebase ( https://ift.tt/nTVkPOD ) is MIT License. It is no way near to being useful to people -- but I would really like to pursue this direction and your feedback/criticism will be immensely helpful. Thanks https://ift.tt/FHwQnsV June 22, 2024 at 05:03PM