AI dapp to transform any 2D PFP NFT into a 3D Decentraland Wearable/Avatar This proposal is now in status: REJECTED. Voting Results: * Yes 1% 6 VP (15 votes) * No 98% 8,931,817 VP (69 votes) * Abstain 1% 859 VP (2 votes)

While not entirely the same, I have access to an AI 3D app. It is only for doing furniture at the moment but is rather impressive. I know there is another that is for shoes currently. So I do believe the ability is not far off.  Ive been playing with a few different things.

yes, not ready yet, but the ingredients are here. that is why we are asking for a grant, to build this. I see we didn't describe our approach enough, and also prototype of a rigged model was requested - we are working on that and will present here soon. however, if you want to see the 100% ready product before voting yes, then we will not need funding anymore - we need it to build. :man_shrugging:

Voting **No**, my understanding is that the technology is not ready to transpose a 2D image into a 3D model with high enough fidelity and accuracy to turn PFPs into Wearables. What is possible now: - Take multiple photos of a item and turn all those photos into a 3D model. The 3D model may need fixing. - Take an image of a human face, and turn it into a 3D face. - Describe a very simple object (like a chair) and get a nice low poly 3D model. - Take an image and compute the depth of each element (like in you example). That is technically 3D, but not the kind of 3D needed to make a wearable. I would need proof that there is a robust technique that can take a PFP image, extrapolate the missing information, and build a polygonal 3D model suitable to rig and turn into a wearable.

First of all we want to build this for DCL as it is the pioneer of a decentralized metaverse. Second, DCL Avatars have very specific requirements. A big part of the results of this project can not just be used for a different metaverse. Third, is that we plan to integrate NFTs from multiple blockchains. Users will be incentivized to create a DCL avatar from their NFTs regardless on which blockchain they hold them. And of these new users will likely discover and explore DCL (ofc I cant promise that, but even in-world games projects can't promise that). You have a point that we want to build this project regardless of the outcome for the grant - because the utility is obvious. We also considering other metaverses. There are very many being built right now, and an app like ours has a great use in this "metaverse of metaverses". We want to contribute to making transitions as easy as possible, lowering the barriers between these worlds. I believe users will enjoy having the freedom of easily switching between these worlds, as they already do. And that metaverses with lower entry barriers will have a competitive advantage over the ones trying to isolate.

hi, thanks for the feedback. to respond to your remarks: "Unfortunately at this stage I cannot support this because you don’t have a prototype that shows a qualifying 3D model that would fit a gaming environment." - we can of course show a prototype and will do so in a couple of days. however, it is for developing the automation process we are requesting funds for, and building this takes time and processing power for testing, which is why we need funding. "Furthermore the tools of depth extraction that you mention are already existing and free to use online for 2D to 3D . Similarly a lot of AI apps that can be used to create 2D images without any financial costs such as stable diffusion." - Yes these models are available, but none of these offer ready to use results of a 360 3D avatar directly from an NFT based on the combination of 3 different models. Also we explan in the proposal that we want to train the models on datasets that help get results especially for our use case. "AI is a trendy topic but is also a very sensitive subject regarding the data on which the models are trained and the methodology of how it is being used to generate models. Will you be transparent on the source of the data you have trained ?" - We will open source our models and also reference the datasets. "Will you give free access to those tools you are developing ? Will it be opensource ? Will it have a Subscription model or paid features ?" - Yes we will open source everything as stated in the submission. However, ai-processing and 3D rendering requires computing power that needs to be covered by the user. Anyone could run these models, but we also plan to offer a service that will require users to pay for the rendering. We could also agree on a shared revenue model with the DAO if there is interest in that - then I would prob. better submit this for the accelerator? "FYI Asking for funding for a project that will have a paywall to access to ( with tools that are already available online for free ) will meet a lot of resistance from the DAO ." - The funding is requested for a tool integrating AI-generated 3D Avatars specifically for DCL. Processing will cost money though - we assume the cost per Avatar (processing only) will effectively be very low compared to manual generation. I see your point here, so we are happy to offer the dapp to DCL users for just the processing cost if we receive a grant.

PFP Avatar sounds exciting, even more so since I have the name :rofl:

While i love the premise, I question how this benefits Decentrland specifically? It sounds like you have planned to build this regardless and yes we have a grants program but it is for those projects that benefit DCL. This is a project for way more than DCL and does nothing to even promise that by using this people will come into world. Have to vote no.

thanks @amanda_mod - the prototype with the first 2 ai modules is online and available on request. Surely, we can def. provide a more advanced proof of concept. working on it!

Thanks for your reply @SugarClub. We would very much appreciate it if you take this project seriously just as we do, already having put a lot of work and money into it. Sure, we are at an early stage aiming to do something which has never been done before. Maybe too early for requesting a grant here. You can find info in the proposal, that fine tuning the models requires a lot of processing power and dedicated work - and this is why we request funding. Sure, we can and will provide a 3D model of how we aim to achieve automated results, as well as the methodology of production. Thank you for the feedback!

Hey, first of all great job on addressing this problem. I'm a maxi on making 3D modelling and design more accessible and an app that could deliver on this would be a game changer for the space. Unfortunately, for me I'd need to see more of a proof of concept that your team can successfully create a low-poly, rigged, weight-painted avatar before voting yes. I imagine scaling and maintaining for DCL would be a huge feat and that a budget of this type would be more suitable to adapt your existing technology to the platform. All the best.

Hi everyone - sorry the images didn't load. please check the prototype screenshots here: [https://postimg.cc/D8GrP8SG](https://beamit generative AI model (prototype screenshot)) [https://postimg.cc/dL91FYXX](https://Depth prediction model 2D-3D transform, prototype screenshot) [https://postlmg.cc/mt6Q4CKK](https://rigging the avatar with decentraland skeleton) lmk about your questions & request prototype access