Should the DAO Reward Genesis City Scenes That Drive Engagement?
Proposal Details
Description
The Decentraland platform emphasizes user-generated content, such as wearables and scenes. This high-quality content is what attracts and retains users, stimulates the marketplace, and ultimately increases revenue for the DAO. Therefore, it's crucial that the DAO incentivizes the creation of exceptional content to maintain this cycle. Currently, the DAO operates a grant program to stimulate the development of in-world experiences. Beyond this initial support, however, there are no direct incentives for creators to continue enhancing their scenes. Scene creators often monetize their creations through methods such as selling NFTs, issuing their own tokens, renting space to third parties, or selling the scene code for others to deploy on their land. A critical question for game developers arises: Why should they build their game on Decentraland instead of other platforms or distribution channels? Besides the project's strong values and initial financial support, there seems to be a long-term economic benefit that has not been fully defined yet. This proposal suggests a distribution of MANA to scene creators based on the number of users their scenes attract. The user addresses and their locations are publicly available information, disclosed by the protocol and accessible via [DCL Metrics](https://dcl-metrics.com/scenes) and [Atlas Corporation](https://governance.decentraland.org/proposal/?id=66d76070-0d27-11ed-92a2-218eab5ea42b). The Decentraland Foundation also maintains a record of this data. There are, however, numerous questions about how such a distribution should operate, particularly concerning its vulnerability to hacking or bot attacks. The purpose of this proposal is to gather community sentiment on the idea and to start discussions about how to design such a system. The Decentraland Foundation could initiate a pilot program, taking responsibility for calculating the winners, filtering bots, and distributing MANA as compensation to creators. Subsequently, any community member could request a grant to keep this program operational. ### Questions & Proposed Answers: **What scenes participate in the engagement contest?** All scenes in Genesis City can participate in the contest, excluding plazas and roads. **How much MANA should be distributed?** The amount should be adjusted based on the revenue generated by the DAO from marketplace fees. For instance, over the last 30 days, there was an income of 30k USD. **How should the MANA be distributed among the scene creators?** Prizes should be distributed monthly. All scenes will be ranked by an engagement metric using data from the past 30 days. The top 20 scenes receive a part of the prize based on the following scheme: * Top 1: 25% = $7,500 * Top 2: 15% = $4,500 * Top 3: 10% = $3,000 * Top 4 to 10: 4% = $1,285 * Top 11 to 20: 2% = $600 _The total prize is based on a 30k USD amount._ **How is the engagement of a scene measured?** Several metrics should be defined to strengthen the algorithm. The key metrics will be calculated using public traffic data reported by the catalyst nodes. The proposed metrics include: * AVG DAILY UNIQUE WEB3 VISITORS: Number of unique web3 visitors for the month divided by the days of the month. * AVG DAILY WEB3 VISITS: Number of times web3 users have entered the scene within the month divided by the days of the month. * AVG SCENE RETENTION: The average of days passed between the first and last appearance of a web3 user in a scene within the month for all web3 users that visited the scene more than once in that month. * AVG RETURNING: Average number of times a web3 user visits the same scene within the month. * AVG STAY MINS: Average time spent by web3 users in the scene, in minutes. _All metrics are calculated over web3 users (non-guest users)._ **How is a ranking produced based on the key engagement metrics?** The process involves creating five different scene rankings, one for each key metric. These rankings are then combined using [Borda’s count method](https://courses.lumenlearning.com/waymakermath4libarts/chapter/borda-count/) using the formula: _scene_score = value(position_ranking_1) + … + value(position_ranking_5)_ The value of each position in the rankings is calculated using numbers derived from different percentiles of a normal distribution. This method ensures that ranking in the top positions is more rewarding. **What does this ranking look like for June engagement metrics?**  You can find the dataset with the example at [this link](https://docs.google.com/spreadsheets/d/1Cjj1qyT7fLOzOCyAzLAh4uVGabB7qkjQRD0F6nD6Esk/edit?usp=sharing). **How are bots prevented from manipulating the ranking?** To prevent fraudulent activity in the engagement metrics, the Decentraland Foundation flags and removes from the analysis web3 users who display suspicious activity. This activity is currently flagged based on the number of sessions connected from the same IP and user agent. The list of suspicious users can be published along with the dataset for auditing purposes.
I'm really late to the party on this one apparently but I just want to say that from the perspective of someone who has built an analytics platform, I must say I'm skeptical that this can be done in a way that can't be gamed if there is a financial incentive to do so. Some questions come into play like - how many unique account addresses can be included in the metrics if they are coming from the same IP address? Will people using VPN or proxy connections be left out of the count, since that could be a way to circumvent the IP restriction? Would engagement be based on number of visitors? Time spent in scene? Time spent active? There are so many variables, and I agree with Nikki Fuego and others who have expressed the importance of getting these metrics right if there will be a financial incentive to influence them. I feel like for $7500 a month, plenty of people around the world would have plenty of incentive to build an AI bot army that "engages" with their scene 24/7. A world full of fake engagement will do more harm than good.
Should the DAO Reward Genesis City Scenes That Drive Engagement? This proposal has been PASSED by a DAO Committee Member (0xbef99f5f55cf7cdb3a70998c57061b7e1386a9b0)
Should the DAO Reward Genesis City Scenes That Drive Engagement? This proposal is now in status: FINISHED. Voting Results: * Yes 81% 3,036,677 VP (95 votes) * No 19% 758,346 VP (16 votes) * Invalid question/options 0% 0 VP (1 votes)
I did a little research between DCL metrics and atlas … there both very different numbers when I tried to get analytics for my scene. Something to look into. Also will worlds be included ? I agree on incentives to creators… Of course we need to have the right data to avoid issues in the future. But this is where we need to be heading if we want an active platform.
Thanks for the reply! Tons of good stuff in there and so many concerns addressed!! [quote="yemel, post:32, topic:19798"] Is there a specific need for this restriction? If DCL is attracting a sufficient number of users and the ranking criteria are effective, it might be more beneficial to reward the most engaging scenes. Implementing a minimum engagement threshold could be perceived as arbitrary. [/quote] The purpose of this is mainly to add threshold at which point the content can be deemed 'successful'. It's not really a big deal now (the number of engaging scenes we have is fairly manageable), but if we get to the point where content abounds and the community can support a large number of scenes it may be easier use certain thresholds to determine what the lowest viable candidate for funding is (rather than just the top 20). It also makes it easier to adjust this minimal threshold for content as the platform gets more popular to ensure the quality of content is upheld & provides a filter against less popular / less engaging / low effort experiences. [quote="yemel, post:32, topic:19798"] I’m wondering what to do with scenes that are “duplicated” in the ranking, such as ICE Poker/Diamond Hands casinos and Ethermon House/Forest. Should they be compensated twice, or should their metrics be added together? [/quote] It feels like the best approach would be to bundle all the metrics for a given experience together as a single entity, measuring the interaction levels with an experience not the location. All the funding a specific experience generates (across every estate/world) is likely going towards the development & maintenance of that experience as a whole. This also helps tackle issues that may rise when an estate is re-branded; we set the time range to only include metrics for a project when estates are displaying content for that brand. Ex: If a part of the Ethermon experience migrated to a new location it would still be part of Ethermon and should be included in the metrics; if the estate that experience moved from hosts a new type of content not relating to the Ethermon, the metrics for that estate should that are to be bundled with Ethermon up to the point where the content changed (metrics past that point are then attributed to the new content experience).
[quote="yemel, post:32, topic:19798"] Session lengths in a scene are currently capped to a maximum limit to prevent AFK behavior from skewing the metrics. The data reported by the Catalyst does not incorporate chat activity or movement within the scene. While it is possible to collect this information by connecting to all peer-to-peer networks and listening for events, it would significantly complicate the process and make auditing more challenging. [/quote] I think it is good starting simple, but maybe just a counter on chat activity isn't too complex, grouping by user (hashed to keep some privacy) or not. Anyway, the idea is there, it's going to be really hard being open source and apply rewards, but better something than nothing and start simple. Maybe some "hidden", not so public measures can also be implemented to apply bans, or a thurstable private third party service providing score.
similar metrics of visits but also giving more importance to **registered names**? also similar to guests / **web3** users?
[quote="yemel, post:32, topic:19798"] At present, we aren’t assigning more weight to any particular metric, including the Daily Active Users (DAU). This is because we believe other metrics mentioned are equally significant. Our goal isn’t just to increase the number of active users, but to cultivate more engaged ones as well! However, we’re open to the possibility of adjusting this approach in the future. This could involve prioritizing the DAU or any other metric that aligns with our strategic objectives. [/quote] Thank you for the update, yes luckily we have a strategic group, and they can discuss if this is needed! Thank you for your leadership!
Hi, first of all, thank you to everyone for your comments and feedback! The data team has reviewed the process and found a bug in the algorithm related to how metrics were counted in scenes with multiple lands. Thank you very much for checking this out and raising your concerns. Below, you will find [a revised version of the results](https://docs.google.com/spreadsheets/d/1SiQoDkuKrVOPmtd22hBGF3EjrKXW5bnnpt1SJbqPY18/edit?usp=sharing). Once again, the analysis was performed on visitors connecting with a web3 wallet during June. Suspicious activity (such as bots) was removed from the analysis. Please share your thoughts on this.  I'm wondering what to do with scenes that are “duplicated” in the ranking, such as ICE Poker/Diamond Hands casinos and Ethermon House/Forest. Should they be compensated twice, or should their metrics be added together? [quote="MetaDogeisme, post:5, topic:19798"] DAU def need to put on more weight since that’s one of the most important figure [/quote] At present, we aren't assigning more weight to any particular metric, including the Daily Active Users (DAU). This is because we believe other metrics mentioned are equally significant. Our goal isn't just to increase the number of active users, but to cultivate more engaged ones as well! However, we're open to the possibility of adjusting this approach in the future. This could involve prioritizing the DAU or any other metric that aligns with our strategic objectives. [quote="NikkiFuego, post:6, topic:19798"] Would be good to know where the data is being sourced. Most scenes run several types of Data/Analytics. [/quote] Please be assured that all the data in use is publicly accessible through the Catalysts and subject to audit. Organizations like DCL Metrics and Atlas Corporation are involved in analytics, and it should be no discrepancy in terms of the raw data. Aligning definitions for Web3 users, Guests, and Bots ensures consistency in results. If discrepancies are detected, it is feasible to compare and reconcile the outcomes through a process known as triple auditing. [quote="TheCryptoTrader69, post:8, topic:19798"] the top 5 to 10 experiences get a more even payout, then lower payouts for less engaging projects (ex: top 4 projects get $3k, lower 9 get $2k). This would greatly increase the number of slots that provide at least ‘viable’ funding for future develop. [/quote] Indeed, that's a valid point. Here's a revised proposal for a more balanced payout distribution: 1st Position: 10% = $3,000 2nd Position: 9% = $2,700 3rd Position: 8% = $2,400 4th Position: 7% = $2,100 Positions 5 to 10: 6% each = $1,800 each Positions 11 to 20: 3% each = $900 each *These calculations are based on a total prize pot of 30k USD.* [quote="TheCryptoTrader69, post:8, topic:19798"] We should find a way to reward scenes proportional to how well they preform/their engagement metrics. In this case we can even treat certain users as more important/define a rating per account (ex: do they spend money (own wearables/name)? do they vote? do they explore or just idle? etc.) [/quote] That's an insightful suggestion. The possibility of assessing user 'quality' through marketplace activities such as the ownership of wearables, names, land, or mana could indeed be considered as a part of the evaluation process. [quote="TheCryptoTrader69, post:8, topic:19798"] An additional entry restriction of a project having at least a certain amount of engagement before a payment would also be ideal (ex: have at least 1000 unique visits in the month or something). [/quote] Is there a specific need for this restriction? If DCL is attracting a sufficient number of users and the ranking criteria are effective, it might be more beneficial to reward the most engaging scenes. Implementing a minimum engagement threshold could be perceived as arbitrary. [quote="akasya.eth, post:9, topic:19798"] You can take a % of the monthly revenue to incentivise the Genesis city but why proposing to use 100% of the Monthly DAO revenue from marketplace fees? [/quote] The initial recommendation is to launch a pilot program, funded by a grant. Should it prove successful, it could then be proposed for governance consideration. To subsidize the cycle, DAO resources could be utilized. The suggestion to peg the price to a percentage of the marketplace activity is intended to align incentives. The actual percentage, whether 30%, 100%, or 200%, is up to the DAO to determine and it can be adjusted as needed in the future. [quote="Yannakis, post:13, topic:19798"] Would it be possible to have some type of bot detection in place? Otherwise this won’t really work/will be a bot race [/quote] Absolutely! The current system flags any user who connects more than 4 users within a day from the same IP Addresses and User Agent as suspicious. As Kyllian pointed out, this will always be a cat-and-mouse game that needs continuous refinement. Despite the challenges, the goal remains a worthwhile pursuit. [quote="pablo, post:30, topic:19798, full:true"] maybe can also include chat activity and non afk action, anything to avoid “stay in my scene to win X” [/quote] Session lengths in a scene are currently capped to a maximum limit to prevent AFK behavior from skewing the metrics. The data reported by the Catalyst does not incorporate chat activity or movement within the scene. While it is possible to collect this information by connecting to all peer-to-peer networks and listening for events, it would significantly complicate the process and make auditing more challenging.
So which way do I vote? This is a good idea but many issues and questions. 1. Data needs to be accurate 2. Bot defenses. AFAK - time limit? 3. Will doing this have an affect on future grant requests? I think if we start paying these places then they should be ineligible for future grants. 4. What about users? Should they be encouraged to participate? Play to Earn? (must have a DCL name to be eligible?) 5. Periodic verification that the data is correct? there's others but I forgot what they were.
maybe can also include chat activity and non afk action, anything to avoid "stay in my scene to win X"
Also I'm doubful about the system, but I think is better to have it even if not perfect than having nothing. It can also be improved on next drafts and over time.
Most of the projects asking for money here are scams/rugpulls. As we know Decentraland is the only place where we can see huge grants for games/venues/events with 3-5 DAU. Just keep in mind that some peeps just like the fake angel investor and doctor are using DAO money to pay their debts. Wake up, Decentraland!
All games are scams.
Just feel like it's too early to say the game does not work.
Plague or cholera? None of those are good.
Decentraland Games took years to build. I doubt such success will ever be repeated. Comparing this proposal to DG is dumb to start with whichever way you look at it.
Nothing to confess, we never ever use any bots, and we even banned multi-realms farming. I was questioning the data part as well, and I was just curious about HP's opinion.
So you are confessing that most of your users are bots?
On the merits of the idea itself, it feels kind of like a share buyback scheme. It doesn't feel like it would take DAO funds and invest in the future of the protocol which is generally what I personally demand from all use of DAO funds, i.e. in such a way that the breadth and depth of what you can do and why you come to DCL increases user growth. Seems somewhat overlapping in intention with the In-World Content grant budget and would be more in favor of such an idea if the ideas were somehow consolidated (I foresee that category to grow more contentious over time given the most intangible delivery criteria). On the other hand, execution of this idea would be exceedingly difficult. Lots of thought would need to be put into how data is transparently collected and measured if it's directly affecting user's cash flows. Bots are also inevitable, and are already exceedingly hard to distinguish in data sets. The analytics providers (including yours truly) might end up being the biggest beneficiaries if this were to move forward. Still voting no tho. Would rather see this kind of KPI reporting applied to the In World Content grants instead. Not ready to be inundated with "come 2 my party plz!!1!" discord messages.
With due respect, Decentral Games is a very good example to prove that game could work following the right process and with the right timing. DG's success does not rely only on Gambling, it's the entire story and economic system that they built that attracted both capital and players. World feature is great to release creativity, but the core thing is how to enable brands to build a similar successful system like DG (with their own experience, dont have to be gambling) by providing a stable platform with useful tools and incentives. I do understand the platform and tools need time for the foundation or community to develop, but incentive schemes like this can be implemented fast and effectively. We will see related number rocketing after the scheme is launched, there will be bots, but that's another problem to be solved.
nothing against you, just curious, bots or basically empty, which one do you prefer more?
Firstly we have to differentiate the difference between scene engagement & scene attraction. Scene attraction based on this proposal is purely for a cash grab. Scene engagement on the other hand is a puzzle we have not yet to solve. Organic scene engagement is always the best solution. For this to happen there has to be a reason. Gaming has been tried many times over and failed. I feel the focus should be more towards the Worlds feature, how other communities & projects could also have their own Worlds. I agree with others on the bot issue. If we think about it, even the best funded projects that took over 6 months to develop still failed to bring in any new users or engagement. How is this proposal going to change that? Foundation is getting their roles mixed up with marketing & clearly they both suck at what they do lately. I call for a change.
*This will encourage bots.* We should find a way to do it anyway. Proof of humanity, DID, referral links, Captcha, person to person interactions, or some as yet undiscovered method should be employed. I used to work in retail. Shrinkage was a known cost of doing business. People will come into the store and steal things. Employees would lift money from the till. That reality doesn't shut down businesses. *It will be gamed and exploited.* We should do it anyway. It will be to everyone's benefit to arrive at accurate, robust metrics on the who, what, where, why, and when users spend time in DCL. Doing it in the open, on a level playing field will be an asset to the platform.
Love the idea! I think that would help the already developed scenes to stay active until there are other ways to generate revenue and become self-sustainable (which atm is almost impossible, even though everyone is always enquireing about this). So if that can be done in a way that... 1. Is accurate (which the sample data set clearly is not) 2. effectively prevents botting ... I would love to see something like this implemented!
39 Comments