Open Metaverse Interoperability Research

[GENERAL] Name and surname of main applicant

Rares Kövesdi (NewMindflow)

[GENERAL] Email address of main applicant

catalyst@newmindflow.com

Additional applicants

Anamaria Kövesdi (NewMindflow)

[GENERAL] Please specify how many months you expect your project to last (from 2-12 months)

6

[GENERAL] Please indicate if your proposal has been auto-translated into English from another language.

No

[GENERAL] Does your project have any dependencies on other organizations, technical or otherwise?

No

[GENERAL] If YES, please describe what the dependency is and why you believe it is essential for your project’s delivery. If NO, please write “No dependencies.”

No dependencies.

[GENERAL] Will your project’s output/s be fully open source?

Yes

[GENERAL] If NO, please describe which outputs are not going to be open source. If YES, please write “Project will be fully open source.”

Project will be fully open source.

[METADATA] Category of proposal

Other

[IMPACT] Please describe your proposed solution.

The promise of web3 is almost synonymous with the promise of the open metaverse. A large number of the components of web3 being built point to that.

The metaverse is a term used to describe a virtual world that is fully immersive and interactive. It is expected to be made up of thousands, possibly millions of virtual worlds, each with its own unique characteristics and features. In order for the metaverse to be fully open, it must be able to seamlessly transfer digital items and assets between different virtual spaces. For the metaverse to be completely open, it needs to be user-owned and completely interoperable. The ownership layer will be guaranteed by NFTs living on truly decentralized public blockchains such as Cardano.

However, for the metaverse to reach its full potential, it must be fully interoperable. This will require on-the-fly adaptation of attributes and styles. As the number of digital items and virtual spaces in the metaverse grows, it will become increasingly difficult to manually ensure interoperability. Hundreds of millions, possibly billions of digital items will need to seamlessly move and adapt to hundreds of thousands, possibly even millions of virtual worlds that will make up the metaverse in its first decade(s). This is why we propose building a system to automate the task of interoperability, and lay the foundation for the future of the open metaverse. This proposal’s goal is to conduct a preliminary feasibility study, further research this idea, and document the outcome in the form of publicly available interviews and reports.

The project will begin with a feasibility study to determine the best approach for building the system, as well as the resources to execute the project. This will involve interviewing experts and researchers in the field, as well as reviewing relevant published papers.

If the feasibility study finds that the project is viable, we will then proceed with the development of the system in a future project (not in the scope of this proposal). For now we see the best approach involving the creation of an MVP version of the it, and testing it on three vertical slices of three distinct metaverse worlds. This will provide valuable insights into the capabilities and limitations of the system, and help to guide its future development. However, this is just a plan, in practice it might radically change as a result of this study.

 It may be that through the research we discover that what we are trying to build is not yet feasible with current technology.

The goal of having the interviews publicly available is that if we determine through the research as a whole that the idea is not yet feasible to build, the information presented and the analysis of the topic will be available for a future when the technology will be ready.

Also, if we discover this is the case and we won’t be available to guide the project by the time the technology is ready, the work we do now and the information we uncover will not be lost and can still be useful and maybe even inspiring.

Along with the interviews we also plan to offer transcripts of everything for easier reference.

The open metaverse has the potential to revolutionize the way we interact with digital content and assets. However, for it to reach its full potential, interoperability must be automated (specifically, the on the fly adaptation of attributes and styles). This is why we propose starting down the path of building a system to automate the task of interoperability, and lay the foundation for the future of the open metaverse. We believe that this project has the potential to set the standard for interoperability in the metaverse, and make a significant contribution to the future of web3 technology.

[IMPACT] How does your proposed solution address the challenge and what benefits will this bring to the Cardano ecosystem?

Our project addresses several aims of the Catalyst Open challenge.

1. Benefits to the Cardano ecosystem: By automating interoperability within the metaverse, we can potentially unlock a new avenue for innovation within the Cardano ecosystem. This project will position Cardano as a pioneer in exploring the future of the metaverse, strengthening its image and increasing its attractiveness for researchers and developers.
2. Open-source approach: Our research findings, the video interviews, and the drafted plan will be publicly available and open source, enabling anyone to build upon our work. This aligns with the ethos of the Cardano community and its commitment to openness and collaboration.
3. Further development possibilities: This project can serve as the foundation for future development. Regardless of whether our research finds that AI can automate interoperability within the metaverse at present, the knowledge we gain and the relationships we build will be valuable for further development when technology advances.
4. Sharing of outputs: We will share our outputs in a variety of formats to make them accessible to different audiences. This will include a dedicated website hosting video interviews and research reports, all of which will be freely accessible.
5. Inability to fit into other Fund 10 challenges: Our project does not fit into any other Fund 10 challenges as it uniquely merges the worlds of AI, ML, the metaverse, and blockchain. It's a pioneering venture that combines diverse areas of knowledge to address a problem that has not been sufficiently explored before.

In terms of the impact, we believe this project can potentially attract new researchers and developers to the Cardano ecosystem. Moreover, it could also spur a new wave of projects focused on enhancing interoperability in the metaverse, thereby strengthening the overall ecosystem.

However, as our project is exploratory in nature, we can't quantify the exact number of users or transactions it will bring to Cardano within a specific timeframe. Our primary goal is to generate knowledge, inspire innovation, and lay the groundwork for future developments in this space.

[IMPACT] How do you intend to measure the success of your project?

The success of our project can be measured through both quantitative and qualitative metrics:

1. Research Completion: The completion of comprehensive research into AI for interoperability in the metaverse and the production of a detailed report. This is a fundamental deliverable, and its completion will be a significant indicator of the project's success.
2. Interviews: Conducting and publishing 15-20 in-depth video interviews with key stakeholders. The quality of the interviews can be gauged by the depth of information obtained, the insights generated, and the audience's feedback.
3. Website Traffic: The number of visitors to the dedicated website hosting the video interviews and reports. This metric provides a rough estimate of the level of interest in our research and its potential influence.
4. Community Engagement: Engagement on our website and social media channels, measured through comments, shares, likes, and feedback. This provides a sense of how well our work is received and whether it's sparking conversations and inspiring others.
5. Feasibility Study: The successful completion of a preliminary feasibility study for automating interoperability in the metaverse using AI. This will demonstrate that we have not only conducted research but have also taken the first steps towards identifying a possible solution.

In the short term, our project will provide a source of knowledge to the Cardano community and beyond, fostering innovation and new ideas. In the long term, it could potentially contribute to the development of solutions for automating interoperability in the metaverse, thereby enhancing the productivity and growth of the Cardano ecosystem.

[IMPACT] Please describe your plans to share the outputs and results of your project?

Our intention is to make our research widely accessible and applicable to as broad an audience as possible. To achieve this, we plan to:

1. Publish Research: We will publish the research report on a dedicated public website, making it accessible to all who are interested in our finding

2. Video Interviews: We will share the recorded video interviews on the same website, as well as on social media platforms, to reach a wider audience. We believe that these interviews will provide valuable insights into the possibilities and challenges of automating interoperability in the metaverse using AI.

3. Social Media Sharing: We plan to utilize social media platforms to share updates about our project, including milestones reached, findings, and the publication of the research report and video interviews.

4. Open Source: All of our research and the resulting outputs will be open source, ensuring that others can build upon our work in their own research and development efforts.

Our hope is that our work will contribute to ongoing efforts to enhance the capabilities and reach of the Cardano ecosystem.

[CAPABILITY/ FEASIBILITY] What is your capability to deliver your project with high levels of trust and accountability?

Our team offers a unique combination of qualifications for this project:

• In-depth Interview Expertise: Our extensive experience in documentary filmmaking has honed our skills in conducting in-depth interviews and facilitating open, insightful discussions. This expertise allows us to effectively engage with subject matter experts to gather crucial data for the project.

• Comprehensive Research Capabilities: With a background in scriptwriting, our team has a proven track record of conducting meticulous research, particularly with a focus on uncovering overlooked details. Our team member Rares, who served as the president of the jury in a prestigious national screenwriting competition, further strengthens these capabilities. Our research is required to withstand scrutiny from diverse audiences, necessitating a high level of accuracy and detail.

• Blockchain and NFT Expertise: Over two years of direct experience in the blockchain industry, particularly in the NFT space, have equipped us with a robust understanding of the technology and the evolving space. Additionally, our experience gives us the necessary understanding to conduct detailed research on automating interoperability in the metaverse.

• Financial Management and Accountability: As part of our commitment to trust and accountability, we have developed processes to ensure proper fund management. We maintain transparent records of all project-related expenditures, provide regular financial updates, and conduct periodic internal audits to confirm funds are used as planned. Within the Cardano and Catalyst ecosystem this is evidenced by our very transparent and responsible management of the NFT Guild treasury.

Together, our diverse skills, relevant experience, and commitment to transparency and accountability position us to successfully execute and deliver on this project's objectives.

[CAPABILITY/ FEASIBILITY] What are the main goals for the project and how will you validate if your approach is feasible?

Conduct In-depth Research: The primary goal is to research the possibility of using AI to automate interoperability within the metaverse, with an emphasis on on-the-fly adaptation of assets and styles. This will involve a comprehensive review of relevant papers in the fields of AI, ML, and computer graphics, as well as discussions and interviews with key stakeholders, including AI specialists, researchers, developers, creators, and users.

Knowledge Sharing: The project aims to share findings with the broader community in a digestible way. The knowledge acquired through the research will be shared via recorded video interviews, a dedicated public website hosting these materials, and a comprehensive research report.

Feasibility Study and Plan Drafting: A significant goal is to draft an implementation plan for automating interoperability in the metaverse using AI, based on the findings from the research. This will include a preliminary feasibility study to assess the practicality and potential effectiveness of the proposed solution.

Set the Foundation for Future Work: Even if our research indicates that the proposed solution is not feasible with current technology, our work can serve as a valuable foundation for future research and development when the technology has advanced.

To implement this approach, we will follow the project plan and milestones outlined below. The feasibility of the proposed solution will be assessed through the in-depth research and the preliminary feasibility study. Through this research, we will be able to determine if the technology needed for our proposed solution currently exists, what challenges we might face in implementing it, and what future developments could make it feasible.

[CAPABILITY/ FEASIBILITY] Please provide a detailed breakdown of your project’s milestones and each of the main tasks or activities to reach the milestone plus the expected timeline for the delivery.

Milestone 1: Project Kickoff and Initial Research (2 months)

• Research and review of relevant published papers in the fields of AI and computer graphics to gather foundational knowledge.
• Initiation of contacts with researchers, developers, and other key stakeholders relevant to the project.
• Setting up the pre-production of interviews, including arranging schedules, confirming participants, and preparing questions.
• Recording and publishing of the first set of 4-6 video interviews with experts and stakeholders.
• Creation of a dedicated public website to host the video interviews and all the relevant reports.

Success criteria: Successful completion of the initial round of interviews, creation and launch of the dedicated website, and a summary of findings from the initial round of paper reviews.

Milestone 2: Continued Research and Stakeholder Engagement (2 months)

• Further research and review of relevant published papers in the fields of AI and computer graphics.
• Establishing additional contacts with researchers, developers, and other key stakeholders in the metaverse and AI field.
• Continuation of the interview series, including pre-production setup and recording. Expected to publish between 6-8 video interviews.
• Drafting the initial version of the research report detailing findings from the interviews, discussions, and the review of relevant papers.

Success criteria: Completion and publishing of the second round of interviews and draft of initial research report summarizing the findings to date.

Milestone 3: Final Research, Report Drafting, and Conclusion (2 months)

• Continued research of relevant published papers, concluding in a comprehensive research report to be published on the dedicated website.
• Establishing additional contacts with more researchers and developers in the AI space relevant to the topic.
• Final round of interview setup, recording, and publishing, targeting between 5-6 interviews with experts and researchers in the field.
• Finalizing the research report detailing findings from the interviews, discussions, and the review of relevant papers.
• Drafting the final report that summarises the outcome of the project and the lessons learned, indicating the feasibility and plan for the proposed AI system.

Success criteria: Completion of all planned interviews, finalization and publishing of comprehensive research report, and completion of the final project report.

[CAPABILITY/ FEASIBILITY] Please describe the deliverables, outputs and intended outcomes of each milestone.

Milestone 1: Project Kickoff and Initial Research

Deliverables & Outputs:

• Between 4-6 recorded video interviews with key stakeholders, including AI & ML specialists, researchers, developers, creators, and users.
• A review and summary of relevant papers in the field of both AI and computer graphics.
• A dedicated public website set up to host the video interviews and all relevant reports.

Intended Outcomes:

• Establish a strong foundational understanding of AI and computer graphics relevant to the project.
• Begin the process of knowledge sharing via interviews and engagement with key stakeholders.
• Initiate public visibility and discussion through the dedicated website.

Progress Measures:

• Number of interviews completed.
• Number of papers reviewed and summarized.
• Successful launch of the dedicated website.

Milestone 2: Continued Research and Stakeholder Engagement

Deliverables & Outputs:

• An additional 6-8 recorded video interviews with key stakeholders.
• Further review of relevant papers in the fields of AI and computer graphics.
• An initial version of the research report detailing findings from the interviews, discussions, and the review of relevant papers.

Intended Outcomes:

• Expand the understanding and insights gathered about AI and metaverse interoperability.
• Continue the knowledge sharing and engagement with key stakeholders.
• Begin synthesizing the findings into a cohesive research report.

Progress Measures:

• Total number of interviews completed.
• Number of new papers reviewed and summarized.
• Completion of the initial draft of the research report.

Milestone 3: Final Research, Report Drafting, and Conclusion

Deliverables & Outputs:

• Final set of 5-6 recorded video interviews with experts and researchers.
• Completion of the review of relevant published papers.
• Final version of the research report detailing findings from the interviews, discussions, and the review of relevant papers.
• A final report that summarises the outcome of the project and the lessons learned.

Intended Outcomes:

• Complete the full series of planned interviews.
• Finalize the research phase with a comprehensive understanding of the subject.
• Complete the final reports providing comprehensive insights into AI's role in the metaverse interoperability and a roadmap for potential implementation.

Progress Measures:

• Total number of interviews completed.
• Completion of the review of relevant papers.
• Completion of the final research report and project summary report.

[RESOURCES & VALUE FOR MONEY] Please provide a detailed budget breakdown of the proposed work and resources.

Research and Interviews: This includes the time and resources spent on in-depth research, as well as conducting and editing the interviews. Estimate: 39,500 ADA

Website Development and Maintenance: This covers the cost of designing, developing, hosting, and maintaining a dedicated website for the project. Estimate: 5,000 ADA

Promotion: This includes promoting the project on various platforms, as well as engaging with the community and seeking their input. Estimate: 5,000 ADA

Project Management: The time and effort spent in managing the project, ensuring it remains on track, and addressing any issues that arise. Estimate: 10,000 ADA

Documentation and Reporting: This includes the time and resources spent on documenting the project's progress, producing the research report, and sharing updates with the community. Estimate: 5,000 ADA

Contingency Fund: An allocation for unexpected costs or challenges that may arise during the course of the project. Estimate: 5,000 ADA

Total: 69,500 ADA

We don't foresee a need for third-party services beyond website hosting, for which we've already budgeted.

[RESOURCES & VALUE FOR MONEY] How does the cost of the project represent value for money for the Cardano ecosystem?

Our project budget has been designed to deliver a comprehensive investigation of AI's potential for interoperability in the metaverse while adhering to the constraints of the Catalyst Open Challenge. We are confident that this project will provide valuable insights to the Cardano community and potentially stimulate further innovation in this space.

The budget components have been calculated based on the estimated hours of work required for each segment of the project, taking into consideration average professional rates. However, it's important to note that our team is highly motivated to execute this project, and as such, we have chosen to set our rates below the typical industry standards. Here's a brief explanation of the costs:

1. Research and Interviews: As the cornerstone of our project, this represents a significant portion of the budget. Despite the extensive amount of work involved in preparing, conducting, and analyzing the interviews, we have priced this element below typical industry rates due to our interest in the project.
2. Website Development and Maintenance: This cost reflects an estimate based on standard rates for website development and hosting.
3. Promotion: The cost here is based on the average expenses for social media promotion and community engagement activities.
4. Project Management: This accounts for the time and effort spent coordinating, planning, and managing the project, again calculated at a rate below the industry standard.
5. Documentation and Reporting: As an essential aspect of our project to maintain transparency and keep the community updated, the costs associated here reflect standard rates for such work.
6. Contingency Fund: This is a common practice in project budgeting and is designed to cover any unforeseen costs.

Our priority is to deliver maximum value to the Cardano community for the investment made. Our lower-than-standard rates represent our dedication to the project and our commitment to making it as accessible as possible within the Catalyst Open framework.

[IMPORTANT NOTE] The Applicant agreed to Fund10 rules and also that data in the Submission Form and other data provided by the project team during the course of the project will be publicly available.

I Accept