[ADAXON] CardanoVision: Empowering Users with Decentralized Computer Vision

[GENERAL] Name and surname of main applicant

Dr. Bharath Ramesh

[GENERAL] Are you delivering this project as an individual or as an entity (whether formally incorporated or not)

Entity (Incorporated)

[GENERAL] Co-proposers and additional applicants

Our very capable team at Adaxon Pte. Ltd. and our partner team for hardware and middleware integrations at Olive Innovations Labs.

Adaxon's admin team is led by our nominee director and our team of accountants - Patrick McGonagle

We also have a web developer in Joshua Richardson and our advisor Kwadwo Konadu Ansahi Antwi.

Associate Professor Xiang Cheng, our esteemed AI advisor, is a distinguished expert in the field of artificial intelligence, with a wealth of knowledge and experience. His academic background and professional contributions make him a valuable asset to our project. Prof. Cheng has a robust track record in cutting-edge AI research, particularly in areas such as computer vision, machine learning, and privacy-preserving technologies.

[GENERAL] Please specify how many months you expect your project to last (from 2-12 months)

7

[GENERAL] Please indicate if your proposal has been auto-translated into English from another language

No

[GENERAL] Summarize your solution to the problem (200-character limit including spaces)

CardanoVision leverages decentralized APIs for computer vision, and showcases secure facial authentication, granting users control over data and privacy on Cardano, advancing advanced AI integration.

[GENERAL] Does your project have any dependencies on other organizations, technical or otherwise?

No

[GENERAL] If YES, please describe what the dependency is and why you believe it is essential for your project’s delivery. If NO, please write “No dependencies.”

No dependencies.

[GENERAL] Will your project’s output/s be fully open source?

No

[GENERAL] Please provide here more information on the open source status of your project outputs

We commit to open-sourcing the non-sensitive components of our project, fostering transparency and community collaboration. The AI codebase will be released ensuring accessibility and contribution from the broader community. Sensitivity levels will be assessed on a case-by-case basis, with the primary goal of maximizing open-source contributions while maintaining privacy and security standards.

[METADATA] SDG rating

The proposed project aligns with UN Sustainable Development Goals (SDGs) related to Innovation, Industry, and Infrastructure (Goal 9), and Partnerships for the Goals (Goal 17). It aims to advance technology, promote inclusive innovation, and encourage collaboration for sustainable development.

[SOLUTION] Please describe your proposed solution

CardanoVision will primarily develop a series of decentralized APIs that perform actions on the Cardano blockchain to ensure secure facial authentication and data management as an initial proof-of-concept. These APIs will empower developers to integrate our privacy-focused Computer Vision as a Service (CVaaS) into various end-user applications, enabling the creation of locally stored and blockchain-verified visual identity and access credentials.

CardanoVision will develop an advanced cross-platform (mobile phone, PC, Mac, iPhone, etc.) API solution, leveraging mobile device intelligence, real-time face authentication and end-to-end encryption. This demonstration underscores the feasibility and value of combining cutting-edge AI capabilities with the Cardano ecosystem, paving the way for future AI applications on the platform.

Identified Problem:

Modern mobile cameras often lack adequate privacy and data security measures, leaving users vulnerable to unauthorized access and privacy breaches. CardanoVision addresses this by utilizing the power of the Cardano blockchain to ensure the encryption of sensitive data and decentralized control over their identity and video footage. The use of mobile devices allows for efficient access capabilities for various security applications, but these very security aspects are severely lacking for applications.

Solution:

Emphasizing the elimination of the need for a trusted third party in the facial authentication process is a crucial and compelling aspect of our proof-of-concept proposal. This approach aligns with the principles of decentralization and user empowerment, addressing concerns related to data privacy and security.

In the context of existing facial recognition/authentication systems on smartphones, users often rely on third-party service providers, potentially exposing their sensitive biometric data to external entities. The proposed CVaaS solution, however, aims to empower users by enabling them to perform facial authentication directly on their devices through the use of decentralized APIs. This not only enhances user privacy but also aligns with the decentralized nature of Cardano.

The outlined steps of the CVaaS proof-of-concept facial authentication system demonstrate a user-centric and privacy-focused approach, leveraging the decentralized capabilities of Cardano

User Registration:

• Connect to the Decentralized CVaaS API through the smartphone.
• Register identity information using the in-built camera.
• Securely store the information encrypted with the user's public key.

On-Device Model Training:

• Utilize the stored information to train a user-specific model directly on the device.
• Ensure privacy through on-device processing, minimizing external data exposure.

Differential Privacy Enhancement:

• Deploy Differential Privacy enabled models on-chain for enhanced security.
• Safeguard user data and maintain privacy through advanced privacy-preserving techniques.

Facial Authentication:

• Empower users to perform facial authentication directly, eliminating the need for a third party.
• Ensure a secure and decentralized authentication process.

Unique Aspects of Our Solution:

CardanoVision stands out by providing unparalleled control over privacy and data security through decentralized issuance of encryption keys. This means only users have the key to decrypt their device using facial authentication, enhancing security compared to traditional mobile cameras vulnerable to hacking and data leaks. Security measures include possible homomorphic encryption (AI model never gets access to the data and computes on encrypted data instead!), decentralized storage, two-factor authentication, and secure Cardano-based facial recognition.

An efficient approach could involve storing references or hashes of videos on-chain while hosting the actual video content on decentralized or distributed storage solutions like IPFS. This way, the integrity and authenticity of the identity data can be ensured through on-chain references without compromising scalability.

Another aspect is Differential-privacy-enabled models that safeguard user privacy. One notable reference is "Differential Privacy: A Survey of Results" by Cynthia Dwork, which provides an in-depth overview of the foundational concepts and techniques in differential privacy. Integrating these privacy-preserving techniques will enhance the overall security and user trust in the CVaaS solution.

Beneficiaries:

CardanoVision benefits individuals and households seeking enhanced privacy and security in their mobile device systems. Users regain control over their video footage, ensuring it is secure and protected from unauthorized access or tampering for AI applications on their smartphones.

Importance to Cardano:

By leveraging Cardano, CardanoVision enhances security and privacy, enabling immutable and transparent storage of video data. The project aims to provide secure access control, allowing authorized parties to interact securely with their mobile device. CardanoVision addresses the shortcomings of traditional mobile device security systems, contributing to a more secure environment for individuals, organizations, and communities on the Cardano platform.

Summary:

• Blockchain Integration: Utilize Cardano to create a distributed ledger for recording metadata and hashes of mobile video data, ensuring data immutability, transparency, and resilience against tampering.
• Smart Contracts: Develop smart contracts to govern access control, permissions, and data sharing, providing fine-grained control over access rights.
• Secure Access and Storage: Implement secure access and storage mechanisms leveraging encryption techniques to enhance resilience.
• Identity Protection: Integrate privacy-enhancing measures such as facial recognition privacy (using a technique known as Differential Privacy in AI-based systems) or anonymization to protect individuals' identities in video footage.
• Data Verification and Auditing: Utilize blockchain transparency for data verification and auditing capabilities, allowing stakeholders to independently verify integrity and authenticity.
• User-Friendly AI Interface: Develop an intuitive and user-friendly interface for managing the blockchain-based AI system, encouraging widespread adoption and acceptance within the Cardano community.

Long-term Vision:

Our long-term vision is rooted in a steadfast commitment to evolve this project into a comprehensive Cardano-based Computer Vision as a Service (CVaaS) solution. Beyond the current proof-of-concept, our trajectory involves trailblazing advancements in cross-platform CVaaS, starting with the integration of face recognition technologies on mobile devices leveraging the robust capabilities of the Cardano blockchain.

Recognizing the vast opportunities that CVaaS presents, our vision extends to position Cardano as a leading platform for pioneering secure blockchain-based CVaaS applications. By harnessing the power of decentralized and secure processing, our aim is to redefine the landscape of computer vision, ensuring it becomes not just a technological milestone but a transformative force.

[IMPACT] Please define the positive impact your project will have on the wider Cardano community

CardanoVision's success will significantly benefit the Cardano community by introducing a privacy-focused Computer Vision as a Service (CVaaS) solution. This innovation ensures secure facial authentication, safeguarding user data and enhancing privacy measures. The project pioneers a new paradigm for AI integration on the Cardano blockchain, aligning with Cardano's principles of security, decentralization, and user empowerment.

Pioneering Innovation in AI and Blockchain Integration:

• Showcases a pioneering proof-of-concept
• Demonstrates the potential of integrating advanced AI capabilities with Cardano's blockchain
• Positions Cardano as a versatile platform capable of supporting cutting-edge technologies

Community Empowerment:

• Empowers individuals and households with enhanced privacy and security in their surveillance systems
• Puts control back into the hands of users
• Aligns with Cardano's commitment to user empowerment and decentralized solutions

Expansion of Use Cases on Cardano:

• Opens the door for a broader range of AI applications on the Cardano platform
• Encourages developers to explore and implement AI solutions
• Expands the ecosystem and attracts diverse projects
• Cross-platform features of the API attract a more diverse user to Cardano's ecosystem.

Sharing Outputs and Opportunities:

CardanoVision's impact will be an ongoing process, with continuous engagement and collaboration with the Cardano community to ensure sustained benefits and advancements. CardanoVision will provide regular updates through official Cardano communication channels, including blogs, newsletters, and social media. It will also conduct webinars and workshops to share insights, discuss implementation challenges, and encourage community participation. CardanoVision will actively seek collaborations with other projects interested in integrating AI with Cardano, fostering a collaborative ecosystem. Finally, it will share relevant portions of the developed API solution as open source and complete the relevant whitepaper with service guidance to encourage community contributions and further innovation. CardanoVision's impact will be an ongoing process, with continuous engagement and collaboration with the Cardano community to ensure sustained benefits and advancements.

[CAPABILITY & FEASIBILITY] What is your capability to deliver your project with high levels of trust and accountability? How do you intend to validate if your approach is feasible?

Capability to Deliver with High Trust and Accountability with expertise in Relevant Domains:

• Our team comprises experienced professionals with expertise in AI, computer vision, blockchain, and project management. Dr. Bharath Ramesh, a leading researcher in the Computer Vision domain, leads the project, ensuring a strong foundation in AI and computer vision. Successfully built various Cardano-based prototypes including Fetachain. Adaxon is proud to host a highly skilled and experienced development team of 5+ members with over 30 years of combined research and industry experience.
• Proven Track Record in Previous Catalyst Rounds: Team members, including Robin Thomas (Hardware Engineer), have a proven track record in Catalyst and in their respective fields. We have successfully contributed to FetaChain project showcasing expertise in blockchain implementation and hardware integration in F9.
• We have already engaged with team members, ensuring a direct line of communication through project management tools and regular meetings. This establishes effective collaboration, progress updates, and problem-solving mechanisms.
• The cost breakdown reflects careful estimation based on specific requirements, market rates, and the expertise needed. Thorough research and analysis have been conducted to ensure a prudent and strategic approach to resource allocation.

Managing Funds Properly:

• Transparent Budgeting: The detailed budget breakdown provides transparency, clearly specifying costs for each project element. This ensures accountability and allows stakeholders to understand how funds will be utilized.
• Contingency Planning: Including a contingency budget for unforeseen expenses (10% of the total budget) demonstrates a responsible and proactive approach to managing funds. This minimizes the risk of budget overruns.
• Third-Party Services Clarification: Clearly stating the engagement of third-party services, such as security testing and auditing, assures stakeholders that funds are allocated to trusted professionals for essential services.
• Timely feedback from users. We will build a community to obtain user feedback in real-time. Users monitor how we spend our funds. Help us correct errors and development routes in a timely manner.

Our capability, combined with thorough feasibility validation and transparent fund management practices, positions us as a trustworthy and accountable team to deliver the proposed project successfully.

[PROJECT MILESTONES] What are the key milestones you need to achieve in order to complete your project successfully?

Milestone 1: Project Initiation and Research (15,000 ADA) - 1 month

Output:

1. Comprehensive project plan including detailed research findings.
2. Confirmation of third-party service providers, if any, and initiation of agreements.
3. Completed project whitepaper providing unified guidance for team collaboration.

Acceptance Criteria:

1. Project plan document covering computer vision trends, blockchain integration challenges, and privacy requirements, with at least 10 pages.
2. Signed agreements or correspondence with third-party service providers, if any.
3. Completed project whitepaper in PDF format, containing a minimum of 10 pages outlining project goals, methodology, and team roles.

Evidence:

1. Link to the project plan document stored in a publicly accessible and permanent location.
2. Copies of signed agreements or correspondence with third-party service providers, if any.
3. PDF document of the completed project whitepaper shared via a publicly accessible link.

Milestone 2: API Development and Identity Management (25,000 ADA) - 2 months

Output:

1. Developed and tested Computer Vision as a Service (CVaaS) base APIs on the testnet.
2. Implementation of decentralized issuance of encryption keys or Atala DIDs for enhanced security.

Acceptance Criteria:

1. Successful completion of CVaaS base APIs development, including API documentation and code repository.
2. Functional prototype demonstrating decentralized issuance of encryption keys or Atala DIDs, including documentation of the implementation process.

Evidence:

1. Link to the API documentation and code repository hosted on a publicly accessible platform.
2. Documentation outlining the implementation process of decentralized issuance of encryption keys or Atala DIDs, along with any relevant code snippets.

Milestone 3: Smart Contract Implementation and Testing (20,000 ADA) - 2 months

Output:

1. Developed and deployed smart contracts governing access control, permissions, and data sharing on the Cardano blockchain.
2. Testing of smart contracts ensuring fine-grained control over access rights.
3. Implementation of secure identity/video storage mechanisms using encryption techniques.

Acceptance Criteria:

1. Successful deployment of smart contracts on the Cardano blockchain, verified through transaction hashes and contract addresses.
2. Testing results confirming fine-grained access control, including documentation of test cases and outcomes.
3. Demonstration of secure video storage implementation with encryption, ensuring data privacy and integrity.

Evidence:

1. Transaction hashes and contract addresses confirming successful deployment of smart contracts on the Cardano blockchain.
2. Test reports documenting the outcomes of smart contract testing, including any issues encountered and resolutions implemented.
3. Documentation outlining the implementation of secure identity/video storage mechanisms, including encryption techniques used and demonstration of secure storage functionality.

Final Milestone: Pilot Testing and Documentation (20,000 ADA) - 2 months

Output:

1. Pilot testing of the CVaaS solution in a real-world scenario with a limited user base.
2. Comprehensive documentation of the pilot phase, including feedback, challenges, and improvements.
3. Final project completion report summarizing the entire project, lessons learned, and potential scalability.
4. Build a community to spread information and collect user feedback.

Acceptance Criteria:

1. Successful completion of the pilot phase with positive user feedback indicating satisfaction with the CVaaS solution.
2. Comprehensive documentation of the pilot phase, including detailed reports on feedback received, challenges encountered, and improvements made.
3. Submission of the final project completion report and video, highlighting key achievements, insights gained, and the overall impact of the project.

Evidence:

1. Pilot testing results and user feedback demonstrating the successful implementation and usability of the CVaaS solution.
2. Detailed documentation of the pilot phase, including reports, feedback surveys, and improvement logs.
3. Final project completion report and video presentation, providing a comprehensive overview of the project journey, outcomes, and future scalability prospects.
4. Solve most of the problems users proposed in the community. 

[RESOURCES] Who is in the project team and what are their roles?

Dr. Bharath Ramesh (Project Lead and AI Researcher - Computer Vision Specialist) and his team at Adaxon Pte Ltd

• LinkedIn: Bharath Ramesh
• As a leading researcher in the domain, Bharath Ramesh will oversee the overall project, provide guidance on AI algorithms, and ensure the integration of mobile intelligence into the camera system. He will also contribute his expertise in computer vision to develop object tracking and classification algorithms. Dr. Bharath has been in the AI space for 10+ years and has done extensive research and development for governments internationally.
• https://scholar.google.com/citations?user=dh9MPA0AAAAJ

Su Hongxu, CTO, Adaxon Pte. Ltd (and our entire team at Adaxon)

• LinkedIn: Su Hongxu
• In his role as Chief Technology Officer (CTO), Su Hongxu has showcased exceptional coding proficiency, making substantial contributions to our team throughout the past year. His expertise in functional programming languages, particularly in Haskell and C/C++, positions him as a valuable asset for steering our development efforts within Cardano's programming language. Hongxu's commitment and skills significantly enhance our team's capabilities, ensuring that we are well-equipped to navigate the intricacies of Cardano's programming landscape.

And Adaxon's administrative team, complemented by the expertise of accountants, ensures effective project management and financial oversight. Joshua Richardson, our web developer, contributes valuable skills in web development. Kwadwo Konadu Ansahi Antwi serves as a key advisor, providing strategic guidance. Associate Professor Xiang Cheng, an esteemed AI expert, enhances the team's capabilities with extensive knowledge in AI, computer vision, and privacy-preserving technologies. Together, this collaborative and skilled team at Adaxon is committed to realizing the success of our project.

Robin Thomas at Olive Innovations Labs (and his team of engineers)

• LinkedIn: Robin Thomas
• Robin and his team will contribute his expertise in hardware dev to develop tightly integrated object tracking and classification systems. Robin will work closely with his team to ensure efficient interactions with the mobile hardware.

Synthia S V (Project Manager)

• As the project manager, Synthia will handle project planning, coordination, and resource management. She will ensure the timely execution of milestones, adherence to project objectives, and effective communication within the team.

Additional Team Members (To be recruited)

• We plan to recruit additional team members with expertise in UI/UX design as a freelancer. The specific skills we will be looking for include front-end development.

We have already engaged with the team members and have established direct lines of communication through project management tools and regular meetings. This allows us to collaborate effectively, share progress updates, and address any challenges that may arise during the project. Please note that consent has been obtained from all team members to include their information in the proposal.

[BUDGET & COSTS] Please provide a cost breakdown of the proposed work and resources

Milestone 1: Project Initiation and Research (15,000 ADA)

• Kick-off and Team Alignment:
• Facilitation of the kick-off meetings, including contingencies, identification and confirmation of third-party service providers: 5,000 ADA
• Team alignment and communication channels: 5,000 ADA
• Research on computer vision trends, blockchain challenges, and privacy requirements: 5,000 ADA

Milestone 2: API Development and Identity Management (25,000 ADA)

• API Development of CVaaS APIs based on Cardano standards: 10,000 ADA
• Integration of APIs with standard cameras for real-time tracking and encryption: 8,000 ADA
• Implementation of decentralized issuance of encryption keys or Atala DIDs: 7,000 ADA

Milestone 3: Smart Contract Implementation and Testing (20,000 ADA)

• Development and deployment of smart contracts: 10,000 ADA
• Smart-contract Testing for fine-grained access control: 6,000 ADA
• Implementation of secure video storage mechanisms: 4,000 ADA

Final Milestone: Pilot Testing and Documentation (20,000 ADA)

• Pilot testing of the CVaaS solution in a real-world scenario: 10,000 ADA
• Documentation of the pilot phase, including feedback and improvements: 8,000 ADA
• Compilation of the final project completion report and video: 2,000 ADA

Total Project Budget: 80,000 ADA

[VALUE FOR MONEY] How does the cost of the project represent value for money for the Cardano ecosystem?

The costs associated with our project are meticulously aligned with the value it brings to Cardano. Our budget reflects the project's extensive scope and complexity, considering the integration of cutting-edge technology like Computer Vision as a Service with the Cardano blockchain. The API we have developed possesses powerful cross-platform capabilities. Given the widespread application of facial recognition in today's networks, our project will drive traffic to Cardano and enhance its image. We've assembled a team of seasoned professionals in AI, blockchain, and project management, justifying costs for their expertise. Thorough market research ensures our budget is competitive, taking into account rates for similar projects. Our resource allocation is tailored to each milestone, optimizing costs for effective project management. The inclusion of a contingency budget showcases a proactive stance towards risk mitigation. Overall, our strategic investment aims to advance Cardano's capabilities, justifying costs with the potential for long-term benefits, including increased visibility and attracting similar projects to Cardano. The budget is a balanced and informed approach, ensuring the project delivers substantial value while maintaining accountability and efficiency in expenditure.