₳GOV: Timelines and Treasury Data

[IMPACT]

Adagov is currently assembling information about Project Catalyst timelines, proposals, campaigns and funds, into a single, open and exportable database.  We propose extending this to all available catalyst data which is currently distributed among a number of resources online.

You can find the currently assembled data here:

Timelines: https://airtable.com/shrpnN4ma5uDR82X8

Campaigns and Funds: https://airtable.com/shrAnqV1lwc6B19tA

The Auditability challenge aims to ensure transparency in the use of Cardano's treasury resources, which will allow the Cardano community to have more information on the development of funded proposals through a checks and balances system.

We propose aggregating and indexing all official publicly available Catalyst data to include treasury funds, funded projects, all proposals, number of wallets voting and information extracted from official funded projects documents and from the multitude of sources.

There is a large amount of data cleaning and entry to be able to execute this project successfully, but the data is available in a number of different, distributed sources.

The biggest risk is that these sources may disappear, or become closed (either technically or legally) in the time it takes to implement the project and that ongoing, these circumstances may also happen to the data sources. At this point, additional funding may be required to keep the concept operational.

[FEASIBILITY]

• Month 1 - Acquire and assemble, extract and clean existing data into tables.
  • Week 1 - Treasury and Wallet Data
  • Week 2-4 - Proposal and Funded Proposal Data
• Month 2-3 - Where possible, create pipelines so this extraction can occur semi-automatically or automatically.
  • Week 1 - Public Sheet Exports
  • Week 2-5 - Extraction mechanisms from web resources
  • Week 6-8 - Verification and Testing
• Month 4+ - Continue to aggregate and standardise Catalyst data. Our goal: A 15+ contributors to the data, backups and version control and a number of integrations.

We're requesting $35,000

The following is our budget breakdown:

• Data extraction and cleaning
  • 200 hours for data entry operator at $25/hr for $5,000
• Project management, reporting and documentation
  • 125 hours for PM at $40/hr for $5000
• Pipeline development (coding, automated services)
  • 140 hours for data engineer at $70/hr for $10,000
• Integration support into other systems. (API, service fees, licences 1 yr etc.)
  • 140 hours for data engineer at $70/hr for $10,000
  • Provision for licences for dashboards and software: $5000

1 x PM, 1 x Data Engineer - Ro Mathew (ex Product Management, 10 Yrs Dev, Machine Learning Lead)

1 x Freelancer - Data Entry operator from the community or ODesk/Upwork

[AUDITABILITY]

We'll place track visits to the platform hosting data location. We will not collect any personally identifiable information and will only use this data for the purposes of Catalyst metric reporting.

A fully functioning platform that provides a unified, integrity validated source for Project Catalyst data.

Continuation of Fund 5 - Open Data and Ideas for Cooperation. This project investigated existing platforms and developed an MVP of possible operation of a platform tracking Catalyst data.