Off-chain fetch RMRK2 entities to CFI/R2

[vikiival]

Current indexing is slow.

the task is:

• fetch this txt.file
• fetch each ipfs fetch it via @kodadot1/minipfs

const res = await $obtain(uri, ['rmrk'])

• Save it to your pc
• for each metadata download image

const link = $purify(uri, ['rmrk']).at(0)
const res = await obtainMedia(link)

Now use ipfs_to_cf (in this repo to push it to CF images)

[vikiival]

➜  ~ wc -l filename.txt
   49039 filename.txt

Got 50k of unique images

Non-unique

  ~ cat rmrk.json | jq '.data.entities | .[] | .image' | wc -l
  525562

so half a mil