In the last catch up we discussed the necessity of hashing names in the Reddit data.
We agreed that the data we are collecting is essentially unchanged from that which is already available publicly available on the web or via the API, and therefore the benefits gained by anonymising any of the data we extract via the API is minimal or nil,
We also discussed how it could represent a significant computation burden as the project scales up.
Given this, we decided not to pursue hashing usernames or anything similar for now, and might explore it as a later date if we transform or join the data in any way.
In the last catch up we discussed the necessity of hashing names in the Reddit data.
We agreed that the data we are collecting is essentially unchanged from that which is already available publicly available on the web or via the API, and therefore the benefits gained by anonymising any of the data we extract via the API is minimal or nil,
We also discussed how it could represent a significant computation burden as the project scales up.
Given this, we decided not to pursue hashing usernames or anything similar for now, and might explore it as a later date if we transform or join the data in any way.