Set a retry limit

[jakewilson]

A bug exists that will retry failed IDs forever. We should have a limit to only retry them, say, once or twice.