perf: Use a scoped collections over a persistent in implicit resolution

While the use of persistent data made the code simpler, performance
suffered greatly. This gives a ~30% speedup mainly by improving lookups
and avoiding allocations.