I can't tell if you're a fan of this idea or not. I'd personally prefer they have no means of gathering red lyrium, but it spreads and there doesn't seem to be a way to completely destroy it.

[He sighs.]

It's not going to stop spreading or be limited. And the sorts that go to harvest it... It's only going to go worse as time goes on.