This ensures that we only try to resolve addresses for ELFs when we know we're inside of the userspace address context.
The lib/ directory was getting a bit out of hand, so this tries to organize things a bit so it is easier going forward to locate the code people want to patch.