Yes, I remember buying my loose tea and coffee beans there about 1908 - so there shouldn't be any great problem over 'change of use'. Unless of course the owner can claim it's been a brothel so long (though without his knowledge of course) it would be a shame to change it to anything else.