Yea. That's what I'm thinking too. If you receive bitcoins from those address you're effectively doing the same as if you were collecting cash from watched boxes in a bank vault, and the cash was radio-actively tagged. (And therefore easily tracked.) Anyone handling a large quantity of those coins is suspect

But if someone got their hands on them and performed a huge laundry so that everyone has tainted coin history, then you might be ok.