Does physical device access = game over?

According to a group of hackers speaking at this years Black Hat conference most manufacturers assume that once a bad guy has physical access to the device, all is lost. That's not going to end well.