You are correct on the set screws for the TV mount. They can be loosened and the TV lifted off the wall mount... However, if your setup is like mine there is no way you are getting your hand in there to loosen those screws. If you look closely you will notice that all the screws for the access panel are accessible from the front without removing the TV. The panel rests on the ledge so I believe the panel and is put up with the TV already on it. A 4" bit should allow you ample length to remove the screws and take the whole thing down. This is what I will be doing once I get mine back from the dealer.
Jack