Only if Recycling a building refunds the same or better amount of resources. (I recently made the mistake of recycling a freshly placed building. It earned me back a whole 26 resources for a 400-res barracks.)
It's a major gameplay flaw. I mean if you intend to make the game hard to understand and inconsistent I'd suggest keeping it.
as much as i dislike that whole DoT thing of scouts ... ... empty has right. its inconsistent this way ...