The building in your gallery is actually the former HQ of the Defense Investigative Service, which confirms the local rumor I heard years ago that this one building was left standing when the rest of the Fort was demolished because it housed a sensitive defense function of some kind.
See this page with the names and addresses of the properties:
http://www.mde.state.md.us/assets/document/Fort_Holabird.pdf See the very last few paragraphs in this file:
http://www.globalsecurity.org/military/library/report/1995/brac95/chap-1-5.htm See also the reference to a Fort Holabird facility on this page:
http://www.globalsecurity.org/military/facility/fort-meade.htm This page mentions a "Defense Security Service Personnel Investigations Center" that used to be located at Fort Holabird through 1996. The odd thing about this account is that all of the base was demolished in the late 70's and early 80's - with the exeception of the rec center now used by the VVA group, the CRC and this building - so this "Investigations Center" must have also been located in this building, it being the only substantial part of "Fort Holabird" left standing. Odd that they still called this little remaining piece of property "Fort Holabird."
Been years since I've driven past this area... the CRC was apparently down the street and around the corner from the DIS building, and I vaguely recall it. The DIS was well-fenced and had that look of a sensitive government facility when I last saw it active.