According to Joetta Cramm's A Pictorial History of Howard County, "Troy was a Dorsey land grant patented in the late 1600's. Colonel Thomas Dorsey lived in a frame dwelling on this patent until his death in 1790. His widow sold the 652 acres in 1808 to Vincent Bailey for $6,520. Bailey appears to have built this large stone house in the 1820's. In the mid-1800's it was called "Troy Hill Farm."

The site is now a landlocked site that was designated surplus property by the State and deeded to Howard County. Troy can be seen sitting high on a hill as you approach from the east on Route 100 towards the intersection of Route 95. The stone has been gutted by far and only the shell remains.