Just three ways I could approach this:
1) Maintain the second person narrative and work more on the story. It is kind of hard to write reactions in the second person though.
2) Change to a first person narrative. Reactions to each room would be easier to write, as would a plot orientated piece.
3) I don’t know how to categorize this but it would be a cross between Julio Cortazars Hopscotch:
and Italo Calvino’s Invisible Cities:
Keep the current beginning to the mansion but then describe the layout (4 wings, upstairs, basement and garden – 5 rooms to a wing, 10 rooms upstairs) and allow the reader to explore the rooms in order or go by their own preference (the rooms would be numbered/categorized). While the plot would be thin, it would be 30 – 40 surreal rooms of bat guano insanity. And part of me likes that a lot.