Pairing Knowledge with Imagination