The physical world is made up of particles, not objects. Objects are abstractions - they are conceptual boundaries we put around clumps of matter. Without the mind, those boundaries wouldn't exist.