Experimental detection of multipartite entanglement using witness operators