Judge refuses to delay ruling on Gulf drilling ban