Yes, you can explore other countries while you're here but you must travel with your BRP/ proof of valid immigration status. If you don't, you may not be allowed back into the UK at the end of your trip.
More information can be found on our 'Travelling in and out of the UK webpage'.