Is it safe to remove a SIM card from my device?

I just purchased an AT&T GoPhone Windows Lumia 640 off Amazon to sync with my Microsoft account and basically have a hyper-portable device for documents and what not. I'm not going to be using any cellular data whatsoever, just wi-fi, and I'm not gonna be making calls or anything. Therefore, would I be able to remove the SIM card and not worry about any issues? Also, what, if any benefits, are there to keeping it in or taking it out?

Read more: Is it safe to remove a SIM card from my device?