Yes and no. To access anything bought from the store/bazaar requires an internet connection unless single player servers are cloud servers.