I had that same issue and realized it's the Google maps app. Everything worked fine until I started the Google maps app (Apple maps worked fine, too). Check that you have the latest Google maps update on your phone.