What do you think to the name harvey james harrison?

we also really like the name oliver just as much but a customer in the pub im onleave from had a little boy called ollie just over a year ago, although i never see them is it wrong to call my baby oliver and do you think they would mind if we did or there is the name harvey that i really love what do you think?