Yamaha P-28 P 28 P28 Turntable Replacement Belt

I'm disappointed it too nearly a month to get my parts through USPS. It too LP Tunes almost two weeks before my parts were boxed and actually brought to the post office and I had to call several times to find out when and if my order was processed. The belt I bought for my Yamaha turntable fit perfectly with no trouble putting it on and seeing my turntable spinning again. I am having trouble getting my old stylus off and putting the new one in. I thought they just slipped in and out. I can't get the old one out and will probably contact Yamaha to see what I need to do. I've yanked and pulled and nothing seems to move. I don't want to break it.