The Black Chancery font's only apostrophe is hex 27 (the plain apostrophe, not a 'smart' one) according to this site:
http://www.fonts2u.com/black-chancer...&submit=Submit
If Word's not displying it correctly upon input, you might find it does so if you choose 'undo' immediately after typing it (to undo Word's autocorrect). Alternatively, you could turn the Autocorrect off (probably not a good idea), or input the font via 0027 followed by Alt-x.