Funnily enough, YOU ONLY LIVE TWICE is highly regarded only within Bond fandom. It has - sadly - no reputation whatsoever in the wider world. "Civilians" usually cite CASINO ROYALE and FROM RUSSIA WITH LOVE as Fleming's best (regardless of whether they've read them).
Well it's much the same as the unindicted citing Sean Connery and Goldfinger as the best of the cinematic Bond world, now isn't it?