Polarization is a tool, like any other. It's great for reducing glare. It's not great in flat or medium to low light conditions, and it tends to mess with depth perception and some terrain contour reading. It's a great option to have access to, but it makes the lens specialized, not necessarily versatile.
Prizm is the proprietary Oakley lens tinting process to enhance some colours to be a bit more vibrant. Whether you care about contrast or how much a lens messes with colour perception is a personal choice. In general, Prizm is versatile, and doesn't make a lens worse at what you bought it for. You should not think a "standard" lens with no Prizm, and no polarization is inherently crappier.
My advice is to try on pairs of sunglasses, and in particular try out different lens tints. Prizm tends to give lenses for everyday wear a slight rosy hue. Some prefer a grey lens that doesn't mess with colours as they naturally appear. Some people like a brown lens in sunny or overcast conditions for the soothing effect on the eyes without darkening so much as a grey lens.
You want to start your research with an idea of what you want to get out of the sunglasses. Do you want something you can wear every day in a lot of conditions? Do you want something for a sport or hobby you enjoy? Do you want something that will go with a specific outfit like a business suit, a uniform, or a sports jersey? With a few ideas of what you want, you can start looking at products designed for that role or look.
Thanks for taking the time to write such a thoughtful response. I appreciate it!