Can I set up a notice to only show on one or more products?

If you do not wish to display the notice on all the products, you can set up notice on per-product basis. Head to the Edit Product screen for any product and look for the Product Notice/Information meta box and add the desired content in the Notice Text field. Choose from a set of default appearance styles to set up how your notice shows up on the page using the Notice Appearance dropdown.