Supplier visibility in Odoo can be controlled by making the partner as Supplier boolean checked or false. This will prevent this record from coming to supplier list in future. So once unmarked as supplier false save the changes before going to other menu/tabs.
Follow the screenshot provided below for reference. Do the changes by following the navigation Purchase>> Purchase>> Vendors or Supplier as applicable.
Please Contact us if you have any Odoo Implementation requirements to Hire dedicated Odoo developers or Odoo