The coastguard was alerted to the discovery and police and disposal teams were sent to deal with it.
Police have asked the public to stay away from the area, which has been cordoned off, while the small device is disposed of.
A force spokesman said: "A small item which appears to be unexploded ordinance has been recovered on the beach. Police will maintain the cordon until the item has been safely disposed of."
It follows the discovery of a suspected mortar bomb on a beach in Norfolk on Saturday. Bomb disposal experts carried out a controlled explosion on the seafront at the village of Hemsby.