You can use ChartChange() to remove all the drawings from a chart:
Framework.ChartChange({
mode: "active", // or "all", or "single" plus a .chartId value
command: "remove-all-drawings"
});
Note: it is almost always inefficient and undesirable to change drawings by removing them and then re-creating them, rather than modifying the drawings.