As for my case, all the answer didn't worked for me. Here is my workaround:
- Open Developer Console -> then open *.design file.
- From Menu: File -> Delete (CTRL + DELETE) to delete the file.
- Create new design file with the same name in Visual Studio Code, then deploy.
You have to do these again if you want to remove one the attribute from design file