Change profile picture via
settings > Account > Your info > under create your picture click on Browse for one
go to the default profile picture location
C:\ProgramData\Microsoft\User Account Pictures
Choose User
On setting > Accounts
It will show your old profile picture
to delete the old profile pictures go to
%appdata%\Microsoft\Windows\AccountPictures
And delete the files you want