Currently old dependency files are only removed when gpm uninstall [dependency] is ran. It might be nice if old dependency files are removed during gpm install if they are no longer listed as a dependency.
However, what if I purposely installed a dependency without the --save option? It might be worth looking into how Composer and NPM handle this.