[Bug Report]: Rust compilation speed is too slow

# Update: See [Do not compile all of swc](https://github.com/web-infra-dev/rspack/pull/2552)

### Details

<img width="1040" alt="image" src="https://user-images.githubusercontent.com/1430279/224604490-78ad60a6-6392-48fb-9f35-d4ddfa42b4c7.png">

### Reproduce Steps

`cargo build --release --timings`