Remove dependencies from rust-lang#461

This has just the changes to Cargo.toml from
rust-lang#461,
without running `cargo update`.

This reduces our number of dependencies from 418 to 412.

Author: jyn514