> PCIe the only high-speed interconnect we have for peripherals to communicate with modern CPUs?

In a pedantic/technical sense, no. Practically speaking though, yes.