Do I need a switch for the replication connection between the cluster nodes?

No – you can connect cables directly – this way you will also minimize the risk (in case switch breaks).

Especially in combination with 10 Gigabit it helps saving the costs for the solution.