If the intermediate speeds aren't working then that points to the resistor pack on the blower. Probably fairly straight forward to debug with a multimeter.
Is it worth taking the switch apart first to check it? My temp control stopped working, switch was taken apart, cleaned and put back together and all was fine.