DatePart, Month and Year return an integer, Format returns text.
With text, more bytes have to be processed than with an integer, which is reflected in different performance - it may be that performance also plays a role at some point.
SELECT Year(RaceDate) * 100 + Month(RaceDate) AS YM
FROM...