The easiest way to wear tartan without it fighting the rest of an outfit is to pull one colour out of the sett and repeat it in something plain — a solid sweater in the same green, a belt in the same red.
Keep everything else neutral. Tartan is already doing the pattern work; a second pattern nearby competes with it rather than complementing it.