“at full employment, employers cannot afford to discriminate against minorities the same way they can in slack markets.”

Link. The Fed does have influence.