Will Irrelevant Backlinks Affect my Website's SEO?

I don't think irrelevant links will affect your website because if it does, a company can build irrelevant links against competing brands and hit them out of search engines.  However, irrelevant links will not increase your page rank.