We present a population of 1317 Infrared Faint Radio Sources (IFRSs) that are reliably detected in the infrared, generated by cross-correlating the Wide-Field Infrared Survey Explorer (WISE) all-sky survey with major radio surveys. We present the first spectroscopic redshifts of IFRSs, as well as the first X-ray counterparts of IFRSs, one of which is the only match from the ROSAT All-Sky Survey. We propose that they represent a population of radio-loud Active Galactic Nuclei (AGN) at z > 2. Evidence for this comes primarily from (1) spectroscopic redshifts for 18 sources, (2) a comparison between the WISE infrared colours, and (3) the radio morphology. 18 spectroscopic redshifts reveal their matching sources to be primarily broadline QSOs at 2 < z < 3. The WISE colours of the sources we present inhabit the same space occupied by obscured AGN, QSOs and Seyferts. The majority of sources are unresolved, but 213 sources contain morphologies of large-scale radio galaxies, showing that a significant portion of this sample consists of radio-loud AGN. We suggest that these are closer versions of the extreme IFRSs believed to be large redshifts (z > 3).