Frank started playing in local bands on the New Jersey punk scene when aged 11. Before joining My Chemical Romance he served as frontman for the punk band Pencey Prep. The band released an album, Heartbreak in Stereo, on the independent Eyeball Records before disbanding. Whilst playing with Pencey Prep, he became friends with Gerard Way and the other My Chemical Romance members, became a fan of their original demo and helped them get their first shows. After his band broke up, Frank played in several bands, including I Am A Graveyard, Hybrid, Sector 12, and American Nightmare before being offered the slot of rhythm guitar in My Chemical Romance.