Answer by OneThree

I actually found another thread that said to switch the texture to True Color, which fixed the error in my case along with making sure that "Alpha from Transparency" was selected. The texture was a 512x512 PNG, and when it was set to compressed, the 128 icon would be corrupt but the rest of them (including the upscaled 1024 version) were fine.