Table was wrong. Oops. Pointer math got me.
Now just need to populate the IDT, then debug the whole thing.