Next-token prediction:
768 dimensions → 50,257 vocabulary logits

Binary classification:
768 dimensions → 2 class logits

        __
        __