He didn't merely say that thing, he wrote it into an executive order. The administration is about two seconds away from declaring trans people terrorists. That's not speculation.
More an the EO:
EDIT: Think I'm wrong. The order appears to be an official memorandum, not an EO.