I've got a J2320 exhibiting the identical behaviour after a CF recovery procedure (the 11.2R3.3 recovery image) and continuing after an upgrade to 11.4R1.6-domestic.
Connecting to the console, deleting "system autoinstall", configuring ge-0/0/0 as DHCP client, committing, THEN re-connecting to J-web lets me access what looks like normal J-web (so far).
Should I be reporting this as a bug?