That’s not entirely correct. The Ultra-Orthodox spectrum is composed of different factions/sects that hold widely varying beliefs and interpretations of Judaism.
While a majority of Ultra-Orthodox are represented in the current government, there are also some Ultra-Orthodox factions that reject the Israeli state completely. Some won’t fight due to their religious studies, some due to their pacifism, some due to their pro-Palestinian sentiment, and other will fight because of their convictions or their desire to settle in the west bank.
The infighting between these groups and their sometimes messianic beliefs and discussions are sometimes very intransparent from the outside. Sometimes internal feuds even erupt in street riots between groups or police.
Their substance laws are also way more lax than the rest of Europe.