So, if I'm supercharging and the power goes out briefly, or the J plug gets pulled and put back in...the connector will close and my BMS will be destroyed?
Brandon answered in terms of my specific error in judgment, but more generally, no, the situation you described wouldn't be dangerous, for two reasons.
First, a power outage or unplug, however brief, would reset the charger. There's no way the charger can maintain its massive current output for even a fraction of a second without input power. So with its input power gone, it would reset and cycle off, including releasing the contactor. It would be safely off when the power came back.
Second, the arcing happens when the input capacitors have discharged to a different voltage level than the battery voltage. If the capacitors and the battery are at the same voltage, there will be no arc when the contactor closes. In a very brief power interruption, there won't be time for the capacitors to drain sufficiently to cause the problem.
So you're protected two ways from a brief interruption of power: First, the caps won't discharge enough to cause an arc even if the contactor immediately closes again, and second, the contactor won't close anyhow, because the charger will be reset.