BENNINGTON, Vt.—  A Vermont man whose domestic violence case went to the U.S. Supreme Court remains held without bail after a stormy hearing Friday in which he swore at a judge.

Michael Brillon, 47, whose delayed conviction in the 2001 case was later thrown out on speedy trial grounds, lashed out at Judge John Wesley during a motion hearing in district court.

Wesley, who ordered the courtroom cleared, eventually rejected defense attorney Chris Montgomery’s request that Brillon be allowed to live with his sister in White Creek, N.Y., citing Brillon’s 1994 conviction for sexual assault on a minor.

When Wesley referred to Brillon being a sex offender, Brillon cursed at him, according to prosecutor Erica Marthage.

Brillon’s case went to the U.S. Supreme Court last year after the Vermont Supreme Court said his Sixth Amendment right to a speedy trial had been violated. The high court ruled states aren’t responsible for a public defender’s delays.