An abandoned scouts hut that has become a "blight" on its local community and hub for antisocial behaviour could soon be knocked down.