I wouldn't translate 'leave us without' that way. I'd think of an entirely different way to say it because that sounds too much like an English phrase.
quedar (remain) - deseamos quedarnos un poco (we wish to stay a bit longer)
dejar (leave) - dejarnos sin recursos (leave us without recourse)
dejar (allow) - déjanos ir (let us go)
quedarse sin spam = to be out of spam
Gracias por quitarnos el spam. = Thanks for getting rid of the spam for us.