The correct on is-
It was us who had left before he arrived.
It was we who had left before he arrived.
It was we who had went before he arrived
It was us who had went before he arrived.